CMR Scaling Law: Predicting Critical Mixture Ratios for Continual Pre-training of Language Models
Paper • 2407.17467 • Published
Fei Tan
tanfei2007
·
AI & ML interests
text generation, prompt learning
Organizations
authored 6
papers 2 months ago
SynthDoc: Bilingual Documents Synthesis for Visual Document Understanding
Paper • 2408.14764 • Published
Balancing Speciality and Versatility: a Coarse to Fine Framework for Supervised Fine-tuning Large Language Model
Paper • 2404.10306 • Published • 1
Cultivating Helpful, Personalized, and Creative AI Tutors: A Framework for Pedagogical Alignment using Reinforcement Learning
Paper • 2507.20335 • Published
MathSmith: Towards Extremely Hard Mathematical Reasoning by Forging Synthetic Problems with a Reinforced Policy
Paper • 2508.05592 • Published • 6
ReSURE: Regularizing Supervision Unreliability for Multi-turn Dialogue Fine-tuning
Paper • 2508.19996 • Published