Understand this story
Story summary
The English summary is being updated. See the reporting timeline below.
Latest development · Report
Why Fine-Tuning Jobs Take Longer Than FLOPs EstimatesDevelopments
1 confirmed developments
- Source:Hugging Face
Reports and discussion timeline
Browse reports and discussion by time. Their evidence levels remain distinct.
Nov 19
Hugging FaceFirst-party
Why Fine-Tuning Jobs Take Longer Than FLOPs Estimates
Fine-tuning jobs often take longer than FLOPs estimates because environment setup, model loading, tokenization, evaluation, checkpoint uploads, and shared-infrastructure I/O are all excluded from training-loop computation. A CatBoost predictor based on 272 SFT runs and 24 features shows that evaluation sample size is the most important factor; even the best 30% MFU baseline has a mean error of more than 12 hours on jobs averaging 23.43 h.
AI Trends