You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Sharded fine-tune path cannot emit Hugging Face eval_loss #778
eval_strategy is accepted on TrainingConfig, but the sharded dataset path cannot actually produce eval_loss.
DatasetFactory.build() asserts eval_strategy == "no" and always returns eval_dataset=None.
ShardedMixtureDataset iterates forever, so HF eval would never finish.
Accelerate prepares the eval iterable dataloader and broadcasts CPU objects through NCCL.
Even if eval runs, Trainer.prediction_step drops the loss: Gr00tN1d7 has empty label_names and no return_loss argument, so logs show eval_runtime only.
Activity
DanielAsadi commentedon Sep 22, 2026
I opened a PR for this: #777