Task
Validate loss curve on held-out data (90% train / 10% val) to ensure no overfitting before Parameter Golf submission.
Acceptance Criteria
- Split TinyShakespeare: 90% train / 10% val
- Run 1000 steps on train set
- Compute BPB on held-out val set
- Check: val_bpb < 2 * train_bpb (no severe overfitting)
- Plot loss curves for train vs val
Deliverables
experiments/loss_curve/train_loss.csv
experiments/loss_curve/val_loss.csv
- Plot:
experiments/loss_curve/loss_curve.png
- Overfitting diagnosis
Configuration
Refs
Go/Pivot Gate
Only proceed to Parameter Golf if val_bpb is plausible (not severely overfit).
Task
Validate loss curve on held-out data (90% train / 10% val) to ensure no overfitting before Parameter Golf submission.
Acceptance Criteria
Deliverables
experiments/loss_curve/train_loss.csvexperiments/loss_curve/val_loss.csvexperiments/loss_curve/loss_curve.pngConfiguration
Refs
Go/Pivot Gate
Only proceed to Parameter Golf if val_bpb is plausible (not severely overfit).