Skip to content

Navigation Menu

Sign in
Sign up

History / FineWeb Edu Agent Run Mar 17 2026

Revisions

  • Add FineWeb-Edu agent run results (101 experiments, Mar 17 2026) First multi-dataset experiment. 101 autonomous experiments on FineWeb-Edu achieving val_bpb=1.2951 (8.1% improvement). Key finding: optimal config is dataset-dependent — FineWeb-Edu prefers AR=32 (half width) with 2x more gradient steps vs climbmix's AR=64. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

    Dave Graham committed Mar 17, 2026

AltStyle によって変換されたページ (->オリジナル) /