YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
bibo-base-1b-6k-s23 (in training)
BiBo base model: 965.5M total / 144.5M active (hidden 512, 64 experts top-6 x1024, L0 8x768), MXFP8 experts. 6000 steps x 262k tokens (1.57B), seed 23. Checkpoints: step1000/ ... step5000/ (+ final at the root), each with train_args.json. W&B: ablations-tinycompany-ai/bibo-base-1b run bz2n3oqz.
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support