small models. bigger possibilities.
OpenSML is an independent research lab exploring the full process of building small language models—from preparing data and training tokenizers to pretraining, evaluation, and fine-tuning.
We build from scratch on Apple Silicon. Our current training setup connects five Macs for distributed training.
We share model weights, code, and research findings so others can explore, experiment, and build on the work.
Explore: OpenSML-150M · Website · Technical report
Contact: william.zebrowski@me.com