view article Article Tokenization in Transformers v5: Simpler, Clearer, and More Modular +4 12 days ago • 86
view article Article Transformers v5: Simple model definitions powering the AI ecosystem +2 29 days ago • 258
view article Article Deep Learning over the Internet: Training Language Models Collaboratively Jul 15, 2021 • 7
SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Model Paper • 2502.02737 • Published Feb 4 • 252
Balancing Pipeline Parallelism with Vocabulary Parallelism Paper • 2411.05288 • Published Nov 8, 2024 • 20
Idefics2 🐶 Collection Idefics2-8B is a foundation vision-language model. In this collection, you will find the models, datasets and demo related to its creation. • 11 items • Updated May 6, 2024 • 92