The Ultra-Scale Playbook
🌌
3.63k
The ultimate guide to training LLM on large GPU Clusters
📝 Research & Long-Form Blog Posts
In-depth technical articles and research pieces published by Hugging Face
-
-
The Smol Training Playbook
📚2.81kThe secrets to building world-class LLMs
-
Evaluation Guidebook
📝231Display benchmark evaluation data for LLMs
-
FineVision: Open Data is All You Need
📝215A new open-source dataset for training VLMs
-
Maintain the unmaintainable
📚74Visualize connections between transformer models
-
FineWeb: decanting the web for the finest text data at scale
🍷1.25kGenerate high-quality text data for LLMs using FineWeb
-
The Eiffel Tower Llama
📝98Explore the Eiffel Tower Llama experiment with open-source models
-
Porting nanochat to Transformers: an AI modeling history lesson
📝44Learn about ML and Transformers through nanochat
-
FinePDFs: Liberating 3T of the finest tokens from PDFs
📄19