gys

gysgysgys's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

upvoted an article 11 months ago

view article

Article

Tricks from OpenAI gpt-oss YOU 🫵 can use with transformers

• 
• 
• +5

ariG23498, sergiopaniego, reach-vb, pcuenq, ArthurZ, SaylorTwift, cyrilvallez

•

Sep 11, 2025

• 192

upvoted 2 papers about 1 year ago

Benchmarking Optimizers for Large Language Model Pretraining

Paper • 2509.01440 • Published Sep 1, 2025 • 25

BeyondWeb: Lessons from Scaling Synthetic Data for Trillion-scale Pretraining

Paper • 2508.10975 • Published Aug 14, 2025 • 60

upvoted an article over 1 year ago

view article

Article

A failed experiment: Infini-Attention, and why we should keep trying?

• 
• 
• +1

neuralink, lvwerra, thomwolf

•

Aug 14, 2024

• 77