Hugging Face's logo
ReactiveAI 's Collections
RxT-Beta 3B A190M - Reactive Transformer MVP
Reactive Transformer PoC - RxT-Beta-Micro models
RxT-Beta Training Datasets
Reactive Transformer PoC - RxT-Alpha Supervised Models
Sparse Query Attention (SQA) Research
Interaction SFT Datasets

RxT-Beta 3B A190M - Reactive Transformer MVP

Reactive Transformer MVP model with 3B total params and 190M activated in decoder. Training in progress

Upvote
-