tiiuae

/

Falcon-H1R-7B

like 96

Follow

Technology Innovation Institute 1.76k

currently its good with small models because of the overtraining "14 trillion tokens" which help it. so the bigger the size the more the tokens And the harder it is to train

@jacek2024 - thanks for the interest in bigger sized models ; Stay tuned for more updates !