Continually pre-trained models - a HPLT Collection

HPLT 's Collections

HPLT 3.0 GPT-BERT models

Continually pre-trained models

HPLT 3.0 T5 models

2505-deduplication

HPLT 2.0 Monolingual reference models

HPLT 2.0 Uni-Direction Translation Models

HPLT 2.0 Bert models

Multilingual Translation Models

HPLT 1.2 Uni-Direction Translation Models

Large Language Models

HPLT 1.2 Bert models

Continually pre-trained models

updated Jan 21

Language-specific LLMs continually pre-trained from fully open English base models