| --- |
| language: |
| - is |
| license: cc-by-4.0 |
| datasets: |
| - igc |
| --- |
| |
| # Icelandic ConvBERT-Base |
| This model was pretrained on the [Icelandic Gigaword Corpus](http://igc.arnastofnun.is/), which contains approximately 1.69B tokens, using default settings. The model uses a WordPiece tokenizer with a vocabulary size of 32,105. |
|
|
| # Acknowledgments |
| This research was supported with Cloud TPUs from Google's TPU Research Cloud (TRC). |
|
|
| This project was funded by the Language Technology Programme for Icelandic 2019-2023. The programme, which is managed and coordinated by [Almannarómur](https://almannaromur.is/), is funded by the Icelandic Ministry of Education, Science and Culture. |
