Instructions to use ESGBERT/GovRoBERTa-base with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use ESGBERT/GovRoBERTa-base with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="ESGBERT/GovRoBERTa-base")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("ESGBERT/GovRoBERTa-base") model = AutoModelForMaskedLM.from_pretrained("ESGBERT/GovRoBERTa-base", device_map="auto") - Notebooks
- Google Colab
- Kaggle
|
Download README.md from ESGBERT/GovRoBERTa-base: direct link, hf CLI and curl.
- Browser
- Download file 1.43 kB
-
https://huggingface.co/ESGBERT/GovRoBERTa-base/resolve/main/README.md
- Command line
-
hf download hf://ESGBERT/GovRoBERTa-base/README.md
-
curl -L -o README.md https://huggingface.co/ESGBERT/GovRoBERTa-base/resolve/main/README.md
1.43 kB
| language: en | |
| license: apache-2.0 | |
| datasets: | |
| - ESGBERT/governance_data | |
| tags: | |
| - ESG | |
| - governance | |
| # Model Card for GovRoBERTa-base | |
| ## Model Description | |
| Based on [this paper](https://www.sciencedirect.com/science/article/pii/S1544612324000096), this is the GovRoBERTa-base language model. A language model that is trained to better understand governance texts in the ESG domain. | |
| *Note: We generally recommend choosing the [GovernanceBERT-base](https://huggingface.co/ESGBERT/GovernanceBERT-base) model since it is quicker, less resource-intensive and only marginally worse in performance.* | |
| Using the [RoBERTa](https://huggingface.co/roberta-base) model as a starting point, the GovRoBERTa-base Language Model is additionally pre-trained on a text corpus comprising governance-related annual reports, sustainability reports, and corporate and general news. | |
| ## More details can be found in the paper | |
| ```bibtex | |
| @article{schimanski_ESGBERT_2024, | |
| title = {Bridging the gap in ESG measurement: Using NLP to quantify environmental, social, and governance communication}, | |
| journal = {Finance Research Letters}, | |
| volume = {61}, | |
| pages = {104979}, | |
| year = {2024}, | |
| issn = {1544-6123}, | |
| doi = {https://doi.org/10.1016/j.frl.2024.104979}, | |
| url = {https://www.sciencedirect.com/science/article/pii/S1544612324000096}, | |
| author = {Tobias Schimanski and Andrin Reding and Nico Reding and Julia Bingler and Mathias Kraus and Markus Leippold}, | |
| } | |
| ``` | |