rvo commited on
Commit
1ed41b2
·
verified ·
1 Parent(s): b96de4f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +18 -8
README.md CHANGED
@@ -286,14 +286,24 @@ Please [see here](https://huggingface.co/MongoDB/mdbr-leaf-mt/blob/main/evaluate
286
  If you use this model in your work, please cite:
287
 
288
  ```bibtex
289
- @misc{mdbr_leaf,
290
- title={LEAF: Knowledge Distillation of Text Embedding Models with Teacher-Aligned Representations},
291
- author={Robin Vujanic and Thomas Rueckstiess},
292
- year={2025},
293
- eprint={2509.12539},
294
- archivePrefix={arXiv},
295
- primaryClass={cs.IR},
296
- url={https://arxiv.org/abs/2509.12539},
 
 
 
 
 
 
 
 
 
 
297
  }
298
  ```
299
 
 
286
  If you use this model in your work, please cite:
287
 
288
  ```bibtex
289
+ @inproceedings{vujanic-ruckstiess-2026-leaf,
290
+ title = "{LEAF}: Knowledge Distillation of Text Embedding Models with Teacher-Aligned Representations",
291
+ author = {Vujanic, Robin and
292
+ R{\"u}ckstie{\ss}, Thomas},
293
+ editor = "Liakata, Maria and
294
+ Moreira, Viviane P. and
295
+ Zhang, Jiajun and
296
+ Jurgens, David",
297
+ booktitle = "Proceedings of the 64th Annual Meeting of the {A}ssociation for {C}omputational {L}inguistics (Volume 1: Long Papers)",
298
+ month = jul,
299
+ year = "2026",
300
+ address = "San Diego, California, United States",
301
+ publisher = "Association for Computational Linguistics",
302
+ url = "https://aclanthology.org/2026.acl-long.2008/",
303
+ doi = "10.18653/v1/2026.acl-long.2008",
304
+ pages = "43362--43383",
305
+ ISBN = "979-8-89176-390-6",
306
+ abstract = "We present a knowledge distillation framework for text embedding models. A key distinguishing feature is that our distilled models are compatible with their teacher, enabling flexible asymmetric architectures where documents are encoded with the larger teacher model, while queries use smaller student models. We also show that our models automatically inherit MRL and robustness to output quantization whenever these properties are present in the teacher model, without explicitly training for them. To demonstrate the effectiveness of our framework we publish leaf-ir, a 23M parameters information retrieval oriented model that, besides being teacher-compatibile, sets a new state-of-the-art (SOTA) on BEIR, ranking no.1 on the public leaderboard for models of its size. Asymmetric mode further increases its retrieval performance. Our scheme is however not restricted to information retrieval. We demonstrate its wider applicability by synthesizing the multi-task leaf-mt model. This also sets a new SOTA, achieving no.1 on the public MTEB v2 (English) leaderboard for models of its size. Our technique is applicable to black-box models, requires no judgments nor hard negatives, and training can be conducted using small batch sizes. Thus, dataset and training infrastructure requirements for our framework are modest. We make our models publicly available under a permissive Apache 2.0 license."
307
  }
308
  ```
309