Pringled Samoed commited on
Commit
73908c3
·
1 Parent(s): fbdc7b7

Add evaluation results for model minishlab/potion-multilingual-128M revision 38ebd7f10f71e67fa8db898290f92b82e9cfff2a (#2)

Browse files

- Add evaluation results for model minishlab/potion-multilingual-128M revision 38ebd7f10f71e67fa8db898290f92b82e9cfff2a (6fea87d68483744bdb34f8ddab7f5c31a94dc0b8)


Co-authored-by: Solomatin Roman <Samoed@users.noreply.huggingface.co>

.eval_results/BrightAopsRetrieval.yaml ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: mteb/BRIGHT
3
+ task_id: BrightAopsRetrieval_default_standard
4
+ revision: c26703e6600d97c579ee2985f16cf307db13ed85
5
+ value: 3.127
6
+ date: '2026-03-31'
7
+ notes: Obtained using MTEB v2.10.12
8
+ source:
9
+ url: https://github.com/embeddings-benchmark/mteb/
10
+ name: Obtained using MTEB v2.10.12
11
+ user: mteb
12
+ - dataset:
13
+ id: mteb/BRIGHT
14
+ task_id: BrightAopsRetrieval
15
+ revision: c26703e6600d97c579ee2985f16cf307db13ed85
16
+ value: 3.127
17
+ date: '2026-03-31'
18
+ notes: Obtained using MTEB v2.10.12
19
+ source:
20
+ url: https://github.com/embeddings-benchmark/mteb/
21
+ name: Obtained using MTEB v2.10.12
22
+ user: mteb
.eval_results/BrightBiologyLongRetrieval.yaml ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: mteb/BRIGHT
3
+ task_id: BrightBiologyLongRetrieval_default_long
4
+ revision: c26703e6600d97c579ee2985f16cf307db13ed85
5
+ value: 15.372
6
+ date: '2026-03-31'
7
+ notes: Obtained using MTEB v2.10.12
8
+ source:
9
+ url: https://github.com/embeddings-benchmark/mteb/
10
+ name: Obtained using MTEB v2.10.12
11
+ user: mteb
12
+ - dataset:
13
+ id: mteb/BRIGHT
14
+ task_id: BrightBiologyLongRetrieval
15
+ revision: c26703e6600d97c579ee2985f16cf307db13ed85
16
+ value: 15.372
17
+ date: '2026-03-31'
18
+ notes: Obtained using MTEB v2.10.12
19
+ source:
20
+ url: https://github.com/embeddings-benchmark/mteb/
21
+ name: Obtained using MTEB v2.10.12
22
+ user: mteb
.eval_results/BrightBiologyRetrieval.yaml ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: mteb/BRIGHT
3
+ task_id: BrightBiologyRetrieval_default_standard
4
+ revision: c26703e6600d97c579ee2985f16cf307db13ed85
5
+ value: 8.666
6
+ date: '2026-03-31'
7
+ notes: Obtained using MTEB v2.10.12
8
+ source:
9
+ url: https://github.com/embeddings-benchmark/mteb/
10
+ name: Obtained using MTEB v2.10.12
11
+ user: mteb
12
+ - dataset:
13
+ id: mteb/BRIGHT
14
+ task_id: BrightBiologyRetrieval
15
+ revision: c26703e6600d97c579ee2985f16cf307db13ed85
16
+ value: 8.666
17
+ date: '2026-03-31'
18
+ notes: Obtained using MTEB v2.10.12
19
+ source:
20
+ url: https://github.com/embeddings-benchmark/mteb/
21
+ name: Obtained using MTEB v2.10.12
22
+ user: mteb
.eval_results/BrightEarthScienceLongRetrieval.yaml ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: mteb/BRIGHT
3
+ task_id: BrightEarthScienceLongRetrieval_default_long
4
+ revision: c26703e6600d97c579ee2985f16cf307db13ed85
5
+ value: 14.368
6
+ date: '2026-03-31'
7
+ notes: Obtained using MTEB v2.10.12
8
+ source:
9
+ url: https://github.com/embeddings-benchmark/mteb/
10
+ name: Obtained using MTEB v2.10.12
11
+ user: mteb
12
+ - dataset:
13
+ id: mteb/BRIGHT
14
+ task_id: BrightEarthScienceLongRetrieval
15
+ revision: c26703e6600d97c579ee2985f16cf307db13ed85
16
+ value: 14.368
17
+ date: '2026-03-31'
18
+ notes: Obtained using MTEB v2.10.12
19
+ source:
20
+ url: https://github.com/embeddings-benchmark/mteb/
21
+ name: Obtained using MTEB v2.10.12
22
+ user: mteb
.eval_results/BrightEarthScienceRetrieval.yaml ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: mteb/BRIGHT
3
+ task_id: BrightEarthScienceRetrieval_default_standard
4
+ revision: c26703e6600d97c579ee2985f16cf307db13ed85
5
+ value: 13.607
6
+ date: '2026-03-31'
7
+ notes: Obtained using MTEB v2.10.12
8
+ source:
9
+ url: https://github.com/embeddings-benchmark/mteb/
10
+ name: Obtained using MTEB v2.10.12
11
+ user: mteb
12
+ - dataset:
13
+ id: mteb/BRIGHT
14
+ task_id: BrightEarthScienceRetrieval
15
+ revision: c26703e6600d97c579ee2985f16cf307db13ed85
16
+ value: 13.607
17
+ date: '2026-03-31'
18
+ notes: Obtained using MTEB v2.10.12
19
+ source:
20
+ url: https://github.com/embeddings-benchmark/mteb/
21
+ name: Obtained using MTEB v2.10.12
22
+ user: mteb
.eval_results/BrightEconomicsLongRetrieval.yaml ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: mteb/BRIGHT
3
+ task_id: BrightEconomicsLongRetrieval_default_long
4
+ revision: c26703e6600d97c579ee2985f16cf307db13ed85
5
+ value: 9.223
6
+ date: '2026-03-31'
7
+ notes: Obtained using MTEB v2.10.12
8
+ source:
9
+ url: https://github.com/embeddings-benchmark/mteb/
10
+ name: Obtained using MTEB v2.10.12
11
+ user: mteb
12
+ - dataset:
13
+ id: mteb/BRIGHT
14
+ task_id: BrightEconomicsLongRetrieval
15
+ revision: c26703e6600d97c579ee2985f16cf307db13ed85
16
+ value: 9.223
17
+ date: '2026-03-31'
18
+ notes: Obtained using MTEB v2.10.12
19
+ source:
20
+ url: https://github.com/embeddings-benchmark/mteb/
21
+ name: Obtained using MTEB v2.10.12
22
+ user: mteb
.eval_results/BrightEconomicsRetrieval.yaml ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: mteb/BRIGHT
3
+ task_id: BrightEconomicsRetrieval_default_standard
4
+ revision: c26703e6600d97c579ee2985f16cf307db13ed85
5
+ value: 7.59
6
+ date: '2026-03-31'
7
+ notes: Obtained using MTEB v2.10.12
8
+ source:
9
+ url: https://github.com/embeddings-benchmark/mteb/
10
+ name: Obtained using MTEB v2.10.12
11
+ user: mteb
12
+ - dataset:
13
+ id: mteb/BRIGHT
14
+ task_id: BrightEconomicsRetrieval
15
+ revision: c26703e6600d97c579ee2985f16cf307db13ed85
16
+ value: 7.59
17
+ date: '2026-03-31'
18
+ notes: Obtained using MTEB v2.10.12
19
+ source:
20
+ url: https://github.com/embeddings-benchmark/mteb/
21
+ name: Obtained using MTEB v2.10.12
22
+ user: mteb
.eval_results/BrightLeetcodeRetrieval.yaml ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: mteb/BRIGHT
3
+ task_id: BrightLeetcodeRetrieval_default_standard
4
+ revision: c26703e6600d97c579ee2985f16cf307db13ed85
5
+ value: 15.94
6
+ date: '2026-03-31'
7
+ notes: Obtained using MTEB v2.10.12
8
+ source:
9
+ url: https://github.com/embeddings-benchmark/mteb/
10
+ name: Obtained using MTEB v2.10.12
11
+ user: mteb
12
+ - dataset:
13
+ id: mteb/BRIGHT
14
+ task_id: BrightLeetcodeRetrieval
15
+ revision: c26703e6600d97c579ee2985f16cf307db13ed85
16
+ value: 15.94
17
+ date: '2026-03-31'
18
+ notes: Obtained using MTEB v2.10.12
19
+ source:
20
+ url: https://github.com/embeddings-benchmark/mteb/
21
+ name: Obtained using MTEB v2.10.12
22
+ user: mteb
.eval_results/BrightPonyLongRetrieval.yaml ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: mteb/BRIGHT
3
+ task_id: BrightPonyLongRetrieval_default_long
4
+ revision: c26703e6600d97c579ee2985f16cf307db13ed85
5
+ value: 3.379
6
+ date: '2026-03-31'
7
+ notes: Obtained using MTEB v2.10.12
8
+ source:
9
+ url: https://github.com/embeddings-benchmark/mteb/
10
+ name: Obtained using MTEB v2.10.12
11
+ user: mteb
12
+ - dataset:
13
+ id: mteb/BRIGHT
14
+ task_id: BrightPonyLongRetrieval
15
+ revision: c26703e6600d97c579ee2985f16cf307db13ed85
16
+ value: 3.379
17
+ date: '2026-03-31'
18
+ notes: Obtained using MTEB v2.10.12
19
+ source:
20
+ url: https://github.com/embeddings-benchmark/mteb/
21
+ name: Obtained using MTEB v2.10.12
22
+ user: mteb
.eval_results/BrightPonyRetrieval.yaml ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: mteb/BRIGHT
3
+ task_id: BrightPonyRetrieval_default_standard
4
+ revision: c26703e6600d97c579ee2985f16cf307db13ed85
5
+ value: 4.463
6
+ date: '2026-03-31'
7
+ notes: Obtained using MTEB v2.10.12
8
+ source:
9
+ url: https://github.com/embeddings-benchmark/mteb/
10
+ name: Obtained using MTEB v2.10.12
11
+ user: mteb
12
+ - dataset:
13
+ id: mteb/BRIGHT
14
+ task_id: BrightPonyRetrieval
15
+ revision: c26703e6600d97c579ee2985f16cf307db13ed85
16
+ value: 4.463
17
+ date: '2026-03-31'
18
+ notes: Obtained using MTEB v2.10.12
19
+ source:
20
+ url: https://github.com/embeddings-benchmark/mteb/
21
+ name: Obtained using MTEB v2.10.12
22
+ user: mteb
.eval_results/BrightPsychologyLongRetrieval.yaml ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: mteb/BRIGHT
3
+ task_id: BrightPsychologyLongRetrieval_default_long
4
+ revision: c26703e6600d97c579ee2985f16cf307db13ed85
5
+ value: 4.95
6
+ date: '2026-03-31'
7
+ notes: Obtained using MTEB v2.10.12
8
+ source:
9
+ url: https://github.com/embeddings-benchmark/mteb/
10
+ name: Obtained using MTEB v2.10.12
11
+ user: mteb
12
+ - dataset:
13
+ id: mteb/BRIGHT
14
+ task_id: BrightPsychologyLongRetrieval
15
+ revision: c26703e6600d97c579ee2985f16cf307db13ed85
16
+ value: 4.95
17
+ date: '2026-03-31'
18
+ notes: Obtained using MTEB v2.10.12
19
+ source:
20
+ url: https://github.com/embeddings-benchmark/mteb/
21
+ name: Obtained using MTEB v2.10.12
22
+ user: mteb
.eval_results/BrightPsychologyRetrieval.yaml ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: mteb/BRIGHT
3
+ task_id: BrightPsychologyRetrieval_default_standard
4
+ revision: c26703e6600d97c579ee2985f16cf307db13ed85
5
+ value: 5.943
6
+ date: '2026-03-31'
7
+ notes: Obtained using MTEB v2.10.12
8
+ source:
9
+ url: https://github.com/embeddings-benchmark/mteb/
10
+ name: Obtained using MTEB v2.10.12
11
+ user: mteb
12
+ - dataset:
13
+ id: mteb/BRIGHT
14
+ task_id: BrightPsychologyRetrieval
15
+ revision: c26703e6600d97c579ee2985f16cf307db13ed85
16
+ value: 5.943
17
+ date: '2026-03-31'
18
+ notes: Obtained using MTEB v2.10.12
19
+ source:
20
+ url: https://github.com/embeddings-benchmark/mteb/
21
+ name: Obtained using MTEB v2.10.12
22
+ user: mteb
.eval_results/BrightRoboticsLongRetrieval.yaml ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: mteb/BRIGHT
3
+ task_id: BrightRoboticsLongRetrieval_default_long
4
+ revision: c26703e6600d97c579ee2985f16cf307db13ed85
5
+ value: 5.941
6
+ date: '2026-03-31'
7
+ notes: Obtained using MTEB v2.10.12
8
+ source:
9
+ url: https://github.com/embeddings-benchmark/mteb/
10
+ name: Obtained using MTEB v2.10.12
11
+ user: mteb
12
+ - dataset:
13
+ id: mteb/BRIGHT
14
+ task_id: BrightRoboticsLongRetrieval
15
+ revision: c26703e6600d97c579ee2985f16cf307db13ed85
16
+ value: 5.941
17
+ date: '2026-03-31'
18
+ notes: Obtained using MTEB v2.10.12
19
+ source:
20
+ url: https://github.com/embeddings-benchmark/mteb/
21
+ name: Obtained using MTEB v2.10.12
22
+ user: mteb
.eval_results/BrightRoboticsRetrieval.yaml ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: mteb/BRIGHT
3
+ task_id: BrightRoboticsRetrieval_default_standard
4
+ revision: c26703e6600d97c579ee2985f16cf307db13ed85
5
+ value: 6.134
6
+ date: '2026-03-31'
7
+ notes: Obtained using MTEB v2.10.12
8
+ source:
9
+ url: https://github.com/embeddings-benchmark/mteb/
10
+ name: Obtained using MTEB v2.10.12
11
+ user: mteb
12
+ - dataset:
13
+ id: mteb/BRIGHT
14
+ task_id: BrightRoboticsRetrieval
15
+ revision: c26703e6600d97c579ee2985f16cf307db13ed85
16
+ value: 6.134
17
+ date: '2026-03-31'
18
+ notes: Obtained using MTEB v2.10.12
19
+ source:
20
+ url: https://github.com/embeddings-benchmark/mteb/
21
+ name: Obtained using MTEB v2.10.12
22
+ user: mteb
.eval_results/BrightStackoverflowLongRetrieval.yaml ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: mteb/BRIGHT
3
+ task_id: BrightStackoverflowLongRetrieval_default_long
4
+ revision: c26703e6600d97c579ee2985f16cf307db13ed85
5
+ value: 5.128
6
+ date: '2026-03-31'
7
+ notes: Obtained using MTEB v2.10.12
8
+ source:
9
+ url: https://github.com/embeddings-benchmark/mteb/
10
+ name: Obtained using MTEB v2.10.12
11
+ user: mteb
12
+ - dataset:
13
+ id: mteb/BRIGHT
14
+ task_id: BrightStackoverflowLongRetrieval
15
+ revision: c26703e6600d97c579ee2985f16cf307db13ed85
16
+ value: 5.128
17
+ date: '2026-03-31'
18
+ notes: Obtained using MTEB v2.10.12
19
+ source:
20
+ url: https://github.com/embeddings-benchmark/mteb/
21
+ name: Obtained using MTEB v2.10.12
22
+ user: mteb
.eval_results/BrightStackoverflowRetrieval.yaml ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: mteb/BRIGHT
3
+ task_id: BrightStackoverflowRetrieval_default_standard
4
+ revision: c26703e6600d97c579ee2985f16cf307db13ed85
5
+ value: 7.862
6
+ date: '2026-03-31'
7
+ notes: Obtained using MTEB v2.10.12
8
+ source:
9
+ url: https://github.com/embeddings-benchmark/mteb/
10
+ name: Obtained using MTEB v2.10.12
11
+ user: mteb
12
+ - dataset:
13
+ id: mteb/BRIGHT
14
+ task_id: BrightStackoverflowRetrieval
15
+ revision: c26703e6600d97c579ee2985f16cf307db13ed85
16
+ value: 7.862
17
+ date: '2026-03-31'
18
+ notes: Obtained using MTEB v2.10.12
19
+ source:
20
+ url: https://github.com/embeddings-benchmark/mteb/
21
+ name: Obtained using MTEB v2.10.12
22
+ user: mteb
.eval_results/BrightSustainableLivingLongRetrieval.yaml ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: mteb/BRIGHT
3
+ task_id: BrightSustainableLivingLongRetrieval_default_long
4
+ revision: c26703e6600d97c579ee2985f16cf307db13ed85
5
+ value: 6.481
6
+ date: '2026-03-31'
7
+ notes: Obtained using MTEB v2.10.12
8
+ source:
9
+ url: https://github.com/embeddings-benchmark/mteb/
10
+ name: Obtained using MTEB v2.10.12
11
+ user: mteb
12
+ - dataset:
13
+ id: mteb/BRIGHT
14
+ task_id: BrightSustainableLivingLongRetrieval
15
+ revision: c26703e6600d97c579ee2985f16cf307db13ed85
16
+ value: 6.481
17
+ date: '2026-03-31'
18
+ notes: Obtained using MTEB v2.10.12
19
+ source:
20
+ url: https://github.com/embeddings-benchmark/mteb/
21
+ name: Obtained using MTEB v2.10.12
22
+ user: mteb
.eval_results/BrightSustainableLivingRetrieval.yaml ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: mteb/BRIGHT
3
+ task_id: BrightSustainableLivingRetrieval_default_standard
4
+ revision: c26703e6600d97c579ee2985f16cf307db13ed85
5
+ value: 6.654
6
+ date: '2026-03-31'
7
+ notes: Obtained using MTEB v2.10.12
8
+ source:
9
+ url: https://github.com/embeddings-benchmark/mteb/
10
+ name: Obtained using MTEB v2.10.12
11
+ user: mteb
12
+ - dataset:
13
+ id: mteb/BRIGHT
14
+ task_id: BrightSustainableLivingRetrieval
15
+ revision: c26703e6600d97c579ee2985f16cf307db13ed85
16
+ value: 6.654
17
+ date: '2026-03-31'
18
+ notes: Obtained using MTEB v2.10.12
19
+ source:
20
+ url: https://github.com/embeddings-benchmark/mteb/
21
+ name: Obtained using MTEB v2.10.12
22
+ user: mteb
.eval_results/BrightTheoremQAQuestionsRetrieval.yaml ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: mteb/BRIGHT
3
+ task_id: BrightTheoremQAQuestionsRetrieval_default_standard
4
+ revision: c26703e6600d97c579ee2985f16cf307db13ed85
5
+ value: 4.035
6
+ date: '2026-03-31'
7
+ notes: Obtained using MTEB v2.10.12
8
+ source:
9
+ url: https://github.com/embeddings-benchmark/mteb/
10
+ name: Obtained using MTEB v2.10.12
11
+ user: mteb
12
+ - dataset:
13
+ id: mteb/BRIGHT
14
+ task_id: BrightTheoremQAQuestionsRetrieval
15
+ revision: c26703e6600d97c579ee2985f16cf307db13ed85
16
+ value: 4.035
17
+ date: '2026-03-31'
18
+ notes: Obtained using MTEB v2.10.12
19
+ source:
20
+ url: https://github.com/embeddings-benchmark/mteb/
21
+ name: Obtained using MTEB v2.10.12
22
+ user: mteb
.eval_results/BrightTheoremQATheoremsRetrieval.yaml ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: mteb/BRIGHT
3
+ task_id: BrightTheoremQATheoremsRetrieval_default_standard
4
+ revision: c26703e6600d97c579ee2985f16cf307db13ed85
5
+ value: 0.658
6
+ date: '2026-03-31'
7
+ notes: Obtained using MTEB v2.10.12
8
+ source:
9
+ url: https://github.com/embeddings-benchmark/mteb/
10
+ name: Obtained using MTEB v2.10.12
11
+ user: mteb
12
+ - dataset:
13
+ id: mteb/BRIGHT
14
+ task_id: BrightTheoremQATheoremsRetrieval
15
+ revision: c26703e6600d97c579ee2985f16cf307db13ed85
16
+ value: 0.658
17
+ date: '2026-03-31'
18
+ notes: Obtained using MTEB v2.10.12
19
+ source:
20
+ url: https://github.com/embeddings-benchmark/mteb/
21
+ name: Obtained using MTEB v2.10.12
22
+ user: mteb