mdda-rdai commited on
Commit
4590c94
·
verified ·
1 Parent(s): 4b53137

Explain where model came from

Browse files
Files changed (1) hide show
  1. README.md +29 -3
README.md CHANGED
@@ -1,3 +1,29 @@
1
- ---
2
- license: mit
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ language:
4
+ - en
5
+ base_model:
6
+ - facebook/fasttext-en-vectors
7
+ ---
8
+
9
+ These reduced dimensionality vectors were produced using the following code:
10
+
11
+ ```py
12
+ import fasttext
13
+ import fasttext.util
14
+
15
+ fasttext.util.download_model('en', if_exists='ignore')
16
+ print("Downloaded 300-D embeddings model")
17
+ ft = fasttext.load_model('cc.en.300.bin')
18
+ print(f"Current embedding dimension : {ft.get_dimension()}\n")
19
+
20
+ print(f"Reducing embedding dimension to 100-D")
21
+ fasttext.util.reduce_model(ft, 100)
22
+ print(f"Reduced embedding dimension : {ft.get_dimension()}\n")
23
+ ft.save_model('cc.en.100.bin') # Use this in the code...
24
+ ```
25
+
26
+ followed by:
27
+ ```bash
28
+ gzip cc.en.100.bin
29
+ ```