Instructions to use lmz/candle-quantized-t5 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use lmz/candle-quantized-t5 with Transformers:
# Load model directly from transformers import AutoTokenizer, AutoModelForSeq2SeqLM tokenizer = AutoTokenizer.from_pretrained("lmz/candle-quantized-t5") model = AutoModelForSeq2SeqLM.from_pretrained("lmz/candle-quantized-t5") - Notebooks
- Google Colab
- Kaggle
Upload model.gguf
Browse files- model.gguf +2 -2
model.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:30b202732ece72a7c4e8bc5875c800ef322d4fa2ae3cde1051c444a339303ef1
|
| 3 |
+
size 64350016
|