llmat
/

Apertus-8B-Instruct-2509-NVFP4

Text Generation

8-bit precision

compressed-tensors

Model card Files Files and versions

Apertus-8B-Instruct-2509-NVFP4

Ctrl+K

Ctrl+K

1 contributor

History: 2 commits

llmat's picture

Add NVFP4 quantized model for swiss-ai/Apertus-8B-Instruct-2509.

7563e00 verified 9 months ago

.gitattributes

271 Bytes
Add NVFP4 quantized model for swiss-ai/Apertus-8B-Instruct-2509. 9 months ago
README.md

531 Bytes
Add NVFP4 quantized model for swiss-ai/Apertus-8B-Instruct-2509. 9 months ago
chat_template.jinja

14 kB
Add NVFP4 quantized model for swiss-ai/Apertus-8B-Instruct-2509. 9 months ago
config.json

2.1 kB
Add NVFP4 quantized model for swiss-ai/Apertus-8B-Instruct-2509. 9 months ago
generation_config.json

137 Bytes
Add NVFP4 quantized model for swiss-ai/Apertus-8B-Instruct-2509. 9 months ago
model-00001-of-00002.safetensors

4.99 GB
xet

Add NVFP4 quantized model for swiss-ai/Apertus-8B-Instruct-2509. 9 months ago
model-00002-of-00002.safetensors

1.08 GB
xet

Add NVFP4 quantized model for swiss-ai/Apertus-8B-Instruct-2509. 9 months ago
model.safetensors.index.json

90.6 kB
Add NVFP4 quantized model for swiss-ai/Apertus-8B-Instruct-2509. 9 months ago
recipe.yaml

130 Bytes
Add NVFP4 quantized model for swiss-ai/Apertus-8B-Instruct-2509. 9 months ago
special_tokens_map.json

565 Bytes
Add NVFP4 quantized model for swiss-ai/Apertus-8B-Instruct-2509. 9 months ago
tokenizer.json

17.1 MB
xet

Add NVFP4 quantized model for swiss-ai/Apertus-8B-Instruct-2509. 9 months ago
tokenizer_config.json

177 kB
Add NVFP4 quantized model for swiss-ai/Apertus-8B-Instruct-2509. 9 months ago