shb777/Llama-3.3-8B-Instruct-128K-GGUF

Llama 3.3 8B Instruct GGUF

Quantized GGUF versions of shb777/Llama-3.3-8B-Instruct-128K

Includes fixes for full context length and chat template (Unsloth)

Quantization	File	Use Case
Q8_0	llama-3.3-8b-instruct-q8_0.gguf	Highest quality, largest size
Q6_K	llama-3.3-8b-instruct-q6_k.gguf	Balanced quality/size
Q4_K_M	llama-3.3-8b-instruct-q4_k_m.gguf	Smaller size, good quality