About
static quants of https://huggingface.co/InfiX-ai/InfiGUI-R1-3B
THIS REPO CONTAINS mmproj-* FILE, CAN BE DEPLOYED WITH ONE SHOT.
Usage
llama-server -m InfiGUI-R1-3B-IQ4_K_M.gguf --mmproj mmproj-InfiGUI-R1-3B-F16.gguf --jinja -c 8196
- Downloads last month
- 3
Hardware compatibility
Log In to add your hardware
4-bit