For use of GPTQ, do you have this available?
https://huggingface.co/elinas/alpaca-30b-lora-int4/discussions/2 this one exists
Β· Sign up or log in to comment