ISTA-DASLab/Llama-3.1-70B-Instruct-3Bit-GSQ
Text Generation • 9B • Updated • 15
None defined yet.
MatryoshkaLoRA: Learning Accurate Hierarchical Low-Rank Representations for LLM Fine-Tuning
GSQ: Highly-Accurate Low-Precision Scalar Quantization for LLMs via Gumbel-Softmax Sampling