The fastest and most accurate quantization method for high-dimensional vectors. Our project introduces Segmented Code Adjustment Quantization (SAQ), a novel quantization algorithm built upon dimension ...
I am encountering an issue while attempting to quantize the Qwen2.5-Coder-14B model using the auto-gptq library. The quantization process fails with a torch.linalg.cholesky error, indicating that the ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results