Tag: rank branch

Source URL: https://hanlab.mit.edu/blog/svdquant Source: Hacker News Title: SVDQuant: 4-Bit Quantization Powers 12B Flux on a 16GB 4090 GPU with 3x Speedup Feedly Summary: Comments AI Summary and Description: Yes **Summary:** The provided text discusses the innovative SVDQuant paradigm for post-training quantization of diffusion models, which enhances computational efficiency by quantizing both weights and activations to…