1 min readfrom Machine Learning

Need Info on quality benchmarks to run on DeepSeek V3.2 different quant levels [D]

I am looking at a product that will do runtime quant on DeepSeek V3.2. I want to measure quality loss compared to no quant. What kind of benchmarks can I run?

submitted by /u/Chachachaudhary123
[link] [comments]

Want to read more?

Check out the full article on the original site

View original article