Need Info on quality benchmarks to run on DeepSeek V3.2 different quant levels [D]

Reddit r/MachineLearning / 4/22/2026

💬 OpinionTools & Practical UsageModels & Research

共有:

Key Points

The post asks what evaluation benchmarks should be used to measure quality degradation when running runtime quantization on DeepSeek V3.2 at different quantization levels.
The goal is to compare each quant level’s outputs against a non-quantized baseline to quantify quality loss.
The request is focused on practical guidance for selecting appropriate benchmark suites rather than on how to implement quantization itself.

I am looking at a product that will do runtime quant on DeepSeek V3.2. I want to measure quality loss compared to no quant. What kind of benchmarks can I run?

submitted by /u/Chachachaudhary123
[link] [comments]