Topic

Nvfp4 Quantization

Coverage tagged nvfp4 quantization.

Articles: 1
Desk: 1

Data graphic: GLM-5.3-Flash's FP8 weights take 328 GB for 320B parameters 1.025 bytes per parameter . A bar chart of effective bytes per parameter shows FP8 and INT8 at 1.0 to 1.05 and the 4-bit formats lower: INT4 GPTQ/AWQ 0.52 to 0.60, NVFP4 0.56, MXFP4 and EXL3 0.53. Worked examples: 328 GB fits four 128 GB DGX Sparks 512 GB , Qwen3.8-Flash in NVFP4 at about 135 GB is 7 GB over one Spark, and a projected 4-bit GLM-5.3-Flash of about 170 GB is an estimate, not a file size.

highResearch Nvfp4 Quantization

NVFP4 vs FP8 vs MXFP4 vs EXL3: The Quantization Format Guide for Local LLMs

The same 320B model is 328 GB in FP8 and near 135 GB at 4 bits. Bytes-per-parameter math, per-format tradeoffs, and how to size a box that actually fits.

Sep 12 · 13 min