NCP-GENL
NVIDIA-Certified Professional: Generative AI LLMs (NCP-GENL)
QuantizationEnglish
Exam overviewPractice session
Which TensorRT-LLM technique stores weights in INT4/INT8 but performs matmuls by dequantizing on the fly, with activations kept in higher precision?
Loading your practice session…