NCP-GENL

NVIDIA-Certified Professional: Generative AI LLMs (NCP-GENL)

QuantizationEnglish
Exam overview

Practice session

Which TensorRT-LLM technique stores weights in INT4/INT8 but performs matmuls by dequantizing on the fly, with activations kept in higher precision?

Loading your practice session…