Skip to content

NCP-GENL

NVIDIA-Certified Professional: Generative AI LLMs (NCP-GENL)

Transformer ArchitectureEnglish

Practice session

In a decoder-only transformer using scaled dot-product attention, what is the purpose of dividing the dot product of Q and K by the square root of the head dimension?

Loading your practice session…