attention

AI·2 November 2026·5 min read

How Attention Lets AI Models Focus on the Right Words

Attention is the mechanism that lets a language model weigh every word in a text against every other word. Here is how queries, keys and values do it, and why it gets costly.