Read any paper without getting stuck.
Highlight any confusing term and get a plain-English explanation. Your glossary and mindmap build themselves as you read.
attention head
The part of the model that decides which words to focus on.
A research paper titled “Sparse Attention for Long-Document Question Answering” with the term “attention head” highlighted and explained: The part of the model that decides which words to focus on.