FlashcardIntermediate
Transformers and Attention
Transformers use attention to weigh the relevance of all words in a sequence when representing each word.
Question
What are transformers and the attention mechanism?
Click to reveal answer
Transformers use attention to weigh the relevance of all words in a sequence when representing each word.
What are transformers and the attention mechanism?