Explore Library
QuizIntermediate

Self-Attention Mechanism

Self-attention lets each token attend to other tokens to build context.

What does self-attention allow a model to do?