Back to directory
self-attention
Deep Learning

What it is

An attention-based deep learning architecture effective for sequence modeling and long contexts.

self-attention illustrative image

Replace this placeholder with a custom image for this term.

Related terms

attention
activation function
backpropagation
convolutional neural network
cross-entropy
deep learning
embeddings
encoder-decoder
gru
loss function