Exploring Self-attention for Image Recognition

Hengshuang ZhaoJiaya JiaVladlen Koltun

   Papers with code   Abstract  PDF

Recent work has shown that self-attention can serve as a basic building block for image recognition models. We explore variations of self-attention and assess their effectiveness for image recognition... (read more)

Benchmarked Models

RANK
MODEL
REPO
CODE RESULT
PAPER RESULT
ε-REPRODUCED
BUILD
1
SAN19-patchwise
78.2%
78.2%
2
SAN15-patchwise
78.1%
78.0%
3
SAN10-patchwise
77.1%
77.1%
4
SAN19-pairwise
76.9%
76.9%
5
SAN15-pairwise
76.6%
76.6%
6
SAN10-pairwise
74.9%
74.9%