Adaptive Input Representations for Neural Language Modeling

Alexei BaevskiMichael Auli

   Papers with code   Abstract  PDF

We introduce adaptive input representations for neural language modeling which extend the adaptive softmax of Grave et al. (2017) to input representations of variable capacity... (read more)

Benchmarked Models

RANK
MODEL
REPO
CODE RESULT
PAPER RESULT
ε-REPRODUCED
BUILD
1
Transformer
(Adaptive inputs)
18.70
18.70