Fast Parametric Learning with Activation Memorization

Jack W RaeChris DyerPeter DayanTimothy P Lillicrap

   Papers with code   Abstract  PDF

Neural networks trained with backpropagation often struggle to identify classes that have been observed a small number of times. In applications where most class labels are rare, such as language modelling, this can become a performance bottleneck... (read more)

Benchmarked Models

No benchmarked models yet. Click here to submit a model.