An Analysis of Neural Language Modeling at Multiple Scales

Stephen MerityNitish Shirish KeskarRichard Socher

   Papers with code   Abstract  PDF

Many of the leading approaches in language modeling introduce novel, complex and specialized architectures. We take existing state-of-the-art word level language models based on LSTMs and QRNNs and extend them to both larger vocabularies as well as character-level granularity... (read more)

Benchmarked Models

No benchmarked models yet. Click here to submit a model.