Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer

Colin RaffelNoam ShazeerAdam RobertsKatherine LeeSharan NarangMichael MatenaYanqi ZhouWei LiPeter J. Liu

   Papers with code   Abstract  PDF

Transfer learning, where a model is first pre-trained on a data-rich task before being fine-tuned on a downstream task, has emerged as a powerful technique in natural language processing (NLP). The effectiveness of transfer learning has given rise to a diversity of approaches, methodology, and practice... (read more)

Benchmarked Models

No benchmarked models yet. Click here to submit a model.