Published onJune 11, 2018Improving language understanding with unsupervised learningGPT-1openairesearchGPT-1, a combination of two existing ideas transformers and unsupervised pre-training.