All Posts

Published on
May 28, 2020
Language models are few-shot learners
GPT-3 openai research
GPT-3, an autoregressive language model with 175 billion parameters, 10x more than any previous non-sparse language model.
Published on
September 19, 2019
Fine-tuning GPT-2 from human preferences
GPT-2 openai research
GPT-2, fine-tuned the 774M parameter GPT-2 language model using human feedback for various tasks.
Published on
September 20, 2018
NVIDIA released first RTX graphics card GeForce RTX 2080
company nvidia
It adopts NVIDIA Turing architecture and supports real-time ray tracing technology.
Published on
June 11, 2018
Improving language understanding with unsupervised learning
GPT-1 openai research
GPT-1, a combination of two existing ideas transformers and unsupervised pre-training.
Published on
June 12, 2017
Attention is All You Need
research googlebrain
Propose a new simple network architecture, the Transformer, based solely on attention mechanisms, dispensing with recurrence and convolutions entirely.

Language models are few-shot learners