Gopher Language Model

DeepMind introduces a 280B parameter language model named Gopher. Investigates its effectiveness in reading comprehension & other complex tasks such as logical reasoning. Ethics & risks are also discussed.

Links:

Article: https://deepmind.com/blog/article/language-modelling-at-scale

Paper: “Scaling Language Models: Methods, Analysis & Insights from Training Gopher“