DeepMind introduces a 280B parameter language model named Gopher. Investigates its effectiveness in reading comprehension & other complex tasks such as logical reasoning. Ethics & risks are also discussed.
Links:
Article: https://deepmind.com/blog/article/language-modelling-at-scale
Paper: “Scaling Language Models: Methods, Analysis & Insights from Training Gopher“