Recommended Reading

Page 5 of 10.

arxiv.org favicon2019-03-10Sara Hooker · arxiv.org

The Hardware Lottery

An essay arguing that the direction of machine learning research is heavily constrained and guided by which ideas happen to run efficiently on current hardware architectures.

openai.com favicon2018-03-15Dario Amodei, Danny Hernandez · openai.com

AI and Compute

A landmark analysis showing that the amount of compute used in the largest AI training runs has been doubling every 3.4 months, far outstripping Moore's Law.