Recommended Reading

Page 5 of 10.

2019-03-10Sara Hooker · arxiv.org

The Hardware Lottery

An essay arguing that the direction of machine learning research is heavily constrained and guided by which ideas happen to run efficiently on current hardware architectures.

2018-03-15Dario Amodei, Danny Hernandez · openai.com

AI and Compute

A landmark analysis showing that the amount of compute used in the largest AI training runs has been doubling every 3.4 months, far outstripping Moore's Law.