Document Type
Article
Abstract
From the introduction: Artificial intelligence (AI) appears poised to transform the economy across sectors ranging from healthcare and finance to retail and education. What some have coined the “Fourth Industrial Revolution” is driven by three key trends: greater availability of data, increases in computing power, and improvements to algorithm design. First, increasingly large amounts of data have fueled the ability for computers to learn, such as by training an algorithmic language model on all of Wikipedia. Second, better computational capacity (often termed “compute”) and compute capability have enabled researchers to build models that were unimaginable merely ten years ago, spanning billions of parameters (an exponential increase in scope from previous models). Third, basic innovations in algorithms are helping scientists to drive forward AI, such as the reinforcement learning techniques that enabled a computer to defeat the world champion in the board game Go.
Recommended Citation
Daniel E. Ho, Jennifer King, Russell C. Wald & Christopher Wan,
The Centrality of Data and Compute for AI Innovation: A Blueprint for the National Research Cloud,
3
Notre Dame J. on Emerging Tech.
71
(2022).