AI History Battle

The roster

152 figures across the history of the field.

ai-classic

Karen Sparck Jones Karen Sparck Jones Inverse document frequency Raj Reddy Raj Reddy Continuous speech recognition Takeo Kanade Takeo Kanade Computer vision: face detection, optical flow, virtualized reality Tom Mitchell Tom Mitchell ask The Machine Learning textbook Rodney Brooks Rodney Brooks Behavior-based robotics Peter Norvig Peter Norvig ask AI: A Modern Approach (with Russell) Cynthia Dwork Cynthia Dwork Differential privacy Stuart Russell Stuart Russell AI: A Modern Approach

deep-modern

John Hopfield John Hopfield Energy-based neural networks Kunihiko Fukushima Kunihiko Fukushima The neocognitron: ancestor of the CNN Shun'ichi Amari Shun'ichi Amari Information geometry Geoffrey Hinton Geoffrey Hinton Backprop popularizer Paul Werbos Paul Werbos Backpropagation in his 1974 thesis Stephen Boyd Stephen Boyd Convex optimization: the book and the solvers Jitendra Malik Jitendra Malik Computer vision: segmentation, perceptual organization Yann LeCun Yann LeCun Convolutional networks Jurgen Schmidhuber Jurgen Schmidhuber LSTM lab Ion Stoica Ion Stoica Spark and Ray: the compute substrate of modern ML Yoshua Bengio Yoshua Bengio Neural language models Christopher Manning Christopher Manning Statistical NLP Leon Bottou Leon Bottou Stochastic gradient descent at scale David MacKay David MacKay Information theory, inference, and learning Sepp Hochreiter Sepp Hochreiter LSTM Daphne Koller Daphne Koller Probabilistic graphical models Jon Kleinberg Jon Kleinberg ask HITS Risi Kondor Risi Kondor ask Group-theoretic and equivariant machine learning Cathy O'Neil Cathy O'Neil ask Weapons of Math Destruction Josh Tenenbaum Josh Tenenbaum ask Probabilistic programs as models of the mind Alex Smola Alex Smola ask Kernel machines at scale Rene Vidal Rene Vidal ask Generalized PCA Carlos Guestrin Carlos Guestrin ask Distributed ML (GraphLab) Dawn Song Dawn Song AI security and adversarial ML Lek-Heng Lim Lek-Heng Lim ask Tensors and multilinear algebra for data science Terence Tao Terence Tao ask Fields Medal Demis Hassabis Demis Hassabis DeepMind Raquel Urtasun Raquel Urtasun ask Perception for self-driving Pieter Abbeel Pieter Abbeel Robot learning Jure Leskovec Jure Leskovec ask Graph machine learning: node2vec, GraphSAGE, the SNAP toolkit Aaron Clauset Aaron Clauset ask Network science Ross Girshick Ross Girshick ask R-CNN lineage of object detection Anima Anandkumar Anima Anandkumar ask Tensor methods for ML Timnit Gebru Timnit Gebru ask Datasheets and model cards Alec Radford Alec Radford ask GPT and CLIP: the language-model lineage Ashish Vaswani Ashish Vaswani 'Attention is all you need': the transformer Ilya Sutskever Ilya Sutskever Seq2seq Ian Goodfellow Ian Goodfellow Generative adversarial networks Rediet Abebe Rediet Abebe ask Algorithms and inequality John Santerre John Santerre ask The professor. Brings AI to companies

early-stat

Karl Pearson Karl Pearson Correlation, chi-squared William Sealy Gosset William Sealy Gosset 'Student' of the t-test Ronald Fisher Ronald Fisher Maximum likelihood, ANOVA, randomized experimental design Jerzy Neyman Jerzy Neyman Confidence intervals Abraham Wald Abraham Wald Statistical decision theory Andrey Kolmogorov Andrey Kolmogorov Axioms of probability John Tukey John Tukey Exploratory data analysis Kiyosi Ito Kiyosi Ito Stochastic calculus George Box George Box 'All models are wrong' C.R. Rao C.R. Rao Cramer-Rao bound, Rao-Blackwellization, information geometry David Cox David Cox Proportional hazards

foundations

Thomas Bayes Thomas Bayes Conditional probability Pierre-Simon Laplace Pierre-Simon Laplace Bayesian inference in practice Carl Friedrich Gauss Carl Friedrich Gauss Least squares and the normal distribution Charles Babbage Charles Babbage Designed the first programmable computer (Analytical Engine) Ada Lovelace Ada Lovelace The first programmer George Boole George Boole Boolean logic underlying all digital computation Florence Nightingale Florence Nightingale Statistical graphics that changed public health policy Andrei Markov Andrei Markov Markov chains

midcentury

Norbert Wiener Norbert Wiener Cybernetics Arthur Samuel Arthur Samuel Checkers program that learned John von Neumann John von Neumann Stored-program computer, game theory, Monte Carlo methods Donald Hebb Donald Hebb Hebbian learning: cells that fire together wire together Grace Hopper Grace Hopper Compilers Alan Turing Alan Turing Computability, the universal machine, the imitation game, codebreaking Paul Erdos Paul Erdos ask The probabilistic method George Dantzig George Dantzig Linear programming and the simplex method Richard Hamming Richard Hamming Error-correcting codes Claude Shannon Claude Shannon Information theory Herbert Simon Herbert Simon Bounded rationality Richard Bellman Richard Bellman Dynamic programming Lotfi Zadeh Lotfi Zadeh Fuzzy logic and fuzzy sets Walter Pitts Walter Pitts The McCulloch-Pitts neuron Allen Newell Allen Newell Symbolic problem solving John McCarthy John McCarthy Coined 'artificial intelligence' Marvin Minsky Marvin Minsky Frames, society of mind Frank Rosenblatt Frank Rosenblatt The perceptron: the first trainable neural classifier John Nash John Nash Equilibrium in non-cooperative games Noam Chomsky Noam Chomsky Formal grammars Rudolf Kalman Rudolf Kalman The Kalman filter Frederick Jelinek Frederick Jelinek Statistical speech recognition Andrew Viterbi Andrew Viterbi The Viterbi algorithm Thomas Cover Thomas Cover Information theory David Marr David Marr Levels of analysis

rl

Richard Sutton Richard Sutton Temporal-difference learning Andrew Barto Andrew Barto Reinforcement learning foundations (with Sutton) Chris Watkins Chris Watkins Q-learning David Silver David Silver AlphaGo and AlphaZero

stat-learning

David Blackwell David Blackwell Rao-Blackwell Hirotugu Akaike Hirotugu Akaike AIC Leo Breiman Leo Breiman CART, bagging, random forests Grace Wahba Grace Wahba Splines Judea Pearl Judea Pearl Bayesian networks Vladimir Vapnik Vladimir Vapnik VC theory Alexey Chervonenkis Alexey Chervonenkis Co-inventor of VC dimension and uniform convergence Bradley Efron Bradley Efron The bootstrap Jerome Friedman Jerome Friedman Gradient boosting Peter Bickel Peter Bickel Semiparametric efficiency Dimitri Bertsekas Dimitri Bertsekas ask Dynamic programming and optimal control Donald Rubin Donald Rubin Causal inference via potential outcomes Trevor Hastie Trevor Hastie Generalized additive models Ingrid Daubechies Ingrid Daubechies Wavelets that work: compactly supported orthonormal bases Michael I. Jordan Michael I. Jordan Graphical models to modern ML Robert Tibshirani Robert Tibshirani The lasso David Donoho David Donoho Wavelets John Lafferty John Lafferty ask Conditional random fields Susan Murphy Susan Murphy ask Micro-randomized trials Larry Wasserman Larry Wasserman ask All of Statistics Corinna Cortes Corinna Cortes ask The soft-margin SVM (with Vapnik) Yoav Freund Yoav Freund AdaBoost (with Schapire) Bin Yu Bin Yu Stability as a statistical principle Robert Schapire Robert Schapire Boosting: weak learners made strong Andrew Gelman Andrew Gelman Hierarchical Bayes Robert Nowak Robert Nowak ask Active learning Peter Bartlett Peter Bartlett Statistical learning theory Partha Niyogi Partha Niyogi ask Manifold learning Bernhard Scholkopf Bernhard Scholkopf ask Kernel methods systematized Emmanuel Candes Emmanuel Candes Compressed sensing Sayan Mukherjee Sayan Mukherjee ask Learning theory Michael Mahoney Michael Mahoney ask Randomized numerical linear algebra Martin Wainwright Martin Wainwright ask High-dimensional statistics Cosma Shalizi Cosma Shalizi ask Computational mechanics Nathan Srebro Nathan Srebro ask Matrix factorization David Blei David Blei ask Topic models Rina Foygel Barber Rina Foygel Barber ask Conformal prediction

systems

Frances Allen Frances Allen Optimizing compilers Margaret Hamilton Margaret Hamilton Apollo flight software Barbara Liskov Barbara Liskov Data abstraction Dennis Ritchie Dennis Ritchie C and Unix Leslie Lamport Leslie Lamport Time in distributed systems Ken Thompson Ken Thompson Unix Tim Berners-Lee Tim Berners-Lee The World Wide Web Guido van Rossum Guido van Rossum Python Jeff Dean Jeff Dean MapReduce, Bigtable, TensorFlow Linus Torvalds Linus Torvalds Linux and Git

theory

Edsger Dijkstra Edsger Dijkstra Shortest paths Tony Hoare Tony Hoare Quicksort Richard Karp Richard Karp 21 NP-complete problems Donald Knuth Donald Knuth The Art of Computer Programming Manuel Blum Manuel Blum Computational complexity Stephen Cook Stephen Cook NP-completeness and the P vs NP question Andrew Yao Andrew Yao Communication complexity Leslie Valiant Leslie Valiant PAC learning: a theory of the learnable Cristopher Moore Cristopher Moore ask The Nature of Computation