AI History Battle
Engraved card portrait of Cynthia Dwork

Cynthia Dwork

b. 1958 · ai-classic

Differential privacy

0wins
0losses
win rate

Strongest on

99 Train on the phones, keep the secrets 99 The census under a privacy budget 99 The statistic that can't betray you 98 Anonymous, except for everything about you 97 The graph that knew your name 95 The score that decides parole

In the mind map

The same ideas, as concepts rather than history — in John's ML knowledge map.

Differential Privacy

Life and career

Cynthia Dwork spent the first half of her career as a theoretical computer scientist in the classical mold, and the second half inventing the definition that a whole industry now organizes its data practices around. She studied at Princeton and took her doctorate at Cornell under John Hopcroft in the early 1980s, in distributed computing — a field then wrestling with the impossibility results that make agreement among unreliable processes so hard. Her paper with Nancy Lynch and Larry Stockmeyer on consensus under partial synchrony is one of the field's canonical results: it identifies exactly what timing assumptions are needed to route around the impossibility of deterministic consensus in a fully asynchronous system with faults, and it underpins essentially every practical consensus protocol built since. It was recognized with the Dijkstra Prize two decades later.

She worked at IBM Almaden, then at the Digital/Compaq Systems Research Center, then at Microsoft Research in Silicon Valley, and since 2017 has been a professor at Harvard, with affiliations extending into the law school and the university's broader work on technology and society. Along the way she did substantial cryptography: with Moni Naor she proposed, in the early 1990s, requiring a small computational payment to send email as a way to make bulk spam economically unattractive — the proof-of-work construction that reappeared, uncredited at first, at the base of Bitcoin. With Danny Dolev and Naor she introduced non-malleable cryptography, formalizing the requirement that an adversary who intercepts a ciphertext cannot produce a related one, a property standard encryption definitions had simply not addressed. With Miklós Ajtai she built a public-key cryptosystem whose security rests on the worst-case hardness of lattice problems, an early instance of the worst-case-to-average-case reductions that make lattice cryptography attractive today.

The pivot came in the mid-2000s, and it began with a negative result. Irit Dinur and Kobbi Nissim had shown that a database answering too many queries too accurately can be reconstructed almost entirely — that privacy is not a property you can add to a system with enough aggregation, because accuracy and privacy trade off against each other as a matter of information theory. Dwork's response was to stop trying to anonymize data and instead define what a *computation* must guarantee. Working with Frank McSherry, Nissim and Adam Smith, and in parallel with Krishnaram Kenthapadi, Ilya Mironov and Naor, she produced differential privacy in 2006. It has since been deployed by the U.S. Census Bureau for the 2020 decennial data, and inside the telemetry and analytics systems of most large technology companies. The work has been recognized with the Gödel Prize, the Knuth Prize, and election to the national academies.

Her more recent work extends the same instinct — *define the guarantee first* — into algorithmic fairness and into the statistical validity of adaptive data analysis.

Key contributions

**Differential privacy.** The definition: a randomized mechanism M is ε-differentially private if for any two datasets differing in a single individual's record, and any set of outputs S, the probability that M lands in S changes by at most a factor of e^ε. Read that carefully, because every consequential property follows from its exact shape. The guarantee is about the *mechanism*, not the data, so it holds regardless of what auxiliary information the adversary possesses — the failure mode of every anonymization scheme, where a supposedly de-identified release is joined against an outside dataset, is defined away rather than patched. The guarantee is *individual-level*: the promise made to you is that the output distribution would be nearly the same had you not participated at all, which makes participation approximately costless and gives the definition a clean decision-theoretic reading. And crucially, the guarantee *composes*: run k mechanisms with budgets ε₁…ε_k and the total is bounded by their sum, with a tighter bound of roughly √(k log(1/δ)) · ε under the (ε,δ) relaxation, from the advanced composition theorem she developed with Guy Rothblum and Salil Vadhan. Composition is what turns a definition into an accounting system — the privacy budget — and it is the reason a real organization can reason about a year of releases rather than a single query.

The basic mechanisms follow from the definition mechanically. Compute a function's *sensitivity*, the maximum change in its output when one record changes, and add Laplace noise scaled to sensitivity/ε; the noise is calibrated to what a single person could possibly have contributed, not to the size of the answer. Counting queries have sensitivity one, so noise stays constant while the signal grows with the database — which is exactly why differential privacy is nearly free for large aggregates and brutal for small cells. Her monograph with Aaron Roth is the standard reference and develops the whole apparatus, including the harder machinery for answering exponentially many queries and for private learning.

**Fairness through awareness.** With Moritz Hardt, Toniann Pitassi, Omer Reingold and Richard Zemel, Dwork gave one of the founding formal treatments of algorithmic fairness. The core proposal, individual fairness, requires that similar individuals receive similar outcomes — formally, that the classifier be Lipschitz with respect to a task-specific similarity metric. The framework's honesty is what makes it valuable: it makes explicit that the hard, contested, unavoidably normative work is *specifying the metric*, and it establishes early and rigorously that blindness does not produce fairness, since removing a protected attribute leaves its correlates intact. The paper also analyzes when group-level statistical parity conflicts with individual-level treatment, staking out the tension that the whole subsequent literature works within.

**Adaptive data analysis.** With Vitaly Feldman, Hardt, Pitassi, Reingold and Roth, Dwork showed that differential privacy's stability property directly solves a problem in statistics: when an analyst repeatedly queries a holdout set and lets the answers guide the next question, the usual guarantees collapse because the queries are no longer independent of the data. Answering those queries through a differentially private mechanism bounds how much the analyst can overfit, yielding a reusable holdout with provable generalization. It is a beautiful transfer — a privacy definition turns out to be the right tool for the replication crisis.

In battle

Dwork's sheet is a specialist's, but the specialty is unusually broad in application: mean 33.6, median 24, nine dominant problems, and forty-six at or below 20. When a problem involves data about people and a guarantee, she is essentially unbeatable; otherwise she contributes little.

The 99s are hers by definition. "The statistic that can't betray you" is the differential-privacy problem statement — a provable bound on inference about any individual, robust to arbitrary auxiliary knowledge, purchased with calibrated noise against an explicit budget. "The census under a privacy budget" is the 2020 decennial deployment, the largest real-world use of her framework and the one where the accuracy-privacy tradeoff became a public policy fight. "Train on the phones, keep the secrets" is federated learning with formal privacy accounting, where composition across training rounds is the whole technical difficulty and her composition theorems are the instrument. "Anonymous, except for everything about you" (98) is the de-anonymization/linkage attack that motivated the entire field, and "The graph that knew your name" (97) is its network-data version, where correlated records make naive anonymization hopeless.

Her fairness numbers deserve attention: 71.5 across fifteen problems, the broadest strength on her sheet. "The score that decides parole" (95) is risk assessment under conflicting fairness criteria; "The variable you removed is still there" (92) is the proxy-variable problem her 2012 paper called out explicitly; "The model memorized the secrets" (85) is training-data extraction, where DP-SGD is the standard defense. Fifteen problems at that average makes her a genuinely valuable card in any modern-ethics-heavy matchup, not just a one-trick privacy carrier.

The losses are total and uniformly non-statistical-privacy. "A thousand words, connected speech" (6) is the 1976 speech-architecture debate; "Where did every pixel go?" (8) is optical flow; "Prune the adversary's replies" (8) is alpha-beta search; "Small tools, loosely joined" (8) is Unix design philosophy; "Compress without knowing the source" (8) is universal compression; "The trend with a memory" (8) is time-series modeling. Her perception average of 7.0, search 11.0, and regression 11.0 mark the dead zones. She is a worst-case theorist of guarantees, and the problems that need a working perceptual system, a good engineering aesthetic, or a fitted model of a time series ask for something her toolkit does not produce.

There is a subtler weakness the game reflects in her mid-range: differential privacy buys its guarantee with utility, and when the privacy budget is spent, the answers stop. Against a problem where the requirement is maximum accuracy from limited data and nobody is asking about disclosure risk, her framework is a tax rather than a tool.