Skip to content
Automated Data Analysis

What Is an Automatic Statistician?

The concept, its research origins and what the term means in practice today.

Key takeaways
  • – An automatic statistician searches a space of candidate models rather than fitting one chosen in advance.
  • – Models are scored by a criterion that trades fit against complexity, so the search can stop.
  • – The output is an explanation — structure, charts, prose and caveats — not just a prediction.
  • – The term is now used loosely; most products described this way automate fitting, not explanation.

The phrase describes a system that does what a statistician does on first contact with a dataset: propose a structure, fit it, check it, revise it, and then explain what was found. The distinguishing feature is the last step. A system that returns a well-tuned model is an automated modeller. A system that returns a description you can argue with is something else.

Where the idea came from

The original research came out of the University of Cambridge, with collaborators at MIT, and framed the problem as search over a grammar of models. Because Gaussian process kernels can be added and multiplied, a small set of building blocks generates an open-ended space of structures — and every structure in that space decomposes into parts with names. The research page covers the papers and credits their authors.

The four ingredients

A language of models expressive enough to capture real phenomena. A search procedure to explore it. A principled evaluation criterion. A translation step that turns structure into prose, figures and limitations.

What it looks like in output

Not “the model achieved 0.94”, but “the series has a smooth upward trend of about 2.7% per year, an annual cycle whose amplitude is growing with the level, and residual variation of about 3%; the model fits poorly in 2008, where behaviour appears to change.” The airline example shows the full form.

How the term is used now

Loosely. Most tools marketed as automatic statisticians or AI analysts automate profiling and model fitting and then generate commentary with a language model. That commentary is not derived from a fitted structure, so it cannot be checked against one. The distinction is worth insisting on.


No. AutoML optimises predictive performance over a model space. An automatic statistician optimises for an interpretable description, which sometimes means preferring a slightly worse-fitting but structurally clearer model.


It removes the mechanical part of the work and produces a draft that a person still has to criticise. The framing of the question and the judgement about whether the answer is plausible remain human.


References

  1. Lloyd, J. R., Duvenaud, D., Grosse, R., Tenenbaum, J. B. & Ghahramani, Z. (2014). Automatic Construction and Natural-Language Description of Nonparametric Regression Models. AAAI 2014.
Written by
Elizabeth Sramek

Leave a response