Skip to content
Gaussian Processes

Gaussian Process Kernels Explained

What each kernel assumes, what it produces, and how combinations change the story.

Key takeaways
  • – Every kernel is a statement about similarity as a function of distance.
  • – Addition models independent components; multiplication models interaction.
  • – Length-scale is the single most consequential hyperparameter.
  • – A changepoint kernel is how a model is given permission to say behaviour changed.

Reading a kernel

A kernel maps a pair of inputs to a covariance. Large covariance at large separation means the function is smooth and slow; covariance that decays quickly means it is rough. The length-scale sets the distance over which the function is expected to change appreciably.

The base set

Squared exponential (SE) — smooth to infinite order; good for trends, over-smooth for physical processes. Matérn — a roughness parameter makes it more realistic for sensor and physical data. Periodic (PER) — exact repetition at a fixed period. Linear (LIN) — straight-line behaviour, useful multiplied rather than alone. White noise (WN) — independent observation error. Changepoint (CP) — a smooth switch between two kernels at a location.

What combinations mean

ExpressionReads as
SE + PERA smooth trend plus a stable cycle
SE × PERA cycle whose amplitude varies smoothly
LIN × PERA cycle whose amplitude grows linearly
CP(t) × SESmooth behaviour that changes at time t
SE + WNA smooth signal observed with noise
TABLE 1 — Reading composed kernels

Choosing by hand vs searching

Hand-choosing works when the phenomenon is understood — a daily cycle in web traffic, an annual cycle in retail. Searching pays off when it is not, and when the interaction terms are where the story is, as in the airline series.

Elizabeth Sramek
Written by
Elizabeth Sramek

Elizabeth Sramek is an independent advisor on search visibility and demand architecture for B2B companies operating in high-competition markets. Based in Prague and working globally, she specializes in designing search presence for AI-mediated discovery and building category visibility that survives algorithmic shifts.

Leave a response