Posts tagged “neural-tangent-kernel”

2 posts found

The Frequency Domain: How Fourier Transforms Secretly Powered Everything We Built

A practitioner-level synthesis of twelve weeks of tutorials through one lens — spectral bias, Fourier features, FFT-based token mixing, Bochner's theorem, and neural operators — showing that positional encodings, kernels, state-space models and diffusion schedules are the same idea in different clothes.

Sep 17, 2026•82 min read

ai-tutorialstutorialgaussian-processes

Attention Is All You Need... Is a Kernel

How scaled dot-product attention is secretly Nadaraya–Watson kernel regression — and what that reveals about the GP–Transformer duality, the Deep GP revival, and why uncertainty is the missing ingredient for world models.

Jul 12, 2026•12 min read