Posts tagged “positional-encoding”

2 posts found

Bochner's Theorem and the Kernel–Fourier Bridge

For continuous stationary positive-definite kernels, Bochner’s theorem turns kernel design into a choice of spectral measure. We derive random Fourier features, connect positional rotations to frequency, and explain where the bridge to attention and spectral transformers needs extra assumptions.

Sep 27, 2026•28 min read

ai-tutorialstutorialvision-transformer

How Vision Transformers Work (and Why Patch Tokenization Is a Hack)

Understand the elegant trick that let transformers process images, why it surprisingly works, and why its fundamental limitations drive the next generation of vision architectures.

Apr 10, 2026•11 min read