Posts tagged “diffusion-models”

6 posts found

The Probability Domain: Measure, Convergence, and Which of Your Training Claims Are Theorems
ai-tutorialstutorialprobability-theory

The Probability Domain: Measure, Convergence, and Which of Your Training Claims Are Theorems

A standalone tutorial, not a survey: probability as a measure and the σ-algebra as the list of questions you may ask, why that is forced (Vitali) and what it buys (conditioning, filtrations, independence as statements about σ-algebras), a random variable as a measurable function and a density as a Radon–Nikodym derivative with KL's infinities and the GAN support problem falling out, the three integral-limit theorems that license every gradient of an expectation and the one loss where they fail, conditional expectation as the L2 projection that makes the regression function optimal by theorem and the Borel–Kolmogorov paradox computed both ways, the four modes of convergence with the typewriter and escaping-mass counter-examples and the law of the iterated logarithm as the envelope a running mean cannot escape, the central limit theorem as a Fourier theorem with its Berry–Esseen rate and the infinite-width network as a CLT, concentration of measure from Markov to Gaussian Lipschitz with the geometry of d = 4096 and the eval-set error bar table, martingales under SGD, peeking and anytime-valid tests, ergodic theorems under MCMC, Langevin and diffusion as SDE reversal, minimax risk and the price of a density in high dimension, conditional independence as architecture and de Finetti as the licence for Bayesian inference, eleven checkpoint and three diagnostic exercises, and an appendix that grades every connection to our earlier posts by how much it actually proves.

Oct 22, 2026•328 min read
The Information Domain: Entropy as a Codelength, and Which of Your Objectives Are One by Theorem
ai-tutorialstutorialinformation-theory

The Information Domain: Entropy as a Codelength, and Which of Your Objectives Are One by Theorem

A standalone tutorial, not a survey: entropy as a coding quantity with its asymptote attached, the cross-entropy floor under both label-smoothing conventions and the table of which held-out loss owns which floor, the plug-in mutual-information estimator as an uncertain measurement with a report format, discrete versus differential entropy in d dimensions before any VAE or kernel claim, the information plane measured three ways (exact count at float64 with a readout cast to float32 and float16, binned, noisy readout at absolute and scale-normalised noise), the ELBO as an exact split into a distortion and an upper bound on rate, with the three failures called posterior collapse and the gap between a β-VAE's curve and Shannon's R(D), the I-MMSE floor under a diffusion loss with both sides integrated, Kolmogorov–Szegő with its convention and hypotheses displayed and its circulant check kept apart from the Toeplitz limit and from the jitter it rides on, hypothesis-testing exponents (Stein, Chernoff, Sanov kept apart) checked against exact finite-sample errors, the Cover & Thomas and MacKay results with proof sketches, modern consumers from InfoNCE to speculative decoding, six checkpoint exercises, and an appendix that grades every connection to our earlier posts by how much it actually proves.

Oct 8, 2026•158 min read
Bayesian Rendering Explained: When a 3D Model Admits What It Doesn't Know
ai-tutorialstutorialbeginner

Bayesian Rendering Explained: When a 3D Model Admits What It Doesn't Know

A beginner-friendly tour of Bayesian 3D reconstruction: why an ordinary 3D scan gives one confident answer everywhere, how turning geometry into a distribution produces honest confidence maps, and where the 'prior' that fills in unseen regions comes from.

Jul 18, 2026•7 min read
When Gaussians Get Uncertain: Probabilistic 3D Reconstruction
ai-tutorialstutorialgaussian-splatting

When Gaussians Get Uncertain: Probabilistic 3D Reconstruction

3D Gaussian Splatting gives us a single best-fit scene — but no sense of where that geometry is trustworthy. This week we turn point-estimate splats into distributions over geometry, connecting Bayesian rendering, Fisher information, and diffusion priors back to last week's GP framework.

Jul 16, 2026•8 min read
The Image-to-3D Landscape—How One Photo Becomes a World
ai-tutorialstutorialimage-to-3d

The Image-to-3D Landscape—How One Photo Becomes a World

Map the modern image-to-3D ecosystem—from LRM-style direct regression and multi-view diffusion to latent 3D generation—and see how the frontier is now moving from static 3D to dynamic 4D worlds.

Apr 5, 2026•20 min read
Inside Marble-Like Architectures: From Pixels to 3D Worlds
ai-tutorialstutorialmachine-learning

Inside Marble-Like Architectures: From Pixels to 3D Worlds

Trend tutorial on World Models -- focusing on Worldlabs' Marble

Apr 2, 2026•12 min read