Alex Alemi's Blog

Some of my thoughts...

If you have feedback, please reach out on twitter or mastodon or have a discussion on github.

A Degree of Certainty

2024-08-14

Let's measure probability in degrees.


Leap Day

2024-03-29

Going overboard to prove the local newspaper wrong.


KL is All You Need

2024-01-08

It's all KL under the hood.


The Method of Imaginary Results

2023-11-30

Don't think about your prior, think about a hypothetical posterior.


Ventilation

2023-11-29

A simple model of CO2 concentration in our home.


Non-equilibrium Thermodynamics Results Seemingly from Nothing

2022-09-16

Deriving some classic results in non-equilibrium thermodynamics from seemingly nothing.


A Path to the Variational Diffusion Loss

2022-09-15

Deriving the (Variational) Diffusion and VAE losses from the non-negativity of KL.


Knots

2022-06-13

A short list of useful knots to know.


A Simple Demonstration of Benford's Law

2022-05-03

Benford's law is a natural consequence of scale invariance, this is relatively easy to see in the face of a circular sliderule.


Blogging

2021-11-15

I miss blogging and reading other researchers blogs.


Why KL?

2020-08-07

Why is the KL divergence so special?