Alex Alemi's Blog

Some of my thoughts...

If you have feedback, please reach out on twitter or mastodon or have a discussion on github.

Non-equilibrium Thermodynamics Results Seemingly from Nothing

2022-09-16

Deriving some classic results in non-equilibrium thermodynamics from seemingly nothing.


A Path to the Variational Diffusion Loss

2022-09-15

Deriving the (Variational) Diffusion and VAE losses from the non-negativity of KL.


Knots

2022-06-13

A short list of useful knots to know.


A Simple Demonstration of Benford's Law

2022-05-03

Benford's law is a natural consequence of scale invariance, this is relatively easy to see in the face of a circular sliderule.


Blogging

2021-11-15

I miss blogging and reading other researchers blogs.


Why KL?

2020-08-07

Why is the KL divergence so special?