Alex Alemi's Blog

Some of my thoughts...

If you have feedback, please reach out on twitter or have a discussion on github.

A Path to the Variational Diffusion Loss

2022-09-15

Deriving the (Variational) Diffusion and VAE losses from the non-negativity of KL.


Knots

2022-06-13

A short list of useful knots to know.


A Simple Demonstration of Benford's Law

2022-05-03

Benford's law is a natural consequence of scale invariance, this is relatively easy to see in the face of a circular sliderule.


Blogging

2021-11-15

I miss blogging and reading other researchers blogs.


Why KL?

2020-08-07

Why is the KL divergence so special?