Variational inference by Chieh Wu in 2015
Concepts
entropy \[H[p] = \sum_x p(x) \log(p(x))\]
differential entropy \[H[p] = \int_x p(x) \log(p(x)) dx\]
KL divergence \[KL[p || q] = \]
Lectures
- 23:55 Variational Inference tutorial series Part 1 (Basic Information Theory )
- 28:01 variational inference part 2 ( KL divergence )
- 10:06 variational inference Part 3 ( Purpose of variational inference ) progress indicators
- 18:26 variational inference Part 4 ( Derivation 1 )
- 19:25 variational inference Part 5 ( Derivation 2