Skip to content
Open
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions chapters/part4/divergence/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -31,14 +31,14 @@ <h3>Earth Mover's Distance</h3>

<p>This value is very meaningful, but it doesn't have a closed form equation. Instead it is computed by solving a linear program. If the range of values that the random variables can take on is of size $n$, the linear program has a run time of $O(n^3 \cdot \log n)$ which is very slow.</p>

<h3>Kullback Leiber Divergence</h3>
<h3>Kullback-Leibler Divergence</h3>

<p>Let $X$ and $Y$ be discrete random variables. Calculate the expected "excess surprise" from using Y as your Probability Mass Function instead of X when the actual Probability Mass Function is X.


<p>
<div class="bordered">
<p><b><i>Definition:</i></b> Kullback Leiber Divergence</p>
<p><b><i>Definition:</i></b> Kullback-Leibler Divergence</p>

<p>Let $X$ and $Y$ be discrete random variables</p>

Expand Down