Information Theory and Coding > Entropy > What is Chain Rule for Distance?

Chain Rule for distance

 

D(p(x, y)||q(x, y)) = D(p(x)||q(x)) + D(p(y|x)||q(y|x))

Prev

What is Chain rule of Mutual Information?

Next

What is data processing inequality?

Feedback

Submit