Cross entropy

From Wikipedia Quality
Jump to: navigation, search

In information theory, the cross entropy between two probability distributions 

 , rather than the "true" distribution

The cross entropy for the distributions

For discrete

The situation for continuous distributions is analogous. We have to assume that

NB: The notation

Retrieved from "https://wikipediaquality.com/index.php?title=Cross_entropy&oldid=5076"