conditional entropy
English
Noun
conditional entropy (plural conditional entropies)
- (information theory) The portion of a random variable's own Shannon entropy which is independent from another, given, random variable.
- The conditional entropy of random variable
given 
(i.e., conditioned by ), denoted as 
, is equal to 
where 
is the mutual information between and .
- The conditional entropy of random variable
given 
(i.e., conditioned by 
, is equal to 
where 
is the mutual information between Related terms
Read in another language
This page is available in 1 language