conditional entropy

noun

The portion of a random variable's own Shannon entropy which is independent from another, given, random variable.

“The conditional entropy of random variable Y given X (i.e., conditioned by X), denoted as H(Y#124;X), is equal to H(Y)-I(Y#59;X) where I(Y#59;X) is the mutual information between Y and X.”

Ask AI about this wordChatGPTClaudePerplexityGoogle AIGrok

Meanings

nounconditional entropy (plural conditional entropies)

plural conditional entropies

  1. computingThe portion of a random variable's own Shannon entropy which is independent from another, given, random variable.

    The conditional entropy of random variable Y given X (i.e., conditioned by X), denoted as H(Y#124;X), is equal to H(Y)-I(Y#59;X) where I(Y#59;X) is the mutual information between Y and X.

Cite this entry
APA

conditional entropy. (n.d.). In WatkinsX Dictionary. Retrieved November 3, 2026, from https://dictionary.watkinsx.com/word/conditional%20entropy

MLA

“conditional entropy.” WatkinsX Dictionary, https://dictionary.watkinsx.com/word/conditional%20entropy. Accessed November 3, 2026.

Chicago

WatkinsX Dictionary, s.v. “conditional entropy,” accessed November 3, 2026, https://dictionary.watkinsx.com/word/conditional%20entropy.

Source: conditional entropy on Wiktionary, CC BY-SA 4.0.