information entropy

noun

A measure of the uncertainty associated with a random variable; a measure of the average information content one is missing when one does not know the value of the random variable (usually in units such as bits); the amount of information (measured in, say, bits) contained per average instance of a character in a stream of characters.

Similar
Shannon entropy
Ask AI about this wordChatGPTClaudePerplexityGoogle AIGrok

Meanings

nouninformation entropy (uncountable)
  1. uncountablecomputingA measure of the uncertainty associated with a random variable; a measure of the average information content one is missing when one does not know the value of the random variable (usually in units such as bits); the amount of information (measured in, say, bits) contained per average instance of a character in a stream of characters.

    Synonyms: Shannon entropy

Synonyms & antonyms

nounA measure of the uncertainty associated with a random variable; a measure of the average information content one is missing when one does not know the value of the random variable (usually in units such as bits); the amount of information (measured in, say, bits) contained per average instance of a character in a stream of characters.

Similar
Shannon entropy

Translations

Chinese Mandarin 信息熵, 資訊熵 /资讯熵
  • 信息熵 (xìnxī shāng)Translations
  • 資訊熵 /资讯熵 (zīxùn shāng)Translations
Polish entropia
  • entropiaTranslations
Cite this entry
APA

information entropy. (n.d.). In WatkinsX Dictionary. Retrieved November 4, 2026, from https://dictionary.watkinsx.com/word/information%20entropy

MLA

“information entropy.” WatkinsX Dictionary, https://dictionary.watkinsx.com/word/information%20entropy. Accessed November 4, 2026.

Chicago

WatkinsX Dictionary, s.v. “information entropy,” accessed November 4, 2026, https://dictionary.watkinsx.com/word/information%20entropy.

Source: information entropy on Wiktionary, CC BY-SA 4.0.