Sunday , May 5 2024
Home / Tag Archives: information theory

Tag Archives: information theory

Jason Smith — One purpose of information theory

Unfortunately, Shannon's entropy, often referred to as information entropy, and then shortened to just information, is often confused with the colloquial term "information". This brings connotations of data, of knowledge, of specific sets of symbols with specific meaning. But as Shannon and Weaver said in their book from a year later, we must not confuse information theory information with meaning. This collision of terminology is amplified when it encounters economics, where information...

Read More »