50 min listen
24: Language and Entropy (Information Theory in Language)
24: Language and Entropy (Information Theory in Language)
ratings:
Length:
48 minutes
Released:
Mar 7, 2018
Format:
Podcast episode
Description
Information theory was founded in 1948 by Claude Shannon, and is a way of both qualitatively and quantitatively describing the limits and processes involved in communication. Roughly speaking, when two entities communicate, they have a message, a medium, confusion, encoding, and decoding; and when two entities communicate, they transfer information between them. The amount of information that is possible to be transmitted can be increased or decreased by manipulating any of the aforementioned variables. One of the practical, and original, applications of information theory is to models of language. So what is entropy? How can we say language has it? And what structures within language with respect to information theory reveal deep insights about the nature of language itself?--- This episode is sponsored by · Anchor: The easiest way to make a podcast. https://anchor.fm/appSupport this podcast: https://anchor.fm/breakingmathpodcast/support
Released:
Mar 7, 2018
Format:
Podcast episode
Titles in the series (100)
6: Word (Linguistics): Mathematics has a lot in common with language. Both have been used since the dawn of time to shape and define our world, both have sets of rules which one must master before bending, both are natural consequences of the way humans are raised, and both... by Breaking Math Podcast