Readable atlas · Release 0.35
Information theory
The mathematical study of the quantification, coding and reliable transmission of uncertainty-bearing signals, including entropy, channel capacity, redundancy and noise.
Open the interactive entry · Explore its map · Download the sourced record (JSON)
Summary
Information theory supplies a mathematical account of uncertainty, coding and communication through noisy channels. It is powerful precisely because it brackets semantic meaning and studies the structure and limits of transmission.
Implications for practice
Systems and cybernetics use information in several senses. Confusing Shannon information with meaning, truth, knowledge or value produces category errors. The mathematical theory can tell us how much uncertainty is reduced, not whether the message is wise, accurate or humane.
Key distinctions
- information quantity vs semantic meaning
- signal vs message interpretation
- entropy vs disorder as a loose metaphor
- channel capacity vs organisational capacity
- data availability vs usable information
Historical development
- Nyquist and Hartley as technical precursors
- Shannon 1948: mathematical theory of communication
- Wiener 1948: cybernetic use of information and control
- Ashby: information and variety in regulation
Ideas it depends on
- a set of possible messages or states
- probability distribution
- source, channel, receiver and noise
- coding and decoding distinctions
Further developments
- coding theory
- communication engineering
- cybernetic information flows
- quantitative complexity measures
Connections to practice
- ask what uncertainty is reduced for which decision
- separate data transmission from interpretation
- measure the channel as well as the message
- notice what the classification scheme makes invisible
Common confusions
- information means meaning
- more data means better knowledge
- entropy is simply chaos
- a message has the same informational value to every observer
Further checks
- Hartley and Nyquist lineage
- Ashby-Shannon formal relation
- semantic information traditions
Recorded connections
Check the wording, direction, scope, sources, and status of a connection before relying on it.
Information theory has a foundational treatment in A Mathematical Theory of Communication
Status: provisional · Relation: described by
A cautious first-pass topic link based on the paper title and collection placement; substantive review remains pending.
No statement-level locator recorded.
- Foundational Papers in Complexity Science — official tables of contents (checked primary register)
Information theory formulated by Claude E. Shannon
Status: corroborated · Relation: formulated by
Locator: Bell System Technical Journal 27
- A Mathematical Theory of Communication (passage checked research pass)
Information theory formalises the mathematical quantity of Information
Status: candidate · Relation: formalises
Shannon formalises message selection and uncertainty while bracketing semantics. This edge concerns that mathematical sense, not a formal derivation of Bateson's account of consequential differences.
Locator: Shannon, Introduction, corrected reprint PDF p. 1; Bateson, Form, Substance, and Difference, printed pp. 459–460
- A Mathematical Theory of Communication (passage checked research pass)
- Steps to an Ecology of Mind (1987 reprint) (passage checked research pass)
Cybernetics draws on formal accounts from Information theory
Status: provisional · Relation: uses
This is a provisional semantic or practice crosswalk. It does not establish historical influence, equivalence, efficacy or universal applicability. Item-level source review and curator acceptance are still required.
Locator: Interpretive comparison of the two maintained public descriptions and their cited source records
- SCiO SysBoK - Feedback v1 · No public link (pass4 legacy internal register audit)
- Cybernetics or Control and Communication in the Animal and the Machine (research pass needs editor)
- Lineages of Systems Practice — Damian Allen · No public link (checked for doncaster lineage)
- Introduction to Complexity (Santa Fe Institute Complexity Explorer) (checked internal syllabus)
- A Mathematical Theory of Communication (passage checked research pass)
Damian Allen claims lineage from Information theory
Status: accepted · Relation: claims lineage from
First-person lineage claim; not independent proof of influence or completeness.
Locator: lineage diagram, slide 1, ‘Information Theory’ box
- Lineages of Systems Practice — Damian Allen · No public link (checked for doncaster lineage)
Warren Weaver appears in Damian's lineage strand Information theory
Status: accepted · Relation: part of
Damian Allen's self-authored lineage diagram only.
Locator: lineage diagram, slide 1, ‘Information Theory’ box
- Lineages of Systems Practice — Damian Allen · No public link (checked for doncaster lineage)
Claude E. Shannon appears in Damian's lineage strand Information theory
Status: accepted · Relation: part of
Damian Allen's self-authored lineage diagram only.
Locator: lineage diagram, slide 1, ‘Information Theory’ box
- Lineages of Systems Practice — Damian Allen · No public link (checked for doncaster lineage)
Unified Theory of Systems Intelligence proposes to integrate Information theory
Status: provisional self reported unpublished · Relation: integrates
Unpublished proto-theory. The diagram says 11 frameworks but visibly contains more than 11 labelled strands; the count ambiguity is unresolved.
Locator: lineage diagram, slide 1, ‘Information Theory’ box
- Lineages of Systems Practice — Damian Allen · No public link (checked for doncaster lineage)
- Damian Allen follow-up correspondence on lineage and UTSI · No public link (checked for doncaster lineage)
The Transmission of Information presents an account of Information theory
Status: candidate · Relation: presents account of
Limited to the identified passage. A practice analogy needs its own assumptions and evidence.
Locator: TR 65, introduction
- The Transmission of Information, Technical Report No. 65 (passage checked)
A Mathematical Theory of Communication presents an account of Information theory
Status: candidate · Relation: presents account of
Limited to the identified passage. A practice analogy needs its own assumptions and evidence.
Locator: Shannon introduction, pp. 3–5
- The Mathematical Theory of Communication — 1949 volume (passage checked)
Status: candidate · Relation: source text mentions
Exact phrase in extracted source text; page-level checking may remain pending as recorded by the locator. Its appearance may be in discussion, a quotation, a reference, or a critical comparison. No semantic or historical claim is inferred.
Locator: Extracted source text, character 731097; page-level locator pending
- Designing Social Systems in a Changing World (located public record)
Status: candidate · Relation: source text mentions
Exact phrase in extracted source text; page-level checking may remain pending as recorded by the locator. Its appearance may be in discussion, a quotation, a reference, or a critical comparison. No semantic or historical claim is inferred.
Locator: Extracted source text, character 34666; page-level locator pending
Status: candidate · Relation: source text mentions
Exact phrase in extracted source text; page-level checking may remain pending as recorded by the locator. Its appearance may be in discussion, a quotation, a reference, or a critical comparison. No semantic or historical claim is inferred.
Locator: Extracted source text, character 460010; page-level locator pending
- Presencing the Future of Democracy and Governance (located public record)
Status: candidate · Relation: source text mentions
Exact phrase in extracted source text; page-level checking may remain pending as recorded by the locator. Its appearance may be in discussion, a quotation, a reference, or a critical comparison. No semantic or historical claim is inferred.
Locator: Extracted source text, character 6159; page-level locator pending
- Quantifying the Complexity of Socio-technical Systems – A Generic, Interdisciplinary Approach (located public record)
Status: candidate · Relation: source text mentions
Exact phrase in extracted source text; page-level checking may remain pending as recorded by the locator. Its appearance may be in discussion, a quotation, a reference, or a critical comparison. No semantic or historical claim is inferred.
Locator: Extracted source text, character 14721; page-level locator pending
Status: candidate · Relation: source text mentions
Exact phrase in extracted source text; page-level checking may remain pending as recorded by the locator. Its appearance may be in discussion, a quotation, a reference, or a critical comparison. No semantic or historical claim is inferred.
Locator: Extracted source text, character 43365; page-level locator pending
- Minimal entropy production rate of interacting systems (located public record)
Law of Requisite Variety has an entropy derivation using Information theory
Status: candidate · Relation: uses in argument
Ashby derives a requisite-variety bound using conditional entropies; this mathematical formulation does not measure semantic meaning.
Locator: Section 11/8, printed pp. 207–208
- An Introduction to Cybernetics (passage checked research pass)
Claims and disputes
Shannon's information theory formalises uncertainty and communication-channel properties but does not by itself define semantic or pragmatic meaning.
Claim status: provisional. Review status: research pass needs editor.
Scope is deliberately narrow. Named editorial review is required.
Supporting sources
- A Mathematical Theory of Communication (passage checked research pass)
- Steps to an Ecology of Mind (research pass needs editor)
Feedforward acts before output error is observed and therefore depends on adequate disturbance measurement, forecasting or a model of likely effects.
Claim status: provisional. Review status: research pass needs editor.
The object is a placeholder for informational/model dependence, not a claim that Shannon information theory is always required.
Supporting sources
- Feedforward systems - IEEE Technology Navigator (research pass needs editor)
Shannon information quantifies uncertainty and communication possibilities; it does not by itself determine semantic meaning, truth or value.
Claim status: corroborated. Review status: research pass needs editor.
A central guard against importing everyday senses of information into the mathematical theory.
Supporting sources
- A Mathematical Theory of Communication (passage checked research pass)
Ashby derives a requisite-variety bound using conditional entropies; this mathematical formulation does not measure semantic meaning.
Claim status: candidate. Review status: research pass needs editor.
Primary-source exposition; editorial acceptance open
Supporting sources
- An Introduction to Cybernetics (passage checked research pass)
Shannon formalises message selection and uncertainty while bracketing semantics. This edge concerns that mathematical sense, not a formal derivation of Bateson's account of consequential differences.
Claim status: candidate. Review status: research pass needs editor.
Primary-source exposition; editorial acceptance open
Supporting sources
- A Mathematical Theory of Communication (passage checked research pass)
- Steps to an Ecology of Mind (1987 reprint) (passage checked research pass)
Sources and passage locators
- Introduction to Complexity (Santa Fe Institute Complexity Explorer) (checked internal syllabus)
- A Mathematical Theory of Communication (passage checked research pass)
- Lineages of Systems Practice — Damian Allen · No public link (checked for doncaster lineage)
- Cybernetics or Control and Communication in the Animal and the Machine (research pass needs editor)
- An Introduction to Cybernetics (passage checked research pass)
- Foundational Papers in Complexity Science — official tables of contents (checked primary register)
- Steps to an Ecology of Mind (1987 reprint) (passage checked research pass)
- SCiO SysBoK - Feedback v1 · No public link (pass4 legacy internal register audit)
- Damian Allen follow-up correspondence on lineage and UTSI · No public link (checked for doncaster lineage)
- The Transmission of Information, Technical Report No. 65 (passage checked)
- The Mathematical Theory of Communication — 1949 volume (passage checked)
- Designing Social Systems in a Changing World (located public record)
- Improving the Systems Thinking Skills of the Systems Architect via Aesthetic Interpretation of Art (located public record)
- Presencing the Future of Democracy and Governance (located public record)
- Quantifying the Complexity of Socio-technical Systems – A Generic, Interdisciplinary Approach (located public record)
- An ecology of bad ideas: approaching human relations with wider nature from an ecological-complexity perspective (located public record)
- Minimal entropy production rate of interacting systems (located public record)
- Steps to an Ecology of Mind (research pass needs editor)
- Feedforward systems - IEEE Technology Navigator (research pass needs editor)
- A Mathematical Theory of Communication: Bell System Technical Journal 27, pp. 379-423 and 623-656 · research pass needs editor
- Cybernetics or Control and Communication in the Animal and the Machine: MIT Press edition description and open-access edition; exact chapter locator pending · research pass needs editor
- An Introduction to Cybernetics: chapters 7–8; official archive bibliography entry 56 · research pass needs editor
- A Mathematical Theory of Communication: Shannon, Introduction, corrected reprint PDF p. 1; Bateson, Form, Substance, and Difference, printed pp. 459–460 · research pass needs editor
- Steps to an Ecology of Mind (1987 reprint): Shannon, Introduction, corrected reprint PDF p. 1; Bateson, Form, Substance, and Difference, printed pp. 459–460 · research pass needs editor
- An Introduction to Cybernetics: Section 11/8, printed pp. 207–208 · research pass needs editor
- Steps to an Ecology of Mind: publisher description and table of contents, Parts III-V · research pass needs editor
- Feedforward systems - IEEE Technology Navigator: Section: What Are Feedforward Systems? · research pass needs editor
Cite this entry
Taylor, B. P. (2026). Information theory. The Necessary Tangle, release 0.35. https://transduction.systems/entries/concept_information_theory/
Include the release and review status when you quote or reuse this account.