An information diagram is a type of Venn diagram used in information theory to illustrate relationships among Shannon's basic measures of information: entropy, joint entropy, conditional entropy and mutual information.[1][2] Information diagrams are a useful pedagogical tool for teaching and learning about these basic measures of information. Information diagrams have also been applied to specific problems such as for displaying the information theoretic similarity between sets of ontological terms.[3]
Venn diagram showing additive and subtractive relationships among various information measures associated with correlated variables X and Y. The area contained by both circles is the joint entropy . The circle on the left (red and violet) is the individual entropy , with the red being the conditional entropy . The circle on the right (blue and violet) is , with the blue being . The violet is the mutual information .
Venn diagram of information theoretic measures for three variables x, y, and z. Each circle represents an individual entropy: is the lower left circle, the lower right, and is the upper circle. The intersections of any two circles represents the mutual information for the two associated variables (e.g. is yellow and gray). The union of any two circles is the joint entropy for the two associated variables (e.g. is everything but green). The joint entropy of all three variables is the union of all three circles. It is partitioned into 7 pieces, red, blue, and green being the conditional entropies respectively, yellow, magenta and cyan being the conditional mutual informations and respectively, and gray being the interaction information . The interaction information is the only one of all that may be negative.
^Fazlollah Reza. An Introduction to Information Theory. New York: McGraw-Hill 1961. New York: Dover 1994. ISBN 0-486-68210-2
^R. W. Yeung, A First Course in Information Theory. Norwell, MA/New York: Kluwer/Plenum, 2002.
^Gardeux, Vincent; Halonen, H; Jackson, D; Martinez, FD; Lussier, YA (1 Jun 2015). "Towards a PBMC "virogram assay" for precision medicine: Concordance between ex vivo and in vivo viral infection transcriptomes". Journal of Biomedical Informatics. 1: 94–103. doi:10.1016/j.jbi.2015.03.003. PMC 4951181. PMID 25797143.
and 25 Related for: Information diagram information
An informationdiagram is a type of Venn diagram used in information theory to illustrate relationships among Shannon's basic measures of information: entropy...
A diagram is a symbolic representation of information using visualization techniques. Diagrams have been used since prehistoric times on walls of caves...
diagram is a widely used diagram style that shows the logical relation between sets, popularized by John Venn (1834–1923) in the 1880s. The diagrams are...
An information flow diagram (IFD) is a diagram that shows how information is communicated (or "flows") from a source to a receiver or target (e.g. A→C)...
Ishikawa diagrams (also called fishbone diagrams, herringbone diagrams, cause-and-effect diagrams) are causal diagrams created by Kaoru Ishikawa that...
types of interaction diagrams: Sequence diagram Communication diagram Interaction overview diagram Timing diagram A Communication diagram models the interactions...
Sankey diagrams are a data visualisation technique or flow diagram that emphasizes flow/movement/change from one state to another or one time to another...
In software engineering, a class diagram in the Unified Modeling Language (UML) is a type of static structure diagram that describes the structure of a...
power and signal connections between the devices. A wiring diagram usually gives information about the relative position and arrangement of devices and...
station at all but aims to give the viewer information without unnecessary visual clutter. A schematic diagram of a chemical process uses symbols in place...
In mathematics, a Voronoi diagram is a partition of a plane into regions close to each of a given set of objects. It can be classified also as a tessellation...
An influence diagram (ID) (also called a relevance diagram, decision diagram or a decision network) is a compact graphical and mathematical representation...
many types of diagrams which can be roughly divided into three main groups: behavior diagrams, interaction diagrams, and structure diagrams. The creation...
In Unified Modeling Language (UML), a component diagram depicts how components are wired together to form larger components or software systems. They...
spacetime diagram is a graphical illustration of locations in space at various times, especially in the special theory of relativity. Spacetime diagrams can...
correlation diagram(s), diagram(s) of correlation, and the like may refer to: Data visualization, the general process of presenting information visually...
in solution chemistry, a Pourbaix diagram, also known as a potential/pH diagram, EH–pH diagram or a pE/pH diagram, is a plot of possible thermodynamically...
Flow diagram is a collective term for a diagram representing a flow or set of dynamic relationships in a system. The term flow diagram is also used as...
Alluvial diagrams are a type of flow diagram originally developed to represent changes in network structure over time. In allusion to both their visual...
A constellation diagram is a representation of a signal modulated by a digital modulation scheme such as quadrature amplitude modulation or phase-shift...
motion diagram represents the motion of an object by displaying its location at various equally spaced times on the same diagram. Motion diagrams are a...
A piping and instrumentation diagram (P&ID or PID) is a detailed diagram in the process industry which shows the piping and process equipment together...
A phase diagram in physical chemistry, engineering, mineralogy, and materials science is a type of chart used to show conditions (pressure, temperature...
depicted in a triangular diagram, known as a ternary plot. Such diagrams are available in the speciality literature. The same information can be depicted in...
Syntax diagrams (or railroad diagrams) are a way to represent a context-free grammar. They represent a graphical alternative to Backus–Naur form, EBNF...
Global Information
Venn diagram showing additive and subtractive relationships among various information measures associated with correlated variables X and Y. The area contained by both circles is the joint entropy . The circle on the left (red and violet) is the individual entropy , with the red being the conditional entropy . The circle on the right (blue and violet) is , with the blue being . The violet is the mutual information .
Venn diagram of information theoretic measures for three variables x, y, and z. Each circle represents an individual entropy: is the lower left circle, the lower right, and is the upper circle. The intersections of any two circles represents the mutual information for the two associated variables (e.g. is yellow and gray). The union of any two circles is the joint entropy for the two associated variables (e.g. is everything but green). The joint entropy of all three variables is the union of all three circles. It is partitioned into 7 pieces, red, blue, and green being the conditional entropies respectively, yellow, magenta and cyan being the conditional mutual informations and respectively, and gray being the interaction information . The interaction information is the only one of all that may be negative.
