Quantifying the Different kinds of Information in a Multimodal Data

13 Oct 2026
Photo by Alex Padurariu on Unsplash
Somewhat surprisingly, the vast majority of work in information theory concerns only the simplest possible case: the information that a single variable provides about another.
— Williams and Beer, 2010

Say we have two variables X1X_1 and X2X_2 that we are using as predictors for a target variable YY. We know the total information that X1X_1 and X2X_2 can give about YY is I(X1,X2∣Y)I(X_1, X_2| Y) but we would also like to know how X1X_1 and X2X_2 contribute to the total information.

Why? Say we're trying to rob a bank. Our espionage efforts have found that the bank has multiple vaults each with a number YY. Opening a vault requires two bank officials to insert two separate codes, X1X_1 and X2X_2. Our social engineer found out that the two codes

X1X_1 represents test questions, X2X_2 images corresponding to the questions and YY represents answers.

[Image of heart with an arrow pointing to a part of the heart. Question: Which part of the heart is this?]

Williams and Beer came up with the idea of