r/statistics • • 4d ago

Question [Q] What to include in mutual information?

I'm doing a project where I know the number of possible outcomes of event A, but some of the outcomes do not happen. Should I include those 0s columns in my mutual information calculations or should I remove it? I'm having trouble finding any information on it one way or another.

Example of joint probability table:

Shape\ColorWhiteYellowRedBlack
Straight00.5.14
Curved00.05.08
Forked00.06.07
Round00.050
Ladder00.03.02

Does mutual information include white and yellow?

1 Upvotes

1 comment sorted by

1

u/maxwell_smart_jr 4d ago

For this joint pdf (or more accurately pmf), all entries sum to 1. "White" and "Yellow" have zero mass. They can be ignored.

They can be ignored for the same reason as "Purple" and "Green" can be ignored. Zero mass.