Tuesday, April 17, 2007

Flowchart and entropy



Sorry about the quality, if you cant read it the text, the first four diamonds saw "Is it greater than" and then "89, 74, 59, and 44" respectively. The last one says "is it less than 44?" Finally the bottom squares say "Return" and "A, B, C, D, and F" respectively. Otherwise it shouldn't be too hard to read.

Hartley's measure deals with simple yes and no question's to measure information using a log with a base of 2
Shannon's entropy uses a weighted measure using probabilities and a log of base 2.
Both measures remove uncertainty to measure information.

No comments: