Monday, September 30, 2013

The Secret's Out

Great security! Too much wear can be a bad thing. From cheezburger.com, thanks Laura.

Monday, September 23, 2013

Simpson's Paradox

Simpson's paradox fools many. Percentages can favor women over men across each of several subgroups but then reverse, favoring men over women when the subgroups are combined into one. At one level this seems illogical. We seem to expect that patterns observed consistently for portions of a whole should also apply when the portions are aggregated together into one. This simple view misses lurking variables. In a famous example, graduate admission to Berkeley seemed biased against women when considered overall, but when the admissions were considered by individual departments there was no bias or bias in favor of women. The lurking variable is that "not all departments are equally easy to enter." and "the proportion of women applicants tends to be high in departments that are hard to get into and low in those departments that are easy to get into".

Lewis Lehe and Victor Powell at UC Berkeley have produced interactive applets to illustrate Simpson's paradox. As Flowing Data mentions "Sometimes when you zoom in, you see a completely opposite trend of what you saw overall".

We've considered Simpson's paradox before where even microbes can be used to illustrate it.


Monday, September 16, 2013

Top of the Line

Upscale neighborhood. Greatest frequency of wear is on the premium.
Forwarded by a colleague (thanks Jun). Originally, I think, from Reddit.

Monday, September 9, 2013

Probability WONK

.
Robert Jernigan WONK Challenge from American University on Vimeo.
I finally saw my American University WONK Challenge Spot on the Jumbotron at the Washington Nationals game on August 27. Here's me pointing, and the Nationals won!
Foul balls have really hit the news lately with a fan in Cleveland catching 4 in one game this last month! As I mention in the spot some put the probability of catching a foul ball in any game at about  1 in 1000. This, of course, varies with where you sit. Defending or attacking this figure was not possible in such a short spot, so if we accept it, we compute the probability that you catch at least one foul ball in say, n, games. We can compute this probability by first finding the probability of its complement.  The complementary event of catching at least one foul ball is catching no foul balls. In one game our chance of not catching a foul ball is 1-0.001=0.999. If our catching a foul ball is independent from game to game, then our chance of not catching a foul in n games is (0.999)n. Subtracting this from one, we get the probability of catching at least one foul ball in n games: 1- (0.999)n. If we want this result to be at least 50-50 (that is, 0.50) we need to find the value of n so that: 0.50 < =1- (0.999)n. You can do this by trial and error on a calculator or by using logarithms to solve for n. This will be the number of home games you must attend to increase your chances of catching at least one foul ball to at least 50-50. Now convert this to seasons of home games. There are 162 games in a season, but only 81 are home games. You should get an answer of 8 home seasons plus about half of a ninth season, hence choice B in the video.

This was fun to do.

Monday, September 2, 2013

Wear Pattern in "Bedrock"

This is a symmetric and bell-shaped pattern of wear on the entry door to the restrooms at Rocky Gap Casino and Resort in Flintstone, MD (yes, Flintstone). We've seen this type of wear often, for example, here and here. People use the handle to open and pass through door, but many, likely on exit, place their hands around the edge of the door to pass through or hold it open for others. They can't reach too high and when they do it seems only fingers are used, leaving little wear.  It's also  uncomfortable to hold it open too low, again likely only with fingers. So most of the wear and likely many whole hands are used between these extremes causing much more wear. Top to bottom, little use, greater use, then little use generates the bell-shaped pattern wear.

Monday, August 26, 2013

Monday, August 19, 2013

Variance Rules

[Earlier this post had errors. Thanks Kevin. I was thinking sequentially instead of group-wise.  For correct reference, my mistake is corrected here. The overall conclusions have not changed.]

An interesting probability paradox from Futility Closet who credits Gábor J. Székely’s Paradoxes in Probability Theory and Mathematical Statistics via's Mark Chang’s Paradoxes in Scientific Inference.

Variance in a jury's judgement seems to be better than taking one person's word for it. As Futility Closet mentions:
Chang writes, “This paradox implies it is better to have your own opinion even if it is not as good as the leader’s opinion, in general.”
From Futility Closet consider:
"A, B, C, D, and E make up a five-member jury. They’ll decide the guilt of a prisoner by a simple majority vote. The probability that A gives the wrong verdict is 5%; for B, C, and D it’s 10%; for E it’s 20%. When the five jurors vote independently, the probability that they’ll bring in the wrong verdict is about 1%".
For such a 5 member juries the possibilities are: mistaken=1, correct=0:
 
A    B    C    D    E        P(A)    P(B)   P(C)   P(D)   P(E)   Product
1    0    0    0    0        0.05    0.9    0.9    0.9    0.8    0.02916
0    1    0    0    0        0.95    0.1    0.9    0.9    0.8    0.06156
0    0    1    0    0        0.95    0.9    0.1    0.9    0.8    0.06156
0    0    0    1    0        0.95    0.9    0.9    0.1    0.8    0.06156
0    0    0    0    1        0.95    0.9    0.9    0.9    0.2    0.13851
1    1    0    0    0        0.05    0.1    0.9    0.9    0.8    0.00324
1    0    1    0    0        0.05    0.9    0.1    0.9    0.8    0.00324
1    0    0    1    0        0.05    0.9    0.9    0.1    0.8    0.00324
1    0    0    0    1        0.05    0.9    0.9    0.9    0.2    0.00729
0    1    1    0    0        0.95    0.1    0.1    0.9    0.8    0.00684
0    1    0    1    0        0.95    0.1    0.9    0.1    0.8    0.00684
0    1    0    0    1        0.95    0.1    0.9    0.9    0.2    0.01539
0    0    1    1    0        0.95    0.9    0.1    0.1    0.8    0.00684
0    0    1    0    1        0.95    0.9    0.1    0.9    0.2    0.01539
0    0    0    1    1        0.95    0.9    0.9    0.1    0.2    0.01539
0    0    1    1    1        0.95    0.9    0.1    0.1    0.2    0.00171
0    1    0    1    1        0.95    0.1    0.9    0.1    0.2    0.00171
0    1    1    0    1        0.95    0.1    0.1    0.9    0.2    0.00171
0    1    1    1    0        0.95    0.1    0.1    0.1    0.8    0.00076
1    0    0    1    1        0.05    0.9    0.9    0.1    0.2    0.00081
1    0    1    0    1        0.05    0.9    0.1    0.9    0.2    0.00081
1    0    1    1    0        0.05    0.9    0.1    0.1    0.8    0.00036
1    1    0    0    1        0.05    0.1    0.9    0.9    0.2    0.00081
1    1    0    1    0        0.05    0.1    0.9    0.1    0.8    0.00036
1    1    1    0    0        0.05    0.1    0.1    0.9    0.8    0.00036
0    1    1    1    1        0.95    0.1    0.1    0.1    0.2    0.00019
1    0    1    1    1        0.05    0.9    0.1    0.1    0.2    0.00009
1    1    0    1    1        0.05    0.1    0.9    0.1    0.2    0.00009
1    1    1    0    1        0.05    0.1    0.1    0.9    0.2    0.00009
1    1    1    1    0        0.05    0.1    0.1    0.1    0.8    0.00004
1    1    1    1    1        0.05    0.1    0.1    0.1    0.2    0.00001


All those possibilities in red are mistaken coalitions with probability totaling:  0.00991.
[This is slightly smaller than the result originally posted which over-estimated this value as a comment suggested.]


From Futility Closet:
"But if E (whose judgment is poorest) abandons his autonomy and echoes the vote of A (whose judgment is best), the chance of an error rises to 1.5%".
In this situation juror E always agrees with juror A, so if A is included in a mistaken coalition it only needs two more jurors to form a simple majority. Of course A might not be included, then a mistaken coalition needs jurors B, C, and D. The possibilities and their probabilities are shown below:

A    B    C    D        P(A)    P(B)   P(C)   P(D)   Product
1    0    0    0        0.05    0.9    0.9    0.9    0.03645
0    1    0    0        0.95    0.1    0.9    0.9    0.07695
0    0    1    0        0.95    0.9    0.1    0.9    0.07695
0    0    0    1        0.95    0.9    0.9    0.1    0.07695
1    1    0    0        0.05    0.1    0.9    0.9    0.00405
1    0    1    0        0.05    0.9    0.1    0.9    0.00405
1    0    0    1        0.05    0.9    0.9    0.1    0.00405
0    1    1    0        0.95    0.1    0.1    0.9    0.00855
0    1    0    1        0.95    0.1    0.9    0.1    0.00855
0    0    1    1        0.95    0.9    0.1    0.1    0.00855
0    1    1    1        0.95    0.1    0.1    0.1    0.00095
1    0    1    1        0.05    0.9    0.1    0.1    0.00045
1    1    0    1        0.05    0.1    0.9    0.1    0.00045
1    1    1    0        0.05    0.1    0.1    0.9    0.00045
1    1    1    1        0.05    0.1    0.1    0.1    0.00005


All those possibilities in red are mistaken coalitions with probability totaling:  0.0145.
[This is slightly smaller than the result originally posted as a comment suggested.]
Again from Futility Closet:
"Even more surprisingly, if B, C, D, and E all follow A, then the chance of a bad verdict rises to 5%, five times worse than if they vote independently, even though A is nominally the best leader".
Variance is good!