The Case of the Fancy Watch
null hypothesis (H0) = The suspect is innocent.
The prosecutor will present evidence against the null hypothesis (i.e. trying to show that the suspect is guilty). The jury will decide if the evidence against the suspect is significant.
Let's say a robbery has taken place at a fancy store…a jewel-encrusted Piaget watch has been stolen! Soon after, a suspect is arrested and brought to court. The evidence against him is simple; when the police found him he was WEARING a jewel-encrusted Piaget watch! The jury must consider this question…What is the chance that this person is innocent (the null hypothesis is true) given that he was wearing a jewel-encrusted Piaget watch?
|image source: piaget.com
But what if, in this particular town, 75% of people were walking around wearing jewel-encrusted Piaget watches. Now the case against the suspect isn't very strong. The fact that he was found wearing a jewel-encrusted Piaget watch is nonsignificant. Saying it another way…there is a 75% chance that the suspect is innocent and wearing a Jewel-encrusted Piaget watch just by coincidence! The jury would most likely NOT reject the null hypothesis and find the suspect not guilty.
Put yourself on that jury…at what point would you be comfortable rejecting the null hypothesis and convicting the suspect? What if 10% of people in the town wore jewel-encrusted Piaget watches? What about 1%? At what point would the evidence (the suspect was wearing a watch) become significant?
In a scientific study, the cut off for significance is 5% (in our courtroom, the jury would reject the null hypothesis and convict the suspect if the chance that he is innocent and wearing a fancy watch is 0.05 or lower.)
In part 2 of this post I'll provide some examples I like for introducing the chi-square calculations. Thanks for reading!