statistical significance

Terms from Statistics for HCI: Making Sense of Quantitative Data

In some contexts this just means the significance level or p-value, but it can also mean the broader idea or quality of something that uses the process of significance testing, for example "a test of statistical significance".

Context:

In summary, all a test of statistical significance means is that if the null hypothesis (often no difference) is true, then the probability of seeing the measured results is low (e.g., < 5%, or < 1%). This is then used as evidence against the null hypothesis. It is good to remind ourselves of this occasionally, but for most purposes an informal understanding is that statistical significance is evidence for the alternative hypothesis (often what you are trying to show), but may be wrong—and the smaller the % or probability, the more reliable the result. However, all that non-significance tells you is that you have neither proved nor disproved your hypothesis.

Also used in hcistats2e: Chap. 6: pages 68, 69, 70, 72, 73; Chap. 8: pages 88, 93, 94, 95, 100; Chap. 9: pages 105, 108; Chap. 13: page 158; Chap. 14: pages 166, 182; Chap. 15: page 188

Also known as: statistically significant