HackerTube.dev

Dance p 3 Mar09

Geoff Cumming · 82.8K views · 2009-03-03 · 9:36

Open on YouTube ↗

If playback is restricted in your region, try opening the original video. Use Mark watched to add it to your marked videos.

Overview

Geoff Cumming uses a simulation to show how wildly the p value varies from one replication to the next because of sampling variability. He argues for estimation and confidence intervals over null hypothesis significance testing.

On Hacker News

Recommended as a vivid visual demonstration of how unreliable p-values are.

Recommended by 2 HN people across 2 months · HN mentions 2011–2015

Topics

Search by tags

What people said

po · 2015-02 · Strong recommendation

The audio is a bit quiet but the 'dance of the p values' video [1] linked to by the article is absolutely fantastic and well worth watching. [1] [VIDEO]

Read the original HN comment ↗
knowledgesale · 2011-12 · Strong recommendation

The p-value [1] criterion is often used to test a proposed hypothesis in medical and social science research papers. When you stumble upon something along the lines of "studies that shown that eating broccoli makes people happy" in your everyday life, it comes down to the p-value calculation being small enough <0.05 for the before and after gathered datasets. The p-value method is practically a standard for scientific reporting in some fields. It also has some drastic shortcomings, including, e,g., dramatic instability for tests with only little data [2]. Naturally, people realize that and try to use additional tools and criteria when available. However, scientists are pretty brutally incentivized to publish positive results and, as a result, more often than it should be, too much weight is put on the single p-value criterion. With issues like this in mind, in my opinion, it makes sense to be somewhat skeptical when seeing reports in the news that "A effects B" and definitely not to rush with the conclusions. Trivial, I know. The [3] video pretty much sums it up and by all means is worth a watch. ------------------- [1] [LINK] [2] [LINK] [3] [VIDEO]

Read the original HN comment ↗
lomnakkus · 2014-03 · Reference

I can't claim to understand much of the statistics, but according to [1], p-values are pretty sketchy as a measure of "is this likely to be true?" [1] [VIDEO]

Read the original HN comment ↗

Sources

Video by Geoff Cumming, played through YouTube.

Data and selection notes

HN summaries and labels may contain AI errors. HN dates refer to discussions, not video publication.

HN Library: HackerTube export (2026-10-31) and open-index/hacker-news. Upstream summaries and classifications may contain AI errors.

Views, duration and playback status refresh separately from the published catalog. When an update fails, existing data remains visible.

Selection checks
  • SaaS & AI candidates: Topic keywords do not match
  • Editor-approved picks: Editorial review is required

Rule matches identify candidates. They do not guarantee video quality or financial results.

About the library and its sources