If you were on a committee to highlight issues surrounding P-values and replication, what’s the first definition you would check? Yes, exactly. Apparently, when it came to the recently released National Academies of Science “Consensus Study” Reproducibility and Replicability in Science 2019, no one did. This Consensus Study was prompted by concerns about the reproducibility […]
Author: Mayo
Hardwicke and Ioannidis, Gelman, and Mayo: P-values: Petitions, Practice, and Perils (and a question for readers)
The October 2019 issue of the European Journal of Clinical Investigations came out today. It includes the PERSPECTIVE article by Tom Hardwicke and John Ioannidis, an invited editorial by Gelman and one by me: Petitions in scientific argumentation: Dissecting the request to retire statistical significance, by Tom Hardwicke and John Ioannidis When we make recommendations […]
(Excerpts from) ‘P-Value Thresholds: Forfeit at Your Peril’ (free access)
A key recognition among those who write on the statistical crisis in science is that the pressure to publish attention-getting articles can incentivize researchers to produce eye-catching but inadequately scrutinized claims. We may see much the same sensationalism in broadcasting metastatistical research, especially if it takes the form of scapegoating or banning statistical significance. A […]
Gelman blogged our exchange on abandoning statistical significance
I came across this post on Gelman’s blog today: Exchange with Deborah Mayo on abandoning statistical significance It was straight out of blog comments and email correspondence back when the ASA, and significant others, were rising up against the concept of statistical significance. Here it is: Exchange with Deborah Mayo on abandoning statistical significance Posted […]
All She Wrote (so far): Error Statistics Philosophy: 8 years on
Error Statistics Philosophy: Blog Contents (8 years) By: D. G. Mayo Dear Reader: I began this blog 8 years ago (Sept. 3, 2011)! A double celebration is taking place at the Elbar Room Friday evening (a smaller one was held earlier in the week), both for the blog and the 1 year anniversary of the […]
(one year ago) RSS 2018 – Significance Tests: Rethinking the Controversy
Here’s what I posted 1 year ago on Aug 30, 2018. Day 2, Wednesday 05/09/2018 11:20 – 13:20 Keynote 4 – Significance Tests: Rethinking the Controversy Assembly Room Speakers: Sir David Cox, Nuffield College, Oxford Deborah Mayo, Virginia Tech Richard Morey, Cardiff University Aris Spanos, Virginia Tech Intermingled in today’s statistical controversies are some […]
Palavering about Palavering about P-values
Nathan Schachtman (who was a special invited speaker at our recent Summer Seminar in Phil Stat) put up a post on his law blog the other day (“Palavering About P-values”) on an article by a statistics professor at Stanford, Helena Kraemer. “Palavering” is an interesting word choice of Schachtman’s. Its range of meanings is relevant […]
A. Spanos: Egon Pearson’s Neglected Contributions to Statistics
Continuing with posts on E.S. Pearson in marking his birthday: Egon Pearson’s Neglected Contributions to Statistics by Aris Spanos Egon Pearson (11 August 1895 – 12 June 1980), is widely known today for his contribution in recasting of Fisher’s significance testing into the Neyman-Pearson (1933) theory of hypothesis testing. Occasionally, he is also credited with […]
Statistical Concepts in Their Relation to Reality–E.S. Pearson
In marking Egon Pearson’s birthday (Aug. 11), I’ll post some Pearson items this week. They will contain some new reflections on older Pearson posts on this blog. Today, I’m posting “Statistical Concepts in Their Relation to Reality” (Pearson 1955). I’ve linked to it several times over the years, but always find a new gem or […]
Performance or Probativeness? E.S. Pearson’s Statistical Philosophy: Belated Birthday Wish
This is a belated birthday post for E.S. Pearson (11 August 1895-12 June, 1980). It’s basically a post from 2012 which concerns an issue of interpretation (long-run performance vs probativeness) that’s badly confused these days. I’ll post some Pearson items this week to mark his birthday. HAPPY BELATED BIRTHDAY EGON! Are methods based on error probabilities […]
S. Senn: Red herrings and the art of cause fishing: Lord’s Paradox revisited (Guest post)
Stephen Senn Consultant Statistician Edinburgh Background Previous posts[a],[b],[c] of mine have considered Lord’s Paradox. To recap, this was considered in the form described by Wainer and Brown[1], in turn based on Lord’s original formulation: A large university is interested in investigating the effects on the students of the diet provided in the university dining halls […]
Summer Seminar in PhilStat Participants and Special Invited Speakers
Participants in the 2019 Summer Seminar in Philosophy of Statistics Renée Bolinger, Asst. Professor Dept of Politics and the Center for Human Values, Princeton University (webpage) Lok Chan, Post Doc Social Science Research Institute, Duke University (webpage) Marcello Di Bello, Asst. Professor Dept of Philosophy, Lehman College CUNY (webpage) […]
The NEJM Issues New Guidelines on Statistical Reporting: Is the ASA P-Value Project Backfiring?
The New England Journal of Medicine NEJM announced new guidelines for authors for statistical reporting yesterday. The ASA describes the change as “in response to the ASA Statement on P-values and Statistical Significance and subsequent The American Statistician special issue on statistical inference” (ASA I and II, in my abbreviation) If so, it seems to have backfired. I don’t […]
B. Haig: The ASA’s 2019 update on P-values and significance (ASA II)(Guest Post)
Brian Haig, Professor Emeritus Department of Psychology University of Canterbury Christchurch, New Zealand The American Statistical Association’s (ASA) recent effort to advise the statistical and scientific communities on how they should think about statistics in research is ambitious in scope. It is concerned with an initial attempt to depict what empirical research might look like in “a […]
SIST: All Excerpts and Mementos: May 2018-July 2019 (updated)
Introduction & Overview The Meaning of My Title: Statistical Inference as Severe Testing: How to Get Beyond the Statistics Wars* 05/19/18 Blurbs of 16 Tours: Statistical Inference as Severe Testing: How to Get Beyond the Statistics Wars (SIST) 03/05/19 Excursion 1 EXCERPTS Tour I Ex1 TI (full proofs) Excursion 1 Tour I: Beyond Probabilism and Performance: […]
The Statistics Wars: Errors and Casualties
Had I been scheduled to speak later at the 12th MuST Conference & 3rd Workshop “Perspectives on Scientific Error” in Munich, rather than on day 1, I could have (constructively) illustrated some of the errors and casualties by reference to a few of the conference papers that discussed significance tests. (Most gave illuminating discussions of […]
“The 2019 ASA Guide to P-values and Statistical Significance: Don’t Say What You Don’t Mean” (Some Recommendations)
Some have asked me why I haven’t blogged on the recent follow-up to the ASA Statement on P-Values and Statistical Significance (Wasserstein and Lazar 2016)–hereafter, ASA I. They’re referring to the editorial by Wasserstein, R., Schirm, A. and Lazar, N. (2019) –hereafter, ASA II–opening a special on-line issue of over 40 contributions responding to the […]
(Full) Excerpt. Excursion 5 Tour II: How Not to Corrupt Power (Power Taboos, Retro Power, and Shpower)
The concept of a test’s power is still being corrupted in the myriad ways discussed in 5.5, 5.6. I’m excerpting all of Tour II of Excursion 5, as I did with Tour I (of Statistical Inference as Severe Testing:How to Get Beyond the Statistics Wars 2018, CUP)*. Originally the two Tours comprised just one, but […]
Don’t let the tail wag the dog by being overly influenced by flawed statistical inferences
An article [i],“There is Still a Place for Significance Testing in Clinical Trials,” appearing recently in Clinical Trials, while very short, effectively responds to recent efforts to stop error statistical testing [ii]. We need more of this. Much more. The emphasis in this excerpt is mine: Much hand-wringing has been stimulated by the reflection that reports […]
SIST: All Excerpts and Mementos: May 2018-May 2019
Introduction & Overview The Meaning of My Title: Statistical Inference as Severe Testing: How to Get Beyond the Statistics Wars* 05/19/18 Blurbs of 16 Tours: Statistical Inference as Severe Testing: How to Get Beyond the Statistics Wars (SIST) 03/05/19 Excursion 1 EXCERPTS Tour I Excursion 1 Tour I: Beyond Probabilism and Performance: Severity Requirement (1.1) […]