Category: Zombies

An actual quote from a paper published in a medical journal: “The data, analytic methods, and study materials will not be made available to other researchers for purposes of reproducing the results or replicating the procedure.”

Someone writes: So the NYT yesterday has a story about this study I am directed to it and am immediately concerned about all the things that make this study somewhat dubious. Forking paths in the definition of the independent variable, sample selection in who wore the accelerometers, ignorance of the undoubtedly huge importance of interactions […]

The post An actual quote from a paper published in a medical journal: “The data, analytic methods, and study materials will not be made available to other researchers for purposes of reproducing the results or replicating the procedure.” appeared first on Statistical Modeling, Causal Inference, and Social Science.

“Fudged statistics on the Iraq War death toll are still circulating today”

Mike Spagat shares this story entitled, “Fudged statistics on the Iraq War death toll are still circulating today,” which discusses problems with a paper published in a scientific journal in 2006, and errors that a reporter inadvertently included in a recent news article. Spagat writes: The Lancet could argue that if [Washington Post reporter Philip] […]

The post “Fudged statistics on the Iraq War death toll are still circulating today” appeared first on Statistical Modeling, Causal Inference, and Social Science.

Statistical Modeling, Causal Inference, and Social Science Regrets Its Decision to Hire Cannibal P-hacker as Writer-at-Large

It is not easy to admit our mistakes, particularly now, given the current media climate and general culture of intolerance on college campuses. Still, we feel that we owe our readers an apology. We should not have hired Cannibal P-hacker, an elegant scientist and thinker who, we have come to believe, after serious consideration, does […]

The post Statistical Modeling, Causal Inference, and Social Science Regrets Its Decision to Hire Cannibal P-hacker as Writer-at-Large appeared first on Statistical Modeling, Causal Inference, and Social Science.

Don’t calculate post-hoc power using observed estimate of effect size

Aleksi Reito writes: The statement below was included in a recent issue of Annals of Surgery: But, as 80% power is difficult to achieve in surgical studies, we argue that the CONSORT and STROBE guidelines should be modified to include the disclosure of power—even if less than 80%—with the given sample size and effect size […]

The post Don’t calculate post-hoc power using observed estimate of effect size appeared first on Statistical Modeling, Causal Inference, and Social Science.

“Tweeking”: The big problem is not where you think it is.

In her recent article about pizzagate, Stephanie Lee included this hilarious email from Brian Wansink, the self-styled “world-renowned eating behavior expert for over 25 years”: OK, what grabs your attention is that last bit about “tweeking” the data to manipulate the p-value, where Wansink is proposing research misconduct (from NIH: “Falsification: Manipulating research materials, equipment, […]

The post “Tweeking”: The big problem is not where you think it is. appeared first on Statistical Modeling, Causal Inference, and Social Science.

Narcolepsy Could Be ‘Sleeper Effect’ in Trump and Brexit Campaigns

Kevin Lewis sent along this example of what in social science is called the “ecological fallacy”: UNDER EMBARGO UNTIL MARCH 8, 2018 AT 10 AM EST Media Contact: Public and Media Relations Manager Society for Personality and Social Psychology press@spsp.org Narcolepsy Could Be ‘Sleeper Effect’ in Trump and Brexit Campaigns Regions where voters have more […]

The post Narcolepsy Could Be ‘Sleeper Effect’ in Trump and Brexit Campaigns appeared first on Statistical Modeling, Causal Inference, and Social Science.

“It’s Always Sunny in Correlationville: Stories in Science,” or, Science should not be a game of Botticelli

There often seems to be an attitude among scientists and journal editors that, if a research team has gone to the trouble of ensuring rigor in some part of their study (whether in the design, the data collection, or the analysis, but typically rigor is associated with “p less than .05” and some random assignment […]

The post “It’s Always Sunny in Correlationville: Stories in Science,” or, Science should not be a game of Botticelli appeared first on Statistical Modeling, Causal Inference, and Social Science.

“We continuously increased the number of animals until statistical significance was reached to support our conclusions” . . . I think this is not so bad, actually!

For some reason, people have recently been asking me what I think of this journal article which I wrote about months ago . . . so I’ll just repeat my post here: Jordan Anaya pointed me to this post, in which Casper Albers shared this snippet from a recently-published paper from an article in Nature […]

The post “We continuously increased the number of animals until statistical significance was reached to support our conclusions” . . . I think this is not so bad, actually! appeared first on Statistical Modeling, Causal Inference, and Social Science.

Some clues that this study has big big problems

Paul Alper writes: This article from the New York Daily News, reproduced in the Minneapolis Star Tribune, is so terrible in so many ways. Very sad commentary regarding all aspects of statistics education and journalism. The news article, by Joe Dziemianowicz, is called “Study says drinking alcohol is key to living past 90,” with subheading, […]

The post Some clues that this study has big big problems appeared first on Statistical Modeling, Causal Inference, and Social Science.