Category: Miscellaneous Science

Raghuveer Parthasarathy’s big idea for fixing science

Raghuveer Parthasarathy writes: The U.S. National Science Foundation ran an interesting call for proposals recently called the “Idea Machine,” aiming to gather “Big Ideas” to shape the future of research. It was open not just to scientists, but to anyone interested in potentially identifying grand challenges and new directions. He continues: (i) There are non-obvious, […]

The post Raghuveer Parthasarathy’s big idea for fixing science appeared first on Statistical Modeling, Causal Inference, and Social Science.

What does it mean to talk about a “1 in 600 year drought”?

Patrick Atwater writes: Curious to your thoughts on a bit of a statistical and philosophical quandary. We often make statements like this drought was a 1 in 400 year event but what do we really mean when we say that? In California for example there was an oft repeated line that the recent historic drought was […]

The post What does it mean to talk about a “1 in 600 year drought”? appeared first on Statistical Modeling, Causal Inference, and Social Science.

Debate about genetics and school performance

Jag Bhalla points us to this article, “Differences in exam performance between pupils attending selective and non-selective schools mirror the genetic differences between them,” by Emily Smith-Woolley, Jean-Baptiste Pingault, Saskia Selzam, Kaili Rimfeld, Eva Krapohl, Sophie von Stumm, Kathryn Asbury, Philip Dale, Toby Young, Rebecca Allen, Yulia Kovas, and Robert Plomin, along with this response […]

The post Debate about genetics and school performance appeared first on Statistical Modeling, Causal Inference, and Social Science.

A study fails to replicate, but it continues to get referenced as if it had no problems. Communication channels are blocked.

In 2005, Michael Kosfeld, Markus Heinrichs, Paul Zak, Urs Fischbacher, and Ernst Fehr published a paper, “Oxytocin increases trust in humans.” According to Google, that paper has been cited 3389 times. In 2015, Gideon Nave, Colin Camerer, and Michael McCullough published a paper, “Does Oxytocin Increase Trust in Humans? A Critical Review of Research,” where […]

The post A study fails to replicate, but it continues to get referenced as if it had no problems. Communication channels are blocked. appeared first on Statistical Modeling, Causal Inference, and Social Science.

“The dwarf galaxy NGC1052-DF2”

Paul Pudaite points to this post by Stacy McGaugh entitled, “The dwarf galaxy NGC1052-DF2.” Pudaite writes that it’s an interesting comment on consequences of excluding one outlier. I can’t really follow what’s going on here but I thought I’d share it for the benefit of all the astronomers out there. P.S. Apparently it is common […]

The post “The dwarf galaxy NGC1052-DF2” appeared first on Statistical Modeling, Causal Inference, and Social Science.

An actual quote from a paper published in a medical journal: “The data, analytic methods, and study materials will not be made available to other researchers for purposes of reproducing the results or replicating the procedure.”

Someone writes: So the NYT yesterday has a story about this study I am directed to it and am immediately concerned about all the things that make this study somewhat dubious. Forking paths in the definition of the independent variable, sample selection in who wore the accelerometers, ignorance of the undoubtedly huge importance of interactions […]

The post An actual quote from a paper published in a medical journal: “The data, analytic methods, and study materials will not be made available to other researchers for purposes of reproducing the results or replicating the procedure.” appeared first on Statistical Modeling, Causal Inference, and Social Science.

“Six Signs of Scientism”: where I disagree with Haack

I came across this article, “Six Signs of Scientism,” by philosopher Susan Haack from 2009. I think I’m in general agreement with Haack’s views—science has made amazing progress over the centuries but “like all human enterprises, science is ineradicably is fallible and imperfect. At best its progress is ragged, uneven, and unpredictable; moreover, much scientific […]

The post “Six Signs of Scientism”: where I disagree with Haack appeared first on Statistical Modeling, Causal Inference, and Social Science.

Cool postdoc position in Arizona on forestry forecasting using tree ring models!

Margaret Evans sends in this cool job ad: Two-Year Post Doctoral Fellowship in Forest Ecological Forecasting, Data Assimilation A post-doctoral fellowship is available in the Laboratory of Tree-Ring Research (University of Arizona) to work on an NSF Macrosystems Biology-funded project assimilating together tree-ring and forest inventory data to analyze patterns and drivers of forest productivity […]

The post Cool postdoc position in Arizona on forestry forecasting using tree ring models! appeared first on Statistical Modeling, Causal Inference, and Social Science.

A psychology researcher uses Stan, multiverse, and open data exploration to explore human memory

Under the heading, “An example of Stan to the rescue, multiverse analysis, and psychologists trying to do well,” Greg Cox writes: I’m currently a postdoc at Syracuse University studying how human memory works. I wanted to forward a paper of ours [“Information and Processes Underlying Semantic and Episodic Memory Across Tasks, Items, and Individuals,” by […]

The post A psychology researcher uses Stan, multiverse, and open data exploration to explore human memory appeared first on Statistical Modeling, Causal Inference, and Social Science.

Post-publication peer review: who’s qualified?

Gabriel Power writes: I don’t recall that you addressed this point in your posts on post-publication peer review [for example, here and here — ed.]. Who would be allowed to post reviews of a paper? Anyone? Only researchers? Only experts? Science is not a democracy. A study is not valid because a majority of people […]

The post Post-publication peer review: who’s qualified? appeared first on Statistical Modeling, Causal Inference, and Social Science.

What to do when your measured outcome doesn’t quite line up with what you’re interested in?

Matthew Poes writes: I’m writing a research memo discussing the importance of precisely aligning the outcome measures to the intervention activities. I’m making the point that an evaluation of the outcomes for a given intervention may net null results for many reasons, one of which could simply be that you are looking in the wrong […]

The post What to do when your measured outcome doesn’t quite line up with what you’re interested in? appeared first on Statistical Modeling, Causal Inference, and Social Science.

Researchers.one: A souped-up Arxiv with pre- and post-publication review

Harry Crane and Ryan Martin write: I’m writing to call your attention to a new peer review and publication platform, called RESEARCHERS.ONE, that I have recently launched with Ryan Martin. The platform can be found at https://www.researchers.one. Given past discussions I’ve seen on your website, I think this new platform might interest you and your […]

The post Researchers.one: A souped-up Arxiv with pre- and post-publication review appeared first on Statistical Modeling, Causal Inference, and Social Science.

“It’s Always Sunny in Correlationville: Stories in Science,” or, Science should not be a game of Botticelli

There often seems to be an attitude among scientists and journal editors that, if a research team has gone to the trouble of ensuring rigor in some part of their study (whether in the design, the data collection, or the analysis, but typically rigor is associated with “p less than .05” and some random assignment […]

The post “It’s Always Sunny in Correlationville: Stories in Science,” or, Science should not be a game of Botticelli appeared first on Statistical Modeling, Causal Inference, and Social Science.

Hey—take this psychological science replication quiz!

Rob Wilbin writes: I made this quiz where people try to guess ahead of time which results will replicate and which won’t in order to give then a more nuanced understanding of replication issues in psych. Based on this week’s Nature replication paper. It includes quotes and p-values from the original study if people want […]

The post Hey—take this psychological science replication quiz! appeared first on Statistical Modeling, Causal Inference, and Social Science.

“Identification of and correction for publication bias,” and another discussion of how forking paths is not the same thing as file drawer

Max Kasy and Isaiah Andrews sent along this paper, which begins: Some empirical results are more likely to be published than others. Such selective publication leads to biased estimates and distorted inference. This paper proposes two approaches for identifying the conditional probability of publication as a function of a study’s results, the first based on […]

The post “Identification of and correction for publication bias,” and another discussion of how forking paths is not the same thing as file drawer appeared first on Statistical Modeling, Causal Inference, and Social Science.

Problems in a published article on food security in the Lower Mekong Basin

John Williams points us to this article, “Designing river flows to improve food security futures in the Lower Mekong Basin,” by John Sabo et al., featured in the journal Science. Williams writes: The article exhibits multiple forking paths, a lack of theory, and abundant jargon. It is also very carelessly written and reviewed. For example, […]

The post Problems in a published article on food security in the Lower Mekong Basin appeared first on Statistical Modeling, Causal Inference, and Social Science.

Problems in a published article on food security in the Lower Mekong Basin

John Williams points us to this article, “Designing river flows to improve food security futures in the Lower Mekong Basin,” by John Sabo et al., featured in the journal Science. Williams writes: The article exhibits multiple forking paths, a lack of theory, and abundant jargon. It is also very carelessly written and reviewed. For example, […]

The post Problems in a published article on food security in the Lower Mekong Basin appeared first on Statistical Modeling, Causal Inference, and Social Science.

The competing narratives of scientific revolution

Back when we were reading Karl Popper’s Logic of Scientific Discovery and Thomas Kuhn’s Structure of Scientific Revolutions, who would’ve thought that we’d be living through a scientific revolution ourselves? Scientific revolutions occur on all scales, but here let’s talk about some of the biggies: 1850-1950: Darwinian revolution in biology, changed how we think about […]

The post The competing narratives of scientific revolution appeared first on Statistical Modeling, Causal Inference, and Social Science.