Category: Miscellaneous Science

A psychology researcher uses Stan, multiverse, and open data exploration to explore human memory

Under the heading, “An example of Stan to the rescue, multiverse analysis, and psychologists trying to do well,” Greg Cox writes: I’m currently a postdoc at Syracuse University studying how human memory works. I wanted to forward a paper of ours [“Information and Processes Underlying Semantic and Episodic Memory Across Tasks, Items, and Individuals,” by […]

The post A psychology researcher uses Stan, multiverse, and open data exploration to explore human memory appeared first on Statistical Modeling, Causal Inference, and Social Science.

Post-publication peer review: who’s qualified?

Gabriel Power writes: I don’t recall that you addressed this point in your posts on post-publication peer review [for example, here and here — ed.]. Who would be allowed to post reviews of a paper? Anyone? Only researchers? Only experts? Science is not a democracy. A study is not valid because a majority of people […]

The post Post-publication peer review: who’s qualified? appeared first on Statistical Modeling, Causal Inference, and Social Science.

What to do when your measured outcome doesn’t quite line up with what you’re interested in?

Matthew Poes writes: I’m writing a research memo discussing the importance of precisely aligning the outcome measures to the intervention activities. I’m making the point that an evaluation of the outcomes for a given intervention may net null results for many reasons, one of which could simply be that you are looking in the wrong […]

The post What to do when your measured outcome doesn’t quite line up with what you’re interested in? appeared first on Statistical Modeling, Causal Inference, and Social Science.

Researchers.one: A souped-up Arxiv with pre- and post-publication review

Harry Crane and Ryan Martin write: I’m writing to call your attention to a new peer review and publication platform, called RESEARCHERS.ONE, that I have recently launched with Ryan Martin. The platform can be found at https://www.researchers.one. Given past discussions I’ve seen on your website, I think this new platform might interest you and your […]

The post Researchers.one: A souped-up Arxiv with pre- and post-publication review appeared first on Statistical Modeling, Causal Inference, and Social Science.

“It’s Always Sunny in Correlationville: Stories in Science,” or, Science should not be a game of Botticelli

There often seems to be an attitude among scientists and journal editors that, if a research team has gone to the trouble of ensuring rigor in some part of their study (whether in the design, the data collection, or the analysis, but typically rigor is associated with “p less than .05” and some random assignment […]

The post “It’s Always Sunny in Correlationville: Stories in Science,” or, Science should not be a game of Botticelli appeared first on Statistical Modeling, Causal Inference, and Social Science.

Hey—take this psychological science replication quiz!

Rob Wilbin writes: I made this quiz where people try to guess ahead of time which results will replicate and which won’t in order to give then a more nuanced understanding of replication issues in psych. Based on this week’s Nature replication paper. It includes quotes and p-values from the original study if people want […]

The post Hey—take this psychological science replication quiz! appeared first on Statistical Modeling, Causal Inference, and Social Science.

“Identification of and correction for publication bias,” and another discussion of how forking paths is not the same thing as file drawer

Max Kasy and Isaiah Andrews sent along this paper, which begins: Some empirical results are more likely to be published than others. Such selective publication leads to biased estimates and distorted inference. This paper proposes two approaches for identifying the conditional probability of publication as a function of a study’s results, the first based on […]

The post “Identification of and correction for publication bias,” and another discussion of how forking paths is not the same thing as file drawer appeared first on Statistical Modeling, Causal Inference, and Social Science.

Problems in a published article on food security in the Lower Mekong Basin

John Williams points us to this article, “Designing river flows to improve food security futures in the Lower Mekong Basin,” by John Sabo et al., featured in the journal Science. Williams writes: The article exhibits multiple forking paths, a lack of theory, and abundant jargon. It is also very carelessly written and reviewed. For example, […]

The post Problems in a published article on food security in the Lower Mekong Basin appeared first on Statistical Modeling, Causal Inference, and Social Science.

Problems in a published article on food security in the Lower Mekong Basin

John Williams points us to this article, “Designing river flows to improve food security futures in the Lower Mekong Basin,” by John Sabo et al., featured in the journal Science. Williams writes: The article exhibits multiple forking paths, a lack of theory, and abundant jargon. It is also very carelessly written and reviewed. For example, […]

The post Problems in a published article on food security in the Lower Mekong Basin appeared first on Statistical Modeling, Causal Inference, and Social Science.

The competing narratives of scientific revolution

Back when we were reading Karl Popper’s Logic of Scientific Discovery and Thomas Kuhn’s Structure of Scientific Revolutions, who would’ve thought that we’d be living through a scientific revolution ourselves? Scientific revolutions occur on all scales, but here let’s talk about some of the biggies: 1850-1950: Darwinian revolution in biology, changed how we think about […]

The post The competing narratives of scientific revolution appeared first on Statistical Modeling, Causal Inference, and Social Science.

The competing narratives of scientific revolution

Back when we were reading Karl Popper’s Logic of Scientific Discovery and Thomas Kuhn’s Structure of Scientific Revolutions, who would’ve thought that we’d be living through a scientific revolution ourselves? Scientific revolutions occur on all scales, but here let’s talk about some of the biggies: 1850-1950: Darwinian revolution in biology, changed how we think about […]

The post The competing narratives of scientific revolution appeared first on Statistical Modeling, Causal Inference, and Social Science.

Let’s get hysterical

Following up on our discussion of hysteresis in the scientific community, Nick Brown points us to this article this article from 2014, “Excellence by Nonsense: The Competition for Publications in Modern Science,” by Mathias Binswanger, who writes: To ensure the efficient use of scarce funds, the government forces universities and professors, together with their academic […]

The post Let’s get hysterical appeared first on Statistical Modeling, Causal Inference, and Social Science.

Let’s get hysterical

Following up on our discussion of hysteresis in the scientific community, Nick Brown points us to this article from 2014, “Excellence by Nonsense: The Competition for Publications in Modern Science,” by Mathias Binswanger, who writes: To ensure the efficient use of scarce funds, the government forces universities and professors, together with their academic staff, to […]

The post Let’s get hysterical appeared first on Statistical Modeling, Causal Inference, and Social Science.

How feminism has made me a better scientist

Feminism is not a branch of science. It is not a set of testable propositions about the observable world, nor is it any single research method. From my own perspective, feminism is a political movement associated with successes such as votes for women, setbacks such as the failed Equal Rights Amendment, and continuing struggles in […]

The post How feminism has made me a better scientist appeared first on Statistical Modeling, Causal Inference, and Social Science.

How feminism has made me a better scientist

Feminism is not a branch of science. It is not a set of testable propositions about the observable world, nor is it any single research method. From my own perspective, feminism is a political movement associated with successes such as votes for women, setbacks such as the failed Equal Rights Amendment, and continuing struggles in […]

The post How feminism has made me a better scientist appeared first on Statistical Modeling, Causal Inference, and Social Science.

Some thoughts after reading “Bad Blood: Secrets and Lies in a Silicon Valley Startup”

I just read the above-titled John Carreyrou book, and it’s as excellent as everyone says it is. I suppose it’s the mark of any compelling story that it will bring to mind other things you’ve been thinking about, and in this case I saw many connections between the story of Theranos—a company that raised billions […]

The post Some thoughts after reading “Bad Blood: Secrets and Lies in a Silicon Valley Startup” appeared first on Statistical Modeling, Causal Inference, and Social Science.

Some thoughts after reading “Bad Blood: Secrets and Lies in a Silicon Valley Startup”

I just read the above-titled John Carreyrou book, and it’s as excellent as everyone says it is. I suppose it’s the mark of any compelling story that it will bring to mind other things you’ve been thinking about, and in this case I saw many connections between the story of Theranos—a company that raised billions […]

The post Some thoughts after reading “Bad Blood: Secrets and Lies in a Silicon Valley Startup” appeared first on Statistical Modeling, Causal Inference, and Social Science.

Let’s be open about the evidence for the benefits of open science

A reader who wishes to remain anonymous writes: I would be curious to hear your thoughts on is motivated reasoning among open science advocates. In particular, I’ve noticed that papers arguing for open practices have seriously bad/nonexistent causal identification strategies. Examples: Kidwell et al. 2017, Badges to Acknowledge Open Practices: A Simple, Low-Cost, Effective Method […]

The post Let’s be open about the evidence for the benefits of open science appeared first on Statistical Modeling, Causal Inference, and Social Science.