My final post on this Tony Blair thing

June 1, 2015
By
My final post on this Tony Blair thing

Gur Huberman writes on the recent fraud in experiments in polisci: This comment is a reaction to the little of the discussion which I [Gur] followed, mostly in the NYTimes. What I didn’t see anybody say is that the system actually worked. First, there’s a peer-reviewed report in Science. Then other people deem the results […] The post My final post on this Tony Blair thing appeared first on Statistical…

Read more »

How to tell if your graphic is underpowered?

June 1, 2015
By
How to tell if your graphic is underpowered?

Some time ago, this chart showed up in a NYT Magazine (it's about sex): In this composition, the visual element (the circles) has no utility. A self-sufficiency test makes this point clear. All the data (four numbers) are printed on...

Read more »

All the things that don’t make it into the news

June 1, 2015
By
All the things that don’t make it into the news

I got buzzed last week by a couple of NY journalists about this recent political science fraud case. My responses were pretty undramatic so I don’t think they made their way into the news stories. Which is fine. As a reader of the news, I like to see excitement so it’s fair enough that reporters […] The post All the things that don’t make it into the news appeared first…

Read more »

On deck this week

June 1, 2015
By

Mon: All the things that don’t make it into the news Tues: Cross-validation != magic Wed: Of buggy whips and moral hazards; or, Sympathy for the Aapor Thurs: Low-power pose Fri: Should you get the blood transfusion? Sat: “History is the prediction of the present” Sun: What to do to train to apply statistical models […] The post On deck this week appeared first on Statistical Modeling, Causal Inference, and…

Read more »

Interview with Chris Wiggins, chief data scientist at the New York Times

June 1, 2015
By

Editor's note: We are trying something a little new here and doing an interview with Google Hangouts on Air. The interview will be live at 11:30am EST. I have some questions lined up for Chris, but if you have others you'd like to ask, you can tweet them @simplystats and I'll see if I can

Read more »

My talk @ the London Machine Learning Meetup

June 1, 2015
By
My talk @ the London Machine Learning Meetup

This Wednesday I've been invited to give a talk at the London Machine Learning Meetup $-$ I don't have a lot of experience of these meetings but I'm told that the audience is typically industry practitioners and some academics, ranging from novice...

Read more »

SAS/IML functions that operate on columns of a matrix

June 1, 2015
By
SAS/IML functions that operate on columns of a matrix

A SAS programmer asked for a list of SAS/IML functions that operate on the columns of an n x p matrix and return a 1 x p row vector of results. The functions that behave this way tend to compute univariate descriptive statistics such as the mean, median, standard deviation, and quantiles. The following […] The post SAS/IML functions that operate on columns of a matrix appeared first on The DO Loop.

Read more »

Connecting Python to Postgres . . . An Arduous Task

May 31, 2015
By

I've decided that I want to learn a bit more about Python.  So, I downloaded Python onto my Mac running OS 10.8.x and decided to connect it to my local Postgres database.  Several days later, I have succeeded! Along the way, I may have learne...

Read more »

The greatest impediment to research progress is not impediments to research progress, it is scientists reading about impediments to research progress

May 31, 2015
By

My short answer is that I think twitter is destructive of clear communication. Now I’ll give the question, and I’ll give my long answer. Here’s the question provided by a reader: Just wondering what you thought of Brian Nosek’s recent comment on twitter, “The biggest impediment to research progress is not fraud, it is all […] The post The greatest impediment to research progress is not impediments to research progress,…

Read more »

500

May 31, 2015
By
500

 Blogstats celebrates a jubilee This blog posts since May 2006. In the nine years, we published 500 posts and got 206 000 views. Every week a blogstats post !   Filed under: 071 Hint, 08 Events

Read more »

Paper Helicopter Experiment, part III

May 31, 2015
By
Paper Helicopter Experiment, part III

As final part of my paper helicopter experiment analysis (part I, part II) I do a reanalysis for one more data set. In 2002 Erik Erhardt and Hantao Mai did an extensive experiment, see The Search for the Optimal Paper Helicopter. They did a number of s...

Read more »

A new R package for detecting unusual time series

May 31, 2015
By
A new R package for detecting unusual time series

The anomalous package provides some tools to detect unusual time series in a large collection of time series. This is joint work with Earo Wang (an honours student at Monash) and Nikolay Laptev (from Yahoo Labs). Yahoo is interested in detecting unusual patterns in server metrics. The package is based on this paper with Earo […]

Read more »

Lessons learned in high-performance R

Lessons learned in high-performance R

On this blog, I've had a long running investigation/demonstration of how to make a "embarrassingly-parallel" but computationally intractable (on commodity hardware, at least) R problem more performant by using parallel computation and Rcpp. The example problem is to find the… Continue reading →

Read more »

Cracking Safe Cracker with R

May 30, 2015
By
Cracking Safe Cracker with R

My wife got me a Safe Cracker 40 puzzle a while back. I believe I misplaced the solution some time back. The company, Creative Crafthouse, stands behind their products. They had amazing customer service and promptly supplied me with a … Continue reading →

Read more »

Cracking Safe Cracker with R

May 30, 2015
By
Cracking Safe Cracker with R

My wife got me a Safe Cracker 40 puzzle a while back. I believe I misplaced the solution some time back. The company, Creative Crafthouse, stands behind their products. They had amazing customer service and promptly supplied me with a … Continue reading →

Read more »

Top of the Heap: How Much Can We Learn from Partial Rankings?

May 30, 2015
By
Top of the Heap: How Much Can We Learn from Partial Rankings?

The recommendation system gives you a long list of alternatives, but the consumer clicks on only a handful: most appealing first, then the second best, and so on until they stop with all the remaining receiving the same rating as not interesting enough...

Read more »

“With that assurance, a scientist can report his or her work to the public, and the public can trust the work.”

May 30, 2015
By

Dan Wright writes: Given your healthy skepticism of findings/conclusions from post-peer-reviewed papers, I thought I would forward the following from Institute of Educational Sciences. Here is a sample quote: Simply put, peer review is a method by which scientists who are experts in a particular field examine another scientist’s work to verify that it makes […] The post “With that assurance, a scientist can report his or her work to…

Read more »

Three Reasons to Prefer GDPplus to Simple GDP Averages

May 29, 2015
By

Let's start with some notation. GDPe is expenditure-side GDP from BEA. GDPi is income-side GDP from BEA. GDPavg is the average of GDPe and GDPi recently introduced by BEA. GDPplus is the Kalman-smoother extraction of GDP from GDPe and GDPi, produced an...

Read more »

OK, I’ll Continue With Google Blogger

May 29, 2015
By

First, apologies for the posts about my Google Blogger situation. I fear that they border on spam, but at the same time I need to communicate the situation.Anyway, wow, what a flow of communications regarding the last post, from more routes and with mo...

Read more »

John Bohannon’s chocolate-and-weight-loss hoax study actually understates the problems with standard p-value scientific practice

May 29, 2015
By
John Bohannon’s chocolate-and-weight-loss hoax study actually understates the problems with standard p-value scientific practice

Several people pointed me to this awesome story by John Bohannon: “Slim by Chocolate!” the headlines blared. A team of German researchers had found that people on a low-carb diet lost weight 10 percent faster if they ate a chocolate bar every day. It made the front page of Bild, Europe’s largest daily newspaper, just […] The post John Bohannon’s chocolate-and-weight-loss hoax study actually understates the problems with standard p-value…

Read more »

Data Journalism avant la lettre

May 29, 2015
By
Data Journalism avant la lettre

From Data to Insight Where there are data, there is insight. However, insight needs know how – know how about …Continue reading →

Read more »

Cutting Ties With Google Blogger

May 28, 2015
By

The nonsense reported in my May 23 post actually goes well beyond what I reported, to the point where I've lost patience.  (I'm sure I'll eventually blog further on it.)  So henceforth I plan to disintermediate Google, instead hosting the No ...

Read more »

The Replication Network

May 28, 2015
By
The Replication Network

Some of my previous posts have dealt with the issue of replicability - e.g., here and here.I had an email from Bob Reed today, alerting me to his involvement in the launching of The Replication Network. I knew that this was a b...

Read more »


Subscribe

Email:

  Subscribe