What happened when I was forced to wait 30 minutes for the subway

July 18, 2016
By

What happened when I was forced to wait 30 minutes for the subway: pondering how easy it is for data analysts to get fooled by bad data

Read more »

Color markers in a scatter plot by a third variable in SAS

July 18, 2016
By
Color markers in a scatter plot by a third variable in SAS

One of my favorite new features in PROC SGPLOT in SAS 9.4m2 is addition of the COLORRESPONSE= and COLORMODEL= options to the SCATTER statement. By using these options, it is easy to color markers in a scatter plot so that the colors indicate the values of a continuous third variable. […] The post Color markers in a scatter plot by a third variable in SAS appeared first on The DO…

Read more »

Teachers and resource providers – uneasy bedfellows

July 18, 2016
By
Teachers and resource providers – uneasy bedfellows

Trade stands and cautious teachers It is interesting to provide a trade stand at a teachers’ conference. Some teachers are keen to find out about new things, and come to see how we can help them. Others studiously avoid eye-contact … Continue reading →

Read more »

Not So Standard Deviations Episode 18 – Divide by n-1, or n-2, or Whatever

July 18, 2016
By

Hilary and I talk about statistical software in fMRI analyses, the differences between software testing differences in proportions (a must listen!), and a preview of JSM 2016. Also, Hilary and I have just published a new book, Conversations on Data Sc...

Read more »

“Pointwise mutual information as test statistics”

July 17, 2016
By

Christian Bartels writes: Most of us will probably agree that making good decisions under uncertainty based on limited data is highly important but remains challenging. We have decision theory that provides a framework to reduce risks of decisions under uncertainty with typical frequentist test statistics being examples for controlling errors in absence of prior knowledge. […] The post “Pointwise mutual information as test statistics” appeared first on Statistical Modeling, Causal…

Read more »

Mittag-Leffler function and probability distribution

July 17, 2016
By
Mittag-Leffler function and probability distribution

The Mittag-Leffler function is a generalization of the exponential function. Since k!= Γ(k + 1), we can write the exponential function’s power series as and we can generalize this to the Mittag=Leffler function which reduces to the exponential function when α = β = 1. There are a few other values of α and β for […]

Read more »

You can post social science papers on the new SocArxiv

July 17, 2016
By

I learned about it from this post by Elizabeth Popp Berman. The temporary SocArxiv site is here. It is connected to the Open Science Framework, which we’ve heard a lot about in discussions of preregistration. You can post your papers at SocArxiv right away following these easy steps: Send an email to the following address(es) […] The post You can post social science papers on the new SocArxiv appeared first…

Read more »

Bigmilk strikes again

July 16, 2016
By
Bigmilk strikes again

The post Bigmilk strikes again appeared first on Statistical Modeling, Causal Inference, and Social Science.

Read more »

One-day workshop on causal inference (NYC, Sat. 16 July)

July 15, 2016
By

James Savage is teaching a one-day workshop on causal inference this coming Saturday (16 July) in New York using RStanArm. Here’s a link to the details: One-day workshop on causal inference Here’s the course outline: How do prices affect sales? What is the uplift from a marketing decision? By how much will studying for an […] The post One-day workshop on causal inference (NYC, Sat. 16 July) appeared first on…

Read more »

Replin’ ain’t easy: My very first preregistration

July 15, 2016
By
Replin’ ain’t easy:  My very first preregistration

I’m doing my first preregistered replication. And it’s a lot of work! We’ve been discussing this for awhile—here’s something I published in 2013 in response to proposals by James Moneghan and by Macartan Humphreys, Raul Sanchez de la Sierra, and Peter van der Windt for preregistration in political science, here’s a blog discussion (“Preregistration: what’s […] The post Replin’ ain’t easy: My very first preregistration appeared first on Statistical Modeling,…

Read more »

Finish line (nearly)

July 15, 2016
By
Finish line (nearly)

We are very close to the finish line $-$ that's being able to finally submit the BCEA book to the editor (Springer).This has been a rather long journey, but I think the current version (I dread using the word "final" just yet...) is very good, I think....

Read more »

the curious incident of the inverse of the mean

July 14, 2016
By
the curious incident of the inverse of the mean

A s I figured out while working with astronomer colleagues last week, a strange if understandable difficulty proceeds from the simplest and most studied statistical model, namely the Normal model x~N(θ,1) Indeed, if one reparametrises this model as x~N(υ⁻¹,1) with υ>0, a single observation x brings very little information about υ! (This is not a […]

Read more »

About that claim that police are less likely to shoot blacks than whites

July 14, 2016
By
About that claim that police are less likely to shoot blacks than whites

Josh Miller writes: Did you see this splashy NYT headline, “Surprising New Evidence Shows Bias in Police Use of Force but Not in Shootings”? It’s actually looks like a cool study overall, with granular data, and a ton of leg work, and rich set of results that extend beyond the attention grabbing headline that is […] The post About that claim that police are less likely to shoot blacks than…

Read more »

Enriching mathematics with statistics

July 14, 2016
By
Enriching mathematics with statistics

Statistics enriches everything! In many school systems in the world, subjects are taught separately. In primary school, children  learn reading and writing, maths and social studies at different times of the day. But more than that, many topics within subjects … Continue reading →

Read more »

The Bits Are Rotting in the State of Data Journalism

July 14, 2016
By
The Bits Are Rotting in the State of Data Journalism

News articles are an incredibly important source of historical information. Online media and interactive pieces are much more at risk of breaking of disappearing, at least in theory. Well, it's not just theory. A quick look around shows a number of even fairly recent pieces in major publications that are broken today. The screenshot above is from … Continue reading The Bits Are Rotting in the State of Data Journalism

Read more »

Notes from the Kölner R meeting, 9 July 2016

July 13, 2016
By
Notes from the Kölner R meeting, 9 July 2016

Last Thursday the Cologne R user group came together again. This time, our two speakers arrived from Bavaria, to talk about Spark and R Server.Introduction to Apache SparkDownload slidesDubravko Dulic gave an introduction to Apache Spark and why Spark ...

Read more »

Of polls and prediction markets: More on #BrexitFail

July 13, 2016
By
Of polls and prediction markets:  More on #BrexitFail

David “Xbox poll” Rothschild and I wrote an article for Slate on how political prediction markets can get things wrong. The short story is that in settings where direct information is not easily available (for example, in elections where polls are not viewed as trustworthy forecasts, whether because of problems in polling or anticipated volatility […] The post Of polls and prediction markets: More on #BrexitFail appeared first on Statistical…

Read more »

Absorbing Markov chains in SAS

July 13, 2016
By
Absorbing Markov chains in SAS

Last week I showed how to represent a Markov transition matrix in the SAS/IML matrix language. I also showed how to use matrix multiplication to iterate a state vector, thereby producing a discrete-time forecast of the state of the Markov chain system. This article shows that the expected behavior of […] The post Absorbing Markov chains in SAS appeared first on The DO Loop.

Read more »

I know you guys think I have no filter, but . . .

July 13, 2016
By

. . . Someone sent me a juicy bit of news related to one of our frequent blog topics, and I shot back a witty response (or, at least, it seemed witty to me), but I decided not to post it here because I was concerned that people might take it as a personal attack […] The post I know you guys think I have no filter, but . .…

Read more »

Extending R

July 12, 2016
By
Extending R

As I was previously unaware of this book coming up, my surprise and excitement were both extreme when I received it from CRC Press a few weeks ago! John Chambers, one of the fathers of S, precursor of R, had just published a book about extending R. It covers some reflections of the author on […]

Read more »

vtreat version 0.5.26 released on CRAN

July 12, 2016
By

Win-Vector LLC, Nina Zumel and I are pleased to announce that ‘vtreat’ version 0.5.26 has been released on CRAN. ‘vtreat’ is a data.frame processor/conditioner that prepares real-world data for predictive modeling in a statistically sound manner. (from the package documentation) ‘vtreat’ is an R package that incorporates a number of transforms and simulated out of … Continue reading vtreat version 0.5.26 released on CRAN

Read more »

Some insider stuff on the Stan refactor

July 12, 2016
By

From the stan-dev list, Bob wrote [and has since added brms based on comments; the * packages are ones that aren’t developed or maintained by the stan-dev team, so we only know what we hear from their authors]: The bigger picture is this, and you see the stan-dev/stan repo really spans three logical layers: stan […] The post Some insider stuff on the Stan refactor appeared first on Statistical Modeling,…

Read more »

It’s more important to know the source than the value of a number

July 12, 2016
By

Here we go again. ABC News reported that Ricky Williams, former NFL star, proclaimed himself as holding "the world record for most times drug tested". (link) He said he was tested 500 times. During this 11-year career, Williams failed the test four times. So there is one thing we know - the drug testing regime is not much of a deterrent. Since the athlete knows when he is juicing or…

Read more »


Subscribe

Email:

  Subscribe