## Thriller (or the return of the living dead?)

December 9, 2012
By

As it turns out, another Italian government is about to end, as Professor-turned-Prime Minister Mario Monti has resigned, following former PM Silvio Berlusconi's party "categorical judgement of no confidence".Arguably, the situation is no piece of cake...

## The pretty picture is just the beginning of the data exploration. But the pretty picture is a great way to get started. Another example of how a puzzle can make a graph appealing

December 9, 2012
By

Ben Hyde sends along this appealing image by Michael Paukner, which represents a nearly perfect distillation of “infographics”: Here are some of the comments on the linked page: Rather than redrawing the picture to make the lines more clear, I’d say: leave the graphic as is, and have a link to a set of statistical [...]

## MOOCs have exploded!

December 9, 2012
By

About a year and two months ago, Stanford University taught three classes online: Intro to Databases, Machine Learning, and Artificial Intelligence. I took two of those classes (I did not feel I had time to take Artificial Intelligence), and found them...

## Sunday data/statistics link roundup (12/9/12)

December 9, 2012
By

Some interesting data/data visualizations about working conditions in the apparel industry. Here is the full report. Whenever I see reports like this, I wish the raw data were more clearly linked. I want to be able to get in, play … Continue reading →

## Hey—here’s a photo of me making fun of a silly infographic (from last year)

December 9, 2012
By

Here’s the story of the graph, which was “was shown as part of a training for FBI agents,” and here’s the more recent long form of my presentation.

## Don’t Birnbaumize that experiment my friend*–updated reblog

December 8, 2012
By

Our current topic, the strong likelihood principle (SLP), was recently mentioned by blogger Christian Robert (nice diagram). So ,since it’s Saturday night, and given the new law just passed in the state of Washington*, I’m going to reblog a post from Jan. 8, 2012, along with a new UPDATE (following a video we include as an experiment). The new [...]

## “Dropping the Stick” in Data Analysis

December 8, 2012
By

When I was a kid growing up in rough-and-tumble suburban New York, one of the major summer activities was roller hockey, the kind with roller blades (remember roller blades?). My friends and I would be playing in some random parking … Continue reading →

## Snorkel* and Surf* in Kauai and Maui

December 8, 2012
By

When I pushed out the first version of Beach G33k / Beach Ball (I'm not actually sure what the thing is called) - a search engine for beaches - I did as close to nothing in terms of features as...

## The Case for More False Positives in Anti-doping Testing

December 8, 2012
By

Kaiser Fung was ahead of the curve on Lance Armstrong: The media has gotten the statistics totally backwards. On the one hand, they faithfully report the colorful stories of athletes who fail drug tests pleading their innocence. (I have written about the Spanish cyclist Alberto Contador here.) On the other hand, they unquestioningly report athletes [...]

## FLAT PRIORS IN FLATLAND: STONE’S PARADOX

December 8, 2012
By
$FLAT PRIORS IN FLATLAND: STONE’S PARADOX$

FLAT PRIORS IN FLATLAND: STONE’S PARADOX Mervyn Stone is Emeritus Professor at University College London. He is famous for his work on Bayesian inference as well as pioneering work on cross-validation, coordinate-free multivariate analysis, as well as many other topics. Today I want to discuss a famous example of his, described in Stone (1970, 1976, [...]

## Bridge hand distribution: simulation vs exact calculation

December 8, 2012
By

Recently I played bridge with my friends. Being frustrated with several consecutive poor hand distributions we asked ourselves a question what is the probability of having a hand good enough for a small slam. A well known rule of thumb is that you need...

## XLLoop framework

December 8, 2012
By

Today I want to highlight the XLLoop framework : Excel User-Define Functions in in any language. The XLLoop consists of two main components: An Excel addin implementation (XLL written in c++). A server and framework written in R (or/and in many other languages). The XLLoop allows you to connect Excel and R in very simple [...]

## Singular Value Decomposition in SciPy

December 7, 2012
By

SciPy contains two methods to compute the singular value decomposition (SVD) of a matrix: scipy.linalg.svd and scipy.sparse.linalg.svds. In this post I'll compare both methods for the task of computing the full SVD of a large dense matrix. The first me...

## Please stop using Excel-like formats to exchange data

December 7, 2012
By

I know “officially” data scientists all always work in “big data” environments with data in a remote database, streaming store or key-value system. But in day to day work Excel files and Excel export files get used a lot and cause a disproportionate amount of pain. I would like to make a plea to my [...] Related posts: Large Data Logistic Regression (with example Hadoop code) Added worked example to…

## Feedback on my Bayesian Data Analysis class at Columbia

December 7, 2012
By

In one of the final Jitts, we asked the students how the course could be improved. Some of their suggestions would work, some would not. I’m putting all the suggestions below, interpolating my responses. (Overall, I think the course went well. Please remember that the remarks below are not course evaluations; they are answers to [...]

## Nov. Palindrome Winner: Kepler

December 7, 2012
By

See Thomas Kepler’s statement and palindrome. Filed under: Announcement, Statistics

December 7, 2012
By

Attention conservation notice: Self-promotion of an academic talk, based on a year-old paper, on arcane theoretical aspects of statistical network models. Since everybody in my professional world seems to be going to Lake Tahoe, I am, naturally, goi...

## StatMilk: Football Statistics Visualized

December 6, 2012
By

StatMilk is for a general sports fans like what Weather Spark is for people who like to talk about the weather. As an increasing number of sports fans and reporters tend to rely on statistics to gauge the quality of their division, teams and players...

## Link to Item Response Theory Presentations Using R

December 6, 2012
By

After my post on item response theory,  a number of you have asked for links to applications that provide R code.  As I noted in that post, a good deal of work is being done in an area of research called patient-related outcome measurement (P...

## Yes, checking calibration of probability forecasts is part of Bayesian statistics

December 6, 2012
By

Yes, checking calibration of probability forecasts is part of Bayesian statistics. At the end of this post are three figures from Chapter 1 of Bayesian Data Analysis illustrating empirical evaluation of forecasts. But first the background. Why am I bringing this up now? It’s because of something Larry Wasserman wrote the other day: One of [...]

## Nate Silver is a Frequentist: Review of “the signal and the noise”

December 6, 2012
By

Reblogged from Normal Deviate: Nate Silver Is A Frequentist Review of ``the signal and the noise'' by Nate Silver There are not very many self-made statisticians, let alone self-made statisticians who become famous and get hired by the New York Times. Nate Silver is a fascinating person. And his book the signal and the noise, […]

## To reject random walk in climate

December 6, 2012
By

I read the post The surprisingly weak case for global warming and the rejection; Climate: Misspecified. Based on the first, I wanted to make a post, just to write I agree with the second.The post features a number of plots like thisFor m...

## Open Data Institute officially launches | RSSeNews

December 6, 2012
By

Open Data Institute officially launches | RSSeNews:December 5, 2012 The Open Data Institute (ODI) was opened by cabinet ministers Francis Maude and David Willetts yesterday (4 December 2012), in a week when the Institute also announced two major affili...