Statistics+journalism=data journalism is not the full truth. The equation may make sense because statistics are the most important source for data …Continue reading →

Monday, October 28, 2013. 6:00pm at Notman House 51 Sherbrooke W., Montreal, QC. We are very pleased to welcome back Dr. Ramnath Vaidyanathan for a talk on interactive documents as it relates to his excellent rCharts package. Bringing a laptop to follow along is highly encouraged. I would recommend installing rCharts prior to the workshop. library(devtools) pkgs <- c(‘rCharts’, ‘slidify’, ‘slidifyLibraries’) install_github(pkgs, ‘ramnathv’, ref […]

I received the following email: These compressed sensing people link to Shannon’s advice. It’s refreshing when leaders of a field state that their stuff may not be a panacea. I replied: Scarily enough, I don’t know anything about this research area at all! My correspondent followed up: Meh. They proved L1 approximates L0 when design […]The post Uncompressing the concept of compressed sensing appeared first on Statistical Modeling, Causal Inference,…

Based on some comments I am looking at using symmetry to obtain Williams style designs. Symmetry allows reduction of the number of combinations examined hence faster calculation times. Two avenues are examined. Both work for a low number of treatments....

Our favorite high school student, Isaac, gets a better shot at showing his college readiness using one of the comparative measures of support or confirmation discussed last week. Their assessment thus seems more in sync with the severe tester, but they are not purporting that z is evidence for inferring (or even believing) an H […]

A quick status update on our upcoming book “Practical Data Science with R” by Nina Zumel and John Mount. We are really happy with how the book is coming out. We were able to cover most everything we hoped to. Part 1 (especially chapter 3) is already being used in courses, and has some very […] Related posts: Data science project planning Data Science, Machine Learning, and Statistics: what is…

Mike Zyphur sent along this paper by Corinna Kruse: This article draws attention to communication across professions as an important aspect of forensic evidence. Based on ethnographic fieldwork in the Swedish legal system, it shows how forensic scientists use a particular quantitative approach to evaluating forensic laboratory results, the Bayesian approach, as a means of […]The post “The Bayesian approach to forensic evidence” appeared first on Statistical Modeling, Causal Inference,…

Yup. The post “We agree that everyone deserves a second chance. But we do prefer when those given a second chance acknowledge that they did something wrong.” appeared first on Statistical Modeling, Causal Inference, and Social Science.

I recently reported here on the Barrigozzi-Brownlees paper, "Network Estimation for Time Series." I heard it presented a few weeks ago at the 2013 NBER/NSF Time Series Conference, hosted this year by the Federal Reserve Board in Washington (a...

In anticipation of the upcoming Unconference on the Future of Statistics next Wednesday at 12-1pm EDT, I thought I'd dig up what people in the past had said about the future so we can see how things turned out. In doing … Continue reading →

In order to illustrate the next section of the non-life insurance course, consider the following example1, inspired from http://sciencepolicy.colorado.edu/…. This is the so-called “Normalized Hurricane Damages in the United States” dataset, for the period 1900-2005, from Pielke et al. (2008). The dataset is available in xls format, so we have to spend some time to import it, > library(gdata) > db=read.xls( + "http://sciencepolicy.colorado.edu/publications/special/public_data_may_2007.xls", + sheet=1) trying URL 'http://sciencepolicy.colorado.edu/publications/special/public_data_may_2007.xls' Content type 'application/vnd.ms-excel'…

Now that the important deadline of October 15 for MCMSki IV is over, First, thanks to the more that 160 participants who already registred! The audience is now larger than at any of the previous MCMSki meetings! (Obviously, from a statistical perspective, the comparison is somewhat unfair as running three parallel sessions instead of one single track session is […]

Amy Cohen writes: A surgeon showed me the “report card” his hospital received about his surgical group. The figure below shows what the report card looks like. I am very curious to hear what you think about the “deciles of the odds ratio” approach to evaluate and rank hospitals used by the American College of […]The post Chasing the noise: W. Edwards Deming would be spinning in his grave appeared…

I left a comment on one of Andrew Gelman's recent posts about Malcolm Gladwell (link). This post discusses briefly a review of Gladwell's recent book. A commenter ("Haile") made the following defense of Gladwell: My point is that many of these criticisms are based on Gladwell’s failure to present rigorous statistical evidence of arguments that are not statistical in nature in the first place. when (if) reading Gladwell, it’s time…

This stumps job applicants all the time (although probably not after this post). I flip a coin two times. Given that at least one of the flips is heads, what's the probability that both flips are heads. 50% you say? Sorry, but no. Don't feel bad...

Music and snow. Poke my eyes out Perhaps your immediate response is: “I’d rather poke my eyes out with a burning stick than do data analysis.” There’s a completely different reaction from a lot of people who have experienced data analysis. Music It’s not entirely clear why humans like music so much. Part of it […] The post The joy of data analysis appeared first on Burns Statistics.

It was over a year since my original post, Backtesting Asset Allocation portfolios. I have expanded the functionality of the Systematic Investor Toolbox both in terms of optimization functions and helper back-test functions during this period. Today, I want to update the Backtesting Asset Allocation portfolios post and showcase new functionality. I will use the […]

Don’t you wish there was a way to comment on papers? Now there is. Thanks to the efforts of Rob Tibshirani, Pat Brown, Mike Eisen, David Lipman and others there is now a system called PubMed Commons. PubMed is the central repository for biomedical research. PubMed Commons allows people to have active discussions of papers. […]