Purists stay clear; many rules to be broken

November 2, 2012
By
Purists stay clear; many rules to be broken

This chart, from Internet Retailer (March 2012, p. 26), is okay, at least they didn't use pie charts. But it could have been much more effective. To make it better, we have to break all the rules: Use lines instead...

Read more »

Political Engagement Map: Reactions to @MittRomney and @BarackObama

November 1, 2012
By
Political Engagement Map: Reactions to @MittRomney and @BarackObama

The "Political Engagement Map" [twitter.com], developed by Miguel Rios and Nicolas Belmonte from Twitter, illustrates the reactions of people to the past Tweets from @MittRomney and @BarackObama. The interactive map shows individual Tweets as a seri...

Read more »

Variable probability Bernoulli outcomes – Fast and Slow

November 1, 2012
By
Variable probability Bernoulli outcomes – Fast and Slow

I am working on a project that requires the generation of Bernoulli outcomes. Typically, I would go about this using the built in sample() function like so: This works great and is fast, even for large n. Problem is, I want to generate each sample with its own unique probability. Seems straight forward enough, I

Read more »

‘Researcher Degrees of Freedom’

November 1, 2012
By

False-Positive Psychology: Undisclosed Flexibility in Data Collection and Analysis Allows Presenting Anything as Significant [I]t is unacceptably easy to publish “statistically significant” evidence consistent with any hypothesis. The culprit is a construct we refer to as researcher degrees of freedom. In the course of collecting and analyzing data, researchers have many decisions to make: Should [...]

Read more »

Recently in the sister blogs: special pre-election edition!

November 1, 2012
By
Recently in the sister blogs:  special pre-election edition!

1. I can simultaneously (a) accept that Obama has a 72 percent chance of winning and (b) say the election is too close to call 2. Michael’s a Republican, Susan’s a Democrat 3. The narcissism of the narcissism of small differences 4. Obamanomics: A Counter-counterhistory 5. Not a gaffe 6. Categories influence predictions about individual [...]

Read more »

Where do the numbers come from?

November 1, 2012
By

Note to readers: There will be few updates to the blog in the next few days until southern Manhattan gets its power back. Note to AT&T: If you listen to your customers, you won't need to "investigate". Cell phone service has been unavailable since Monday. *** Lots of numbers are thrown around in the media all the time. Do you know how they are derived? This is a really important…

Read more »

Regime Detection

November 1, 2012
By
Regime Detection

Regime Detection comes handy when you are trying to decide which strategy to deploy. For example there are periods (regimes) when Trend Following strategies work better and there are periods when Mean Reversion strategies work better. Today I want to show you one way to detect market Regimes. To detect market Regimes, I will fit [...]

Read more »

It not necessary that Bayesian methods conform to the likelihood principle

October 31, 2012
By

Bayesian inference, conditional on the model and data, conforms to the likelihood principle. But there is more to Bayesian methods than Bayesian inference. See chapters 6 and 7 of Bayesian Data Analysis for much discussion of this point. It saddens me ...

Read more »

U-Phil: Blogging the Likelihood Principle: New Summary

October 31, 2012
By
U-Phil: Blogging the Likelihood Principle: New Summary

U-Phil: I would like to open up this post, together with Gandenberger’s (Oct. 30, 2012), to reader U-Phils, from December 6- 19 (< 1000 words) for posting on this blog (please see # at bottom of post).  Where Gandenberger claims, “Birnbaum’s proof is valid and his premises are intuitively compelling,” I have shown that if Birnbaum’s [...]

Read more »

(B)AIES

October 31, 2012
By

Francesco and Andrea have asked me to join them in doing a short course before the conference of the Italian Health Economics Association (AIES). The course is about Bayesian statistics and health economics and will be in Rome on November 14th. I ...

Read more »

Cox & Mayo

October 31, 2012
By
Cox & Mayo

One of my favourite Friends episodes is when Joey finally has a breakthrough and gets his first starring role in the show "Mac & Cheese" (in fact the robot was called C.H.E.E.S.E. $-$ "Computerised Humanoid Electronically Enhanced Se...

Read more »

Social scientists who use medical analogies to explain causal inference are, I think, implicitly trying to borrow some of the scientific and cultural authority of that field for our own purposes

October 31, 2012
By

I’m sorry I don’t have any new zombie papers in time for Halloween. Instead I’d like to be a little monster by reproducing a mini-rant from this article on experimental reasoning in social science: I will restrict my discussion to social science examples. Social scientists are often tempted to illustrate their ideas with examples from [...]

Read more »

Willful statistical illiteracy

October 31, 2012
By
Willful statistical illiteracy

The fine folks over at Simply Statistics have a very good educational article about the difference between the probability of winning an election and vote share. This article stems from a controversial column over at Politico criticizing Nate Silver an...

Read more »

Other doping myths busted

October 31, 2012
By

The Lance Armstrong story continues to regale. The biggest myth that is busted is that a series of negative tests prove anything. (This shouldn't be controversial to anyone who follows doping. Marion Jones, Tyler Hamilton, etc. etc. all passed hundreds of tests before getting caught.) Another myth in the doping circle is the "victimless crime". Of course there are losers. Apart from Armstrong, who now stands to lose both reputationally…

Read more »

Compute the log-determinant of a matrix

October 31, 2012
By
Compute the log-determinant of a matrix

The determinant of a matrix arises in many statistical computations, such as in estimating parameters that fit a distribution to multivariate data. For example, if you are using a log-likelihood function to fit a multivariate normal distribution, the formula for the log-likelihood involves the expression log(det(Σ)), where Σ is the [...]

Read more »

Makefiles for R/LaTeX projects

October 31, 2012
By
Makefiles for R/LaTeX projects

Updated: 21 November 2012 Make is a marvellous tool used by programmers to build software, but it can be used for much more than that. I use make whenever I have a large project involving R files and LaTeX files, which means I use it for almost all of ...

Read more »

Makefiles for R/LaTeX projects

October 31, 2012
By
Makefiles for R/LaTeX projects

Updated: 21 November 2012 Make is a marvellous tool used by programmers to build software, but it can be used for much more than that. I use make whenever I have a large project involving R files and LaTeX files, which means I use it for almost all of the papers I write, and almost of the consulting reports I produce. If you are using a Mac or Linux, you…

Read more »

The Future of Machine Learning (and the End of the World?)

October 31, 2012
By
The Future of Machine Learning (and the End of the World?)

The Future of Machine Learning (and the End of the World?) On Thursday (Oct 25) we had an event called the ML Futuristic Panel Discussion. The panelists were Ziv Bar-Joseph, Steve Fienberg, Tom Mitchell Aarti Singh and Alex Smola. Ziv is an expert on machine learning and systems biology. Steve is a colleague of mine [...]

Read more »

Microsoft Seeks an Edge in Analyzing Big Data

October 31, 2012
By

Microsoft Seeks an Edge in Analyzing Big Data: Microsoft is incorporating advanced computing technologies into many of its products, allowing users to comb huge amounts of data and get suggestions based on their habits.

Read more »

Microsoft Seeks an Edge in Analyzing Big Data

October 31, 2012
By

Microsoft Seeks an Edge in Analyzing Big Data: Microsoft is incorporating advanced computing technologies into many of its products, allowing users to comb huge amounts of data and get suggestions based on their habits.

Read more »

Microsoft Seeks an Edge in Analyzing Big Data

October 31, 2012
By

Microsoft Seeks an Edge in Analyzing Big Data: Microsoft is incorporating advanced computing technologies into many of its products, allowing users to comb huge amounts of data and get suggestions based on their habits.

Read more »

Microsoft Seeks an Edge in Analyzing Big Data

October 31, 2012
By

Microsoft Seeks an Edge in Analyzing Big Data: Microsoft is incorporating advanced computing technologies into many of its products, allowing users to comb huge amounts of data and get suggestions based on their habits.

Read more »

visit to ISU

October 30, 2012
By
visit to ISU

  A short visit to ISU but and therefore a busy and proftable day! About ten appointments in Snedecor Hall after a nice morning run, a highly attended Zyskind Lecture, and many interesting discussions all over the day: e.g., I had a great time discussing using null recurrent Markov chains for integral approximations with Krishna [...]

Read more »


Subscribe

Email:

  Subscribe