Applied Statistics Lesson of the Day – Additive Models vs. Interaction Models in 2-Factor Experimental Designs

$Applied Statistics Lesson of the Day – Additive Models vs. Interaction Models in 2-Factor Experimental Designs$

In a recent “Machine Learning Lesson of the Day“, I discussed the difference between a supervised learning model in machine learning and a regression model in statistics.  In that lesson, I mentioned that a statistical regression model usually consists of a systematic component and a random component.  Today’s lesson strictly concerns the systematic component. An […]

Ever wonder how popular your favorite R functions are?

March 8, 2014
By

How's that fried pickle sandwich treating you?  Perhaps your taste in R  functions are less bizarre than your taste in R commands?Now you can easily find out using this new shiny app!  In this post I use the R function frequency table co...

Per capita GDP versus years since women received right to vote

March 7, 2014
By

Below is a plot of per capita GPD (in log scale) against years since women received the right to vote for 42 countries. Is this cause, effect, both or neither? We all know correlation does not imply causation, but I … Continue reading →

Selection bias in the reporting of shaky research

March 7, 2014
By

I’ll reorder this week’s posts a bit in order to continue on a topic that came up yesterday. A couple days ago a reporter wrote to me asking what I thought of this paper on Money, Status, and the Ovulatory Cycle. I responded: Given the quality of the earlier paper by these researchers, I’m not […]The post Selection bias in the reporting of shaky research appeared first on Statistical Modeling,…

RUG-Philippines Meetup: Markov Switching Models in R

March 7, 2014
By

To the R users based in the Philippines, there will be upcoming meetup, here are the details:topics: Markov Switching Models in R           by Ohly Santos           How to use the op...

Advances in scalable Bayesian computation [day #4]

March 7, 2014
By

Final day of our workshop Advances in Scalable Bayesian Computation already, since tomorrow morning is an open research time ½ day! Another “perfect day in paradise”, with the Banff Centre campus covered by a fine snow blanket, still falling…, and making work in an office of BIRS a dream-like moment. Still looking for a daily theme, […]

On replacing calculus with statistics

March 7, 2014
By

Russ Roberts had this to say about the proposal to replacing the calculus requirement with statistics for students. Statistics is in many ways much more useful for most students than calculus. The problem is, to teach it well is extraordinarily difficult. It’s very easy to teach a horrible statistics class where you spit back the […]

IJF news

March 7, 2014
By

This is a short piece I wrote for the next issue of the Oracle newsletter produced by the International Institute of Forecasters. Special section topics We continue to publish special sections on selected topics. Because of the change in the way regular papers are now handled, we do not publish whole special issues any more. Rather, each issue has regular papers at the front, and if there are any special…

Analytics Software Popularity Update: Counting Blogs, Simplifying Job Searches

March 7, 2014
By

My latest update to The Popularity of Data Analysis Software is an attempt to use blog counts to estimate the popularity of analytics software. While I was able to greatly broaden the coverage of packages when studying job data, I … Continue reading →

Freshman hordes slightly more godless than ever

March 6, 2014
By

This article is an update to my annual series on one of the most under-reported stories of the decade: the fraction of college freshmen who report no religious preference has tripled since 1985, from 8% to 24%, and the trend is accelerating.In last yea...

How much time (if any) should we spend criticizing research that’s fraudulent, crappy, or just plain pointless?

March 6, 2014
By

I had a brief email exchange with Jeff Leek regarding our recent discussions of replication, criticism, and the self-correcting process of science. Jeff writes: (1) I can see the problem with serious, evidence-based criticisms not being published in the same journal (and linked to) studies that are shown to be incorrect. I have been mostly […]The post How much time (if any) should we spend criticizing research that’s fraudulent, crappy,…

The Secret to Entropy’s role in Statistics

March 6, 2014
By

Entropy is the single most powerful statistical tool discovered to date. That’s a bold claim. I intend to back that claim up in this post. Forget for a moment about Entropy and Statistics and start fresh. Suppose we know two variables , are relat...

Two charts that fail self-sufficiency

March 6, 2014
By

My twitter followers have been sending in several howlers. Twitter (link) made a bunch of bold claims about its own influence by using the number of tweets about the Oscars as fodder. They also adopt the euphenism common to the...

Advances in scalable Bayesian computation [day #3]

March 6, 2014
By

We have now gone over the midpoint of our workshop Advances in Scalable Bayesian Computation with three talks in the morning and an open research or open air afternoon. (Maybe surprisingly I chose to stay indoors and work on a new research topic rather than trying cross-country skiing!) If I must give a theme for […]

Machine Learning Lesson of the Day – Memory-Based Learning

Memory-based learning (also called instance-based learning) is a type of non-parametric algorithm that compares new test data with training data in order to solve the given machine learning problem.  Such algorithms search for the training data that are most similar to the test data and make predictions based on these similarities.  (From what I have learned, memory-based learning […]

Highlighting the web

March 6, 2014
By

Users of my new online forecasting book have asked about having a facility for personal highlighting of selected sections, as students often do with print books. We have plans to make this a built-in part of the platform, but for now it is possible to do it using a simple browser extension. This approach allows any website to be highlighted, so is even more useful than if we only had…

"Unifying the Counterfactual and Graphical Approaches to Causality" (Tomorrow at the Statistics Seminar)

March 5, 2014
By

Attention conservation notice: Late notice of an academic talk in Pittsburgh. Only of interest if you care about the places where the kind of statistical theory that leans on concepts like "the graphical Markov property" merges with the kind of analy...

Exploring Ball Locations and Player Behaviors in Basketball

March 5, 2014
By

"Game on!" by Fathom Information Design is an exploratory visualization prototype that allows users to parse through a basketball game's data, to investigate the behaviors and patterns in terms of the statistics and locations of players. Based on a ...

Fun with Mike Steele Quotes and Rants

March 5, 2014
By

Check out the web page of my Penn Statistics buddy, Mike Steele, probabilist, statistician and mathematician extraordinaire. (And that's just his day job. At night he battles the really hard stuff -- financial markets.) Among other things, you'll ...

PLoS One, I have an idea for what to do with all your profits: buy hard drives

March 5, 2014
By

I've been closely following the fallout from PLoS One's new policy for data sharing. The policy says, basically, that if you publish a paper, all data and code to go with that paper should be made publicly available at the … Continue reading →

Plagiarism, Arizona style

March 5, 2014
By

Last month a history professor sent me a note regarding plagiarism at Arizona State University: Matthew Whitaker, who had received an expedited promotion to full professor and was made Director of a new Center for the Study of Race and Democracy by Provost Elizabeth Capaldi and President Michael Crow, was charged by most of the […]The post Plagiarism, Arizona style appeared first on Statistical Modeling, Causal Inference, and Social Science.

Advances in scalable Bayesian computation [day #2]

March 5, 2014
By

And here is the second day of our workshop Advances in Scalable Bayesian Computation gone! This time, it sounded like the “main” theme was about brains… In fact, Simon Barthelmé‘s research originated from neurosciences, while Dawn Woodard dissected a brain (via MRI) during her talk! (Note that the BIRS website currently posts Simon’s video as […]

Optimizing a function that evaluates an integral

March 5, 2014
By

SAS programmers use the SAS/IML language for many different tasks. One important task is computing an integral. Another is optimizing functions, such as maximizing a likelihood function to find parameters that best fit a set of data. Last week I saw an interesting problem that combines these two important tasks. [...]