HBR, Webinar, Nate Silver, Krugman, writing about data

March 25, 2014
By
HBR, Webinar, Nate Silver, Krugman, writing about data

A revised version of my previous post is picked up by Harvard Business Review (link). This post introduces the OCCAM framework for Big Data that I have been speaking about at my book talks (upcoming events are listed on the right column of the blog). The OCCAM framework identifies five elements of today's data sets that present challenges compared to traditional data sets. These challenges are not new but they…

Read more »

How to Calculate Regression Coefficients without Data

March 25, 2014
By

I’m going to derive the regression formulas without assuming “normality” and in such a way that the coefficients can be calculated from first principles without data. This’ll look magical to anyone who didn’t get the post ...

Read more »

A statistical graphics course and statistical graphics advice

March 25, 2014
By

Dean Eckles writes: Some of my coworkers at Facebook and I have worked with Udacity to create an online course on exploratory data analysis, including using data visualizations in R as part of EDA. The course has now launched at https://www.udacity.com/course/ud651 so anyone can take it for free. And Kaiser Fung has reviewed it. So definitely feel free […]The post A statistical graphics course and statistical graphics advice appeared first on Statistical Modeling,…

Read more »

An easy way to get started with automatic essay scoring

March 25, 2014
By
An easy way to get started with automatic essay scoring

Wow, it's been way too long since I have updated this blog! I am going to start making more frequent updates, and I have some cool things in the pipeline, so bear with me. Last year, I wrote this post on automated essay scoring. This was essentially distilling my experience with automated essay scoring and trying to introduce it to people unfamiliar with it. I got a lot of great…

Read more »

Update on Dataviz Workshop 3

March 25, 2014
By

My chart making workshop has passed the point where each participant (except one) has presented the first draft of his or her project, and the class has opined on these efforts. Previously, I posted the syllabus of the course here....

Read more »

An easy way to get started with automated essay scoring

March 25, 2014
By
An easy way to get started with automated essay scoring

Wow, it’s been way too long since I have updated this blog! I am going to start making more frequent updates, and I have some cool things in the pipeline, so bear with me.

Read more »

Sankey diagrams with googleVis

March 25, 2014
By
Sankey diagrams with googleVis

Sankey diagrams are great for visualising flows from one set of data values to another. Although named after Irish Captain Matthew Henry Phineas Riall Sankey, who used this type of diagram in 1898 to show the energy efficiency of a steam engine, the be...

Read more »

The Unexpected Way Philosophy Majors Are Changing The World Of Business

March 25, 2014
By
The Unexpected Way Philosophy Majors Are Changing The World Of Business

  “Philosophy majors rule” according to this recent article. We philosophers should be getting the word out. Admittedly, the type of people inclined to do well in philosophy are already likely to succeed in analytic areas. Coupled with the chuzpah of taking up an “outmoded and impractical” major like philosophy in the first place, innovative tendencies […]

Read more »

Browser Plugin Maps Your Browser History as a Favicon Tapestry

March 24, 2014
By
Browser Plugin Maps Your Browser History as a Favicon Tapestry

Iconic History [shan-huang.com] by Carnegie Mellon University interaction design student Shan Huang is as simple as it is beautifully revealing. The Chrome browser plugin resulted as an accidental discovery while developing a quite sophisticated 3D ...

Read more »

Sheldon Hackney Memorial Celebration, March 27

March 24, 2014
By

If you're in the area:  Sheldon Hackney Celebration, Thursday, March 27. Program 4-5, reception 5-6, Irvine Auditorium, 34th and Spruce, Philadelphia.  See my earlier memorial post.

Read more »

Empirical implications of Empirical Implications of Theoretical Models

March 24, 2014
By
Empirical implications of Empirical Implications of Theoretical Models

Robert Bloomfield writes: Most of the people in my field (accounting, which is basically applied economics and finance, leavened with psychology and organizational behavior) use ‘positive research methods’, which are typically described as coming to the data with a predefined theory, and using hypothesis testing to accept or reject the theory’s predictions. But a substantial […]The post Empirical implications of Empirical Implications of Theoretical Models appeared first on Statistical Modeling,…

Read more »

Image CGI with R

March 24, 2014
By

I received an email recently with a question about using R in the common gateway interface (CGI) framework to create and pass image data to the web browser. I posted to stackoverflow about this some time ago, but had forgotten the details. The trouble is that R's graphics devices only write image data to file, […]

Read more »

On deck this week

March 24, 2014
By

OK, I’ve given up on theme weeks. I have enough saved-up material to do it, and it wouldn’t be too much trouble to group the scheduled posts into themes, but there doesn’t really seem to be a point. I say this because, having looked at the comment threads from the past few weeks, the comments […]The post On deck this week appeared first on Statistical Modeling, Causal Inference, and Social…

Read more »

The fact that data analysts base their conclusions on data does not mean they ignore experts

March 24, 2014
By

Paul Krugman recently joined the new FiveThirtyEight hating bandwagon. I am not crazy about the new website either (although I'll wait more than one weeks before judging) but in a recent post Krugman creates a false dichotomy that is important to … Continue reading →

Read more »

Thumbs Up; Thumbs Down

March 24, 2014
By
Thumbs Up; Thumbs Down

People say and do the darnedest things! I'll let you assign your own "thumbs up" and "thumbs down" to the following gems. I imagine you can guess where I stand on each of them!'But which is a bigger menace to society, laziness about data or lazine...

Read more »

On deck this month

March 24, 2014
By

Actually, more like the next month and a half . . . I just have this long backlog so I thought I might as well share it with you: Empirical implications of Empirical Implications of Theoretical Models A statistical graphics course and statistical graphics advice What property is important in a risk prediction model? Discrimination […]The post On deck this month appeared first on Statistical Modeling, Causal Inference, and Social…

Read more »

Video: What’s new in SAS/IML 13.1

March 24, 2014
By
Video: What’s new in SAS/IML 13.1

SAS/IML 13.1 shipped a few months ago. I was asked to produce a video that highlights some of the new features in SAS/IML 13.1. In this video I describe several changes to the language before introducing the new built-in subroutines that create ODS statistical graphs. If your browser does not […]

Read more »

Estimating Variance as a Function of Treatment Rank Class

March 24, 2014
By

Imagine that we have a treatment that we give to five different groups of individuals.  Each individual has a variable response which as a unique mean and variance based on the treatment.  We do not know how the means will change but we belie...

Read more »

Reminder: Abstract submission for the 2014 ‘R in Insurance’ conference will close this Friday

March 24, 2014
By
Reminder: Abstract submission for the 2014 ‘R in Insurance’ conference will close this Friday

Don't forget, this is the final week you can submit an abstract for the second R in Insurance conference. For more details see http://www.rininsurance.com and perhaps for inspiration review last year's programme.

Read more »

Seymour Geisser and Me

March 24, 2014
By

A few stories from graduate school at the University of Minnesota School of Statistics where Seymour Geisser was head. I didn't have as many interactions with Seymour as some folks did, but his philosophy certainly influenced me. Perhaps I'll detail hi...

Read more »

Seymour Geisser and Me

March 24, 2014
By

A few stories from graduate school at the University of Minnesota School of Statistics where Seymour Geisser was head. I didn't have as many interactions with Seymour as some folks did, but his philosophy certainly influenced me. Perhaps I'll detail hi...

Read more »

Stories Are Gateways Into Worlds

March 24, 2014
By
Stories Are Gateways Into Worlds

Moritz Stefaner recently wrote a posting titled Worlds, not stories. He basically argues that while there is a clear role for the designer of a visualization, the result should be a world that users can explore, rather than a story that they’re told. I have a few things to say about this, and will do so in two parts. This is part one.

Read more »

MCMC on zero measure sets

March 23, 2014
By
MCMC on zero measure sets

Simulating a bivariate normal under the constraint (or conditional to the fact) that x²-y²=1 (a non-linear zero measure curve in the 2-dimensional Euclidean space) is not that easy: if running a random walk along that curve (by running a random walk on y and deducing x as x²=y²+1 and accepting with a Metropolis-Hastings ratio based […]

Read more »


Subscribe

Email:

  Subscribe