Blog Archives

Practical Data Science with R: Release date announced

March 26, 2014
By
Practical Data Science with R: Release date announced

It took a little longer than we’d hoped, but we did it! Practical Data Science with R will be released on April 2nd (physical version). The eBook version will follow soon after, on April 15th. You can preorder the pBook now on the Manning book page. The physical version comes with a complimentary eBook version […] Related posts: Data Science, Machine Learning, and Statistics: what is in a name? Setting…

Read more »

The Statistics behind “Verification by Multiplicity”

March 2, 2014
By
The Statistics behind “Verification by Multiplicity”

There’s a new post up at the ninazumel.com blog that looks at the statistics of “verification by multiplicity” — the statistical technique that is behind NASA’s announcement of 715 new planets that have been validated in the data from the Kepler Space Telescope. We normally don’t write about science here at Win-Vector, but we do […] Related posts: “I don’t think that means what you think it means;” Statistics to…

Read more »

The Extra Step: Graphs for Communication versus Exploration

January 12, 2014
By
The Extra Step: Graphs for Communication versus Exploration

Visualization is a useful tool for data exploration and statistical analysis, and it’s an important method for communicating your discoveries to others. While those two uses of visualization are related, they aren’t identical. One of the reasons that I like ggplot so much is that it excels at layering together multiple views and summaries of […] Related posts: Revisiting Cleveland’s The Elements of Graphing Data in ggplot2 My Favorite Graphs…

Read more »

Big News! Practical Data Science with R is content complete!

December 19, 2013
By
Big News! Practical Data Science with R is content complete!

The last appendix has gone to the editors; the book is now content complete. What a relief! We are hoping to release the book late in the first quarter of next year. In the meantime, you can still get early drafts of our chapters through Manning’s Early Access program, if you haven’t yet. The link […] Related posts: Data science project planning Data Science, Machine Learning, and Statistics: what is…

Read more »

Bayesian and Frequentist Approaches: Ask the Right Question

May 6, 2013
By
Bayesian and Frequentist Approaches: Ask the Right Question

It occurred to us recently that we don’t have any articles about Bayesian approaches to statistics here. I’m not going to get into the “Bayesian versus Frequentist” war; in my opinion, which style of approach to use is less about philosophy, and more about figuring out the best way to answer a question. Once you […] Related posts: Statistics to English Translation, Part 2a: ’Significant’ Doesn’t Always Mean ’Important’ Worry…

Read more »

Revisiting Cleveland’s The Elements of Graphing Data in ggplot2

February 18, 2013
By
Revisiting Cleveland’s The Elements of Graphing Data in ggplot2

I was flipping through my copy of William Cleveland’s The Elements of Graphing Data the other day; it’s a book worth revisiting. I’ve always liked Cleveland’s approach to visualization as statistical analysis. His quest to ground visualization principles in the context of human visual cognition (he called it “graphical perception”) generated useful advice for designing [...] Related posts: Good Graphs: Graphical Perception and Data Visualization Your Data is Never the…

Read more »

Error Handling in R

October 9, 2012
By
Error Handling in R

It’s often the case that I want to write an R script that loops over multiple datasets, or different subsets of a large dataset, running the same procedure over them: generating plots, or fitting a model, perhaps. I set the script running and turn to another task, only to come back later and find the [...] Related posts: R annoyances Your Data is Never the Right Shape Survive R

Read more »

On Being a Data Scientist

September 20, 2012
By
On Being a Data Scientist

When people ask me what it means to be a data scientist, I used to answer, “it means you don’t have to hold my hand.” By which I meant that as a data scientist (a consulting data scientist), I can handle the data collection, the data cleaning and wrangling, the analysis, and the final presentation [...] Related posts: Book Review: Ensemble Methods in Data Mining (Seni & Elder) Setting expectations…

Read more »

On Writing Technical Articles for the Nonspecialist

September 5, 2012
By
On Writing Technical Articles for the Nonspecialist

This was originally posted at ninazumel.com. I’m re-blogging it here. Photo: John Mount I came across a post from Emily Willingham the other day: “Is a PhD required for Good Science Writing?”. As a science writer with a science PhD, her answer is: is it not required, and it can often be an impediment. I [...] Related posts: What does a generalized linear model do? Kernel Methods and Support Vector…

Read more »

Modeling Trick: Impact Coding of Categorical Variables with Many Levels

July 23, 2012
By
Modeling Trick: Impact Coding of Categorical Variables with Many Levels

One of the shortcomings of regression (both linear and logistic) is that it doesn’t handle categorical variables with a very large number of possible values (for example, postal codes). You can get around this, of course, by going to another modeling technique, such as Naive Bayes; however, you lose some of the advantages of regression [...] Related posts: Modeling Trick: Masked Variables A bit more on impact coding Modeling Trick:…

Read more »


Subscribe

Email:

  Subscribe