Posts Tagged ‘ statistics ’

an inverse permutation test

September 22, 2016
By
an inverse permutation test

A straightforward but probabilistic riddle this week in the Riddler, which is to find the expected order of integer i when the sequence {1,2,…,n} is partitioned at random into two sets, A and B, each of which is then sorted before both sets are merged. For instance, if {1,2,3,4} is divided in A={1,4} and B={2,3}, […]

Read more »

A Fun Gastronomical Dataset: What’s on the Menu?

September 20, 2016
By
A Fun Gastronomical Dataset: What’s on the Menu?

I just found a fun food themed dataset that I’d never heard about and that I thought I’d share. It’s from a project called What’s on the menu where the New York Public Library has crowdsourced a digitization of their collection of historical ...

Read more »

Uncertainty in a probability

September 20, 2016
By
Uncertainty in a probability

Suppose you did a pilot study with 10 subjects and found a treatment was effective in 7 out of the 10 subjects. With no more information than this, what would you estimate the probability to be that the treatment is effective in the next subject? Easy: 0.7. Now what would you estimate the probability to be […]

Read more »

Relative error distributions, without the heavy tail theatrics

September 20, 2016
By
Relative error distributions, without the heavy tail theatrics

Nina Zumel prepared an excellent article on the consequences of working with relative error distributed quantities (such as wealth, income, sales, and many more) called “Living in A Lognormal World.” The article emphasizes that if you are dealing with such quantities you are already seeing effects of relative error distributions (so it isn’t an exotic … Continue reading Relative error distributions, without the heavy tail theatrics

Read more »

How I made some Pokémon Business Cards

September 14, 2016
By
How I made some Pokémon Business Cards

As I’m in the industry now I figured I needed some business cards and as it seems the 90s never left us and Japanese monsters are hip again, I decided to make them Pokémon themed. I think they turned out pretty well, and here I’m just going ...

Read more »

Insufficient statistics

September 12, 2016
By

Experience with the normal distribution makes people think all distributions have (useful) sufficient statistics [1]. If you have data from a normal distribution, then the sufficient statistics are the sample mean and sample variance. These statistics are “sufficient” in that the entire data set isn’t any more informative than those two statistics. They effectively condense […]

Read more »

Adversarial machine learning

September 11, 2016
By

I just got back from a very good conference organized by startup.ml: Adversarial Machine Learning. Please read on for my to comments on part of one of the very good talks. Classic machine learning (especially as it is taught in classes) emphasizes a nice safe static environment where you are given some unchanging data and … Continue reading Adversarial machine learning

Read more »

Graphical inequity ruins the chart

September 9, 2016
By
Graphical inequity ruins the chart

This Economist chart has a great concept but I find it difficult to find the story: (link) I am a fan of color-coding the text as they have done here so that part is good. The journalist has this neat...

Read more »

The nature of mathematics and statistics and what it means to learn and teach them

September 6, 2016
By
The nature of mathematics and statistics and what it means to learn and teach them

I’ve been thinking lately…. Sometimes it pays to stop and think. I have been reading a recent textbook for mathematics teachers, Dianne Siemon et al, Teaching mathematics: foundations to middle years (2011). On page 47 the authors asked me to “Take … Continue reading →

Read more »

astroABC: ABC SMC sampler for cosmological parameter estimation

September 5, 2016
By
astroABC: ABC SMC sampler for cosmological parameter estimation

“…the chosen statistic needs to be a so-called sufficient statistic in that any information about the parameter of interest which is contained in the data, is also contained in the summary statistic.” Elise Jenningsa and Maeve Madigan arXived a paper on a new Python code they developed for implementing ABC-SMC, towards astronomy or rather cosmology […]

Read more »


Subscribe

Email:

  Subscribe