The following is from Quora-Kaggle. And I think it’s very useful for data scientist to do a project. Question: To do well in a competition, clearly many aspects are important. But, what do you think helped you (or a top competitor you know) do better than others? At a high level, I’m curious if you [...]
The following is from JSM: Guidelines for Preparing Effective Presentations These tips apply regardless of whether the time for the presentations is short (less than 30 minutes) or long. Complaints about poor presentations have been received for decades and continue to be received. The ASA has offered a short-course on presentation for many years, and [...]
R has great support for Holt-Winter filtering and forecasting. I sometimes use this functionality, HoltWinter & predict.HoltWinter, to forecast demand figures based on historical data. Using the HoltWinter functions in R is pretty straightforward. Let's say our dataset looks as follows; demand <- ts(BJsales, start = c(2000, 1), frequency = Read more »The post Holt-Winters forecast using ggplot2 appeared first on FishyOperations.
Dynamite plots are a somewhat pejorative term for a graphical display where the height of a bar indicates the mean, and the vertical line on top of it represents the standard deviation (or standard error). These displays are commonly found in many scie...
I present an alternative to Ezra Klein’s chart showing Romney’s and Obama’s tax plans in one chart so that equal intervals on the axis represent equal amounts.
Elias Bareinboim asked what I thought about his comment on selection bias in which he referred to a paper by himself and Judea Pearl, “Controlling Selection Bias in Causal Inference.” I replied that I have no problem with what he wrote, but that from my perspective I find it easier to conceptualize such problems in [...]
I list and discuss the three books on Bayesian analysis that I recommend to social scientists. I encourage you to share this with others and contribute to the conversation at Best Books for Social Scientists on Bayesian Analysis, which first appeared at carlislerainey.com.For more of my thoughts and ideas, subscribe to my blog (via RSS or Email) and follow me on Twitter. You also might like to browse my archive and…
I have blogged about three different SAS/IML techniques that iterate over categories and process the observations in each category. The three techniques are as follows: Use a WHERE clause on the READ statement to read only the observations in the ith category. This is described in the article "BY-group processing [...]
Gregor Aisch recently wrote a posting about gauges, and how he finds them inspiring and beautiful in their simplicity, even though they are generally disliked in visualization. His posting highlights a common misconception about visualization, and a conflation of different uses of data display, that is worth exploring. Gregor takes issue with the notion that visualization requires a certain number of data points to be displayed. He also considers “breaking…
In my July 8, 2012 post “Metablog: Up and Coming,” I wrote: “I will attempt a (daring) deconstruction of Professor Wasserman’s paper[i] and at that time will invite your “U-Phils” for posting around a week after (<1000 words).” These could reflect on Wasserman’s paper and/or my deconstruction of it. See an earlier post for the [...]
For many people, a graph is not obvious. Let me illustrate: Here are two graphs showing the results from two classes of students in some mythical test out of 10. Have a look at them and decide which one shows … Continue reading →
eQTL tries to regress each gene expression against each SNP, in order to find those regulatory elements. And eQTL uses “normal” samples, right? (by normal I mean “no disease” like those in 1000genome project) GWAS compares SNPs between normal(control) and disease(test) samples, trying to find out those higher-frequency variants enriched for diseases. linkage mapping/recombination mapping/positional [...]
Simplicity is hard to sell Self-Repairing Bayesian Inference Praxis and Ideology in Bayesian Data Analysis In-consistent Bayesian inference Big Data Generalized Linear Models with Revolution R Enterprise Quants, Models, and the Blame Game Fun with the googleVis Package for R Topological Data Analysis The Winners of the LaTeX and Graphics Contest Is Machine Learning Losing Impact? Machine Learning Doesn’t [...]
A really nice list of journals software/data release policies from Titus’ blog. Interesting that he couldn’t find a data/release policy for the New England Journal of Medicine. I wonder if that is because it publishes mostly clinical studie...
Finally there’s a very interesting comparison of OGD in three leading countries. qunb did it . Have a look at this presentation. 1) There are lots of duplicates on OGD platforms . 2) There are very few structured data yet . . 3) Apps are the real challenge There are different strategies fostering the developmemt …Read More
Cassie Murdoch reports: A 47-year-old woman in Uxbridge, Massachusetts, got behind the wheel of her car after having a bit too much to drink, but instead of wreaking havoc on the road, she ended up lodged in a sand trap at a local golf course. Why? Because her GPS made her do it—obviously! She said [...]
I attended the The 1000 Genomes Project Community Meeting 12th and 13th July 2012 at University of Michigan. Because lots of the presentations are more from the computation point of view instead of statistical point of view, I have little idea about those talks. But from my point of view, if you want me to [...]
Bits: Betaworks Buys What's Left of Social News Site Digg: Betaworks, a technology incubator in New York, has purchased Digg, a social news site that has slowly lost steam amid the rise of services like Twitter and Facebook. It’s a bit sad to see Di...
Working on my R bootcamp materials and I thought it would be handy to get the bootcamp computers setup by sourcing an R script that will install all necessary non-core packages in it. The problem? How to deploy this script efficiently. A quick method w...
When you are a student, one of the first problems you learn about is the two-sample test. So you might think that this problem is old news. But it has had a revival: there is a lot of recent research activity on this seemingly simple problem. What makes the problem still interesting and challenging is [...]
First of all, a shout out to R-bloggers for adding my feed to their website! Linear programming is a valuable instrument when it comes to decision making. This post shows how R in conjunction with the lpSolveAPI package, can be used to build a linear programming model and to analyse Read more »The post Linear programming in R: an lpSolveAPI example appeared first on FishyOperations.
Bits: Mobile App Developers Scoop Up Vast Amounts of Data, Reports Say: As mobile apps proliferate, new details are emerging about how much data mobile advertising networks inhale and how uninformed their users might be about this. Two new reports thi...
I opened the newspaper today (recall that this blog is on an approximately one-month delay) to see a moderately horrifying story about art appraisers who are deterred by fear of lawsuits from expressing an opinion about possible forgeries. Maybe this trend will come to science too? Perhaps Brett Pelham will sue Uri Simonsohn for the [...]
