Posts Tagged ‘ Spark ’

Books on Scala for statistical computing and data science

December 22, 2016
By
Books on Scala for statistical computing and data science

Introduction People regularly ask me about books and other resources for getting started with Scala for statistical computing and data science. This post will focus on books, but it’s worth briefly noting that there are a number of other resources available, on-line and otherwise, that are also worth considering. I particularly like the Coursera course … Continue reading Books on Scala for statistical computing and data science

Read more »

Scala for Data Science [book review]

December 22, 2016
By
Scala for Data Science [book review]

This post will review the book: Scala for Data Science, Bugnion, Packt, 2016. Disclaimer: This book review has not been solicited by the publisher (or anyone else) in any way. I purchased the review copy of this book myself. I have not received any benefit from the writing of this review. Introduction On this blog … Continue reading Scala for Data Science [book review]

Read more »

Organize your data manipulation in terms of “grouped ordered apply”

December 15, 2016
By
Organize your data manipulation in terms of “grouped ordered apply”

Consider the common following problem: compute for a data set (say the infamous iris example data set) per-group ranks. Suppose we want the rank of iris Sepal.Lengths on a per-Species basis. Frankly this is an “ugh” problem for many analysts: it involves all at the same time grouping, ordering, and window functions. It also is … Continue reading Organize your data manipulation in terms of “grouped ordered apply”

Read more »

The case for index-free data manipulation

December 10, 2016
By
The case for index-free data manipulation

Statisticians and data scientists want a neat world where data is arranged in a table such that every row is an observation or instance, and every column is a variable or measurement. Getting to this state of “ready to model format” (often called a denormalized form by relational algebra types) often requires quite a bit … Continue reading The case for index-free data manipulation

Read more »

A scalable particle filter in Scala

July 22, 2016
By
A scalable particle filter in Scala

Introduction Many modern algorithms in computational Bayesian statistics have at their heart a particle filter or some other sequential Monte Carlo (SMC) procedure. In this blog I’ve discussed particle MCMC algorithms which use a particle filter in the inner-loop in order to compute a (noisy, unbiased) estimate of the marginal likelihood of the data. These … Continue reading A scalable particle filter in Scala

Read more »

Notes from the Kölner R meeting, 9 July 2016

July 13, 2016
By
Notes from the Kölner R meeting, 9 July 2016

Last Thursday the Cologne R user group came together again. This time, our two speakers arrived from Bavaria, to talk about Spark and R Server.Introduction to Apache SparkDownload slidesDubravko Dulic gave an introduction to Apache Spark and why Spark ...

Read more »

Data frames and tables in Scala

August 21, 2015
By
Data frames and tables in Scala

Introduction To statisticians and data scientists used to working in R, the concept of a data frame is one of the most natural and basic starting points for statistical computing and data analysis. It always surprises me that data frames aren’t a core concept in most programming languages’ standard libraries, since they are essentially a … Continue reading Data frames and tables in Scala

Read more »

Data frames and tables in Scala

August 21, 2015
By
Data frames and tables in Scala

Introduction To statisticians and data scientists used to working in R, the concept of a data frame is one of the most natural and basic starting points for statistical computing and data analysis. It always surprises me that data frames aren’t a core concept in most programming languages’ standard libraries, since they are essentially a … Continue reading Data frames and tables in Scala

Read more »


Subscribe

Email:

  Subscribe