Map reduce opens up a number of interesting possibilities in data processing, especially in the commonly talked about areas of big data, but there are number of other less explored applications of map reduce. One such possibility is pipelined map reduce operations gradually funneling from the database down to the browser. This allows for device manageable levels of data, while providing different levels of filtering.
On the database level, CouchDB’s incremental map reduce will be used to turn large volumes of data into an efficiently indexed structure allowing a variety of dynamic queries. These queries be aggregated on different levels, providing efficient queries in either raw form, or aggregated down to a desired data size.
The final map reduce level will happen client side in the browser. This is where low latency filtering on top of funneled data will provide fast interactive feedback for user queries and visualizations.
This talk will take a deep dive into exploring the “map reduce all the way down” paradigm, and examine how to progress through the different levels of the pipeline.
I’m Russell Branca, you may know me as Chewbranca. I’m a programmer at Cloudant, CouchDB aficionado, enjoyer of food, and father to a red headed tornado of a toddler.
Help us make this conference the best it can be for you. Have questions you'd like this speaker to address? Suggestions for issues that deserve extra attention? Feedback that you'd like to share with the speaker and other attendees?
Join the conversation here (requires login)
For information on exhibition and sponsorship opportunities at the conference, contact Sharon Cordesse at (707) 827-7065 or firstname.lastname@example.org.
View a complete list of OSCON contacts