Taming Your Data: Practical Data Integration Solutions with Kettle

Roland Bouman (XCDSQL Solutions / Strukton Rail)
Business, Databases, Java, Programming
Location: Ballroom A2
Average rating: ****.
(4.25, 4 ratings)

A few years ago, business Intelligence software in general, and data integration software in particular was very expensive. Therefore, it was only accessible to large enterprises.

Recently, this market has been severely disrupted by a number of open source products and companies. Combined with the success of a number of open source database products, data warehousing and business intelligence are more and more becoming a commodity that can successfully be used even by smaller businesses.

In this 45 minute session I will demonstrate a number of practical data integration solutions with Kettle. Kettle (a.k.a. Pentaho Data Integration) is an open source (LGPL), cross-platform data integration tool written in java. It is part of the open source Pentaho business intelligence suite (GPL), and can be run standalone or in conjunction with the Pentaho stack.

Topics include:

  • extracting data from compressed text files (using internet movie database data)
  • unfolding convoluted data formats into more sensible tabular forms (using internet movie database data)
  • reading XML data into a database
  • non-intrusively capturing data changes by reading database logs (using MySQL binary logs)
  • Scaling-out: running the data integration solution in parallel on a Kettle cluster
Photo of Roland Bouman

Roland Bouman

XCDSQL Solutions / Strukton Rail

I studied Molecular Biology, but I’m professionally occupied as Web Application Developer, Information and Business Process Analyst, and Business Intelligence Guy. I have worked for Inter Access, MySQL AB, Sun Microsystems, and I currently work for Strukton Rail as application/BI developer.

  • Intel
  • Microsoft
  • Google
  • SourceForge.net
  • Sun Microsystems
  • Facebook
  • Gear6
  • Kaltura
  • Liferay
  • MindTouch
  • MySpace.com
  • Novell, Inc.
  • Open Invention Network
  • Rackspace Cloud
  • Schooner Information Technology
  • Silicon Mechanics
  • Symbian Foundation
  • Twilio
  • WSO2
  • Yabarana Corporation

Sponsorship Opportunities

For information on exhibition and sponsorship opportunities at the conference, contact Sharon Cordesse at scordesse@oreilly.com

Download the OSCON Sponsor/Exhibitor Prospectus

Media Partner Opportunities

Download the Media & Promotional Partner Brochure (PDF) for information on trade opportunities with O'Reilly conferences or contact mediapartners@ oreilly.com

Press and Media

For media-related inquiries, contact Maureen Jennings at maureen@oreilly.com

OSCON Newsletter

To stay abreast of conference news and to receive email notification when registration opens, please sign up for the OSCON newsletter (login required)

Contact Us

View a complete list of OSCON contacts