Kevin Weil
Analytics Lead, Twitter, Inc.

Web site | @kevinweil | Attendee Directory Profile

Kevin Weil leads the analytics team at Twitter, building distributed infrastructure and leveraging data analysis at a massive scale to help grow the popular micro-blogging service. With millions of monthly site visitors and many more interacting through API-based third party applications, Twitter has one of the world’s most varied and interesting datasets. Prior to joining Twitter, Kevin led the analytics team at the Kleiner Perkins-backed web media startup Cooliris. Kevin earned his bachelor’s degree in Mathematics and Physics from Harvard University, and has a master’s degree in Physics from Stanford University.

Sessions

2:30pm Thursday, 07/22/2010

Hadoop, Pig, and Twitter

Databases
Location: E145/E146

Tags:

Kevin Weil (Twitter, Inc.)

Average rating:

(4.20, 15 ratings)

How does Twitter analyze its massive dataset? What tools do we use, and where do we focus our analysis? In this talk, I will discuss our transition from a MySQL-based to a Hadoop-based data infrastructure and our use of Pig (a scripting language built on top of Hadoop) to democratize big-data analysis across the company. I will present concrete examples of interesting analyses at each step. Read more.

Diamond Sponsors

Premier Platinum Sponsor

Gold Sponsors

Silver Sponsors

Premier Media Partner

Sponsorship Opportunities

For information on exhibition and sponsorship opportunities at the conference, contact Sharon Cordesse at scordesse@oreilly.com

Download the OSCON Sponsor/Exhibitor Prospectus

Media Partner Opportunities

Download the Media & Promotional Partner Brochure (PDF) for information on trade opportunities with O'Reilly conferences or contact mediapartners@ oreilly.com

Press and Media

For media-related inquiries, contact Maureen Jennings at maureen@oreilly.com

OSCON Newsletter

To stay abreast of conference news and to receive email notification when registration opens, please sign up for the OSCON Newsletter (login required)

OSCON 2.0 Ideas

Have an idea for OSCON to share? oscon-idea@oreilly.com

Contact Us

View a complete list of OSCON contacts

Kevin Weil Analytics Lead, Twitter, Inc.