Scaling SourceForge with MongoDB

Nosh Petigara (10gen), Rick Copeland (SourceForge.net / GeekNet)
Average rating: ***..
(3.93, 15 ratings)

NoSQL Landscape – Nosh Petigara, 10gen

As more web developers strive to make their applications scalable we see a shift away from the traditional LAMP stack towards technologies built with a focus on scaling. As part of this shift, a new approach to data storage for the web is needed – the traditional RDBMS are not suited to many of the problems that appear in large scale web applications. Fortunately, a large number of alternatives to the RDBMS have sprung up, each with different goals and approaches to the problem of scalability. Nosh will talk about the NoSQL landcape (key-value stores, document databases, map-reduce frameworks, and column-oriented databases), the advantages and disadvantages of these datastores, and how they are used today to solve real-world problems.

NoSQL at Geeknet – Rick Copeland, Geeknet

The Geeknet engineering team manages the sites SourceForge.net, Slashdot, freshmeat, and fossfor.us. Geeknet had been using relational databases (Postgres and MySQL) for a variety of things for a long time. But there are many situations where our needs for scalability, replication, and higher throughput, were not being well met by relational databases, and so Geeknet investigated a number of alliterative NoSQL’ data storage solutions. Geeknet’s tests led to MongoDB, a scalable, high-performance, open source, schema-free, document-oriented database with a flexible query system. Mark will highlight the process Geeknet used to evaluate and select a NoSQL solution that was applicable to their business and technology requirements.

Building and Deploying a NoSQL Datastore Application with MongoDB – Rick Copeland, Geeknet

Geeknet rewrote the download pages on SourceForge.net, and the requirements were for high read performance, replication, and a way to easily do partial updates of large records. Basically Geeknet wanted a document store that would allow them to save all the data needed for a project page render in a single record.

Rick will discuss:

  • Rewriting the Sourceforge application to take advantage of MongoDB’s unique features
  • Moving data from a relational to non-relational store
  • Deployment architecture in use at Sourceforge
  • Benefits and challenges
  • Future plans

People planning to attend this session also want to see:

Photo of Nosh Petigara

Nosh Petigara

10gen

Nosh Petigara is Director of Product Strategy at 10gen, the company that sponsors and provides commercial support for the open source project MongoDB. Prior to 10gen, Nosh headed product management for OATSystems. He has an MBA from INSEAD and a Bachelor’s and Master’s in Computer Science from MIT.

Photo of Rick Copeland

Rick Copeland

SourceForge.net / GeekNet

Rick Copeland is a software engineer at Geeknet, the company that owns the websites SourceForge, Slashdot, ThinkGeek, and FreeCode. Rick is the primary author of Ming, a Python object mapper for MongoDB, as well as Zarkov, a MongoDB-based event logging and aggregation framework. Rick has participated in several initiatives at SourceForge using MongoDB and Python. Prior to GeekNet, Rick worked in fields from retail analytics to hardware chip design. He holds MS in Electrical and Computer Engineering and Bachelor of Computer Engineering degrees from Georgia Tech and a Bachelor of Computer Science degree from Eckerd College.

  • Intel
  • Microsoft
  • Google
  • Facebook
  • Rackspace Hosting
  • (mt) Media Temple, Inc.
  • ActiveState
  • CommonPlaces
  • DB Relay
  • FireHost
  • GoDaddy
  • HP
  • HTSQL by Prometheus Research
  • Impetus Technologies Inc.
  • Infobright, Inc
  • JasperSoft
  • Kaltura
  • Marvell
  • Mashery
  • NorthScale, Inc.
  • Open Invention Network
  • OpSource
  • Oracle
  • Parallels
  • PayPal
  • Percona
  • Qualcomm Innovation Center, Inc.
  • Rhomobile
  • Schooner Information Technology
  • Silicon Mechanics
  • SourceGear
  • Symbian
  • VoltDB
  • WSO2
  • Linux Pro Magazine

Sponsorship Opportunities

For information on exhibition and sponsorship opportunities at the conference, contact Sharon Cordesse at scordesse@oreilly.com

Download the OSCON Sponsor/Exhibitor Prospectus

Media Partner Opportunities

Download the Media & Promotional Partner Brochure (PDF) for information on trade opportunities with O'Reilly conferences or contact mediapartners@ oreilly.com

Press and Media

For media-related inquiries, contact Maureen Jennings at maureen@oreilly.com

OSCON Newsletter

To stay abreast of conference news and to receive email notification when registration opens, please sign up for the OSCON Newsletter (login required)

OSCON 2.0 Ideas

Have an idea for OSCON to share? oscon-idea@oreilly.com

Contact Us

View a complete list of OSCON contacts