Sponsors

  • Microsoft
  • Nebula
  • Google
  • SugarCRM
  • Facebook
  • HP
  • Intel
  • Rackspace Hosting
  • WSO2
  • Alfresco
  • BlackBerry
  • CUBRID
  • Dell
  • eBay
  • Heroku
  • InfiniteGraph
  • JBoss
  • LeaseWeb
  • Liferay
  • Media Temple, Inc.
  • OpenShift
  • Oracle
  • Percona
  • Puppet Labs
  • Qualcomm Innovation Center, Inc.
  • Rentrak
  • Silicon Mechanics
  • SoftLayer Technologies, Inc.
  • SourceGear
  • Urban Airship
  • Vertica
  • VMware
  • (mt) Media Temple, Inc.

Sponsorship Opportunities

For information on exhibition and sponsorship opportunities at the convention, contact Sharon Cordesse at scordesse@oreilly.com

Download the OSCON Sponsor/Exhibitor Prospectus

Contact Us

View a complete list of OSCON contacts

Visualizing Economic Data Using Perl and HTML5's Canvas

A.Sinan Unur (Unur)
Perl
Location: Portland 256
Average rating: *....
(1.60, 5 ratings)

Government sites such as bea.gov and census.gov provide lot of
interesting data relevant current events. These data are usually
provided in dense spreadsheet tables with limited, if any,
charting facilities making them relatively inaccessible to the
casual visitor. As a former Economics and Statistics educator, I
have an interest in presenting data in a straightforward, visual
manner.

Perl’s libraries such as Text::CSV, HTML::TableExtract,
Spreadsheet::ParseExcel provide means to extract relevant
information from data distributed in commonly used file
formats.

With the advent of HTML5’s canvas element, the task of
generating graphics can be offloaded to the visitor’s web
browser (ignoring, for the moment issues with browser support
for this feature). Web applications can avoid external graphics
files, instead embedding the data necessary to produce a chart
in a table element in the HTML. Such a table can then be
displayed as a chart using unobtrusive JavaScript, if the client
browser supports it.

Recently, Perl has gained a number of simple Web application
frameworks. One of these is Dancer .
Web applications written using Dancer can be deployed easily in
a number of ways, including as standalone scripts. Dancer works
well with Perl’s Template::Toolkit for HTML generation.

I propose a presentation putting these elements together to
create a simple interface to the National Income Accounts data
provided by the Bureau of Economic
Analysis
:

  • A backend that puts the data in an easily queryable format,
  • A simple web application that presents a straightforward UI
    which enables the visitor select components of the data set to
    plot and generates the data table and the HTML document using
    Template::Toolkit
  • Client-side scripting to visualize the data.

None of this is particularly complicated, but I am not aware of
any tutorials or documentation that would help someone with
reasonable familiarity with all the technologies involved to put
together such an application. Therefore, an example of such a
self-contained web application might be of interest.

Of course, these building blocks can be used to provide
interfaces to data from other domains than Economics as well.

Photo of A.Sinan Unur

A.Sinan Unur

Unur

Sinan Unur is an economist by training and currently works as an
independent programmer and consultant helping his clients make
sense of large and complicated data sets.

He earned his Ph.D. in Consumer Economics at Cornell University
where he worked as a Senior Lecturer until 2009, teaching
Economics and Statistics to graduate and undergraduate students.
Unur’s passion for Perl dates back about ten years to when he
decided to switch from Java to Perl as his tool of choice for
writing Economics experiments. He is an active contributor to
the Perl tag on
Stackoverflow
and
maintains Perl’s Crypt::SSLeay and Net::Sharktools modules on
CPAN.

Comments on this page are now closed.

Comments

Joshua Keroes
07/29/2011 9:25am PDT

I’m most interested in solving problems. Too much time was spent showing that there was data on the web in several different formats and complaining that it’s hard to work with.

I was there to see the solutions to the finding and fetching problem, offering indexes to users, munging the various formats, leveraging datasets against one another, and how it was all realized visually.

Shawn Page
07/29/2011 8:26am PDT

I felt that there was way too much time spent on the graphs and why embedded graphs are bad. In the end I felt as if we were told that his experiment was a bad idea, that canvas is not good for drawing conceptual stuff and that svg is better. I guess I expected more of a walkthrough on how to use perl with HTML5 Canvas.

Mark Deason
07/28/2011 5:51pm PDT

Supporting materials are great, however you should download them prior to presentation. Sorry I can’t help you with your problems, I was expecting you to help me with mine. Finally got to the point… canvas is not ready for prime time.