Tag Archives: Open Data

The Expanding (Digital) Universe: Visualizing How BIG a Zettabyte Really Is

Note: This post was originally published at Oulixeus Consulting

A lot of news articles recently (Google News currently shows 1,060 articles) are citing the annual EMC-IDC Digital Universe studies of the massive growth of the digital universe through 2020. If you have not read the study, it indicates that the digital universe is now doubling every two years and will grow 44-fold 50-fold now 55-fold from 0.8 Zettabytes (ZB) of data in 2009 to 35 40 now 44 Zettabytes in 2020. (Every year IDC has revised the growth curve upward by several Zettabytes.)

Usually these articles show a diagram such as this:

DigitalDecade

This type of diagram is great at showing how much 44-fold growth is. However it really does not convey how big a Zettabyte really is—and how much data we will be swimming (or drowning in) by 2020.

A Zettabyte (ZB) is really, really big – in terms of today’s information systems. It is not a capacity that people encounter every day. It’s not even in Microsoft Office’s spell-checker, Word “recommended” that I meant to type “Petabyte” instead 😉

The Raw Definition: How big is a Zettabyte?

A Computer Scientist will tell you that 1 Zettabyte is 270 bytes. That does not sound very big to a person who does not usually visualize think in exponential or scientific notation—especially given that a one-Terabyte (1 TB) solid state drive has a capacity to store 240 bytes.

Wikipedia describes a ZB (in decimal math) as one-sextillion bytes. While this sounds large, it is a hard to visualize. It is easier to visualize 1 ZB (and 44 ZBs) in relation to things we use everyday.

Visualizing Zettabytes in Units of Smartphones

The most popular new smartphones today have 32 Gigabytes (GB) or 32 x 230 bytes of capacity. To get 1 ZB you would have to fill 34,359,738,368 (34.4 billion) smartphones to capacity. If you put 34.4 billion Samsung S5’s end-to-end (length-wise) you would circle the Earth 121.8 times:

1ZB-Earth-Distance
Click to see a higher resolution image and the dot that represents Earth to-scale vs. the line

You can actually circumnavigate Jupiter almost 11 times—but that is not obvious to visualize.

The number of bytes in 44 Zettabytes is a number too large for Microsoft Excel to compute correctly. (The number you will get is so large that Excel will cut off seven digits of accuracy–read that as a potential rounding error up to one million bytes). Assuming that Moore’s Law will allow us to double the capacity of smartphones three times between now and 2020, it would take 188,978,561,024 (188+ trillion) smartphones to store 44 ZB of data. Placing these end-to-end- would circumnavigate the world over nearly 670 times.

This is too hard to visualize, so lets look at it another way. You could tile the entire City of New York two times over (and the Bronx and Manhattan three times over) with smartphones filled to capacity with data to store 44 ZBs. That’s a big Data Center!

Clik
Amount of Smartphones (with 2020 tech) you would need to store 44 ZB (click for higher resolution)

This number also represents 25 smartphones per person for the entire population of the planet. Imagine the challenge of managing data spread out across that many smartphones.

Next Page: Visualizing Zettabytes in Units of Facebook

An Opportunity Missed: The Olympics-as-a-Platform

Article first published as An Opportunity Missed: The Olympics-as-a-Platform on Technorati. Embedded video of “Rethink Possible” added in this blog post.

The Summer Olympics are very special. Every four years, for over two weeks, people all over the world (even those who are not normally sports fans) spend hours every day engrossed in the innermost details of dozens of sports—at home, at work, at school and at play.

However, in 2012 the IOC had opportunities never seen in any prior Summer Olympics…

olympic_open_data_280pxThis year was not just the first Summer Olympics since social media, multi-media mobile phones, and smart phone (and tablet) apps have become the ubiquitous means that over a billion people use to find and share information, opinion, photos and video globally—and instantly. It was also the first Summer Olympics since the rise in use of Open Data Platforms and Apps Competitions to tap the innovation of thousands of people to create better ways to access information (without adding the cost and complexity of hiring thousands of designers, developers and testers).

The IOC could have taken advantage of this by doing four things:

If the IOC had done this they could have created the biggest, most exciting Open Data and App competition we have ever seen. Not only would this have tapped into the innovation of tens of thousands of developers, it would have harnessed competition between teams who wanted to highlight the technology strength of their countries, their love of their country’s history and culture, and their passion for the athletes representing them in their favorite sports.

Imagine what kind of Apps this global technology could have created:

  • Apps written by ex-gymnasts that combined athlete bios and explanations of events and rules with (official and fan) video of preliminary rounds and the World Championships. Apps that even let the audience score what they saw in real-time.
  • Apps combining location-based data with captured photos and video along the entire 26-mile, 385-year course of the marathon, letting you play back key parts of the race, see every part of the course at once, and cheer on runners via Facebook and Twitter
  • Fantasy Olympic Team apps that let you assemble your own dream team for events and compete with your friends—or globally in the Olympic spirit
  • Training gamification apps that let you record and visually display your running and swimming times (like Nike’s training apps) to understand in new ways the tremendous the speed, strength and endurance of Olympians


AT&T’s Rethink Possible Ad: Imagine if the swimmer did not have to write down the new record (and instead an App logged his times and showed them again every record Olympic Record—and every qualifying round—back to 1896)

Apps like these would have made these Olympics more interactive and participatory than any in history. While we did not get this in 2012, I am keeping my fingers crossed for a 2014 Sochi Winter Apps Competition, and perhaps an even 2016 Rio Summer Apps competition.