Posts tagged visualization

Mapping 400,000 Hours of US TV News
Via the Internet Archive:

We are excited to unveil a couple experimental data-driven visualizations that literally map 400,000 hours of U.S. television news. One of our collaborating scholars, Kalev Leetaru, applied “fulltext geocoding” software to our entire television news research service collection. These algorithms scan the closed captioning of each broadcast looking for any mention of a location anywhere in the world, disambiguate them using the surrounding discussion (Springfield, Illinois vs Springfield, Massachusetts), and ultimately map each location. The resulting CartoDB visualizations provide what we believe is one of the first large-scale glimpses of the geography of American television news, beginning to reveal which areas receive outsized attention and which are neglected….
…What you see here represents our very first experiment with revealing the geography of television news and required bringing together a bunch of cutting-edge technologies that are still very much active areas of research. While there is still lots of work to be done, we think this represents a tremendously exciting prototype for new ways of interacting with the world’s information by organizing it geographically and putting it on a map where it belongs!

There are two ways to explore the visualization: one is to watch news mentions of different places in the world each day, the other is to select a TV station and time window and see what it reported on.
Related: This former librarian single-handedly taped 35 years of TV news. This one’s well worth the read. Marion Stokes recorded Philadelphia news stations from 1977 - 2012, and a batch of the 140,000 VHS tapes she produced is being digitized by The Internet Archive.
Image: Screenshot, TV News Archive, via the Internet Archive. Select to embiggen.

Mapping 400,000 Hours of US TV News

Via the Internet Archive:

We are excited to unveil a couple experimental data-driven visualizations that literally map 400,000 hours of U.S. television news. One of our collaborating scholars, Kalev Leetaru, applied “fulltext geocoding” software to our entire television news research service collection. These algorithms scan the closed captioning of each broadcast looking for any mention of a location anywhere in the world, disambiguate them using the surrounding discussion (Springfield, Illinois vs Springfield, Massachusetts), and ultimately map each location. The resulting CartoDB visualizations provide what we believe is one of the first large-scale glimpses of the geography of American television news, beginning to reveal which areas receive outsized attention and which are neglected….

…What you see here represents our very first experiment with revealing the geography of television news and required bringing together a bunch of cutting-edge technologies that are still very much active areas of research. While there is still lots of work to be done, we think this represents a tremendously exciting prototype for new ways of interacting with the world’s information by organizing it geographically and putting it on a map where it belongs!

There are two ways to explore the visualization: one is to watch news mentions of different places in the world each day, the other is to select a TV station and time window and see what it reported on.

Related: This former librarian single-handedly taped 35 years of TV news. This one’s well worth the read. Marion Stokes recorded Philadelphia news stations from 1977 - 2012, and a batch of the 140,000 VHS tapes she produced is being digitized by The Internet Archive.

Image: Screenshot, TV News Archive, via the Internet Archive. Select to embiggen.

Census Bureau Releases Mapping Tool
The US Census Bureau today released an updated set of statistics based on its nation-wide, 2008-2012 American Community Survey. Along with it, the Bureau’s created an interactive map to allow users to visually explore communities across the country.
Via the US Census Bureau:

The new application allows users to map out different social, economic and housing characteristics of their state, county or census tract, and to see how these areas have changed since the 1990 and 2000 censuses. The mapping tool is powered by American Community Survey statistics from the Census Bureau’s API, an application programming interface that allows developers to take data sets and reuse them to create online and mobile apps.

Site visitors can explore eight core statistics (eg, median household income, total population and education levels) via the map.
Those with coding chops can hit up the Census Bureau’s API to develop creations of their own. The API gives access to 40 social, economic and housing topics.
Image: Screenshot, Census Explorer.

Census Bureau Releases Mapping Tool

The US Census Bureau today released an updated set of statistics based on its nation-wide, 2008-2012 American Community Survey. Along with it, the Bureau’s created an interactive map to allow users to visually explore communities across the country.

Via the US Census Bureau:

The new application allows users to map out different social, economic and housing characteristics of their state, county or census tract, and to see how these areas have changed since the 1990 and 2000 censuses. The mapping tool is powered by American Community Survey statistics from the Census Bureau’s API, an application programming interface that allows developers to take data sets and reuse them to create online and mobile apps.

Site visitors can explore eight core statistics (eg, median household income, total population and education levels) via the map.

Those with coding chops can hit up the Census Bureau’s API to develop creations of their own. The API gives access to 40 social, economic and housing topics.

Image: Screenshot, Census Explorer.

Visualizing Our Drone Future

Via Alex Cornell:

Our Drone Future explores the technology, capability, and purpose of drones, as their presence becomes an increasingly pervasive reality in the skies of tomorrow.

In the near future, cities use semi-autonomous drones for urban security. Human officers monitor drone feeds remotely, and data reports are displayed with a detailed HUD and communicated via a simulated human voice (designed to mitigate discomfort with sentient drone technology). While the drones operate independently, they are “guided” by the human monitors, who can suggest alternate mission plans and ask questions.

Specializing in predictive analysis, the security drones can retask themselves to investigate potential threats. As shown in this video, an urban security drone surveys San Francisco’s landmarks and encounters fierce civilian resistance.

Run Time: ~3:00.

Hard Drives
Via Chad Wittke.

Hard Drives

Via Chad Wittke.

Jay Z’s Most Name-Dropped Products, By Album
Via Vanity Fair. Select to embiggen.

Jay Z’s Most Name-Dropped Products, By Album

Via Vanity Fair. Select to embiggen.

Internet Populations
Cartograms are interesting. Instead of displaying political boundaries, they show data boundaries. So, for example, mapping the world across social and economic indicators.
Here, though, is Internet penetration, via the Oxford Internet Institute. It represents who’s online and where.
Via The Atlantic

The map, created as part of the Information Geographies project at the Oxford Internet Institute, has two layers of information: the absolute size of the online population by country (rendered in geographical space) and the percent of the overall population that represents (rendered by color). Thus, Canada, with a relatively small number of people takes up little space, but is colored dark red, because more than 80 percent of people are online. China, by contrast, is huge, with more than half a billion people online, but relatively lightly shaded, since more than half the population is not online. Lightly colored countries that have large populations, such as China, India, and Indonesia, are where the Internet will grow the most in the years ahead.

And, via the Oxford Institute’s Mark Graham and Stefano De Sabbata, some trends:

First, the rise of Asia as the main contributor to the world’s Internet population; 42% of the world’s Internet users live in Asia, and China, India, and Japan alone host more Internet users than Europe and North America combined…
…The map also reveals interesting patterns in some of the world’s poorest countries. Most Latin American countries now can count over 40% of their citizens as Internet users. Because of this, Latin America as a whole now hosts almost as many Internet users as the United States.
Some African countries have seen staggering growth, whereas other have seen little change since we last mapped Internet use globally in 2008. In the last three years, almost all North African countries doubled their population of Internet users (Algeria being a notable exception). Kenya, Nigeria, and South Africa, also saw massive growth. However, it remains that over half of Sub-Saharan African countries have an Internet penetration of less than 10%, and have seen very little grow in recent years.
It is therefore important to remember that despite the massive impacts that the Internet has on everyday life for many people, most people on our planet remain entirely disconnected. Only one third of the world’s population has access to the Internet.

FJP: Global mobile penetration? At 6.8 billion mobile subscribers, that’s another story. So, disconnected in a sense. But being mobile can be very connected.
Image: Internet Population and Penetration, via the Oxford Internet Institute. Select to embiggen.

Internet Populations

Cartograms are interesting. Instead of displaying political boundaries, they show data boundaries. So, for example, mapping the world across social and economic indicators.

Here, though, is Internet penetration, via the Oxford Internet Institute. It represents who’s online and where.

Via The Atlantic

The map, created as part of the Information Geographies project at the Oxford Internet Institute, has two layers of information: the absolute size of the online population by country (rendered in geographical space) and the percent of the overall population that represents (rendered by color). Thus, Canada, with a relatively small number of people takes up little space, but is colored dark red, because more than 80 percent of people are online. China, by contrast, is huge, with more than half a billion people online, but relatively lightly shaded, since more than half the population is not online. Lightly colored countries that have large populations, such as China, India, and Indonesia, are where the Internet will grow the most in the years ahead.

And, via the Oxford Institute’s Mark Graham and Stefano De Sabbata, some trends:

First, the rise of Asia as the main contributor to the world’s Internet population; 42% of the world’s Internet users live in Asia, and China, India, and Japan alone host more Internet users than Europe and North America combined…

…The map also reveals interesting patterns in some of the world’s poorest countries. Most Latin American countries now can count over 40% of their citizens as Internet users. Because of this, Latin America as a whole now hosts almost as many Internet users as the United States.

Some African countries have seen staggering growth, whereas other have seen little change since we last mapped Internet use globally in 2008. In the last three years, almost all North African countries doubled their population of Internet users (Algeria being a notable exception). Kenya, Nigeria, and South Africa, also saw massive growth. However, it remains that over half of Sub-Saharan African countries have an Internet penetration of less than 10%, and have seen very little grow in recent years.

It is therefore important to remember that despite the massive impacts that the Internet has on everyday life for many people, most people on our planet remain entirely disconnected. Only one third of the world’s population has access to the Internet.

FJP: Global mobile penetration? At 6.8 billion mobile subscribers, that’s another story. So, disconnected in a sense. But being mobile can be very connected.

Image: Internet Population and Penetration, via the Oxford Internet Institute. Select to embiggen.

Visualizing the Bible

Top: textual cross-references within the Bible via Chris Harrison:

The bar graph that runs along the bottom represents all of the chapters in the Bible. Books alternate in color between white and light gray. The length of each bar denotes the number of verses in the chapter. Each of the 63,779 cross references found in the Bible is depicted by a single arc - the color corresponds to the distance between the two chapters, creating a rainbow-like effect.

Bottom: applying sentiment analysis in the Bible, via OpenBible:

This visualization explores the ups and downs of the Bible narrative, using sentiment analysis to quantify when positive and negative events are happening…

Things start off well with creation, turn negative with Job and the patriarchs, improve again with Moses, dip with the period of the judges, recover with David, and have a mixed record (especially negative when Samaria is around) during the monarchy. The exilic period isn’t as negative as you might expect, nor the return period as positive. In the New Testament, things start off fine with Jesus, then quickly turn negative as opposition to his message grows. The story of the early church, especially in the epistles, is largely positive.

For more examples of biblical visualizations, visit The Guardian.

Images: Visiting the source links above gives you biggie versions. Alternatively, select to embiggen.

Digital Media Might Be Making a Cash Comeback
Via the Economist:

After years of wreaking havoc, the internet is helping media companies to grow. PricewaterhouseCoopers (PwC), a professional-services firm, reckons that revenues for online media and entertainment will increase by around 13% a year for the next five years. Even in music, which took the biggest hit from the internet, downloads are something to sing about. For the first time in over a decade global music-industry revenues grew last year, by about 0.2%, according to the IFPI, a trade group. Online sales just about made up for the drop in physical ones for the first time. Subscription services, such as Spotify and Deezer, let people stream songs over the internet either for a subscription or free with adverts. Online radio is also growing. On-demand and radio streaming services raked in about $1 billion, 15% of the industry’s revenues in America in 2012.

Read the rest of the Economist’s discussion here about how “digital pennies” are stacking up, transforming digital media disruptors like Spotify, YouTube, Netflix, and Hulu into cash … calves. 
Related: The PwC report referenced by the Economist (Global entertainment and media outlook) is here, with macro as well as country- and industry-specific projections.
Image: The Economist via PwC, graph of forecasted spending on digital and non-digital media spending in the next five years

Digital Media Might Be Making a Cash Comeback

Via the Economist:

After years of wreaking havoc, the internet is helping media companies to grow. PricewaterhouseCoopers (PwC), a professional-services firm, reckons that revenues for online media and entertainment will increase by around 13% a year for the next five years. Even in music, which took the biggest hit from the internet, downloads are something to sing about. For the first time in over a decade global music-industry revenues grew last year, by about 0.2%, according to the IFPI, a trade group. Online sales just about made up for the drop in physical ones for the first time. Subscription services, such as Spotify and Deezer, let people stream songs over the internet either for a subscription or free with adverts. Online radio is also growing. On-demand and radio streaming services raked in about $1 billion, 15% of the industry’s revenues in America in 2012.

Read the rest of the Economist’s discussion here about how “digital pennies” are stacking up, transforming digital media disruptors like Spotify, YouTube, Netflix, and Hulu into cash … calves. 

Related: The PwC report referenced by the Economist (Global entertainment and media outlook) is here, with macro as well as country- and industry-specific projections.

Image: The Economist via PwC, graph of forecasted spending on digital and non-digital media spending in the next five years

How the Internet Ecosystem Works

CollegeHumor explains the Internet in four simple stages. Predditors and BuzzardFeeds and AggreGators, oh my!
So where does Tumblr fit in the ecosystem?

TumblBees gather LOLlen to take back to their hive, where it is converted into #funny and fed to follower drones. Sometimes a hive will collapse due to an overload of drama. Scientists have attempted to explain this phenomenon, but for unexplainable reasons they “can’t even.”

Image: Stage 1 of the Internet Ecosystem. See the whole thing here.

How the Internet Ecosystem Works

CollegeHumor explains the Internet in four simple stages. Predditors and BuzzardFeeds and AggreGators, oh my!

So where does Tumblr fit in the ecosystem?

TumblBees gather LOLlen to take back to their hive, where it is converted into #funny and fed to follower drones. Sometimes a hive will collapse due to an overload of drama. Scientists have attempted to explain this phenomenon, but for unexplainable reasons they “can’t even.”

Image: Stage 1 of the Internet Ecosystem. See the whole thing here.

"Listen to Wikipedia" Offers Visualization and Sonification of Wikipedia Edits
Listen to Wikipedia (L2W) uses a real-time stream of edits made on Wikipedia to produce both a visual representation and a sonification of the data. L2W is the newest open-source project from Hatnote, a self-described “collection of perspectives on wiki life,” whose previous project was rcmap. 
From Hatnote’s blog post about L2W:

Bells are additions, strings are subtractions. There’s something reassuring about knowing that every user makes a noise, every edit has a voice in the roar. (Green circles are anonymous edits and purple circles are bots. White circles are brought to you by Registered Users Like You.) …
Listen to Wikipedia was written by Stephen LaPorte and Mahmoud Hashemi, and is open-source. Like RCMap, L2W gets its real-time Wikipedia data as broadcast by Wikimon. L2W was inspired by and partially based on Listen to Bitcoin, but was mostly rebuilt to use D3.js (also like RCMap). We also use howler.js for cross-browser audio support, and additional sound processing was facilitated by SoX.

You can fiddle around with the controls to follow edits for just English Wikipedia or any combination of up to 23 languages.
FJP: I just cooked dinner to English, Farsi, and Russian Wikipedia. Open it in a tab and let it lull you with its algorithmic lullaby. O brave new world that has such harmonies in it! — Shining
H/T: Motherboard for the find.
Image: Screenshot of L2W at 8:02 p.m. EDT on August 6, 2013, with a momentary 72 edits per minute

"Listen to Wikipedia" Offers Visualization and Sonification of Wikipedia Edits

Listen to Wikipedia (L2W) uses a real-time stream of edits made on Wikipedia to produce both a visual representation and a sonification of the data. L2W is the newest open-source project from Hatnote, a self-described “collection of perspectives on wiki life,” whose previous project was rcmap. 

From Hatnote’s blog post about L2W:

Bells are additions, strings are subtractions. There’s something reassuring about knowing that every user makes a noise, every edit has a voice in the roar. (Green circles are anonymous edits and purple circles are bots. White circles are brought to you by Registered Users Like You.) …

Listen to Wikipedia was written by Stephen LaPorte and Mahmoud Hashemi, and is open-source. Like RCMap, L2W gets its real-time Wikipedia data as broadcast by Wikimon. L2W was inspired by and partially based on Listen to Bitcoin, but was mostly rebuilt to use D3.js (also like RCMap). We also use howler.js for cross-browser audio support, and additional sound processing was facilitated by SoX.

You can fiddle around with the controls to follow edits for just English Wikipedia or any combination of up to 23 languages.

FJP: I just cooked dinner to English, Farsi, and Russian Wikipedia. Open it in a tab and let it lull you with its algorithmic lullaby. O brave new world that has such harmonies in it! — Shining

H/T: Motherboard for the find.

Image: Screenshot of L2W at 8:02 p.m. EDT on August 6, 2013, with a momentary 72 edits per minute

Coincidence?

Coincidence?

The World of Verified Twitter users

Twitter constructed a nifty visualization map of the mutual follows between 50,000 users with verified accounts. The map categorized the users by color: news (blue), government and politics (purple), music (red), sports (yellow) and TV (green). Twitter found some interesting trends:

One of the many fascinating things about this diagram is that it shows which accounts tend to follow those outside their category. For example, the reason that blue and purple almost seem to merge into one another is that journalists tend to follow politicians, and vice versa. The same is true of TV and music, down in the bottom right, with musicians and TV stars following each other often.

We can even see how usage varies by country. For instance, on the left you have a purple swath of government users following yellow sports users — it turns out these are largely UK politicians following prominent athletes. In the top middle, a line of Spanish-language pop stars, TV companies, sportspeople and government bodies. The purple outcrop at around two o’clock is Japanese politics; the red island below it is Japanese music.

Images: Twitter Media Blog, interactive map (bottom is zoomed-in image)

Does Math Actually Exist?

Your Sunday ponderable via the PBS Idea Channel.

Yes, You Can Have Fun Reporting the News

The Center for Investigative Reporting released its investigation into the 17 million pounds of marijuana seized between 2005 and 2011 by US Customs and Border Protection.

To visualize how much pot that actually is, they created this throwback video, riffing on the All Your Bass Are Belong to Us meme popularized around the turn of the century.

So how much pot is 17 million pounds? A lot of pot.

Say, the equivalent of 16.3 billion joints or “a 583-foot-tall 3-D flying joint”. Here’s the math:

For our calculations, we assumed the joint was made using a classic Zig-Zag 70-millimeter rolling paper.

Single joint dimensions (rolled): 7 centimeters long with a radius of 0.477 centimeters (circumference of 3 centimeters)

Volume of single joint: 5 cubic centimeters

()

Volume of giant joint: 16,274,535,552 joints * 5 cubic centimeters = 81,372,677,760 cubic centimeters

We want our giant joint to have nearly the same proportions as our standard joint, so we want a radius-to-length ratio of 0.477 / 7, or 0.068. So we solve for:

(This is too hard for us to remember how to do from high school algebra, so thanks to Truman State University math professor Jason Shaw for helping us out with this one.)

We end up with a joint 17,759.755 centimeters long with a radius of 1,207.663 centimeters (583 feet long with a 40-foot radius).

FJP: Math, journalism and pot. Your Saturday may now begin.