Researchers Predict Future Epidemics Using Old Newspapers

Researchers Predict Future Epidemics Using Old Newspapers

Scientists have created software that analyzes past events in order to predict future health threats and events.

Ryan Gerhardt
  • 5 february 2013

There’s an old axiom asserting that history repeats itself, and those who fail to learn from it are bound to make the same mistakes. With computers and data processing programs, it’s becoming easier to see the patterns in the cycles of history – now it’s time to learn from them.

Which is exactly what Eric Horvitz and Kira Radinsky are attempting to do.

Horvitz, a researcher from Microsoft, and Radinsky, a researcher at the Technion-Israel Institute of Technology, have developed software that helps analyze past events and health related headlines so as to forecast future real-world events. The systems works by:

identifying significant increases in the likelihood of disease outbreaks, deaths, and riots in advance of the occurrence of these events in the world.

The published paper ‘Mining the Web to Predict Future Events’ relays their findings, and offers a platform on which to build a more practical program. The software developed by Horvitz and Radinsky analyzes, qualifies, and even contextualizes online archival data that mentions natural events (like droughts), deaths, and health related epidemics. The analytical and ‘learning’ ability of the software

builds predictive models that generalize from specific sets of sequences of events to provide likelihoods of future outcomes, based on patterns of evidence observed in near-term newsfeeds.

The software is able to leverage articles, headlines, and data from over 90 sources spanning from the 1980s to the early 2000s, including The New York Times, Wikipedia, FreeBase, and WordNet.




Predictive software of this nature could potentially allow for more proactive alerting systems, which could lead to a greater preparedness and even reduction in disease outbreaks, deaths, and related riots worldwide. One of the examples highlighted in the paper is a drought in Angola in 2006 that precipitated an outbreak of cholera in 2007, which the software successfully predicted would happen based on the analyzed patterns. Amazingly, the precision of the forecasts for natural events/disease outbreaks, deaths, and riots was in the range of ‘70% to 90%’ accurate.



While researchers do much of the current analysis on health trends manually, a clear advantage of the software is highlighted in the conclusion of the research paper:

Beyond knowledge that is easily discovered in studies or available from experts, new relationships and context-sensitive probabilities of outcomes can be discovered with such automated analyses. Systems employing the methods would have fast and comprehensive access to news stories, including stories that might seem insignificant but that can provide valuable evidence about the evolution of larger, more important stories.

Businesses have been practicing forecasting for years. Futures markets, stocks, and futurists are rooted in the idea of predicting coming trends based on historical data, so it’s no wonder that the same approach can be applied to natural and human related events, which tend to be similarly cyclical. One startup, Recorded Future, has already received funding from Google and the CIA and works to

constantly collect news, blogs, and public social media…[to] identify the events: past, present, and future…[and] help you find predictive signals in the noise of the web.

Twenty-two years of data to analyze is a relatively small sample set, which is why Horvitz aims to gather and analyze more data that digs further into the past. The foundation of the software laid out in the ‘Mining’ research paper could prove especially useful in underdeveloped countries that are held under the constant sway of recurring natural events.

Mining the Web to Predict Future Events

Recorded Future

Images via ‘Mining the Web’ and Flickr


IKEA Is Letting Kids Design Its New Line Of Toys

Food Today

Chef Turns Invasive Species Into Delicious Sushi

Creator Bun Lai is adapting strange new ingredients for his menu, which responds to the ecological impact of overabundant creatures in the local environment

Travel Today

Build Your Own Subway System In This Minimalist Game

Mini Metro lets you design your own fully functional transit network, simulating the flow of urban commuters with pared-down visuals


Get PSFK's Related Report: Sports Debrief

See All
Work Today

Keyboard Designed To Help Women Use More Assertive Language

The device is a commentary on gender roles in the workplace, and features easy access to "power verbs" that help reinforce a habit of being direct in writing

Arts & Culture Today

Spanish Artist Dreams Up What Animals Would Look Like In Modern Clothing

Yago Partal's portraits depict the fantasized style preferences of creatures worldwide, from an Arctic wolf to a zebra

Fitness & Sport Today

New Data Technologies Make Hyper-Personalized Training A Reality

The Sports Debrief from PSFK Labs looks at how analytics tools are being developed to optimize human performance across all industries

Technology Today

IBM Watson Helps Grammy-Winning Producer Craft An EP

The computer system's data technology generated musical scores for Alex Da Kid's first solo project

Retail Today

Why The Apple Watch Is Taking Foot In The Restaurant Industry

An app for the wrist-mounted device is looking to revolutionize customer service for staff


Future Of Automotive
Scenarios Driving The Digital Transformation Of An Industry

PSFK Op-Ed october 26, 2016

Creative Leadership Expert: Experiencing A Seismic Shift From Brand Loyalty To Interface Loyalty

Marc Shillum, founder of Chief Creative Office, explains why product designers must rethink the way they capture consumer attention

PSFK Labs october 25, 2016

The Keys For Exceptional Performance On And Off The Field

PSFK Labs' new report highlights five important insights for businesses to perform better than the competition

Travel Yesterday

30-Year-Old Photographs Used As Travel Guides

A new photo series revolves around tracing the origins of images from the past

Technology Yesterday

Album Turns Into Something New Each Time It’s Streamed

Bill Baird's new album explores the relationship between time and music through a website crafted by design team, One Pixel Wide

Health Yesterday

VR App Prescribed For Pain Relief

A pharmacy chain in Sweden is stepping away from tradition to develop a happy place for the pain-afflicted

Financial Services Yesterday

Banks Are Coming Together To Create A New Payment Network That Rivals Venmo

A number of financial institutions are collaborating to make a new person-to-person monetary system called Zelle for their customers

Media & Publishing Yesterday

Pocket Camera Aims To Facilitate The Struggles Of Live Streams

The Mevo helps resolve the complexities of streaming video with an intuitive setup and smart editing controls

Health Yesterday

Startup Believes Traceability Will Help Disrupt The Multivitamin Industry

Ritual is a daily supplement for women that traces every ingredient back to its source

Arts & Culture Yesterday

Photo Series Brutally Murders Some Of Your Favorite Fast Food

The portraits by artist duo Ilka & Franz do away with mealtime regulars in a way that is both beautiful and humorous

Mobile Yesterday

Coffeemaker Teaches You How To Make The Perfect Cup

The device comes with an accompanying app that guides novices and experts alike through the brewing process

No search results found.