Researchers Predict Future Epidemics Using Old Newspapers

Researchers Predict Future Epidemics Using Old Newspapers

Scientists have created software that analyzes past events in order to predict future health threats and events.

Ryan Gerhardt
  • 5 february 2013

There’s an old axiom asserting that history repeats itself, and those who fail to learn from it are bound to make the same mistakes. With computers and data processing programs, it’s becoming easier to see the patterns in the cycles of history – now it’s time to learn from them.

Which is exactly what Eric Horvitz and Kira Radinsky are attempting to do.

Horvitz, a researcher from Microsoft, and Radinsky, a researcher at the Technion-Israel Institute of Technology, have developed software that helps analyze past events and health related headlines so as to forecast future real-world events. The systems works by:

identifying significant increases in the likelihood of disease outbreaks, deaths, and riots in advance of the occurrence of these events in the world.

The published paper ‘Mining the Web to Predict Future Events’ relays their findings, and offers a platform on which to build a more practical program. The software developed by Horvitz and Radinsky analyzes, qualifies, and even contextualizes online archival data that mentions natural events (like droughts), deaths, and health related epidemics. The analytical and ‘learning’ ability of the software

builds predictive models that generalize from specific sets of sequences of events to provide likelihoods of future outcomes, based on patterns of evidence observed in near-term newsfeeds.

The software is able to leverage articles, headlines, and data from over 90 sources spanning from the 1980s to the early 2000s, including The New York Times, Wikipedia, FreeBase, and WordNet.




Predictive software of this nature could potentially allow for more proactive alerting systems, which could lead to a greater preparedness and even reduction in disease outbreaks, deaths, and related riots worldwide. One of the examples highlighted in the paper is a drought in Angola in 2006 that precipitated an outbreak of cholera in 2007, which the software successfully predicted would happen based on the analyzed patterns. Amazingly, the precision of the forecasts for natural events/disease outbreaks, deaths, and riots was in the range of ‘70% to 90%’ accurate.



While researchers do much of the current analysis on health trends manually, a clear advantage of the software is highlighted in the conclusion of the research paper:

Beyond knowledge that is easily discovered in studies or available from experts, new relationships and context-sensitive probabilities of outcomes can be discovered with such automated analyses. Systems employing the methods would have fast and comprehensive access to news stories, including stories that might seem insignificant but that can provide valuable evidence about the evolution of larger, more important stories.

Businesses have been practicing forecasting for years. Futures markets, stocks, and futurists are rooted in the idea of predicting coming trends based on historical data, so it’s no wonder that the same approach can be applied to natural and human related events, which tend to be similarly cyclical. One startup, Recorded Future, has already received funding from Google and the CIA and works to

constantly collect news, blogs, and public social media…[to] identify the events: past, present, and future…[and] help you find predictive signals in the noise of the web.

Twenty-two years of data to analyze is a relatively small sample set, which is why Horvitz aims to gather and analyze more data that digs further into the past. The foundation of the software laid out in the ‘Mining’ research paper could prove especially useful in underdeveloped countries that are held under the constant sway of recurring natural events.

Mining the Web to Predict Future Events

Recorded Future

Images via ‘Mining the Web’ and Flickr


How Indiegogo Is Becoming An Adult Product Destination

Work Today

Editorial Roundtable: The Arrival Of The People-First Workplace

Managed By Q, Soma, Workbar, Primary, AltSchool and thinkPARALLAX enumerate the reasons why companies need an employee-embracing workforce in order to exist

Food Today

Bringing Food Innovation To America’s Crowded Milk Market

a2 Milk's Blake Winthrop, Chief Executive of the USA region, discusses how the distributor plans on bringing the popular drink for the dairy-sensitive to the States


Get PSFK's Related Report: Future of Automotive

See All
Financial Services Today

Device Makes Digital Currency Feel Tangible

The concept gadget wants you to experience the highs and lows of spending money

Advertising Today

Lyft Gives Free Rides To Those Who Have Had Too Much To Drink

Thanks to a new partnership between the ride sharing service and Budweiser, drunk passengers are able to receive free rides

Related Expert

Greg Hong

Mobile Payments

Design & Architecture Today

Why Building Better Offices Is The Key To Employee Engagement

Interaction Designer and Audio-visual Technologist at ESI Design illustrates the value in creating environments filled with surprise and delight

Augmented / Virtual Reality Today

NBC Is Planning To Stream The Presidential Debates In Virtual Reality

Partnering with AltspaceVR, the broadcaster offers another way for Americans to engage with the election season

Travel Today

What Happens When An Entire Airport Terminal Rebrands Itself?

JFK's Terminal 4 underwent a dramatic design facelift to guide and delight travelers


Future Of Automotive
Scenarios Driving The Digital Transformation Of An Industry

PSFK Op-Ed september 21, 2016

Creative Agency Founder: Using VR As A Race Relationship Tool

Maurice Bernstein, CEO and Founder of Giant Step, explores the value in transforming headsets from high-tech entertainment tools into empathy machines

PSFK Labs september 22, 2016

The Future Of Work: Why Innovation Is Every Employee’s Job

PSFK Labs sits down with management at Johnson & Johnson to learn how the company comes up with their next ‘big idea’

Home september 23, 2016

Watch This Fire Pit Dance Along To Your Favorite Song

Music City Fire is a system that is designed to flicker in time to ambient music

Automotive september 23, 2016

Slick GPS Navigator Gives Directions To Moped Riders

This small, round device attaches to a sideview mirror to display maps for safer traveling

Home september 23, 2016

A Clock That Beautifully Manages Your Information Overload

The wall-mounted timekeeper is made to help people maintain focus and stay up to date with their appointments

Arts & Culture september 23, 2016

Performance Piece Blends Dancers Into Folds Of Light

The work provides commentary on the increasing connection between programmed and analog dimensions

Design & Architecture september 23, 2016

Design Firm Adapts Childhood Homes For Unemployed Young Adults

The studio has unveiled three prototypes of transformed living spaces for people forced to move back in with their families


Future Of Work
Cultivating The Next Generation Of Leaders

Health september 23, 2016

These Chocolate Squares Claim To Reverse The Aging Process

A group of researchers from Cambridge University have developed a candy bar that promises to give you a youthful glow

Cities september 23, 2016

Food-Producing Architecture Competition Seeks To Better Feed Cities

A design challenge in Copenhagen highlights the need and beauty of urban farming

Health september 23, 2016

Wearable Monitors Sun Exposure To Prevent Sunburn

The clip monitors UV rays to make sure you're not receiving too much sunlight

No search results found.