menu

Creating The Next Google Just Became More Affordable

Creating The Next Google Just Became More Affordable
technology

The Common Crawl Foundation has made 5 billion indexed web pages readily available for free.

Yi Chen
  • 16 november 2011


The Common Crawl Foundation has indexed 5 billion web pages and has made the data readily available to anyone for free on the Amazon EC2/S3 cloud computing infrastructure. What this essentially means is that tech innovators looking to challenge Google and create the next best search engine can do so more easily, quicker and cheaper.

To access the information, users will need to setup their own Amazon EC2 Hadoop cluster and pay for the time they use it. There are no upfront costs to use the Amazon EC2 Hadoop and it charges cost per instance hour.

Common Crawl Foundation

+#technology
+amazon
+cloud computing
+Google
+Science
+search engine
+technology
+web
+Work & Business
Trending

Wearable Serves As A Digital Guide For People With Visual Impairments

Baby Boomers
NEW TREND REPORT


RETAIL SNAPSHOT IN LA

A neighborhood-by-neighborhood guide to the city's retail experiments.

DOWNLOAD TODAY

PSFK EVENTS


PSFK 2017 Conference

Ranked #1 of the Most Innovative Conferences of 2016 by Inc. Magazine


BUY YOUR TICKETS, MAY 19

Financial Services Yesterday
Arts & Culture Yesterday
No search results found.