homepage Welcome to WebmasterWorld Guest from 23.22.217.122
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
AWS look out.
Not a spider report, a warning of increased activity!
tangor




msg:4408454
 6:26 am on Jan 19, 2012 (gmt 0)

AWS is also eating its own dog food: itís already using DynamoDB for its e-commerce platform and on sites like IMDB, SmugMug, and Elsevier. A software development kit has also been published, and the company is keen for developers to get cracking on the service.

Thereís currently 100MB of free storage, with five writes/second and 10 reads/second (up to 40 million per month), so people can try out the basics. The base costs for the data storage is a dollar per gigabyte per month, although Amazon warns that itíll be adding 100 bytes per item for indexing. Transmission costs are on a sliding scale of five to 12 cents per gigabyte for data coming out of the system, with incoming data free to receive, and full location control.

[theregister.co.uk...]
These steps to speedup/beef-up AWS services with NoSQL and SSD drives might produce a new level of spider/crawler/bot activity. At those dollar values, might even be worth it. :(

 

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved