Page is a not externally linkable
- Search Engines
-- Ask - Teoma
---- Ask Teoma bot crawling again


bird - 6:59 am on Nov 25, 2010 (gmt 0)


Actually, amazonaws provides extremely useful services for a large number of purposes. They are quite unlikely to scrap that just because of a few disgruntled webmasters... ;)

That said, I'm probably going to block their ranges as well. If a legitimate and useful spider ever happens to operate from there, it's easy enough to make an exception.


Thread source:: http://www.webmasterworld.com/ask_jeeves_teoma/4234253.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com