Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- Fake user agent strings

g1smd - 6:21 am on Jun 15, 2012 (gmt 0)


By returning a 302 or 301 you're telling the bot to make a new request for a different URL. If the bot returns and requests that other URL that action more than doubles the work your server is doing.

Where do you redirect these bots to?

Thread source:: http://www.webmasterworld.com/search_engine_spiders/4462691.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com