Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- Synapse user-agent


bigtoga - 8:19 pm on Jan 16, 2013 (gmt 0)


"bigtoga - I have not seen that scenario. It is quite feasible for different operators to run different operations, though. Do you allow the UA to read your pages or do you return (eg) 403? "

I redirect them to a different place on my sites...


Thread source:: http://www.webmasterworld.com/search_engine_spiders/4532904.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com