Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- Undefined Error in Logs


MxAngel - 3:58 am on Aug 2, 2012 (gmt 0)


Lucy,

But what I really meant to ask was: In the original post, what exactly does "MY SITE URL" in the Referer represent? Is it the exact content of the Request, minus only the "/undefined" element, or is it always www.example.com/ (bare domain) regardless of request?


On my site I get them in two different ways ...

GET /example_category/undefined
Referer: http://www.example.com/example_category/article.html

or

GET /undefined
Referer: http://www.example.com/


Thread source:: http://www.webmasterworld.com/search_engine_spiders/4480179.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com