Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- Fake user agent strings


grandma_genie - 9:22 pm on Jun 15, 2012 (gmt 0)


All my files are in a folder in the root directory. My index.php file is in one folder. It is pointing to a different index file in another folder. That is what is causing the 302 code. I think I need to add this piece of code:
header ('HTTP/1.1 301 Moved Permanently');
I just haven't done it yet.

As for the Ruby UA, whenever anyone comes on the site with just one hit, I always check their IP. I've never seen the Ruby UA before. I assume it's a bot from Hetzner. Blocked it. Why wait for trouble?


Thread source:: http://www.webmasterworld.com/search_engine_spiders/4462691.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com