Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- SonicWALL Firewall Blocks Spiders


EliteWeb - 1:48 am on May 4, 2005 (gmt 0)


carguy84, what was great about this issue with the SonicWALL was that it was default settings of firewall protection listed with all the other known exploits to protect against in its thousands of definitions. When bringing the issue to SonicWALL they hadn't any clue of what the issue could have been because nobody ever reported anything like it and anything accessing robots.txt is a spybot. Sure you can go through the hundreds of thousands of items these devices protect against one by one but you would figure if its default its widely known and its a cert'd issue or whatnot. In the end the system admin did indeed figure it out but nothing was documented on it so id figure id share my fun horror story :)

Remember there's a lot of people who don't know about SEO at all so it hasn't become issues for majority of people out there unless they notice it.

Makes it so you can add another thought in besides thinking the whole host is blacklisted by google :D


Thread source:: http://www.webmasterworld.com/robots_txt/631.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com