Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- SonicWALL Firewall Blocks Spiders


carguy84 - 9:15 pm on May 4, 2005 (gmt 0)


OK, after talking to our SonicWALL guru, this ISN'T a service of all SonicWALLs, it's only a part of SonicWALLS with IPS(Intrusion Prevention Service) installed, which is an add-on service.

[sonicwall.com...]

Firewalls that do not have the service activated(it's a pay-for add-on) are not "blocking" spiders from accessing the robots.txt files. And it can be disabled, as noted above.

Chip-


Thread source:: http://www.webmasterworld.com/robots_txt/631.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com