Forum Moderators: open
Mozilla/4.0 (compatible; MSIE 5.0; www.galaxy.com; MY.DOMAIN.com; +http://www.galaxy.com/info/crawler.html)"
Yes, I edited that.... but a UA personalized with MY DOMAIN NAME in it?
Should be noted this site has 3 domain names pointing to it... and thre visits with three different UA names, all from the same UA (63.121.41.179)
dave
Mozilla/4.0 (compatible; MSIE 5.0; www.galaxy.com; www.example.com; +http://www.galaxy.com/info/crawler.html)
Mozilla/4.0 (compatible; MSIE 5.0; www.galaxy.com; www.example.com)
Yes, I mean IP... sorry.
Galaxy is a search engine. I visited, and saw their robots page... they seemed legit, so no ban or anything for them. I justr thought it was weird they have a DYNAMIC spider that put the URL of the site being spidered in as it spidered. Probably good for error checking...
I checked the logs, seemed polite, not oo fast, well behaved, stayed where it was supposed to!
dave