Globalspec

engineering search engine

[volatilegx]

# Globalspec
# UA "Ocelli/1.1 (http://www.globalspec.com)"
66.194.55.242

[PCInk]

They take too many pages, too quickly, and do not obey robots.txt.

[volatilegx]

Maybe somebody should remind them how important conventions and standards are to engineers (such as robots.txt convention). :-)

[Wizcrafts]

I was visited by the same spider yesterday. It read Robots.txt, began indexing my site, then proceeded to GET three files Disallowed in Robots.txt. When it went for the fourth Disallowed file, it GOT my Bot Trap, and has banned itself from my website.

I have sent a problem report to the company that owns the Bot. They apparently distribute an Engineering Resources Toolbar.

The funny thing is that I had the same problem with the MSNBot, when it was first released this year. I sent a couple of problem reports to the MSN Dude in charge, and they fixed the Bot. Maybe Globalspec will fix their Ocelli/1.1 Bot. If not, it will remained banned from my website (I told them so).

Wiz

[Wizcrafts]

I have just been contacted by the Chief Technology Officer at Globalspec Inc, and they are working to fix the problems with their search bot, Ocelli. Here is a quote from his email to me (name not posted):

(snip)

I don't believe that this is a bad bot, but a good bot with a programming issue, soon to be resolved. I recall a similar problem with the new MSN search bot, with a similar result after I contacted them.

And the Bot goes on (to the tune of The Beat Goes On).

Wiz

[edited by: volatilegx at 1:10 pm (utc) on Oct. 21, 2004]
[edit reason] Email excerpts not allowed. See T.O.S. [/edit]