WhizBang revisited

[Feynman]

I recently had some OPTIONS requests for the index.htm file on our site from Whizbang (see [webmasterworld.com...] for more on whizbang)

Is there any reason why any spider should be doing an OPTIONS request on files on a site?

[grnidone]

Welcome Fenyman,

Usually we are quicker to respond than this. Can you describe what is happening?

I'll try to find someone to help you as this is *not* my area of expertise.

[Air]

It would do this to see if the site is coded in XML, do you have XML code on your site?

[wilderness]

[whizbanglabs.com...]

[Feynman]

Haven't had a similar occurance since that one day. Whizbang has done some more standard spidering of the site I am involved with (I sit on a committee overseeing my Town's official Site).

As for the XML, there is none, unless you count those ever annoying HTML files that got exported from word. We have man with the last name of Christy in our town, and this is how it does his name.

<st1:PersonName><span style='font-size:11.0pt;mso-bidi-font-size:10.0pt'>Chris</span></st1:PersonName><span
style='font-size:11.0pt;mso-bidi-font-size:10.0pt'>ty. </span>

Gotta love MS

[skirril]

pixnat08.whizbang.com - - [18/Mar/2002:07:49:22 +0100] "GET /robots.txt HTTP/1.1ler)"

The thing seems to obey robots.txt, but ewhat is it after?

Skirril

[wilderness]

anything it can use which you allow it to take ;-)http://www.whizbanglabs.com/about/

[wilderness]

These folks have a new IP
Netblock: 208.1.109.0 - 208.1.109.255