Mozilla/5.0 (compatible; robtexbot/1.0; http://www.robtex.com/ )

Note space before close paren. Also: no robots.txt; uses site URL in ref

[Pfui]

crawler.robtex.com
Mozilla/5.0 (compatible; robtexbot/1.0; [robtex.com...] )
07/18 01:58:39 /

REFERER: [www...] .robtex.com/host/www .yoursitehere.com.html
(boo-hiss)

(I added a blank after each www .)

.
FYI from a Domain Tools domain-t-o-o-l-s-dot-com/robtex.com (handy for peeking:) --

"Multi RBL check and AS numbercheck"

(I don't know what that means but results from a Google check make the site look suspect.)

[edited by: volatilegx at 3:46 am (utc) on July 23, 2006]
[edit reason]
[1][edit reason] fixed some broken stuff [/edit] [/edit][/1]

[System]

The following message was cut out to new thread by volatilegx. New thread at: search_engine_spiders/3018958.htm [webmasterworld.com]
9:47 pm on July 22, 2006 (CDT -6)

[GaryK]

Hmm, whois Annie? ;)

[Pfui]

(Someone who is having a heckuva time avoiding BBS bombs today, apparently;)

[volatilegx]

Wow this thread is so broken I may have to commit sepuku. Please forgive my heavy handed editing.

Dan

[Pfui]

Um...

The link provided by "System" --

[webmasterworld.com...]

-- that's intentionally unbroken so you can scroll along and see any errors of its way(s) because that routes to --

[webmasterworld.com...]

-- but it results in a pithy, unstyled:

Some times a 404 is just a 404...1:dv4
Go home... [webmasterworld.com]

-- even though there's a boatload of code therein.

Curiouser and curiouser!

Perhaps it's time to officially move this thread to the bit bucket and start anew?

: )

[edited by: Pfui at 9:04 am (utc) on July 23, 2006]

[incrediBILL]

This UA I've seen, but I'd swear she was making up about 10 of the others just posted ;)

[edited by: incrediBILL at 8:23 pm (utc) on July 23, 2006]

[Pfui]

Do try and keep up, dear:[smilestopper])

Heck, I didn't even include another handful of new sightings. Even the ubiquitous McCOLO is even more so, hiding --

psycheclone
http://www.webmasterworld.com/forum11/3269.htm
(see also P.P.S., below)

208.66.195.10 - - [11/Jul/2006:07:56:14 -0700] "GET /robots.txt HTTP/1.1" 403 815 "-" "psycheclone"

-- a.k.a. --

208.66.195.5
208.66.195.6
208.66.195.9
208.66.195.4

-- behind --

208.66.195.10 - - [20/Jul/2006:09:03:32 -0700] "GET /robots.txt HTTP/1.1" 403 815 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; .NET CLR 1.0.3705; .NET CLR 1.1.4322)"

-- still a.k.a. (and still 403-worthy in my book) --

208.66.195.8
208.66.195.3
208.66.195.11
208.66.195.7

-- and still hitting up to eight times a day.

(I need to get a free-standing firewall box that's Mac-programmable. I'd really love to place rules against hoards of robotic vermin.)

.
P.S./FWIW
McColo Corporation MCCOLO (NET-208-66-192-0-1)
208.66.192.0 - 208.66.195.255
Digital Infinity Ltd DIGITALINFINITY (NET-208-66-195-0-1)
208.66.195.0 - 208.66.195.15

.
P.P.S.
The psycheclone/McColo thread, lasted posted-to on June 30th, is already closed. I wish threads in this forum stayed open longer so we could simply append new observations over time rather than going through the post/hold/approve/post process all over again for the same subjects. (hint,hint?:[smilestopper])

Aw, shoot. Another belated tpyo-catch shows up as:

[1][[b]edited by[/b]: Pfui at 12:27 am (utc) on July 24, 2006][/1]

[volatilegx]

> I wish threads in this forum stayed open longer

Unfortunately I have no control over that... I'll see what I can do, though.

[GaryK]

Dan, while you're at it please see if you can get Brett to fix all the stuff he broke in the process of fixing all the previous stuff that was broken. LOL.