Forum Moderators: DixonJones

Message Too Old, No Replies

TSW Bot 1.0.1

Another new one...w/o robots.txt

         

pendanticist

3:26 pm on Apr 27, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Just thought I'd give a heads-up that this critter doesn't ask for robots.txt.

64.169.118.134

Pendanticist.

GaryK

3:58 pm on Apr 27, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Judging from the rDNS, adsl-64-169-118-134.dsl.lsan03.pacbell.net, my guess is it's some kid whose initials are TSW and he just made his first bot plus one tweak.

The only Google reference I could find for it led me to ripe.net's logfiles.

I know the bot didn't read robots.txt and in my book that's enough to get it banned, but how abusive was it in terms of its "Hoover" effect?

Thanks for the heads up.

pendanticist

12:05 am on Apr 28, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



...how abusive was it in terms of its "Hoover" effect?

Not too bad actually. First dozen or so requests were a few seconds apart, which it held throughout the visit.

I should add that it only went thru the letter A and stopped.

You may be right about the juvie-ness of it. I'll see if he comes back later in the week as I've noticed some of these do.

Pendanticist.