AtlocalBot/1.1 - Crawler, Spider, and User Agent ID forum at WebmasterWorld - WebmasterWorld

Forum Moderators: open

Message Too Old, No Replies

AtlocalBot/1.1

well behaved, but hungry

Edouard_H

4:56 am on Mar 21, 2005 (gmt 0)

10+ Year Member

216.55.159.189 - AtlocalBot/1.1 +(http://www.atlocal.com/local-web-site-owner.html)

Checked and observed robots.txt, but took alot of files in short order...

volatilegx

2:29 pm on Mar 21, 2005 (gmt 0)

WebmasterWorld Senior Member

10+ Year Member

Good catch; thanks.