Welcome to WebmasterWorld Guest from

Forum Moderators: Ocean10000 & incrediBILL

Message Too Old, No Replies

New Excite Bot?


8:52 am on Apr 9, 2001 (gmt 0)

10+ Year Member


Grabbed 3 pages. Did not get robots.txt

2:16 pm on Apr 9, 2001 (gmt 0)

10+ Year Member

Not new they've been doing the lib thing for quite a while, I have them coming out of all over but they've been running them for a while .
5:02 pm on Apr 9, 2001 (gmt 0)

10+ Year Member

Thanks for the info tcmalaska, first time I have seen Excite use the lib ua. I know that they use ArchitextSpider so I thought they might be testing a new one and did not give it a real ua yet. But the real thing that caught my eye was the storm part. I took a look at SEW's page on the Excite spider [searchengineworld.com] and did not see storm listed. I looked up the IP address and it is

Featured Threads

Hot Threads This Week

Hot Threads This Month