Welcome to WebmasterWorld Guest from

Forum Moderators: Ocean10000 & incrediBILL

Message Too Old, No Replies

New Excite Bot?




8:52 am on Apr 9, 2001 (gmt 0)

10+ Year Member


Grabbed 3 pages. Did not get robots.txt


2:16 pm on Apr 9, 2001 (gmt 0)

Not new they've been doing the lib thing for quite a while, I have them coming out of all over but they've been running them for a while .


5:02 pm on Apr 9, 2001 (gmt 0)

10+ Year Member

Thanks for the info tcmalaska, first time I have seen Excite use the lib ua. I know that they use ArchitextSpider so I thought they might be testing a new one and did not give it a real ua yet. But the real thing that caught my eye was the storm part. I took a look at SEW's page on the Excite spider [searchengineworld.com] and did not see storm listed. I looked up the IP address and it is

Featured Threads

Hot Threads This Week

Hot Threads This Month