Welcome to WebmasterWorld Guest from 18.104.22.168
Forum Moderators: open
Here are the stats:
UA - FAST-WebCrawler/3.6 (atw-crawler at fast dot no; [fast.no...]
IP - 22.214.171.124
Number of requests for the same page
February 7, 2003 559
February 8, 2003 771
February 9, 2003 699
February 10, 2003 386
(there are still about 7 hrs left today - PST)
Has anyone seen this before?
How is FAST about feedback?
I've been a little hesitant about contacting them as they have been very good to me. Wouldn't want to change any of that - most of my content is targeted at Canadians.
Thanks for any insight.
joined:Oct 23, 2000
Hmm, that's certainly strange crawler behaviour and I have no idea why the crawler would hit the same page over and over again.
FASTs crawler usually behaves like a good boy (girl?) and imo their feedback is really good. I wouldn't hesitate to contact them on this matter.
Good luck and let us know if you get it solved.
Big_Dug: Can you explain little more what you mean by session IDs spider traps?
BTW - The crawler quit requesting that page about 1/2 a day after posting the topic.
FAST feedback was excellent, next time I won't hesitate emailing them right away.