What does this UA mean? Maybe a kind of freshbot to check only first pages if still available? Have anyone else seen this hitting your site?
heini
9:32 am on Mar 14, 2003 (gmt 0)
FirstPage has been an attempt at branding Fast's ranking method, similar to PageRank, TM. Fast has, to my knowledge given up on that long ago. There have however always been crawlers with FirstPage in the UA string.
MarieC
11:40 pm on Mar 14, 2003 (gmt 0)
That same one hit my site once Thursday evening, saw that it was disallowed, and left.
heini
11:48 pm on Mar 14, 2003 (gmt 0)
>dissallowed Erm, why would you not allow Fast to crawl your site?
