What do you guys think?

[littleman]

208.186.202.21 fastlwspider/1.0. No host name lookup.

Plug that ip into a browser and you will find the generic apache "It Worked!" startup page. But the thing to notice is the powered by FreeBSD at the bottom - that is
what the fast db is run [fast.no] on.

Then go one ip up or down and you will enter two no name (www.ah-ha.com and eFamily.com) portals that are powered by fast.

[redzone]

Littleman:
You getting crawls from this IP/UA????
I haven't seen it hit my noreferer logs....

[littleman]

Yeah, but it only has hit one domain at the root and didn't go on a crawl. I found it in my server's noreferrer log - custom log I use for tracking spider patterns. Sounds like you are doing the same type of thing. At this point I don't think it is the genuine article. It acted like a frames compatible browser and made no request for the robot.txt.

Does anyone know about fast's licensed caching/proxy technology?

Perhaps this [fast.no] is what hit me?

"The spider, or automatic data collector, provides data for the indexing operation by scanning the Internet or intranets/extranets.... Data collection and indexing occur in parallel with searching."

Edited by: littleman

[Kamikaze]

I was also sniffed by this eFamily.com guy. And the UA came in as fastlwspider/1.0. Looks to me like some Joe Moe sniffin around.

[redzone]

Got "one" root URL crawled this morning.. One thing to note, eFamily.com's results are served by FAST, after their select sites?

Not much content other than the search function though.