Bluestreak - 2:26 am on Feb 8, 2003 (gmt 0)

The one downside I've seen to using dynamically driven content on my site (powered by PHP) is that search engines like FAST and Inktomi adamantly refuse to deep crawl my site. They basically skim off the top and then leave. Wimps. :D

Google has almost since the beginning always deep crawled my PHP pages without so much as a ho hum, and recently I noticed that Teoma/Ask.com has suddenly started deep crawling my site quite unexpectantly. I don't think it's a time issue, since my site has been online for over a year. That's why I question the concept of FAST being an engine that could overtake Google, since they are apparently incapable of deep crawling anything other than static content. Am I wrong?