270 page site has .5 million results

session ID

[jpavery]

I just checked what FAST has indexed for my site - it shows .5 million results... but I only have 270 pages.

The site is served up from a DB - we use a sesion ID and IP in the URL (this is not a spam technique) - I assume this is the culprit for the high number of results.

Should I be worried?
Thank,s
JP

[johnraphone]

yikes, thats a lotta bandwidth being eatten up. I don't think All The Web's duplicate filter is tuned in correctly because I have noticed duplicating results a few times before.

[Rumbas]

JP, I'd worry a bit. All things equal FAST will see your site with a lot of dupe content, which in the long run can't be good. Make sure you provide a site map etc. with links without session id's. That way the spider can crawl your site with out the id's and probably find the actual number of pages.

Dupe-like content can get you in trouble imo.

[heini]

JP, additionally you might consider sending them a message, going through ATW.
All in all there seem to be issues with their crawlers handling dynamic content.