homepage Welcome to WebmasterWorld Guest from 54.237.54.83
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Yahoo / Deprecated - Altavista, Alltheweb.com
Forum Library, Charter, Moderator: open

Deprecated - Altavista, Alltheweb.com Forum

    
270 page site has .5 million results
session ID
jpavery




msg:222437
 3:57 pm on Mar 4, 2003 (gmt 0)

I just checked what FAST has indexed for my site - it shows .5 million results... but I only have 270 pages.

The site is served up from a DB - we use a sesion ID and IP in the URL (this is not a spam technique) - I assume this is the culprit for the high number of results.

Should I be worried?
Thank,s
JP

 

johnraphone




msg:222438
 7:45 am on Mar 5, 2003 (gmt 0)

yikes, thats a lotta bandwidth being eatten up. I don't think All The Web's duplicate filter is tuned in correctly because I have noticed duplicating results a few times before.

Rumbas




msg:222439
 10:09 pm on Mar 5, 2003 (gmt 0)

JP, I'd worry a bit. All things equal FAST will see your site with a lot of dupe content, which in the long run can't be good. Make sure you provide a site map etc. with links without session id's. That way the spider can crawl your site with out the id's and probably find the actual number of pages.

Dupe-like content can get you in trouble imo.

heini




msg:222440
 10:14 pm on Mar 5, 2003 (gmt 0)

JP, additionally you might consider sending them a message, going through ATW.
All in all there seem to be issues with their crawlers handling dynamic content.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Yahoo / Deprecated - Altavista, Alltheweb.com
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved