homepage Welcome to WebmasterWorld Guest from 54.227.40.166
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Visit PubCon.com
Home / Forums Index / Local / WebmasterWorld Community Center
Forum Library, Charter, Moderators: lawman

WebmasterWorld Community Center Forum

    
SearchEngineWorld SimSpider doesn't pick up site content
and not sure specifically why........
skibum




msg:517550
 12:02 am on Mar 7, 2002 (gmt 0)

The site is built in .cfm, it's got some kind of database behind it. It's got enough code before the content to give Windows a run for the money, which I suspect is the reason.

Does the SearchEngineWorld SimSpider put a limit on the amount of code it will go through when spidering a page, or is this more likely to be some other kind of SE unfriendly design? No question marks or other troublesome characters in the URLs.

 

Marcia




msg:517551
 1:04 am on Mar 7, 2002 (gmt 0)

Moved this here for you skibum, since it's Brett's handiwork and we want to make sure he catches your question.

Brett_Tabke




msg:517552
 11:31 am on Mar 8, 2002 (gmt 0)

Yes, there is a limit Ski. Has to be to stop dos attacks. I believe it is at 128k.

I'd take a quick look if you want...stickymail.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Local / WebmasterWorld Community Center
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved