homepage Welcome to WebmasterWorld Guest from 50.19.172.0
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Local / WebmasterWorld Community Center
Forum Library, Charter, Moderators: lawman

WebmasterWorld Community Center Forum

    
SearchEngineWorld SimSpider doesn't pick up site content
and not sure specifically why........
skibum

WebmasterWorld Administrator skibum us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 460 posted 12:02 am on Mar 7, 2002 (gmt 0)

The site is built in .cfm, it's got some kind of database behind it. It's got enough code before the content to give Windows a run for the money, which I suspect is the reason.

Does the SearchEngineWorld SimSpider put a limit on the amount of code it will go through when spidering a page, or is this more likely to be some other kind of SE unfriendly design? No question marks or other troublesome characters in the URLs.

 

Marcia

WebmasterWorld Senior Member marcia us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 460 posted 1:04 am on Mar 7, 2002 (gmt 0)

Moved this here for you skibum, since it's Brett's handiwork and we want to make sure he catches your question.

Brett_Tabke

WebmasterWorld Administrator brett_tabke us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 460 posted 11:31 am on Mar 8, 2002 (gmt 0)

Yes, there is a limit Ski. Has to be to stop dos attacks. I believe it is at 128k.

I'd take a quick look if you want...stickymail.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Local / WebmasterWorld Community Center
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved