Welcome to WebmasterWorld Guest from 54.166.102.61

Forum Moderators: lawman

SearchEngineWorld SimSpider doesn't pick up site content

and not sure specifically why........

   
12:02 am on Mar 7, 2002 (gmt 0)

WebmasterWorld Administrator skibum is a WebmasterWorld Top Contributor of All Time 10+ Year Member



The site is built in .cfm, it's got some kind of database behind it. It's got enough code before the content to give Windows a run for the money, which I suspect is the reason.

Does the SearchEngineWorld SimSpider put a limit on the amount of code it will go through when spidering a page, or is this more likely to be some other kind of SE unfriendly design? No question marks or other troublesome characters in the URLs.

1:04 am on Mar 7, 2002 (gmt 0)

WebmasterWorld Senior Member marcia is a WebmasterWorld Top Contributor of All Time 10+ Year Member



Moved this here for you skibum, since it's Brett's handiwork and we want to make sure he catches your question.
11:31 am on Mar 8, 2002 (gmt 0)

WebmasterWorld Administrator brett_tabke is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



Yes, there is a limit Ski. Has to be to stop dos attacks. I believe it is at 128k.

I'd take a quick look if you want...stickymail.

 

Featured Threads

Hot Threads This Week

Hot Threads This Month