homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Visit PubCon.com
Home / Forums Index / Code, Content, and Presentation / HTML
Forum Library, Charter, Moderators: incrediBILL

HTML Forum

Description cannot be spidered. Help!!

 5:42 pm on Sep 4, 2001 (gmt 0)


I have been using Bretts Sim Spider to check out a friends site. It spiders everything except the description. Any suggestions would be very much appreciated as to why it ignores the description. The site is


Thanks in advance.



 5:44 pm on Sep 4, 2001 (gmt 0)

Hmmm. Must be choking on the cigarettes? lol

I'll look at it - it should be getting it from outward appearances.


 6:14 pm on Sep 4, 2001 (gmt 0)

Updated. There is something about that many script sections on the page and trying to strip it down.


 6:36 pm on Sep 4, 2001 (gmt 0)

I dont quite get what you mean Brett.

The site was in PHP and I was concerned about it getting spidered and listed properly so I suggested to my friend that maybe PHP isnt the best. His webmaster made some changes and changed the pages to html. I am not sure the extent of the changes.


 7:19 pm on Sep 4, 2001 (gmt 0)

OT a bit here, but you might want to kill the tiny tiny text, on a mac you can't read a thing. I believe the illegible threshold for mac users is 8 point.


 10:10 pm on Sep 4, 2001 (gmt 0)

Hi Brett,

Where you talking about the following code?

<form name=MainForm onsubmit="return CheckData();"
action="sendinfo.php" method=post>
<SCRIPT language=JavaScript type=text/javascript><!-- //Hide >
<!-- document.title.value="CIGARETTES-CLUB.COM - OnLine Store - Main Page" -->
function setHome(o) {


 5:12 pm on Sep 5, 2001 (gmt 0)

Hi Folks,

I thought I would give it one last try to get an answer before this message falls into the abyss.

If anyone has any idea why Bretts Sim Spider cannot spider the description please let me know. A solution would be even better but any information would be helpful. Thanks.


 5:39 pm on Sep 5, 2001 (gmt 0)

It was more-than-likely my fault is what I was saying there CyberBear. There was something about the interaction between the duplicate script sections that was causing my util to grab more of the head section than it was suppose to. It's one of those "I fixed it, but I'm not sure what I did to fix it" things.


 8:19 pm on Sep 5, 2001 (gmt 0)

Thanks Brett,

I thought it was a problem on the web site and I was beating my head trying to figure it out. So glad to see that spiders shouldnt have a problem with these pages.

It's one of those "I fixed it, but I'm not sure what I did to fix it" things.

I do a lot of that, make things work without knowing the whole story. It works for me.

Global Options:
 top home search open messages active posts  

Home / Forums Index / Code, Content, and Presentation / HTML
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved