Welcome to WebmasterWorld Guest from 54.198.147.221

Forum Moderators: incrediBILL

Message Too Old, No Replies

Description cannot be spidered. Help!!

     
5:42 pm on Sep 4, 2001 (gmt 0)

Junior Member

10+ Year Member

joined:Nov 6, 1999
posts:194
votes: 0


Hi,

I have been using Bretts Sim Spider to check out a friends site. It spiders everything except the description. Any suggestions would be very much appreciated as to why it ignores the description. The site is

[cigarettes-club.com...]

Thanks in advance.

5:44 pm on Sept 4, 2001 (gmt 0)

Administrator from US 

WebmasterWorld Administrator brett_tabke is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Sept 21, 1999
posts:38070
votes: 16


Hmmm. Must be choking on the cigarettes? lol

I'll look at it - it should be getting it from outward appearances.

6:14 pm on Sept 4, 2001 (gmt 0)

Administrator from US 

WebmasterWorld Administrator brett_tabke is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Sept 21, 1999
posts:38070
votes: 16


Updated. There is something about that many script sections on the page and trying to strip it down.
6:36 pm on Sept 4, 2001 (gmt 0)

Junior Member

10+ Year Member

joined:Nov 6, 1999
posts:194
votes: 0


I dont quite get what you mean Brett.

The site was in PHP and I was concerned about it getting spidered and listed properly so I suggested to my friend that maybe PHP isnt the best. His webmaster made some changes and changed the pages to html. I am not sure the extent of the changes.

7:19 pm on Sept 4, 2001 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Apr 3, 2001
posts:1609
votes: 0


OT a bit here, but you might want to kill the tiny tiny text, on a mac you can't read a thing. I believe the illegible threshold for mac users is 8 point.
10:10 pm on Sept 4, 2001 (gmt 0)

Junior Member

10+ Year Member

joined:Nov 6, 1999
posts:194
votes: 0


Hi Brett,

Where you talking about the following code?

<form name=MainForm onsubmit="return CheckData();"
action="sendinfo.php" method=post>
<SCRIPT language=JavaScript type=text/javascript><!-- //Hide >
<!-- document.title.value="CIGARETTES-CLUB.COM - OnLine Store - Main Page" -->
function setHome(o) {
o.style.behavior='url(#default#homepage)';
o.setHomePage('http://www.cigarettes-club.com')
}

5:12 pm on Sept 5, 2001 (gmt 0)

Junior Member

10+ Year Member

joined:Nov 6, 1999
posts:194
votes: 0


Hi Folks,

I thought I would give it one last try to get an answer before this message falls into the abyss.

If anyone has any idea why Bretts Sim Spider cannot spider the description please let me know. A solution would be even better but any information would be helpful. Thanks.

5:39 pm on Sept 5, 2001 (gmt 0)

Administrator from US 

WebmasterWorld Administrator brett_tabke is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Sept 21, 1999
posts:38070
votes: 16


It was more-than-likely my fault is what I was saying there CyberBear. There was something about the interaction between the duplicate script sections that was causing my util to grab more of the head section than it was suppose to. It's one of those "I fixed it, but I'm not sure what I did to fix it" things.
8:19 pm on Sept 5, 2001 (gmt 0)

Junior Member

10+ Year Member

joined:Nov 6, 1999
posts:194
votes: 0


Thanks Brett,

I thought it was a problem on the web site and I was beating my head trying to figure it out. So glad to see that spiders shouldnt have a problem with these pages.

It's one of those "I fixed it, but I'm not sure what I did to fix it" things.

I do a lot of that, make things work without knowing the whole story. It works for me.

 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members