Forum Moderators: open

Message Too Old, No Replies

Spider Simulator software

The simulator is not finding keywords in my page. What's wrong?

         

sunsetsands

9:24 pm on Nov 1, 2001 (gmt 0)



I am using the Spider Simulator softwware that is included as a search engine utility from this web site. The URL is: [searchengineworld.com...]

Atfer giving the program a URL, I never get any information in the "Spider Meta Keywords" section. Does anyone know what I am doing wrong?

I doesn't see to put anything in that section for a number of different URLs that I tried. However, the title and description sections work fine.

Thanks in advance for your help.

John Pluth

Air

2:46 am on Nov 2, 2001 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Welcome to wmw sunsetsands!

I just tried it and it worked fine for me, maybe the sites you are trying don't have keywords, or there is an error in the keywords meta tag (guessing ..)

Woz

3:06 am on Nov 2, 2001 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I am getting the same problem. The Spider Sim doesn't pick up the Description or Keywords, but the Keyword Density Analyser does.

Curious.

Onya
Woz

Will

10:50 am on Nov 2, 2001 (gmt 0)



One possible explanation is that the sites you are looking at have a script protecting their meta tags.

Any script able to detect the spider simulator would be able to hide them easily.

One indicator when this is being done can be a few lines of whitespace inside the head tag where the keywords/description would usually go. This can be caused by the server side script, but can obvsiouly also be done by inserting some carriage returns in the html :), so it's not a dead giveaway.

TallTroll

11:15 am on Nov 2, 2001 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Funny you should ask. I had EXACTLY the same problems with it recently. Here is what I found out

1) The SimSpider is VERY picky. The formatting of the tag must be perfect, no "illegal" spaces. I had a tag which ended...

...keyword1,keyword2" >

and it was rejected. Also, I had another which started

<META name="keywords" content = "Keyword1,keyword2....

That was rejected too. Changed it to

<META name="keywords" content="Keyword1,keyword2....

and it all worked again.

2) You have to list the tags in the correct order, description, THEN keywords, or it won't see keywords.

I also have had one VERY silly mistake where I had somehow put a <BODY> tag before the <HEAD> tag. Although the SimSpider saw the <TITLE>, it ignored the (correct) <META> tags.

Most likely explanation is 2) I spent a couple of frustrating hours cursing the SimSpider before I twigged that one :)

Once you know the rules, everythings great....

I'm not sure why it does this, I was trying to figure out if it was a requirement of one of the "strict" DTDs or something, but I couldn't find anything. Maybe Brett could enlighten us there?

Will

6:06 pm on Nov 2, 2001 (gmt 0)



A valid document using the XHTML Transitional DTD needs to have any keyword or description tags appear before the title tag, i.e. anything with META in it comes before title, linked/inline stylesheets etc.

bemay

5:17 am on Nov 16, 2001 (gmt 0)



On searchengineworld.com we are also not getting any information on spider meta key words. Have checked your comments but still can not find a solution.