Forum Moderators: open
Atfer giving the program a URL, I never get any information in the "Spider Meta Keywords" section. Does anyone know what I am doing wrong?
I doesn't see to put anything in that section for a number of different URLs that I tried. However, the title and description sections work fine.
Thanks in advance for your help.
John Pluth
Any script able to detect the spider simulator would be able to hide them easily.
One indicator when this is being done can be a few lines of whitespace inside the head tag where the keywords/description would usually go. This can be caused by the server side script, but can obvsiouly also be done by inserting some carriage returns in the html :), so it's not a dead giveaway.
1) The SimSpider is VERY picky. The formatting of the tag must be perfect, no "illegal" spaces. I had a tag which ended...
...keyword1,keyword2" >
and it was rejected. Also, I had another which started
<META name="keywords" content = "Keyword1,keyword2....
That was rejected too. Changed it to
<META name="keywords" content="Keyword1,keyword2....
and it all worked again.
2) You have to list the tags in the correct order, description, THEN keywords, or it won't see keywords.
I also have had one VERY silly mistake where I had somehow put a <BODY> tag before the <HEAD> tag. Although the SimSpider saw the <TITLE>, it ignored the (correct) <META> tags.
Most likely explanation is 2) I spent a couple of frustrating hours cursing the SimSpider before I twigged that one :)
Once you know the rules, everythings great....
I'm not sure why it does this, I was trying to figure out if it was a requirement of one of the "strict" DTDs or something, but I couldn't find anything. Maybe Brett could enlighten us there?