Welcome to WebmasterWorld Guest from 184.108.40.206
Forum Moderators: mademetop
Half a year ago, I've got some (security) reasons to set a "noindex" metatag. But now the site is a bit securer and it seems better to appear in some searchengines. So I switched the tags to "index,follow" in July.
But the site wasn't found by any engines. I updatet the description tag and killed the frameset at the index.html! I've set the lycos/google bots to visit the page, but nothing happens!
Any ideas? Thanks!
You may need to submit again. And sometimes again and again. I always give a 2-3 week gap before resubmitting the same page.
However, if your logs show that the spiders have visited you but you aren't in the index, it may have something to do with the way your pages are coded. So many possibilities that it's hard to answer in a general way.
I admit my conclusion involves some guesswork. But I was struggling to get position in Ink for one client who didn't have "follow" meta tags. Ink never crawled beyond page 1 of the site - until I read Brett's comment and then put the meta's up.
I think I'll try it some weeks, submitting the site sometimes to be spidered.
The log shows some IP adresses, but I did'nt find them at Searchengineworld.com. Are there some spiders using NT5 IE4 compatible? Is there a NT5 using IE4 ;)?
At the end of these log lines I found the words "Nikoma" and "DigEx"!
Was it a failure, to give the site a "nofollow" tag?