Welcome to WebmasterWorld Guest from 188.8.131.52
Forum Moderators: open
Until we switched, paid inclusion via Inktomi was working a treat and reasonable positions for key phrases were being acheived.
After the switch however, Inktomi will no longer crawl the index page and Position Tech are showing the url as Disallowed by noindex meta tag. There is however, no such tag on the page - never has been, never will be. As such, the site is dropping down and out of the index & I'm awaiting a response from Position Tech regarding the problem.
Has anyone else experienced this or similar? There's an earlier thread about exclusion due to content of robots.txt, but nothing similar to this.
I seem to remember swapping pages around, which is a pain because it is just like resubmitting, and it fixed itself. I think talking to PT is the way to go, they have always been very helpful and prompt when I have needed to get some help on something.
There used to be one particular site that it would happen to qute a bit but the client would change his robots file daily and kept banning various bots, sometimes all of them, not the quickest fellow. ;)
I'd assumed (assumption being the mother of all cock ups) that Inktomi would read through the index page, take the non-frames into account & go for the frames that didn't include a <NOINDEX> tag. :(
Seems that by including that tag in two of four frames, I'd scuppered things a little & was preventing Inktomi from crawling the site.
These things happen - I'll not be making the same mistake again!