|Inktomi, PHP3 pages and a lack of indexing|
| 2:17 pm on May 8, 2003 (gmt 0)|
For a particular frames based site, we've just switched from using an index.html page to an index.php3 page - hosting limitations mean that .php extensions won't work, but that's an aside to the problem anyhow.
Until we switched, paid inclusion via Inktomi was working a treat and reasonable positions for key phrases were being acheived.
After the switch however, Inktomi will no longer crawl the index page and Position Tech are showing the url as Disallowed by noindex meta tag. There is however, no such tag on the page - never has been, never will be. As such, the site is dropping down and out of the index & I'm awaiting a response from Position Tech regarding the problem.
Has anyone else experienced this or similar? There's an earlier thread about exclusion due to content of robots.txt, but nothing similar to this.
| 3:53 pm on May 9, 2003 (gmt 0)|
I have had some weird things happen but not in a while. I seem to remember having that exact same error, quite a while ago though.
I seem to remember swapping pages around, which is a pain because it is just like resubmitting, and it fixed itself. I think talking to PT is the way to go, they have always been very helpful and prompt when I have needed to get some help on something.
There used to be one particular site that it would happen to qute a bit but the client would change his robots file daily and kept banning various bots, sometimes all of them, not the quickest fellow. ;)
| 4:10 pm on May 9, 2003 (gmt 0)|
I'm guessing one of the frames has a meta noindex tag in it. Inktomi reads framesets, if any of the frames contain a noindex tag the main frameset URL will display a "Disallowed by noindex meta tag" error.
| 4:32 pm on May 9, 2003 (gmt 0)|
Your reply landed in my inbox at the same time as PositionTech's did Jim!
I'd assumed (assumption being the mother of all cock ups) that Inktomi would read through the index page, take the non-frames into account & go for the frames that didn't include a <NOINDEX> tag. :(
Seems that by including that tag in two of four frames, I'd scuppered things a little & was preventing Inktomi from crawling the site.
These things happen - I'll not be making the same mistake again!
| 4:36 pm on May 9, 2003 (gmt 0)|
|Your reply landed in my inbox at the same time as PositionTech's did Jim! |
hey ritch_b, check out Jim's profile, ;) lol
| 4:43 pm on May 9, 2003 (gmt 0)|
Jim'll be our resident Ink' guru then?!?...well - now I know who to direct all my daft questions to!...;)