Welcome to WebmasterWorld Guest from 54.144.79.200

Forum Moderators: open

Message Too Old, No Replies

Inktomi, PHP3 pages and a lack of indexing

     

ritch_b

2:17 pm on May 8, 2003 (gmt 0)

10+ Year Member



For a particular frames based site, we've just switched from using an index.html page to an index.php3 page - hosting limitations mean that .php extensions won't work, but that's an aside to the problem anyhow.

Until we switched, paid inclusion via Inktomi was working a treat and reasonable positions for key phrases were being acheived.

After the switch however, Inktomi will no longer crawl the index page and Position Tech are showing the url as Disallowed by noindex meta tag. There is however, no such tag on the page - never has been, never will be. As such, the site is dropping down and out of the index & I'm awaiting a response from Position Tech regarding the problem.

Has anyone else experienced this or similar? There's an earlier thread about exclusion due to content of robots.txt, but nothing similar to this.

R.

jatar_k

3:53 pm on May 9, 2003 (gmt 0)

WebmasterWorld Administrator jatar_k is a WebmasterWorld Top Contributor of All Time 10+ Year Member



I have had some weird things happen but not in a while. I seem to remember having that exact same error, quite a while ago though.

I seem to remember swapping pages around, which is a pain because it is just like resubmitting, and it fixed itself. I think talking to PT is the way to go, they have always been very helpful and prompt when I have needed to get some help on something.

There used to be one particular site that it would happen to qute a bit but the client would change his robots file daily and kept banning various bots, sometimes all of them, not the quickest fellow. ;)

Jim_Stob

4:10 pm on May 9, 2003 (gmt 0)

10+ Year Member



I'm guessing one of the frames has a meta noindex tag in it. Inktomi reads framesets, if any of the frames contain a noindex tag the main frameset URL will display a "Disallowed by noindex meta tag" error.

ritch_b

4:32 pm on May 9, 2003 (gmt 0)

10+ Year Member



Your reply landed in my inbox at the same time as PositionTech's did Jim!

I'd assumed (assumption being the mother of all cock ups) that Inktomi would read through the index page, take the non-frames into account & go for the frames that didn't include a <NOINDEX> tag. :(

Seems that by including that tag in two of four frames, I'd scuppered things a little & was preventing Inktomi from crawling the site.

These things happen - I'll not be making the same mistake again!

Cheers peeps,

R.

jatar_k

4:36 pm on May 9, 2003 (gmt 0)

WebmasterWorld Administrator jatar_k is a WebmasterWorld Top Contributor of All Time 10+ Year Member



Your reply landed in my inbox at the same time as PositionTech's did Jim!

hey ritch_b, check out Jim's profile, ;) lol

ritch_b

4:43 pm on May 9, 2003 (gmt 0)

10+ Year Member



Jim'll be our resident Ink' guru then?!?...well - now I know who to direct all my daft questions to!...;)

R.