homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Advertising / Paid Inclusion Engines and Topics
Forum Library, Charter, Moderator: open

Paid Inclusion Engines and Topics Forum

  posting off  
Inktomi, PHP3 pages and a lack of indexing

 2:17 pm on May 8, 2003 (gmt 0)

For a particular frames based site, we've just switched from using an index.html page to an index.php3 page - hosting limitations mean that .php extensions won't work, but that's an aside to the problem anyhow.

Until we switched, paid inclusion via Inktomi was working a treat and reasonable positions for key phrases were being acheived.

After the switch however, Inktomi will no longer crawl the index page and Position Tech are showing the url as Disallowed by noindex meta tag. There is however, no such tag on the page - never has been, never will be. As such, the site is dropping down and out of the index & I'm awaiting a response from Position Tech regarding the problem.

Has anyone else experienced this or similar? There's an earlier thread about exclusion due to content of robots.txt, but nothing similar to this.




 3:53 pm on May 9, 2003 (gmt 0)

I have had some weird things happen but not in a while. I seem to remember having that exact same error, quite a while ago though.

I seem to remember swapping pages around, which is a pain because it is just like resubmitting, and it fixed itself. I think talking to PT is the way to go, they have always been very helpful and prompt when I have needed to get some help on something.

There used to be one particular site that it would happen to qute a bit but the client would change his robots file daily and kept banning various bots, sometimes all of them, not the quickest fellow. ;)


 4:10 pm on May 9, 2003 (gmt 0)

I'm guessing one of the frames has a meta noindex tag in it. Inktomi reads framesets, if any of the frames contain a noindex tag the main frameset URL will display a "Disallowed by noindex meta tag" error.


 4:32 pm on May 9, 2003 (gmt 0)

Your reply landed in my inbox at the same time as PositionTech's did Jim!

I'd assumed (assumption being the mother of all cock ups) that Inktomi would read through the index page, take the non-frames into account & go for the frames that didn't include a <NOINDEX> tag. :(

Seems that by including that tag in two of four frames, I'd scuppered things a little & was preventing Inktomi from crawling the site.

These things happen - I'll not be making the same mistake again!

Cheers peeps,



 4:36 pm on May 9, 2003 (gmt 0)

Your reply landed in my inbox at the same time as PositionTech's did Jim!

hey ritch_b, check out Jim's profile, ;) lol


 4:43 pm on May 9, 2003 (gmt 0)

Jim'll be our resident Ink' guru then?!?...well - now I know who to direct all my daft questions to!...;)


Global Options:
 top home search open messages active posts  

Home / Forums Index / Advertising / Paid Inclusion Engines and Topics
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved