Welcome to WebmasterWorld Guest from 18.104.22.168
Forum Moderators: open
I use that meta tag in content pages but not frameset. No avoid searchers coming into orphan content pages, set up series of about 10 framesets with each content page given noindex, nofollow. Each frameset is tied to one content page and each frameset links to the others.
Should this set-up keep site from being indexed by Inktomi?
Should I remove noindex, nofollow metatag from content pages?
Thanks tons for taking the time to help!
Inktomi is reporting that your pages are being excluded by the meta robots
tag. I did look at your pages and they do have the following line which
needs to be removed for any of the engines to index your pages.
<META NAME="ROBOTS" CONTENT="INDEX,FOLLOW">
Wasn't aware that Inktomi rejects all "ROBOTS" tags. I'll try removing them and see what happens.
Regarding your question, I'm submitting only the 10 framesets, each with a noframes area that I've attempted to "optimize." I've put noindex,nofollow in the content pages. Wanted the framesets indexed, not the orphaned content pages.
stcrim, thanks. I removed the index,follow robots metatag from the framesets. From your talk with PositionTech, do you also think I should remove the noindex,nofollow from the content pages as well?
Submitted framesets were indexed yesterday after, as suggested, I removed the noindex,nofollow robots metatags from the contents pages. Removing the index,follow tags from the framesets didn't have an effect.
WebGuerilla, thanks for the tip on robots.txt.
mog, you're absolutely right. I had no idea they were reading the contents pages and would hold a NOINDEX tag against the frameset.
I guess the PositionTech service could work well for me. With Christmas here, I don't have the time (or skill) to get in the old fashioned way. We'll see if it's worthwhile.