Welcome to WebmasterWorld Guest from 184.108.40.206
Forum Moderators: open
I use that meta tag in content pages but not frameset. No avoid searchers coming into orphan content pages, set up series of about 10 framesets with each content page given noindex, nofollow. Each frameset is tied to one content page and each frameset links to the others.
Should this set-up keep site from being indexed by Inktomi?
Should I remove noindex, nofollow metatag from content pages?
Thanks tons for taking the time to help!
Inktomi is reporting that your pages are being excluded by the meta robots
tag. I did look at your pages and they do have the following line which
needs to be removed for any of the engines to index your pages.
<META NAME="ROBOTS" CONTENT="INDEX,FOLLOW">
Wasn't aware that Inktomi rejects all "ROBOTS" tags. I'll try removing them and see what happens.
Are you only submitting the content pages alone or the framset? I would remove it from the content pages and try submitting only the content pages if you can.
Were you at the SEW conference in Dallas?
Regarding your question, I'm submitting only the 10 framesets, each with a noframes area that I've attempted to "optimize." I've put noindex,nofollow in the content pages. Wanted the framesets indexed, not the orphaned content pages.
stcrim, thanks. I removed the index,follow robots metatag from the framesets. From your talk with PositionTech, do you also think I should remove the noindex,nofollow from the content pages as well?
Submitted framesets were indexed yesterday after, as suggested, I removed the noindex,nofollow robots metatags from the contents pages. Removing the index,follow tags from the framesets didn't have an effect.
WebGuerilla, thanks for the tip on robots.txt.
mog, you're absolutely right. I had no idea they were reading the contents pages and would hold a NOINDEX tag against the frameset.
I guess the PositionTech service could work well for me. With Christmas here, I don't have the time (or skill) to get in the old fashioned way. We'll see if it's worthwhile.