| 5:10 pm on Nov 11, 2000 (gmt 0)|
Just got the following message from PositionTech after a previous e-mail inquiry.
Inktomi is reporting that your pages are being excluded by the meta robots
tag. I did look at your pages and they do have the following line which
needs to be removed for any of the engines to index your pages.
<META NAME="ROBOTS" CONTENT="INDEX,FOLLOW">
Wasn't aware that Inktomi rejects all "ROBOTS" tags. I'll try removing them and see what happens.
| 5:20 pm on Nov 11, 2000 (gmt 0)|
Are you only submitting the content pages alone or the framset? I would remove it from the content pages and try submitting only the content pages if you can.
Were you at the SEW conference in Dallas?
| 5:45 pm on Nov 11, 2000 (gmt 0)|
First welcome to the INK forum of WmW. I talked with PositionTech yesterday and they said there are two main reasons people aren't getting in right away - yours was one of them. The other related to payment issues, credit cards, etc.
| 6:12 pm on Nov 11, 2000 (gmt 0)|
Oh yeah, you are new! Welcome John. Let us know how it goes after you remove the robots tags.
| 9:39 pm on Nov 11, 2000 (gmt 0)|
grnidone, thanks so much for your response. Unfortunately, I wasn't in Dallas. I'm a newbie to SEO. Would have LOVED to have gone. Right now, I gotta pick up SE optimization here on the cyber-street.
Regarding your question, I'm submitting only the 10 framesets, each with a noframes area that I've attempted to "optimize." I've put noindex,nofollow in the content pages. Wanted the framesets indexed, not the orphaned content pages.
stcrim, thanks. I removed the index,follow robots metatag from the framesets. From your talk with PositionTech, do you also think I should remove the noindex,nofollow from the content pages as well?
| 11:44 pm on Nov 11, 2000 (gmt 0)|
Yes - I do - go in with a clean slate and then tweak and add or take away as needed. At this time you don't want a lot of variables to confuse or complicate your results. Remember this is for the most part very un-charted lands you/we are venturing into.
Please keep us posted...
| 8:43 pm on Nov 12, 2000 (gmt 0)|
stcrim, Thanks again.
Removed entire robots metatags from contents pages. Left robots metatags as index,follow in framesets.
Let's see what that does.
| 8:54 pm on Nov 12, 2000 (gmt 0)|
If you still want to prevent people coming across orphan pages, I would use a robots.txt file to exclude your interior pages. Shouldn't cause any problems with Ink and will make sure that any spider that doesn't recognize meta robots tags will leave the internal pages alone.
| 11:03 am on Nov 13, 2000 (gmt 0)|
Inktomi seems to be indexing the content pages within the frameset. I put different descriptions in my frameset than in my content pages, the description used when indexed was the one in the main content page, not the one from the frameset.
I hope that this helps.
| 1:18 am on Nov 15, 2000 (gmt 0)|
Okay, figured it out.
Submitted framesets were indexed yesterday after, as suggested, I removed the noindex,nofollow robots metatags from the contents pages. Removing the index,follow tags from the framesets didn't have an effect.
WebGuerilla, thanks for the tip on robots.txt.
mog, you're absolutely right. I had no idea they were reading the contents pages and would hold a NOINDEX tag against the frameset.
I guess the PositionTech service could work well for me. With Christmas here, I don't have the time (or skill) to get in the old fashioned way. We'll see if it's worthwhile.