Forum Moderators: Robert Charlton & goodroi
I added a new link, (a sitemap), with links to many new other pages I am creating. I added this link to my homepage, and many other pages of my site, a few days ago.
Google has since re-indexed my site three times, and my new sitemap page is still not indexed. Why?
In the past, for my other pages, (over a hundred), they all got indexed on their own, from the homepage. I didn't do anything.
It's just a simple text link that I added. No javascript.
Do I need to add a robot.txt file, or something like that? I know nothing about those things. I thought google, msn, and yahoo would just crawl through my site, and see the new links on their own. Since my homepage gets relooked at everyday.
Please tell me what's wrong.
I didn't know if I should post the link to my site or not, so I left that out.
Thank you,
Shane
Do I need to add a robot.txt file, or something like that?
No... if you had one that was not right, then there could be a problem, but not having one shouldn't be keeping it out (especially since it sounds like your new pages usually get indexed quickly).
Perhaps someone with a similar problem will pitch in with some thoughts.
YES.
Also consider linking to the sitemap from many, most or all of your other pages.
DID THAT.
MSN.COM HAS INDEXED MY SITEMAP.PHP FILE, BUT NOT YAHOO OR GOOGLE YET. IT SURE DOES SEEM TO BE TAKING A WHILE. I GUESS I JUST HAVE TO KEEP WAITING.
THANKS, SHANE