Forum Moderators: mack

Message Too Old, No Replies

Slow indexing of new pages

Is anyone having this problem?

         

Fish_Texas

12:51 am on Nov 28, 2006 (gmt 0)

10+ Year Member



It's taking 2+ months to index new pages compared to 2 weeks a few months ago. Site being crawled daily...all white hat, no spam pages...but still a no-show on msn search or live.

Any comments appreciated.

Fish Texas

Meird

3:16 pm on Nov 28, 2006 (gmt 0)

10+ Year Member



I can confirm that i experience the same on my sites.

I have launched 7 new sites early this month. expected msnbot to be the first to visit the new sites and was surprised to see Yahoo was the first.

Until today, msnbot rarely visit the new sites and grabs only the robots.txt

My robots.txt is valid and excludes several directories from being indexed but DOES NOT block any robot.