Forum Moderators: open

Message Too Old, No Replies

Newbie question about lack of spiders to recently optimized pages

         

lawboy

4:52 pm on Oct 20, 2003 (gmt 0)

10+ Year Member



About ten days ago, we optimized about 50 pages (forty of which were brand new but under existing sections on website).

Since then there have been about 700 google spider page views. However, none are the brand new pages. Is that normal?

By the, the band new pages are three levels deep - second level is a page with hyperlinks to new pages.

Maybe I'm just being impatient :)

If there is a Spiders 101 site somewhere, please let me know.

rogerd

5:01 pm on Oct 20, 2003 (gmt 0)

WebmasterWorld Administrator 10+ Year Member



Google spidering isn't always predictable. The better linked and higher PR the new content is, in general, the more likely it will be spidered promptly. If you check your pages in Googles indexed, too, you may find that Google knows about the pages (URL listed with nothing else), but hasn't gotten to spidering them yet.

lawboy

3:44 pm on Oct 25, 2003 (gmt 0)

10+ Year Member



I've decided to try this as well: <META NAME="robots" CONTENT="index,follow">

I put it on every single page. I hope it works.

BigFish

11:16 pm on Oct 28, 2003 (gmt 0)

10+ Year Member



You don't need to be already spidered to have a PR? How does his brand new pages attain PR since they are so new?