Welcome to WebmasterWorld Guest from

Forum Moderators: open

Message Too Old, No Replies

Main Page Crawled Very Quickly.. but other pages wont!



4:55 pm on Dec 16, 2003 (gmt 0)

Dear Webmasters...

Google Crawl my Main Page Daily, but my other pages wont crawl by google in even a month, please help me in it, and tell me a thing which will crawl my other pages like my home page...

please help..



8:38 pm on Dec 16, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member

It could be for a number of reasons, but it's best to start with basics. Check your links on your main page to the other pages with sim spider:
Make sure the links are crawlable.

What is the Page Rank of your main page?

<edit>Fixed URL</edit>


2:09 am on Dec 17, 2003 (gmt 0)

My page rank for main page is 5
but other pages have 4,3,2 etc..


2:14 am on Dec 17, 2003 (gmt 0)

Dear Stefan!

i have checked my main page with that SIM, and i saw all the links there!


2:28 am on Dec 17, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member

If they have that PR, they must be indexed by Google...

What happens if you put up a new page linked from the home page? Does it get crawled soon after the index/default gets its regular crawl? (I have pages a few clicks away from the home-page that only get crawled every 3-5 weeks).

If your inner pages are indexed, but just not getting crawled that often, you could play with the internal navigation from the home page and steer bots towards those pages that you want crawled frequently. That would be ones you change often, I would guess.

ADDED: Those pages not getting crawled often are indexed right? If you do a search of, "www.site.org/infrequently_crawled_page.htm", do you find them?


9:17 am on Dec 17, 2003 (gmt 0)

10+ Year Member

On my web site I noticed that new pages which are linked from main page appear in search results after approx. 1 month from the moment when Google Crawler came to my main page at the first time.

Featured Threads

Hot Threads This Week

Hot Threads This Month