homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Google / Google News Archive
Forum Library, Charter, Moderator: open

Google News Archive Forum

Main Page Crawled Very Quickly.. but other pages wont!

 4:55 pm on Dec 16, 2003 (gmt 0)

Dear Webmasters...

Google Crawl my Main Page Daily, but my other pages wont crawl by google in even a month, please help me in it, and tell me a thing which will crawl my other pages like my home page...

please help..




 8:38 pm on Dec 16, 2003 (gmt 0)

It could be for a number of reasons, but it's best to start with basics. Check your links on your main page to the other pages with sim spider:
Make sure the links are crawlable.

What is the Page Rank of your main page?

<edit>Fixed URL</edit>


 2:09 am on Dec 17, 2003 (gmt 0)

My page rank for main page is 5
but other pages have 4,3,2 etc..


 2:14 am on Dec 17, 2003 (gmt 0)

Dear Stefan!

i have checked my main page with that SIM, and i saw all the links there!


 2:28 am on Dec 17, 2003 (gmt 0)

If they have that PR, they must be indexed by Google...

What happens if you put up a new page linked from the home page? Does it get crawled soon after the index/default gets its regular crawl? (I have pages a few clicks away from the home-page that only get crawled every 3-5 weeks).

If your inner pages are indexed, but just not getting crawled that often, you could play with the internal navigation from the home page and steer bots towards those pages that you want crawled frequently. That would be ones you change often, I would guess.

ADDED: Those pages not getting crawled often are indexed right? If you do a search of, "www.site.org/infrequently_crawled_page.htm", do you find them?


 9:17 am on Dec 17, 2003 (gmt 0)

On my web site I noticed that new pages which are linked from main page appear in search results after approx. 1 month from the moment when Google Crawler came to my main page at the first time.

Global Options:
 top home search open messages active posts  

Home / Forums Index / Google / Google News Archive
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved