Forum Moderators: Robert Charlton & goodroi

Message Too Old, No Replies

Problem in Google Crawling two domain names

its been many months google hasn't crawled my site

         

Pradeep

3:46 pm on Jan 3, 2006 (gmt 0)

10+ Year Member



Hi All,

I have 2 sites names, <a regular domain and a geocities subdomain>. Both are equally old say around 5 to 6 months, But the problem being only index pages is crawled till today. But somtime when i checked on the weekends it says first site is crawled around 10 pages and the other one is around 37 pages its so strange that if i check the same in the weekend i would see completely different results. I want both of my site be crawled as early as possible COULD ANYONE HELP ME OUT OR GIVE ME SOME TIPS TO GET THIS CRAWLED.

Another strange things is home page of both the site will be crawled frequently. I am so worried please help me ASAP.

Thanks in Advance

Cheers

Pradeep SV

<Sorry, no personal domain names.
See Terms of Service [webmasterworld.com]>

[edited by: tedster at 5:54 pm (utc) on Jan. 3, 2006]

Stefan

10:23 pm on Jan 3, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



The frequency of googlebot crawls for any particular page seems to be at least somewhat related to the Page Rank of that page. I assume your index (home) pages on the two sites have the highest PR, so that could partly explain your problem. Are your sub-pages that are not being crawled above, or below, PR3? Are they actually listed (if you search the URL in G, www.example.org/uncrawled_page.ext, no quotes around it, does it give you any info on them)?

In addition to the PR, pages that are edited/amended frequently are crawled more often, that is, if the PR is high enough to have G pay much attention to them in the first place.

A possible solution to your problem would be more incoming links, and if you can get a few good ones to the sub-pages that aren't being crawled, so much the better.

ADDED: Are the uncrawled pages regular static html, or are they dynamic?