Why my site is taking sooo long to get crawled

[uniaxaj]

Hello

a bit of introduction.
i had a site A and gave 301 redirect to site B arnd 2 months bac.
then a few weeks back I redesigned site B now its a new site.

but i find in google webmaster tools
it still shows
Googlebot last successfully accessed your home page on Aug 9, 2007.

I have added sitemap robots.txt everything referred in WebmasterWorld forum.

the new site is coming up in google results with the new meta desc n all..but many of the prev pages are still indexed and many new pages are not indexed.

What can i do..some prob with google crawler and the IF modified since stuff.

some one help

[tedster]

Hello uniaxaj, and welcome to the forums.

A couple things - first, even some sites who have been crawled more recently (they can tell this by their server logs) are showing old cache dates right now. August is a common date (see [webmasterworld.com...] for more.)

Second, new sites can have a slow breaking-in period with Google. I don't know how many pages your site is, or how many backlinks it is attracting - both are important factors - but in the average situation, complete indexing is rare and even nearly complete indexing can take months.

ome prob with google crawler and the IF modified since stuff.

Not sure whatyou are pointing to here - it shouldn't affect the first crawl of a url. And even if your page hasn't changed since the last crawl and the server returns a 304 Not Modified, that usually still changes the last crawl date. Except for periods like this, where the cache dates seem stuck for lots of sites.

To the core of your post, depend on your own server logs more than Webmaster Tools when it comes to accurate crawl data.

[uniaxaj]

Thanks tedster for the reply

well my site got arnd 50 new pages now(new design and content) and a pagerank of 3 .. but it was mainly towards the old content which i have removed. and its arnd 1 yr old.i meant the site.

..only arnd 5-6 new pages are indexed. and all of the old pages r still showing in search results and are indexed

and for some of the new keywords which i have optimized the site...my site is appearing in the searches. but over all i fear it should appear for even more keywords in searches. as the competetion for the specified keywords r very less and the site has a pagerank of 3.

Are there anything more i goto do?like any meta tag or anything.
i tought the whole prob happened bcoz prev the domain was used for a 301 from another domain.and when i suddenly changed to new site thought that was the whole deal of mistake.

[dailypress]

uniaxaj: it takes time for all pages to be indexed. (several months and sometimes over a year)
the more good back links you get (to your homepage and other pages), the faster the indexing process will be.

[FlexAjaxSEO]

It does not take up to a year!
Google will index you in 25 days or NOT index you.
25 days max.
Link to your site from a good blog to speed up index.

[edited by: FlexAjaxSEO at 4:44 pm (utc) on Oct. 22, 2007]

[dailypress]

FlexAjaxSEO,
I said for ALL pages to be indexed it takes a while, but youre right, i was probably thinking about the green PR toolbar which doesnt show up for many of my pages.