Welcome to WebmasterWorld Guest from 54.161.110.186

Message Too Old, No Replies

10 year old site - but new urls can't get Google to index

     
10:35 pm on Mar 20, 2006 (gmt 0)

10+ Year Member



I'm perplexed why my site can't get a new crawl from Google.

The site is 10 years old and a PR6. On Jan. 1st we switched to a new database with search friendly URL's (old db had long query strings). Google has all the old pages in the SERP's. When I run "site:www.mysite.com" I only see the old pages. When I check Google cache, it appears G visits my site once or twice a week (last visit was on March 15). Everything on the site is above board, no black hat, no over-optimization, etc.

I'd really appreciate any ideas as to why I can't get a new crawl/index and what I can do about it.

Thanks in advance....

12:26 am on Mar 21, 2006 (gmt 0)

WebmasterWorld Senior Member tedster is a WebmasterWorld Top Contributor of All Time 10+ Year Member



There are two issues here. One is whether the new urls are being crawled, and the second is whether the new urls are in the index. We know that you are not seeing new urls when you do a site:example.com query, but can you clarify whether you see googlebot in your server logs - crawling the new urls?

Also, how are you handling the old, longer urls?

12:33 am on Mar 21, 2006 (gmt 0)

10+ Year Member



I think Google is having some issues at the moment. I launched a new site with about 7 links incluiding links in the Yahoo dir and several links from my own pages that are crawled heavily by Google and have PR6 or PR7. It's been well over a month and when I do a site:mynewsite.com nothing but crickets.

MSN indexed the entire site weeks ago and it's already ranking #1 for its keywords. Yahoo has only indexed one page... but that's to be expected from Yahoo, but I can't fathom why Google isn't crawling it. This has never happened before.

3:53 am on Mar 21, 2006 (gmt 0)



Just one sample for reference: I uploaded a new page on March 4 and it was crawled that same day. It first appeared on one DC on March 19, and first began getting significant traffic today, though I don't think it has reached its full potential (all DC's) yet. The site is four years old, PR6-5, most pages are 3,4.
6:53 am on Mar 23, 2006 (gmt 0)

10+ Year Member



There are two issues here. One is whether the new urls are being crawled, and the second is whether the new urls are in the index. We know that you are not seeing new urls when you do a site:example.com query, but can you clarify whether you see googlebot in your server logs - crawling the new urls?
Also, how are you handling the old, longer urls?

According to my logs, Googlebot is visiting. 18 "visits" today so far. As for the old URL's, the URL's were temporary (user postings which delete themselves upon expiration) so rather than individually redirecting each one, the old URL's show a 404, which redirects to the home page.

So... if Google visits my site as it appears to do, can I assume it's being crawled? I have not seen one new URL in the index, which has been online since Jan. 1. As a sidenote, MSN has picked up the whole site and is actually sending a fair amount of traffic.

11:40 am on Mar 23, 2006 (gmt 0)

10+ Year Member



I heard recently, that google does not start up in serp's first ten by highly popular inquiries domain registred after 2003 year.
12:23 pm on Mar 23, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Google Sitemaps might help.
 

Featured Threads

Hot Threads This Week

Hot Threads This Month