Welcome to WebmasterWorld Guest from 184.72.177.182

Message Too Old, No Replies

10 year old site - but new urls can't get Google to index

     
10:35 pm on Mar 20, 2006 (gmt 0)

Junior Member

10+ Year Member

joined:June 20, 2004
posts:158
votes: 0


I'm perplexed why my site can't get a new crawl from Google.

The site is 10 years old and a PR6. On Jan. 1st we switched to a new database with search friendly URL's (old db had long query strings). Google has all the old pages in the SERP's. When I run "site:www.mysite.com" I only see the old pages. When I check Google cache, it appears G visits my site once or twice a week (last visit was on March 15). Everything on the site is above board, no black hat, no over-optimization, etc.

I'd really appreciate any ideas as to why I can't get a new crawl/index and what I can do about it.

Thanks in advance....

12:26 am on Mar 21, 2006 (gmt 0)

Senior Member

WebmasterWorld Senior Member tedster is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:May 26, 2000
posts:37301
votes: 0


There are two issues here. One is whether the new urls are being crawled, and the second is whether the new urls are in the index. We know that you are not seeing new urls when you do a site:example.com query, but can you clarify whether you see googlebot in your server logs - crawling the new urls?

Also, how are you handling the old, longer urls?

12:33 am on Mar 21, 2006 (gmt 0)

Preferred Member

10+ Year Member

joined:July 5, 2004
posts:470
votes: 0


I think Google is having some issues at the moment. I launched a new site with about 7 links incluiding links in the Yahoo dir and several links from my own pages that are crawled heavily by Google and have PR6 or PR7. It's been well over a month and when I do a site:mynewsite.com nothing but crickets.

MSN indexed the entire site weeks ago and it's already ranking #1 for its keywords. Yahoo has only indexed one page... but that's to be expected from Yahoo, but I can't fathom why Google isn't crawling it. This has never happened before.

3:53 am on Mar 21, 2006 (gmt 0)

Preferred Member

joined:July 8, 2002
posts:584
votes: 0


Just one sample for reference: I uploaded a new page on March 4 and it was crawled that same day. It first appeared on one DC on March 19, and first began getting significant traffic today, though I don't think it has reached its full potential (all DC's) yet. The site is four years old, PR6-5, most pages are 3,4.
6:53 am on Mar 23, 2006 (gmt 0)

Junior Member

10+ Year Member

joined:June 20, 2004
posts:158
votes: 0


There are two issues here. One is whether the new urls are being crawled, and the second is whether the new urls are in the index. We know that you are not seeing new urls when you do a site:example.com query, but can you clarify whether you see googlebot in your server logs - crawling the new urls?
Also, how are you handling the old, longer urls?

According to my logs, Googlebot is visiting. 18 "visits" today so far. As for the old URL's, the URL's were temporary (user postings which delete themselves upon expiration) so rather than individually redirecting each one, the old URL's show a 404, which redirects to the home page.

So... if Google visits my site as it appears to do, can I assume it's being crawled? I have not seen one new URL in the index, which has been online since Jan. 1. As a sidenote, MSN has picked up the whole site and is actually sending a fair amount of traffic.

11:40 am on Mar 23, 2006 (gmt 0)

New User

10+ Year Member

joined:June 24, 2005
posts:3
votes: 0


I heard recently, that google does not start up in serp's first ten by highly popular inquiries domain registred after 2003 year.
12:23 pm on Mar 23, 2006 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:July 27, 2001
posts:1472
votes: 0


Google Sitemaps might help.