Forum Moderators: Robert Charlton & goodroi
The site is 10 years old and a PR6. On Jan. 1st we switched to a new database with search friendly URL's (old db had long query strings). Google has all the old pages in the SERP's. When I run "site:www.mysite.com" I only see the old pages. When I check Google cache, it appears G visits my site once or twice a week (last visit was on March 15). Everything on the site is above board, no black hat, no over-optimization, etc.
I'd really appreciate any ideas as to why I can't get a new crawl/index and what I can do about it.
Thanks in advance....
Also, how are you handling the old, longer urls?
MSN indexed the entire site weeks ago and it's already ranking #1 for its keywords. Yahoo has only indexed one page... but that's to be expected from Yahoo, but I can't fathom why Google isn't crawling it. This has never happened before.
There are two issues here. One is whether the new urls are being crawled, and the second is whether the new urls are in the index. We know that you are not seeing new urls when you do a site:example.com query, but can you clarify whether you see googlebot in your server logs - crawling the new urls?
Also, how are you handling the old, longer urls?
According to my logs, Googlebot is visiting. 18 "visits" today so far. As for the old URL's, the URL's were temporary (user postings which delete themselves upon expiration) so rather than individually redirecting each one, the old URL's show a 404, which redirects to the home page.
So... if Google visits my site as it appears to do, can I assume it's being crawled? I have not seen one new URL in the index, which has been online since Jan. 1. As a sidenote, MSN has picked up the whole site and is actually sending a fair amount of traffic.