Forum Moderators: open

Message Too Old, No Replies

Google didn't crawl my sites for 10 days now...

does anyone else have this problem?

         

chris007

10:08 pm on Feb 11, 2004 (gmt 0)



Since the beggining of this month (1-2 Feb) google's spider didn't visit my sites, although I put lots of new pages up and i updated other.

Is this happening to anybody else? I am beggining to worry...

Any imput is apprecited.

ThomasB

12:19 pm on Feb 12, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Chris, first of all welcome to WebmasterWorld!

what is your pagerank? Did you check your logs or is it what a counter tool tells you?

prejudice

12:46 pm on Feb 12, 2004 (gmt 0)



I'm a Pagerank 6 site, with one link which is a pr=0

I haven't had a fresh date next to my listing in about 4 months!

Can anyone explain this?

TIA

tantalus

12:54 pm on Feb 12, 2004 (gmt 0)

10+ Year Member



For what its worth. Google crawled a new page of mine a day or so ago. Its now in the index but without fresh tags.

Maybe fresh tags are thing of the past?

sem4u

1:03 pm on Feb 12, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I saw a load of fresh tags just a few days ago.

tantalus

1:09 pm on Feb 12, 2004 (gmt 0)

10+ Year Member



What can I say.

It wasn't in the index yesterday... it is today - no fresh tags.

sem4u

1:13 pm on Feb 12, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Well that can happen too :)

Google can crawl, index and show no fresh dates.

prejudice

1:19 pm on Feb 12, 2004 (gmt 0)



You think so?

A PR6 site has no fresh date next to the listing for four months? You think that's normal?

Seems even more bizarre to see that when checking the backlinks in google for this site it only shows one link! And that link is a pr=0 lol. I know this site has about 1000 links most above PR4

Google is a joke.

frances

1:30 pm on Feb 12, 2004 (gmt 0)

10+ Year Member



I got one pr6 site, used to be crawled every time there were new fresh tags. Suddenly, a month or two ago, that stopped. The site still does well in the serps for a range of search terms. It is strange

Zigire

1:34 pm on Feb 12, 2004 (gmt 0)

10+ Year Member



I have a PR4 (although it is #1 for a quite competitive search phrase) - it gets crawled daily.

When was the last PR update? - For me it's been like this for a few months.

ThomasB

3:17 pm on Feb 12, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



When was the last PR update? - For me it's been like this for a few months.

The last backlink update was on monday, but I'm not sure if the PR were updated, too. But the last I'm aware of was about 3 weeks ago.

But I think you won't realize every PR update because the toolbar scale is from 0-10 in steps of 1, which gives 11 chances, with big distances between each other the higher the PR is.

UK_Web_Guy

6:39 pm on Feb 13, 2004 (gmt 0)

10+ Year Member



I don't think freshbot visiting is just a PR thing - others things - I wish I knew what, seem to make a difference and I don't just mean high PR links

cabbie

10:03 pm on Feb 14, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



>>Is this happening to anybody else? I am beggining to worry...

chris007 This is also happenening to one of my more solid sites.
At first i thought it was a flag that google was going to drop the site the next update but it seems to have made through brandy okay.
It hasn't lost any of its positions in the serps yet but its pecular that its the only one in the serps not getting freshdated nor has the cache been updated for 2 weeks.
i even moved it onto another host but google still wont touch it.
I am hoping its a glich.

Roel

7:26 am on Feb 15, 2004 (gmt 0)

10+ Year Member



>>Is this happening to anybody else? I am beggining to worry...

Same here... Took a long time around 1-10 Feb for Google to find my updated pages... eventually it got trough...

Cheers
Roel

Snookered

4:02 am on Feb 16, 2004 (gmt 0)

10+ Year Member



Hm, I havn't had a visit from Googlebot all month. I think I've been penalized for something. I wish the whole thing was more transparent. Why do we have to guess like this?

BeeDeeDubbleU

9:16 am on Feb 16, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



My site is also suffering in a similar way. About two or three weeks ago Googlebot stopped indexing my site. All my pages and PR5 are still there and I am still in DMOZ but they no longer show any cache or page title when I do a site:www.mydomain.com check. I have tried contacting them 5 times but still no joy!?!

power_iq

10:27 am on Feb 16, 2004 (gmt 0)

10+ Year Member



Start a search for "slow death syndrom"

Best Regards, Tom

glengara

11:21 am on Feb 16, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



These days, few things function as they ought, including their crawling.
For a while they've seemed to be concentrating on bulking-up, so it's new pages and the more exotic formats, re-spidering of low-PR pages will just have to wait.
Strictly IMO, of course.

Bobby_Davro

11:56 am on Feb 16, 2004 (gmt 0)

10+ Year Member



I have seen the "no spidering" problem on two sites now, and it has been 2 weeks since either had a hit from Googlebot. Both previously had strong spidering, both sites are PR6 and both still have thousands of pages in Google.

One site is somewhat dubious in its content, and could plausibly have been banned from Google, if they were so inclined. The other site is about a clean as they come; no spam, no dodgy content, excellent link and theming structure. There would be no justification for removal of this site from Google AFAIK.

power_iq

12:39 pm on Feb 16, 2004 (gmt 0)

10+ Year Member



Well, I thinks it is a kind of duplicate content filering / penalty.

Check the Links "link:www.blubb-blubb.com" to your site. In most cases there are gone completley!

Bobby_Davro

1:20 pm on Feb 16, 2004 (gmt 0)

10+ Year Member



There is definitely some merit in that idea. Both sites contain large quantities of content that is very similar from page to page in particular areas. If it is a duplicate content problem, then it would appear that once a site breaches a certain theshold, the entire site is taken out of the spidering cycle. That doesn't seem likely to me; not a very "Google" solution.

I would have expected them to simply keep one copy of the original content and remove any duplicate pages.

power_iq

1:42 pm on Feb 16, 2004 (gmt 0)

10+ Year Member



I think this the case now. Most of my "killed sites" are back with title and description now. But no Links are pointing to the site. No change in Serps, hmmm. No Googlebot come to me since the "kill".

BeeDeeDubbleU

2:17 pm on Feb 16, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Bobby,

I think that this is what happened to me a couple or more weeks ago. I now get a "200 OK" when I do a robots.txt check on both www and -www versions of my domain. Does this not suggest that they are seeing two versions of my site? Anyway my info is that it could be caused by an inbound link to [mydomain.com...] (-www).

Does anyone out there know of any quick way of finding out who has created this link?

Bobby_Davro

3:10 pm on Feb 16, 2004 (gmt 0)

10+ Year Member



The site owner has sent an email to Google about this issue, and they have forwarded it to their "engineers". I will keep you posted regarding any answer that he gets, although I don't expect to hear any time soon.

Bobby_Davro

3:32 pm on Feb 16, 2004 (gmt 0)

10+ Year Member



I was just investigating the "clean" site some more, and it is very strange.

The front page, PR6, isn't cached, but it does have recorded back links. There are over 90,000 pages from the site indexed and cached, but the front page isn't one of them (!).

I can only assume that this is a penalty and it just hasn't filtered all the way down yet.

Jakpot

8:19 pm on Feb 16, 2004 (gmt 0)

10+ Year Member



I have a problem with 75% of my pages
showing a url only. Googebot has not visited for
10 days.

BeeDeeDubbleU

8:46 pm on Feb 16, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Welcome to this rapidly growing club Jakpot!

Is there anyone listening at Google? This is not an isolated occurrence!

BeeDeeDubbleU

8:51 am on Feb 17, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Any more news on this yet?

power_iq

9:06 am on Feb 17, 2004 (gmt 0)

10+ Year Member



>> I have a problem with 75% of my pages
showing a url only. Googebot has not visited for
10 days

You should begin to plan a new project.

Can you sticky me the URL, please?

Tom

BeeDeeDubbleU

12:59 pm on Feb 17, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



OK, I now understand that strictly speaking Google is not to blame for this. Apparently some hosts allow you to have different content on domain.com and www.domain.com. I was not aware of this. Can anyone confirm?

If this is the case then Google may be correct in NOT assuming that they are the same site. However, would it not be fair to assume that ...

IF site_content at domain.com = site content at www.domain.com
THEN domain.com = www.domain.com
ELSE IF site_content at domain.com <> site_content at www.domain.com
THEN domain.com <> www.domain.com
ENDIF

There, I wrote the code! :-} (Don't laugh - it's been a while!)

Incidentally, I have now successfully installed a 301 on my site. Does anyone have any information on how long it takes for Google to catch up with this? My site has PR5 and it is in DMOZ. Also, is there anything else that can be done to speed the process?

This 89 message thread spans 3 pages: 89