GoogleBot didn't visit me after 23rd

Anyone same here?

[jamesyap]

I have a new site and GoogleBot seems to visiting my site almost everyday since the start of december. But suddently it stop on 23rd and never come back. No even christmas. Anyone has the same problem.

I recall I add a robot.txt at that period that ask all robots to exclude a specific file which do meta refreshes to sites located outside. I just don't think this robot.txt is the main reason that stop google from coming back. Anywhere, I have remove it.

Just want to see if anyone facing the same problem here.

[LuckyMan]

I had such a situation 2 month ago with few of my domains, and after dance i found those domains banned.

[gaber]

On 15rd of dicember I got a freshtag on my site and GoogleBot visited it every two days but at 21rd stop and now the index show the old cache

[bluecorr]

That's strange...before the 23rd Googlebot would drop by very early in the morning, 6-7 AM but since then he's crawling at 11-12 in the morning. Maybe he's taking a holiday?

[jamesyap]

If googlebot taking holiday, then it is a long one as it never return until today!

[troels nybo nielsen]

I am one of those lucky webmasters that are visited daily by freshbot. Without being quite sure my guess about the reason would be that so many of my incoming links are from pages that are updated daily. So even if for a time I myself do not make any updates I am still visited, only freshbot stops digging deep into the websites.

What kind of incoming links do you have, jamesyap?

[jamesyap]

It is a new site that is not index yet, I do have around 10 links from other sites, include DMOZ.

[warmasol]

I think the freshbot reduced his work after the 23rd. The crawler-activity on the site controlled by me is only by 30% of the normal access.

[Marval]

I noticed a similar activity...FreshBot normally gets my sites every day..lots of incoming high PR sites, and like clockwork. The last week has been every other day for some reason...server definitely online, other bots requesting the heck out of my robots file, so Im at a loss. Been listed for a few years and only everflux effects with new content and links out. Just struck me as odd behaviour.

[AhmedF]

For what its worth, freshbot hit me on the 26th, and it is showing in the results.

[jamesyap]

I am still waiting for googlebot to come after 23rd, but no news. :(

[jomaxx]

This is completely normal for newer sites. The important thing is to not freak out if the bot doesn't come every day, or the Googledance is late, or your PR drops one point, or you don't immediately make the top ten, or your rankings sometimes jump around a little bit.

Patience in all things.

[jamesyap]

The time to wait is killing me, I have been waiting for more than a month! Nothing can be done.

[Ramzes]

I had also strange behaivor:

1) site was visited first time at middle of November and every few days it only took robots.txt and / a few times google took the whole site (220 pages).
3) We upgraded inital site to production site (around 14K pages)
4) At begining of December, google crawled night and day, but only indexed 220 pages (for the first time) while downloading almost 3.5K pages from avaliable 14K. (near 200Mb of traffic for 2 days)
5) A day after all 220 pages disapears from google index, currenlty only root page is indexed.
6) Ever since the big crawl Google visits the site every day taking only (robots.txt and /).

Can someone please explain this?

[jomaxx]

Anything crawled in December, or even the latter part of November, will not be in Google's main database yet. The database update (the "Googledance") is typically around the end of the month (i.e. soon). Again, PATIENCE.

[Danielo21]

I don't think we'll see new google dance 2002.

[jamesyap]

Have google skip any dance in a particular month in history? I don't think so.

[chiyo]

>> Have google skip any dance in a particular month in history? I don't think so<<

Yes they have, early this year or late last i think...

[jamesyap]

Hopefully they won't skip this dance, I have wait for a month to see what a google dance (everflux) really is because I have never seen one.

[Danielo21]

Are there any signs that can predict a google dance?

[jomaxx]

Barnyard animals often become agitated before a Googledance.

[jamesyap]

haha, then googledance must be more exciting then earthquake.

[Brett_Tabke]

Ask Barney Google:

last one to the gossip fence is a rotten egg:

[seattlepi.nwsource.com...]

I think there's some hidden meaning in those ;-)

[jady]

She has been hitting us as always - every few days... We have a PR of 6.

[h_b_k]

Hi!

for my PR5-.de-domain
I have registrated

fully deep crawl between 2nd and 4th Dec
a second (only partly) deep crawl on 11th Dec

fresh bot visted me last
on 27th Dec - only 1 hit to the home-page
before
26th about 30% of pages

25th about 30%
24th about 100%
23rd about 30%
22nd about 50%
...

[jamesyap]

Looks like googlebot take a break after 27th.

But WHY googlebot skip my site from 24th to 17th.

Make me MAD MAD MAD~~~

[kfander]

>> I had such a situation 2 month ago with few of my domains, and after dance i found those domains banned <<

I don't think that's it. I haven't seen a Google bot in the last couple of days either, and I'm far too nice of a guy to be banned. :-)

[FredZeppelin]

Patience is "definitely" a virtue.
Still I suspect the folks at Google have a quirk similar to that of a "sadistic comedian's".
With all their attention to the holidays, I wouldn't be a bit surprised if "the dance" was activated on New Years Eve.
So the "impatient" would focus their attentions on Google, and forsake the upcoming holiday.

My advice is to step away from your computer, put on a silly hat, then dance and laugh with a pretty girl dressed in one of those slinky sequined dresses.
And have fun on New Years Eve!
That's what I'll be doing.

You can watch the Google dance if you want, but it will be another week until the index "falls into place".
So what's the point?

[javascripter]

Hey peoples,

Google says that if I type <META NAME="googlebot" CONTENT="noindex,nofollow"> in my tags, Google will avoid scanning the site. But what-if I put <META NAME="googlebot" CONTENT="index,follow">
in my site....will this make it more likely that google will take it because I recognized it? mmmmmmm....just curious. :) Only googleguy would know. hehehe.

Ken Eynon

[Ramzes]

Looks like all crawlers go to sleep as bears at winter.

1. InternetSeer Dec. 30, 2002 914 (4.8%) 898 (15.6%)
2. TurnitinBot Dec. 29, 2002 1,912 (10.1%) 20 (0.3%)
3. Mercator Dec. 29, 2002 2,202 (11.6%) 20 (0.3%)
4. Google Search Engine Dec. 27, 2002 12,626 (66.8%) 4,628 (80.2%)
5. FAST-WebCrawler Dec. 26, 2002 8 (0.0%) 8 (0.1%)
6. Baiduspider+(+http: Dec. 25, 2002 2 (0.0%) 2 (0.0%)
7. Larbin Dec. 25, 2002 4 (0.0%) 4 (0.1%)
8. BaiDuSpider Dec. 24, 2002 4 (0.0%) 2 (0.0%)
9. SurveyBot Dec. 15, 2002 6 (0.0%) 6 (0.1%)
10. WiseNut Search Engine Dec. 15, 2002 171 (0.9%) 108 (1.9%)
11. Internet Archive Dec. 10, 2002 80 (0.4%) 50 (0.9%)