Forum Moderators: Robert Charlton & goodroi

Message Too Old, No Replies

Googlebot AWOL

No July visits on over 30 sites

         

Go60Guy

1:15 am on Jul 11, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I have over 30 newish sites, aged three to five months, that were being crawled almost daily by Googlebot until the end of June. All have ibls, are content rich and are frequently updated. Most pages are in the main index and most have tbpr of 3.

Not a one has had a single Gbot visit in July. I'm wondering why this could be. Does it suggest some drastic change is about to occur? Anyone seeing similar? Worrying here.

tedster

6:15 pm on Jul 11, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Some folks in the SERPs watching thread are reporting a flurry of deep crawling, so who knows, eh? This is one time of year when Google gets a bit more "experimental". Do you have Webmaster Tools accounts for any of these domains? You might get more feedback there - especially if there are barriers to crawling.

[edited by: tedster at 7:27 pm (utc) on July 11, 2007]

Go60Guy

7:21 pm on Jul 11, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I'm not using the Webmaster Tools on those sites. The strange thing is that my sites on the WordPress platform on the same servers are being crawled like crazy by G. It's the static sites that haven't been crawled this month. So, it's not a server issue. They all run AdSense, and mediabot has also been absent in July.

I think something is up, and I'm just going to exercise what ever patience I can muster for the time being in the hope that Gbot comes calling again soon.

trinorthlighting

8:54 pm on Jul 11, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



You might want to contact the adsense team. They will actually shed some light about media bot crawling. They are responsive when it comes to adsense sites not being crawled because the data that media bot uses helps in displaying advertisements.

Go60Guy

5:58 am on Jul 12, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Well, I finally figured it out. It had nothing to do with Gbot behavior. I saw that the stoppages coincided timewise with uploading of altered .htaccess files to the various servers. I had followed some erroneous advice with regard to WordPress installations. Once the offending code was removed, Gbot almost immediately began paying calls again. Whew!

workingNOMAD

6:49 am on Jul 12, 2007 (gmt 0)

10+ Year Member



How do you manage to put out that number of sites?

Go60Guy

2:01 pm on Jul 12, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Putting up sites is easy. It's loading them with good content and getting good links that's not so easy. It's with the latter that the real work begins. I take each of them one step at a time. Ya gotta have the right tools, money and time.