Forum Moderators: open
I'm reading this forum for few weeks now, and learning alot of things, i had alot of sites hosted on one of my servers.
Someting very odd happened few days ago (before the last update), it seems that all of the domains that were hosted on that server are out of google, part of them was on google for few months, i didn't do any type of spamming or someting like that, all of them were very clean sites, with alot of content, no link farms, no spamming and etc....
I also hosted each of these domains in a diffrent ip.
One thing that happened is that in the same day that google took all of this domains out of his database, my server was kinda down, named was still working, so all of the domains were resolved to the ips, but httpd wasn't working, so all of the sites were offline.
I also notice that since then, on 01/01 and 01/02(today) googlebot has visited most of this sites, what does it mean?
maybe it was bcz the few hours of downtime (notice that it wasn't a regular downtime, named was still working).
or maybe someone tried to do someting to my domains?
it's not one or two domains, it's more than 100 domains.
What should i do, what can i check?
Thanks.
1. There are more than 100 domains, could it be that google visit all of my 100 domains on the same 12 hours that the server was down?
2. It seem that a day the day that they was removed, googlebot visited some of them again (he also visited them today and yesterday), and they still didn't come back, please notice that they were removed from www.google.com few days before of the www2.google.com update, so it got nothing todo with the new update.
3. I had some domains that was down for more than a month, and googlebot didn't remove them in that month, i'm sure that he visit some of them and they wasn't working.
So what do you think?
Could it still be that it bcz of the 12 hours downtime?
It is possible that googlebot tried to spyder all of my 100+ domains on the same 12 hours of the downtime?
Thanks.
It is possible that googlebot tried to spyder all of my 100+ domains on the same 12 hours of the downtime?
It is certainly possible - Over a four-day period, most webmasters here report being deep-crawled, which probably means that Googlebot spiders the whole web within just a few days.
If some of your sites disappeared before or after the update window, then that implies that it was a result of Google's freshbot activity. If you are not violating any of Google's forbidden practices, then check your server headers [webmasterworld.com], validate your robots.txt files [searchengineworld.com], and test any redirects you may have in place on your sites to make sure this is not a problem on your end. Other than that, all you can do is wait.
HTH,
Jim