Forum Moderators: open

Message Too Old, No Replies

Domain dropped from Google. What to do?

         

rfgdxm1

3:36 am on Jul 29, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Here is the situation. My site, barring some last minute miracle, is inexplicably MIA in the latest Google update. And, even though it is listed in the DMOZ, Yahoo, and even Looksmart directories, and has inbound links from a number of other sites, including the most notable on the topic, Googlebot hasn't been around for 2 weeks, when usually it came by every 2 days. I've written to comments@google.com, and got the auto-ack back to "Keep on Googlin'"; however I suspect that everything going to that e-mail is just sent to /dev/null, so this was a pointless effort anyhow.

This site gets basically all its traffic from search engines, links from other sites, and things like my Usenet .sig. It is a non-commercial informational site, and doesn't really have any regular users. Although, it used to have over 100 unique users a day before the Google disaster. Checking the logs, over half the inbound traffic was from Google. As such, unless I thought that Google would ever find it again, it would make sense just to abandon it quick, move it to another domain where it might have a chance to get into Google. I do have already a couple of suitable, unused domains in my collection already that could be used.

However, while I could quickly move the site to another domain, and just put up a "site moved, the new URL is: www.newdomain.org", this obviously creates a slew of problems with those directory listings, and also trying to get other sites to change links. Moving to get back into Google would be rather trivial if all I was worried about was being in Google. Unfortunately, it isn't that simple.

Thus, my question for those old hands who would know the answer. In other cases like this, statistically what are the odds of getting back to the status quo ante on the next update? If very high, then obviously doing nothing and praying for the next month would make sense. If not, bailing out as soon as possible and starting from scratch again makes sense.

And, given all these inbound links, I'd consider the longer that Googlebot shuns my site, the more likely that it is a goner. How much longer without a visit from Googlebot is it reasonable to consider the old domain a dead duck?

Beachboy

4:24 am on Jul 29, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Googlebot seems to have a mind of its own, a 2-week absence isn't life threatening.

When this update finally stabilizes, determine what the Toolbar PR is. If you're actually missing from Google, it should be gray. If it's white showing no PR, that could well be bad news. As you know, there are occasional hiccups on the web, maybe your site got caught up in one of those and it got dropped. Submit your site to Google again, and sit tight for another month. Rebuilding the site at this point could well be premature.

rfgdxm1

5:17 am on Jul 29, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Google is still dancing. However, every time the toolbar hits the server without my website in it I definitely get a grey toolbar, not a white indicatining PR0. Also, checking by searching "insite:mysite.TLD" shows oddly 2 pages indexed. One a "Apache Server Frequently Asked Questions", and the other "Index of /manual/howto", these being server manuals?!

There is no particular justifiable reason why Google would give my site some sort of death penalty. No link farming [I only have 2 active domains ;)], no hidden keyword stuffing, or any of the other shenanigans people try. The most probable explanation is some sort of hiccup. However, I'd think more some sort of Google bug than the web, given that with all my inbound links, including the DMOZ/Google directory (my site is still in the Google directory), they ought to keep checking up on my site if they thought it was dead.

I've submitted the site again. However, with all the links it has, including the DMOZ and Yahoo directory, Googlebot should have no trouble finding it if it wants to. The thought of what it would take to rebuild the site at this point definitely does not appeal to me. Merde. I just got an e-mail as I was writing this. My site just got into the zenzibar.com directory. Dunno how much traffic that would ever bring, but the directory page has a PR4, and moving my site would mean having yet another link with decent PR elsewhere to try and change. I'm tending to lean toward sitting tight for another month at this moment. Although I sure wish I knew exactly what happened?

WebGuerrilla

6:59 am on Jul 29, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member




Just relax. It sounds like it just got dropped this month. Each month the number of pages Google must crawl grows, but the available time to complete the crawl does not.

After every update, there are a certain number of sites that get dropped. It just happens.

The best thing to do is to monitor your logs to observe this month's crawling. If you see normal behavior, you'll probably be back next month. If you see a bunch of robots.txt and index requests, but no deep crawling, you might have a problem.

KakenBetaal

7:45 am on Jul 29, 2002 (gmt 0)

10+ Year Member



Rfgdxm1, if Google is showing only those two apache pages indexed for your domain, it seems very likely that there was some kind of server problem at your web host when Googlebot came visiting. You'll probably need to wait for the next crawl and the next update to re-appear in the index. From my own perspective I'm also hoping that the main crawl hasn't happened yet, but I'm not holding my breath.

Those pages show that your domain hasn't been dropped as it is still in the index.

rfgdxm1

7:11 pm on Jul 29, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



>The best thing to do is to monitor your logs to observe this month's crawling. If you see normal behavior, you'll probably be back next month. If you see a bunch of robots.txt and index requests, but no deep crawling, you might have a problem.

Googlebot hasn't been around for 2 weeks even for a robots.txt request, which is very odd. I'd agree if Googlebot comes back and crawls the whole site, that would be an encouraging sign.