Msg#: 34372 posted 9:11 pm on May 18, 2006 (gmt 0)
How about this: sign up for Google sitemaps. (You don't actually have to submit a sitemap to sign up.) In the process of adding the main site URL, they will tell you whether the site is banned or not. At least, this is how I found out for sure yesterday that one of my sites had been banned: they just say you've violated TOS, fix it and submit a reinclusion request if you want it to come back. I get the idea it will never come back if I don't submit the reinclusion request, but who knows? One of the pages had hundreds of links to it.
I haven't decided to submit the request yet even though I have fixed the TOS violation. Believe it or not there may be good reasons not to get this site back into Google - I had already moved much of the content to a different domain that has a better name for it and already has a lot of links to it. I'm tempted just to leave the banned domain be for a few months and see if Google does anything with it just for the hell of it.
Msg#: 34372 posted 12:34 am on May 19, 2006 (gmt 0)
Thats good info charliegeek thanks. Now if your site is not banned then make sure googlebot is not being hampered somehow because that could also cause your site some big problems and if that is the case then sitemaps won't help. (because googlebot still needs to crawl properly.)
Msg#: 34372 posted 12:59 am on May 19, 2006 (gmt 0)
Yes I do believe some do. Have had some web sites that were on obvious penalties come back to there former selves after a certain time period. In particular if it's a manual penalty, I have a feeling the Google employee may set a certain timeline and timestamp and once a certain date is reached, they are able to rank again with the previous power that the domain/website once held. Well in my case anyway. Again it depends on what type of penalty. An outright ban on a scraper site for instance, you might not be seeing this.
Msg#: 34372 posted 2:25 pm on May 19, 2006 (gmt 0)
yes robots.txt can block googlebot also server headers (mostly to do with cache-control issues) can turn googlebot away. Sometimes a global change to the website (switching to dynamic pages for example) can cause problems. I've seen a lot of people on WW who complain about penalties or being banned when it turned out to be one of these issues.