Welcome to WebmasterWorld Guest from 34.204.168.57

Forum Moderators: Robert Charlton & goodroi

Message Too Old, No Replies

Four old domains axed (thrown out of index)

     
6:53 pm on May 25, 2016 (gmt 0)

Preferred Member

10+ Year Member Top Contributors Of The Month

joined:Feb 10, 2005
posts: 497
votes: 0


4 from 8 old domains can no longer found on Google since a few weeks,

Dns records for all 12 domains are in a perfect standing. Checked multiple times by web host, registrar and various tools including those from Google.

WMT can read sitemap, confirms connectivity, robots txt but flags dns error ....

Any suggestions fellows .... after weeks of checking i am clueless ....

.
9:01 pm on May 25, 2016 (gmt 0)

Senior Member from GB 

WebmasterWorld Senior Member andy_langton is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Jan 27, 2003
posts:3332
votes: 140


Seems a bit mysterious - but why not just change DNS? This could just be a temporary measure - you could pay for DNS hosting (which is inexpensive) or use a service like Cloudflare who demand you change to them.

Otherwise, troubleshooting DNS can become a little involved. Is there any more info from Google? Do you know if it is a problem contacting your name servers or with retrieving the relevant records?
9:09 pm on May 25, 2016 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month

joined:Sept 25, 2005
posts:2091
votes: 370


You can check that the records are OK, but what about the servers? Take the errors seriously and set up different (or secondary) nameservers. I use Route53 myself but there are plenty of free and reliable hosted DNS services as well. Also consider a DNS monitoring service.
9:47 pm on May 25, 2016 (gmt 0)

Preferred Member

10+ Year Member Top Contributors Of The Month

joined:Feb 10, 2005
posts: 497
votes: 0


Thanks a lot lads, but why changing the infrastructure when 4 domains are doing fine since ages with exactly the very same settings ... ? Any idea on how to contact Google apart from posting at their useless forums?
10:12 pm on May 25, 2016 (gmt 0)

Senior Member from GB 

WebmasterWorld Senior Member andy_langton is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Jan 27, 2003
posts:3332
votes: 140


Trying to fix it yourself will, at the very least, be quicker than getting Google to fix it. It's also a way to prove that it's a problem with them, which increases your chances of a permanent fix.
6:43 am on May 26, 2016 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month

joined:Sept 25, 2005
posts:2091
votes: 370


Like I said, the DNS settings may be fine, but there may be an issue with the nameservers not (properly) responding to queries. Apparently, Google has trouble fetching your DNS records, so the first thing I would have done is set up DNS monitoring and probably change the nameservers. Google can't solve it if the problem is on your end.
7:36 am on May 26, 2016 (gmt 0)

Preferred Member

10+ Year Member Top Contributors Of The Month

joined:Feb 10, 2005
posts: 497
votes: 0


robzilla, every #*$! dns tool that you can find on the web including googleapps confirmes, that all dns entries are fine.

And WMT can even reach these domains as robots text and server connectivity are confirmed to be ok.

Also several other domains on the same server with exactly the very same settings show none of such issues.

.
10:28 am on May 26, 2016 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month

joined:Sept 25, 2005
posts:2091
votes: 370


Still doesn't mean the problem can't be with your nameservers. Change them and you'll know.

Are the DNS errors dated? Are they still occurring? Is the type of error specified?
3:21 pm on May 26, 2016 (gmt 0)

Preferred Member

10+ Year Member Top Contributors Of The Month

joined:Feb 10, 2005
posts: 497
votes: 0


What could be possibly be wrong with the nameservers when Google has no issues with 8 domains and calls 4 temporarily unavailable though connectivity and robots txt are fine for all 12?

Neither web host nor registry seem to have any clues after checking all dns records thoroughly ....
3:39 pm on May 26, 2016 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member lucy24 is a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month

joined:Apr 9, 2011
posts:15900
votes: 876


Well, ###, I thought there was going to be a pervasive google/DNS problem because a near-identical issue came up less than a week ago:
[webmasterworld.com...]
But it's the same person asking. Are the same sites involved? What's the difference between that thread and this one?
5:06 pm on May 26, 2016 (gmt 0)

Preferred Member

10+ Year Member Top Contributors Of The Month

joined:Feb 10, 2005
posts: 497
votes: 0


Things have gone worse Lucy, so i started a new thread seeking solutions. Meanwhile those 4 domains can no longer be found on Google.

Everyone seems clueless, from web host to registrar. No response from Google and nothing on their product forum.
6:17 pm on May 26, 2016 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month

joined:Sept 25, 2005
posts:2091
votes: 370


Or you did not get the answers you were hoping for. Google is not going to fix your DNS errors, and if you don't try a change of nameservers (5 minutes work?) or answer my questions, I can't help you.
6:42 pm on May 26, 2016 (gmt 0)

Full Member from GB 

5+ Year Member Top Contributors Of The Month

joined:Mar 26, 2013
posts:270
votes: 36


Just because your online tools are not reporting any problems now does not mean there were no problems when Google tried to resolve your domain name. Im presuming this is some sort of a shared hosting package?
7:08 pm on May 26, 2016 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member tangor is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Nov 29, 2005
posts:10481
votes: 1099


Are these domains or subdomains?
8:29 pm on May 26, 2016 (gmt 0)

Preferred Member

10+ Year Member Top Contributors Of The Month

joined:Feb 10, 2005
posts: 497
votes: 0


Why changing nameservers that were doing fine since years for these real domains when all of a sudden WMT flags 4/12 for DNS errors? All 12 have the same records.
Google reads all 12 robots.txt well and confirms server connectivity.

Bing has no problems at all ?
8:32 pm on May 26, 2016 (gmt 0)

Junior Member

joined:Jan 13, 2014
posts:115
votes: 23


Are these domains or subdomains?


Great question also do you have a wildcard *.domain.com in your dns records?
9:36 pm on May 26, 2016 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month

joined:Sept 25, 2005
posts:2091
votes: 370


Open questions:
Is there any more info from Google? Do you know if it is a problem contacting your name servers or with retrieving the relevant records?

Are the DNS errors dated? Are they still occurring? Is the type of error specified?

Are these domains or subdomains?

do you have a wildcard *.domain.com in your dns records?
1:26 am on May 27, 2016 (gmt 0)

Preferred Member

10+ Year Member Top Contributors Of The Month

joined:Feb 10, 2005
posts: 497
votes: 0


Do you have a wildcard *.domain.com in your dns records?

No

Are these domains or subdomains?

All 12 domains are old regular domains, no sub domains. 3 of them are several years old with exactly the same dns records since ever.
All were indexed well with a few hundred real content pages, original videos, photos and writing at Google
Is there any more info from Google? Do you know if it is a problem contacting your name servers or with retrieving the relevant records?

Are the DNS errors dated? Are they still occurring? Is the type of error specified?

Google fetch reports for 4/12 : temporarily unreachable but confirms, that server connectivity is given as well as that robots txt are available for all 12/12
DNS errors started in April .
2:04 am on May 27, 2016 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member tangor is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Nov 29, 2005
posts:10481
votes: 1099


Are all 12 on the same nameserver?

Is there a reason you won't change the nameserver?
5:54 am on May 27, 2016 (gmt 0)

Preferred Member

10+ Year Member Top Contributors Of The Month

joined:Feb 10, 2005
posts: 497
votes: 0


As said,. All 12 on the same nameservers since years without any issues until this happened.
9:24 am on May 27, 2016 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month

joined:Sept 25, 2005
posts:2091
votes: 370


That's not a reason not to change the nameservers. They might have been corrupted or whatever, it's hard to tell. But if Google has encountered DNS errors since April and it's an ongoing thing, then changing nameservers is the simplest thing you can do that could possibly get your sites re-indexed, so I don't understand why you keep resisting it.

...temporarily unreachable but confirms, that server connectivity...

I asked about DNS errors. That doesn't sound much like a DNS error. More like your website or server configuration is blocking Googlebot for those domains (i.e. can resolve IP, can connect to IP, cannot access website). Post a screenshot of your (DNS) errors in Search Console, if you can.
11:03 am on May 27, 2016 (gmt 0)

Junior Member

Top Contributors Of The Month

joined:May 27, 2016
posts:68
votes: 22


Switch to cloudflare DNS and test.

Google YOURDOMAIN [SPACE] EXTENSION if you are not 1 or 2 you are deindexed.
6:05 pm on May 27, 2016 (gmt 0)

Preferred Member

10+ Year Member Top Contributors Of The Month

joined:Feb 10, 2005
posts: 497
votes: 0


Was already testing cloudflare on 2 of the affected domains since this afternoon, thanks.
And both are ok now ....

More like your website or server configuration is blocking Googlebot for those domains


Why for only 4/12 ... All the same settings.
Anyway, cloudflare seems to be a good solution, also improving the speed ...
Thanks a lot guys!
8:39 pm on May 27, 2016 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month

joined:Sept 25, 2005
posts:2091
votes: 370


I'm glad you caved and solved the problem ;-)
6:41 am on May 28, 2016 (gmt 0)

Preferred Member

10+ Year Member Top Contributors Of The Month

joined:Feb 10, 2005
posts: 497
votes: 0


Sorry to report, that joy was premature.

Google fetch can now connect to all 4 affected domains, but still 3 of them report DNS error.

And the one that shows no longer dns error has now robots txt error.

So, not even cloudflare dns seem to get accepted.
9:55 am on May 28, 2016 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month

joined:Sept 25, 2005
posts:2091
votes: 370


You should probably have another word with your web host, then.
10:45 am on May 28, 2016 (gmt 0)

Preferred Member

10+ Year Member Top Contributors Of The Month

joined:Feb 10, 2005
posts: 497
votes: 0


In the meantime the 4 sites have at least gone back into the index, google fetch works, so that probably WMT might take another while to fix that for those flagged 3 domains.

Btw. been with that web host since 10 years with various projects. Very reliable and with some outstanding, speedy service and only 1 downtime. Very capable fellows.. .