Forum Moderators: open
I noticed that daily the site gets crawled by googlebot.
My question is how can this be? There are no links to the domain. The only reference that would be on the web would be the registrar record and even in that there is no actual link.
I don't mind the crawl, just was wondering how google found it so fast without any references to it anywhere else on the web.
My situation is a little different.
I run my own DNS and rum my own hosting. I currently have around 65 domains that have strictly construction pages. All of these show the DNS as being pointed to my servers.
My question is...
Is this in anyway detrimental to these domain names? The only text on all of these is "this site is currently under construction." No tags, metas, nothing.
Some of these will eventually become regular sites. I just find it odd that googlebot has found and is crawling them.
Thanks for any replies...
Is the spyware on your Google Toolbar switched off? If not, when you visit your domain in your web browser with the Toolbar on Google takes a note of the page and adds it to its crawl list. (Or so we're led to believe)
What do you mean by spyware? Nothing I can see gives any indication of spyware. An how do you turn it off?