I registered a new domain mid August and put the in-development site live a week later. I had no reason to look at logs until today - no links in and no submissions. I've just noticed that Slurp came by last week. It followed hot on the heels of a Whois IP. Is this normal of Yahoo! to check out newly registered domains and should I expect such pro-active behaviour of other robots?
A new site with a prviously unregistered domain is new to me so I won't be offended if anyone says "so what", "of course they found you - Yahoo is thirsty for new blood" etc.
I also had the same thing happen to me with a site I recenty registered. First referral was from yahoo via whois. That was the only bot that visited until I linked it from another site. Not to say that other bots might not find you anyway.
Are you saying that you noticed this as a *fact* from your logs or that Yahoo just found your new site and you *think* it came from whois?
Many times webmasters do not realize that running toolbar(s) is all it takes for your site to have bots crawling all over it whether you are submitting (does anyone still do that?), being linked to, or promoting in any other way..
The same thing happened to me too, Import Export, brings up a good point, so I don't know if it was the Whois or the Toolbar, but eventually Google, MSN and Yahoo indexed my site.
This was unfortunate because I didn't know this would happen. I was slowly developing my site and it went several months with out an update and no inbound links. Google must think it's spam because it got tossed into the Supplemental index. The past few months I've done a lot of work on this site but it still struggles in all the search engine's SERPs.
Funny thing is, there are about 70 pages total, not a single advertisement, no Adsense, no affiliate links, just pure content. I guess it shows how important inbound links are, without them I guess you get labeled as spam.
My logs are minute, with visits from only 4 IP addresses – 2 are mine (office & home), 1 Whois immediately followed by 1 Yahoo. The day after I uploaded the site my laptop blew up and only visited the site with a temporary one without anything but MS Office – so no visits with toolbars.
I have no doubt it came via Whois and was surprised and not sure whether I should be impressed with Yahoo. My experience with previous sites is Yahoo is slow to crawl and slow to index but once it does it is steady and the results stable.