homepage Welcome to WebmasterWorld Guest from 54.204.141.129
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Yahoo / Yahoo Search Engine and Directory
Forum Library, Charter, Moderators: martinibuster

Yahoo Search Engine and Directory Forum

    
Slurp from Whois
Is this normal for Yahoo to look for new domains?
Escape




msg:844405
 2:17 pm on Sep 7, 2005 (gmt 0)

I registered a new domain mid August and put the in-development site live a week later. I had no reason to look at logs until today - no links in and no submissions. I've just noticed that Slurp came by last week. It followed hot on the heels of a Whois IP. Is this normal of Yahoo! to check out newly registered domains and should I expect such pro-active behaviour of other robots?

A new site with a prviously unregistered domain is new to me so I won't be offended if anyone says "so what", "of course they found you - Yahoo is thirsty for new blood" etc.

 

rjwmotor




msg:844406
 8:02 pm on Sep 7, 2005 (gmt 0)

I also had the same thing happen to me with a site I recenty registered. First referral was from yahoo via whois. That was the only bot that visited until I linked it from another site. Not to say that other bots might not find you anyway.

Import Export




msg:844407
 10:55 am on Sep 8, 2005 (gmt 0)

Are you saying that you noticed this as a *fact* from your logs or that Yahoo just found your new site and you *think* it came from whois?

Many times webmasters do not realize that running toolbar(s) is all it takes for your site to have bots crawling all over it whether you are submitting (does anyone still do that?), being linked to, or promoting in any other way..

morphisb




msg:844408
 3:32 pm on Sep 8, 2005 (gmt 0)

The same thing happened to me too, Import Export, brings up a good point, so I don't know if it was the Whois or the Toolbar, but eventually Google, MSN and Yahoo indexed my site.

This was unfortunate because I didn't know this would happen. I was slowly developing my site and it went several months with out an update and no inbound links. Google must think it's spam because it got tossed into the Supplemental index. The past few months I've done a lot of work on this site but it still struggles in all the search engine's SERPs.

Funny thing is, there are about 70 pages total, not a single advertisement, no Adsense, no affiliate links, just pure content. I guess it shows how important inbound links are, without them I guess you get labeled as spam.

Escape




msg:844409
 6:37 pm on Sep 8, 2005 (gmt 0)

My logs are minute, with visits from only 4 IP addresses 2 are mine (office & home), 1 Whois immediately followed by 1 Yahoo. The day after I uploaded the site my laptop blew up and only visited the site with a temporary one without anything but MS Office so no visits with toolbars.

I have no doubt it came via Whois and was surprised and not sure whether I should be impressed with Yahoo. My experience with previous sites is Yahoo is slow to crawl and slow to index but once it does it is steady and the results stable.

Thanks for your thoughts.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Yahoo / Yahoo Search Engine and Directory
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved