Welcome to WebmasterWorld Guest from 220.127.116.11
Forum Moderators: martinibuster
Most important question is that would they affect AdSense?
>What are they doing?
They are indexing your pages just like Google does, except those usually send you less traffic (see below)
>Why is yahoo using so large number of ip's for crawling?
Because they are not very smart.
>would they affect AdSense
No, they don't load Java ads, they are getting only the text on your pages.
[edited by: Hobbs at 12:01 pm (utc) on July 14, 2007]
My question is since Yahoo visits so excessively do my traffic stats programs count them as unique visitors and therfeore inflate my stats? With some of my lower traffic or new websites it sometimes appears the majority of its traffic comes from the Yahoo crawlers.
Why does Yahoo do that anyway? Seems like a waste of resources and bandwith.
P.S. What is the difference between a crawl and indexing?
to make it worse they often use different IP's
That's just standard operating procedure for ALL search engines as the crawlers are distributed across multiple servers and multiple IPs.
More IPs doesn't make it worse, it's just how it works normally.
Google comes from a consistent IP
Um no, Google has a LOT of IP's, it doesn't just crawl from a single IP.
Even with Yahoo and MSN crawling from China it's still a consistent block of IPs.
[edited by: incrediBILL at 7:21 am (utc) on July 15, 2007]