Forum Moderators: DixonJones

Message Too Old, No Replies

Huge site is my biggest visitor

Why?

         

bouncybunny

12:50 am on Dec 17, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I'm hoping it's OK to mention this site, as I have seen it mentioned many times on this forum.

According to my visitor logs, the IP address for Superpages.com is by far the largest single visitor to my site. About 5 times as many pages visited as by Google, MSN and Yahoo put together.

Now my site is UK based and I don't know much about superpages. My web site does not appear to be listed on their directory and would not be much use to anyone if it was.

Anyone know why they are interested and would there be any loss to me if I blocked their IP address?

Thanks

gregbo

2:58 am on Dec 18, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Do you mean Superpages' crawlers are visiting you 5x as much as G+Y+MSN, or you're getting 5x the referrals from Superpages as the latter three?

There is always a risk in blocking access that the visits may be legit and useful to your business. This must be weighed against the risk of them scraping you, driving up your CPC, sucking up your bandwidth, etc.

bouncybunny

12:20 pm on Dec 18, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Well. I get 5x the amount of visits from an IP address that is registered to Superpages.com, as I do from any other IP address.

I've no idea whether these are referals, or bot visits. Do Superpages.com function as an ISP? I can't see them being a referrer, as I can't find any reference to my site in their listings.

Are they a known scraper?

gregbo

9:32 pm on Dec 18, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Do the visitor logs say what the referring URLs are or what the user agent is? What's the average interval between visits? What files are being retrieved (if any)?