Welcome to WebmasterWorld Guest from 50.17.16.177

Message Too Old, No Replies

Huge Disparity in "site:" Results Between Data Centers

     
5:44 pm on Nov 19, 2009 (gmt 0)

Full Member

10+ Year Member

joined:Mar 17, 2004
posts: 301
votes: 0


When I run a "site:domain.com" search on the different data centers, I see two very distinct grouping of results:
1) 200-250 pages found
2) 8000-8500 pages found

I haven't seen much fluctuation in these numbers over the past month.

What does this kind of chasm between data centers usually mean? Are some centers applying a filter? Can you offer any guidance on which centers deserve more attention than others?

6:48 pm on Nov 19, 2009 (gmt 0)

Senior Member

WebmasterWorld Senior Member tedster is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:May 26, 2000
posts:37301
votes: 0


Are you only talking about data center results seen when you poll them directly by IP address? Or do you also mean google.com results that are served from different IP addresses?
7:14 pm on Nov 19, 2009 (gmt 0)

Full Member

10+ Year Member

joined:Mar 17, 2004
posts:301
votes: 0


tedster, I am using an online tool that polls multiple datacenters and returns the results in iframes....or the equivalent of your first scenario.
8:12 pm on Nov 19, 2009 (gmt 0)

Senior Member

WebmasterWorld Senior Member tedster is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:May 26, 2000
posts:37301
votes: 0


Then it seems clear that many of the URLs are being filtered before your domain's spidering is made available live on google.com. The most common reason for this kind of filtering seems to be link juice (PageRank) but if you do an analysis of your own case, you may find that some other characteristic is involved.
2:15 am on Nov 20, 2009 (gmt 0)

Moderator from AU 

WebmasterWorld Administrator anallawalla is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Mar 3, 2003
posts:3701
votes: 3


For over a month I see an extra 2M pages for our site: if I check from home compared to the office (not logged in). Parent company is also the country's biggest ISP, so a colleague using that ISP from home gets the same count as at work.

The only difference I can see is that my home ISP is not powered by the employer's ISP arm. Yes, I typed ISP, not IP. Weird.