Drastic drop in pages indexed - due to Big Daddy?

[leoo24]

hey guys :)

site:domain gives me 130k pages, BD gives me 20k, but using the API always gave me around 10k, but yesterday i suddenly lost 8k pages!

anyone else experienced a huge drop in real indexed pages, as opposed to site:domain?

i read someone comment that his own opinion about sites losing pages was due to BD, from that comment i would assume others have also experienced the same as me.

[classifieds]

Page count via site: has tripled - mostly old pages from August of last year. *All* of them in the Supplemental Index.

I also noticed the similar results for my competitors.

It looks really strange - I suspect they’ve screwed something up and are trying to figure out how to fix it.

[Crush]

"Now, I have only old supplementals in the index :-( "

Our main site has all gone supplemental. 234k pages. 18 languages. Cost a fortune to build + 3 years work. Would be interested to see if any other major sites like ours have gone the route of sups?

[classifieds]

Crush,

How is your traffic?

[Crush]

Going to be bad. Yesterday was normal but by the look of the data centres we going to be in poo.

[sit2510]

I have compared the non-BD and BD datacenter by running site search for 30 websites, all of whom are more or less the competitors in my field. Many of them have over 10k or even 100k pages, stay in the field for a long time and survive after Jagger. Here is the rough statistics that I found:

Out of 30 websites:

1) Now 9 of them have more pages in BD than non-BD
2) 6 of 30 lose pages in BD with less that 3%
3) 15 of 30 lose pages in BD starting from 5%-99% (11 of which lose more than 20%)

So you aren't alone...

One thing that I notice is that for every search term (not sites) I made, BD always report much more number of pages than non-BD; many times the no. is double...if so many websites are losing pages in BD, where are those new pages come from?

[Armi]

I would like to find out with the following interview why some sites lost pages at Bigdaddy.

Is on the not BigDaddy data center everything correct (fully indexed, ranking Ok)?

Is the 2.1 Googlebot normally active?

How strong is the activity of the Mozilla-Bot?

You were fully indexedon Bigdaddy approx. 1 week ago?

Do you use the Google sitemap?

[sit2510]

Is on the not BigDaddy data center everything correct (fully indexed, ranking Ok)?

++ YES, non-BD show everything correctly

Is the 2.1 Googlebot normally active?

++ YES, it is normal. Those pages drop today are even crawled normally on 28 Feb 06.

How strong is the activity of the Mozilla-Bot?

++ Normal

You were fully indexedon Bigdaddy approx. 1 week ago?

++ YES

Do you use the Google sitemap?

++ NO.

[Armi]

Is on the not BigDaddy data center everything correct (fully indexed, ranking Ok)?

++ No, I´ve lost lots of pages on August 2005 - but ranking is Ok

Is the 2.1 Googlebot normally active?

++ No, very poor since August 2005.

How strong is the activity of the Mozilla-Bot?

++ Very BIG!

You were fully indexedon Bigdaddy approx. 1 week ago?

++ YES! 4x pages then on the not Bigdaddy datacenters

Do you use the Google sitemap?

++ NO