Welcome to WebmasterWorld Guest from 54.147.199.169

Forum Moderators: Robert Charlton & aakk9999 & andy langton & goodroi

Message Too Old, No Replies

Drastic drop in pages indexed - due to Big Daddy?

     
6:24 pm on Feb 21, 2006 (gmt 0)

Junior Member

10+ Year Member

joined:Feb 6, 2003
posts:164
votes: 0


hey guys :)

site:domain gives me 130k pages, BD gives me 20k, but using the API always gave me around 10k, but yesterday i suddenly lost 8k pages!

anyone else experienced a huge drop in real indexed pages, as opposed to site:domain?

i read someone comment that his own opinion about sites losing pages was due to BD, from that comment i would assume others have also experienced the same as me.

10:19 am on Mar 2, 2006 (gmt 0)

Junior Member

10+ Year Member

joined:Dec 17, 2004
posts:110
votes: 0


Page count via site: has tripled - mostly old pages from August of last year. *All* of them in the Supplemental Index.

I also noticed the similar results for my competitors.

It looks really strange - I suspect they’ve screwed something up and are trying to figure out how to fix it.

10:21 am on Mar 2, 2006 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Mar 24, 2002
posts:1094
votes: 0


"Now, I have only old supplementals in the index :-( "

Our main site has all gone supplemental. 234k pages. 18 languages. Cost a fortune to build + 3 years work. Would be interested to see if any other major sites like ours have gone the route of sups?

10:40 am on Mar 2, 2006 (gmt 0)

Junior Member

10+ Year Member

joined:Dec 17, 2004
posts:110
votes: 0


Crush,

How is your traffic?

10:54 am on Mar 2, 2006 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Mar 24, 2002
posts:1094
votes: 0


Going to be bad. Yesterday was normal but by the look of the data centres we going to be in poo.
10:56 am on Mar 2, 2006 (gmt 0)

Full Member

10+ Year Member

joined:Jan 3, 2003
posts:325
votes: 0


I have compared the non-BD and BD datacenter by running site search for 30 websites, all of whom are more or less the competitors in my field. Many of them have over 10k or even 100k pages, stay in the field for a long time and survive after Jagger. Here is the rough statistics that I found:

Out of 30 websites:

1) Now 9 of them have more pages in BD than non-BD
2) 6 of 30 lose pages in BD with less that 3%
3) 15 of 30 lose pages in BD starting from 5%-99% (11 of which lose more than 20%)

So you aren't alone...

One thing that I notice is that for every search term (not sites) I made, BD always report much more number of pages than non-BD; many times the no. is double...if so many websites are losing pages in BD, where are those new pages come from?

11:52 am on Mar 2, 2006 (gmt 0)

Junior Member

10+ Year Member

joined:May 28, 2004
posts:89
votes: 0


I would like to find out with the following interview why some sites lost pages at Bigdaddy.

Is on the not BigDaddy data center everything correct (fully indexed, ranking Ok)?

Is the 2.1 Googlebot normally active?

How strong is the activity of the Mozilla-Bot?

You were fully indexedon Bigdaddy approx. 1 week ago?

Do you use the Google sitemap?

12:00 pm on Mar 2, 2006 (gmt 0)

Full Member

10+ Year Member

joined:Jan 3, 2003
posts:325
votes: 0



Is on the not BigDaddy data center everything correct (fully indexed, ranking Ok)?

++ YES, non-BD show everything correctly

Is the 2.1 Googlebot normally active?

++ YES, it is normal. Those pages drop today are even crawled normally on 28 Feb 06.

How strong is the activity of the Mozilla-Bot?

++ Normal

You were fully indexedon Bigdaddy approx. 1 week ago?

++ YES

Do you use the Google sitemap?

++ NO.

12:03 pm on Mar 2, 2006 (gmt 0)

Junior Member

10+ Year Member

joined:May 28, 2004
posts:89
votes: 0


Is on the not BigDaddy data center everything correct (fully indexed, ranking Ok)?

++ No, I´ve lost lots of pages on August 2005 - but ranking is Ok

Is the 2.1 Googlebot normally active?

++ No, very poor since August 2005.

How strong is the activity of the Mozilla-Bot?

++ Very BIG!

You were fully indexedon Bigdaddy approx. 1 week ago?

++ YES! 4x pages then on the not Bigdaddy datacenters

Do you use the Google sitemap?

++ NO

This 38 message thread spans 2 pages: 38