homepage Welcome to WebmasterWorld Guest from 23.20.63.27
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Visit PubCon.com
Home / Forums Index / Google / Google SEO News and Discussion
Forum Library, Charter, Moderators: Robert Charlton & aakk9999 & brotherhood of lan & goodroi

Google SEO News and Discussion Forum

This 38 message thread spans 2 pages: < < 38 ( 1 [2]     
Drastic drop in pages indexed - due to Big Daddy?
leoo24




msg:707337
 6:24 pm on Feb 21, 2006 (gmt 0)

hey guys :)

site:domain gives me 130k pages, BD gives me 20k, but using the API always gave me around 10k, but yesterday i suddenly lost 8k pages!

anyone else experienced a huge drop in real indexed pages, as opposed to site:domain?

i read someone comment that his own opinion about sites losing pages was due to BD, from that comment i would assume others have also experienced the same as me.

 

classifieds




msg:707367
 10:19 am on Mar 2, 2006 (gmt 0)

Page count via site: has tripled - mostly old pages from August of last year. *All* of them in the Supplemental Index.

I also noticed the similar results for my competitors.

It looks really strange - I suspect they’ve screwed something up and are trying to figure out how to fix it.

Crush




msg:707368
 10:21 am on Mar 2, 2006 (gmt 0)

"Now, I have only old supplementals in the index :-( "

Our main site has all gone supplemental. 234k pages. 18 languages. Cost a fortune to build + 3 years work. Would be interested to see if any other major sites like ours have gone the route of sups?

classifieds




msg:707369
 10:40 am on Mar 2, 2006 (gmt 0)

Crush,

How is your traffic?

Crush




msg:707370
 10:54 am on Mar 2, 2006 (gmt 0)

Going to be bad. Yesterday was normal but by the look of the data centres we going to be in poo.

sit2510




msg:707371
 10:56 am on Mar 2, 2006 (gmt 0)

I have compared the non-BD and BD datacenter by running site search for 30 websites, all of whom are more or less the competitors in my field. Many of them have over 10k or even 100k pages, stay in the field for a long time and survive after Jagger. Here is the rough statistics that I found:

Out of 30 websites:

1) Now 9 of them have more pages in BD than non-BD
2) 6 of 30 lose pages in BD with less that 3%
3) 15 of 30 lose pages in BD starting from 5%-99% (11 of which lose more than 20%)

So you aren't alone...

One thing that I notice is that for every search term (not sites) I made, BD always report much more number of pages than non-BD; many times the no. is double...if so many websites are losing pages in BD, where are those new pages come from?

Armi




msg:707372
 11:52 am on Mar 2, 2006 (gmt 0)

I would like to find out with the following interview why some sites lost pages at Bigdaddy.

Is on the not BigDaddy data center everything correct (fully indexed, ranking Ok)?

Is the 2.1 Googlebot normally active?

How strong is the activity of the Mozilla-Bot?

You were fully indexedon Bigdaddy approx. 1 week ago?

Do you use the Google sitemap?

sit2510




msg:707373
 12:00 pm on Mar 2, 2006 (gmt 0)


Is on the not BigDaddy data center everything correct (fully indexed, ranking Ok)?

++ YES, non-BD show everything correctly

Is the 2.1 Googlebot normally active?

++ YES, it is normal. Those pages drop today are even crawled normally on 28 Feb 06.

How strong is the activity of the Mozilla-Bot?

++ Normal

You were fully indexedon Bigdaddy approx. 1 week ago?

++ YES

Do you use the Google sitemap?

++ NO.

Armi




msg:707374
 12:03 pm on Mar 2, 2006 (gmt 0)

Is on the not BigDaddy data center everything correct (fully indexed, ranking Ok)?

++ No, I´ve lost lots of pages on August 2005 - but ranking is Ok

Is the 2.1 Googlebot normally active?

++ No, very poor since August 2005.

How strong is the activity of the Mozilla-Bot?

++ Very BIG!

You were fully indexedon Bigdaddy approx. 1 week ago?

++ YES! 4x pages then on the not Bigdaddy datacenters

Do you use the Google sitemap?

++ NO

This 38 message thread spans 2 pages: < < 38 ( 1 [2]
Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Google / Google SEO News and Discussion
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved