homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Google / Google SEO News and Discussion
Forum Library, Charter, Moderators: Robert Charlton & aakk9999 & brotherhood of lan & goodroi

Google SEO News and Discussion Forum

This 218 message thread spans 8 pages: < < 218 ( 1 2 [3] 4 5 6 7 8 > >     
Big Daddy Part 6

 5:33 pm on Mar 24, 2006 (gmt 0)

< continued from [webmasterworld.com...] >

It seems nearly all the data centers are showing some form of bigdaddy results now. I am not sure if there is a 100% bigdaddy/not bigdaddy distinction anymore.

The only two DCs I see that are showing different results are and and those results seem to be from late December, early January, at least in the sectors I monitor.

[edited by: tedster at 5:31 am (utc) on Mar. 25, 2006]



 2:03 pm on Mar 26, 2006 (gmt 0)


Not sure about how google sees you updating and whether it is fresh content or feed from someone else already recognized by google and sort of filtering out dupe content pushes you down in the serps some?

As far as contacting them there is an email address but from what I am reading theyre no longer monitoring as they know they have issues.


 2:07 pm on Mar 26, 2006 (gmt 0)

Hi Cheers for that.
Most of the updating has been, as always, new products, new info etc.
Dup filter could be having an effect - we used copyscape to find some idiots copying whole pages including the "how to make payment" sections and "about us" -utterly bizzare.
Well if they know they have problems it will get resolved, they're generally quite good in that way.


 3:16 pm on Mar 26, 2006 (gmt 0)

Maybe this is just coincidence, would like some other opinions. googlebot often hit our robots.txt file several times a day. It almost always hit it first as a 301 (no www), then followed up with the correct version and got the 200.

A few days ago we finally started ranking number one for our home page and our home page was listed number one when you do the site search. (the rest of the site is still supplemental)

Googlebot has not hit the robots.txt file since our homepage started ranking for it's own unique name, is this just coincidence or could there be something to this.

It is a site over 5 years that dropped from googles grace Feb 2nd of 2005.


 4:03 pm on Mar 26, 2006 (gmt 0)


More than likely Google has your robots.txt stored and sees it not changing between crawls so it knows the history no need to keep banging the server for it.

It will show up as an error when the bots are looking for iti intially but seems after several updates it no longer looks.

Also are you using Google Sitemap?

As for the dump in Feb 2005 when does your domain name expire?

Avalance are you using Froogle? You should be uploading your new products to Google via their upload ftp. This will get you into Google before others can rip/scrape you and outrank.

Yes eventually Google straightens things out. It took me three months to get a huge 100k pharm site back in after going from shared to dedicated servers but anythings possible and why I always say...

Live by Google...Die by Google...

never a good business model to place all your eggs in one search engine basketcase...



 4:14 pm on Mar 26, 2006 (gmt 0)

>>Maybe this is just coincidence, would like some other opinions.

Pure coincidence. Websites change their robots.txt all the time. Google would never know if it changed unless it looks at it. They can't assume just because it hasn't changed in the last three months, it's never going to change - that's just plain silly.


 4:15 pm on Mar 26, 2006 (gmt 0)


Yeah we have a sitemap. Have has since the first week they google introduced them.

I just thought it was strange that for over a year googlebot would hit the robots.txt several times a day first as a 301 and then as a 200.

Then when it appears that the canonical problems MAY be fixed on our site the robots.txt quits visiting like that.


 4:18 pm on Mar 26, 2006 (gmt 0)


The last time we renewed it we did it for 5 years so it will expire late in the year 2007. Does that make a difference?


 4:21 pm on Mar 26, 2006 (gmt 0)


I realize they hit the robot file a lot. But it still seems strange that it always hit the non www version first all the time.


 4:29 pm on Mar 26, 2006 (gmt 0)


No it would appear not as Feb 2005 is over a year from the expiration date. I've seen a few sites tank when domain expires in less than a year which is not saying that is what caused the drop but seems coinicdental.

As for what version of the robots.txt the googlebot was looking for how is your domain name set up in DNS records?

This could be your answer if not the full absolute URL but one of the Symlinks then Google probably was banging for non www due to DNS

Just a thought


I have to disagree with your assertion. From my findings many websites do not change their robots.txt files often.. most do not have one...I would say 80% that I have run into over the years do not even have one.

It's SEO 101 step.. and I have clients who've used 3 firms before myself.. and none of them even added a robots file to the server.

Go figure ....


 6:39 pm on Mar 26, 2006 (gmt 0)

You lost me a little bit there about the DNS records,
I am not sure exactly what you are looking for.


 7:09 pm on Mar 26, 2006 (gmt 0)

Hi RobinK

DNS records are the basis of how computer know how to communicate with each other on the Internet.

Each domain name and DNS records that will tell "other computer"

where to look for a "web page" (Your Site) or an email server as well as many other resources.

If your DNS records are not set properly googlebot could be getting the wrong form of your domain name.



 7:24 pm on Mar 26, 2006 (gmt 0)

Hi Robin

You can also read more on DNS records on Matt Cutts blog here



 11:29 am on Mar 27, 2006 (gmt 0)

Im am not back again although i still have a lot of pages yet to be added back in ... no supps and many rankings back




 11:35 am on Mar 27, 2006 (gmt 0)

Still no change for me other than Googlebot-Mozilla crawling the entire site yesterday.


 12:37 pm on Mar 27, 2006 (gmt 0)

It's a big day for me today guys. It's the 3 month anniversary of my BigDaddy hell, starting Dec 27th 2005 (80% - 90% decrease in traffic). It's crazy but I've gotten used to it. Took the time to redesign my main site and whatever traffic I am getting is optimized to squeeze as much revenue as possible out of it. Looking forward to the big G clearup and the dawn of the BigDaddy age in earnest.

Silver linings anyone.


 1:16 pm on Mar 27, 2006 (gmt 0)


You may be one of the few webmasters with common sense and whom doesn't want to blame Google for their losses even though it's clear that was part of the problem

You have to remember Google will only send 40% or so of all traffic to websites,, Msn & Yahoo have the other 60% or so.

SEO your site for those two engines and you'll probably do as well if not better than with Google as Google conversion to sales is poor!


 2:50 pm on Mar 27, 2006 (gmt 0)

On Im completely out of the Supplemental Hell!


 2:51 pm on Mar 27, 2006 (gmt 0)

Thanks for that Armi :)

Seeing some pages return for a site there.


 2:53 pm on Mar 27, 2006 (gmt 0)

Also on!


 2:54 pm on Mar 27, 2006 (gmt 0)

>>Google conversion to sales is poor!

With all due respect, you should not be making blanket statements like this. Someone might mistake this for fact.


 2:54 pm on Mar 27, 2006 (gmt 0)

Finally seeing more of my pages coming out of SuppHell - just in the last day or so...should give hope to some. Also seeing the 'last cached' date next to my site for the first time in a long while


 2:59 pm on Mar 27, 2006 (gmt 0)


I am seeing 10 or so pages returning from hell on this DC!

First improvement since day one.

Could this be the start of a fix?


 3:08 pm on Mar 27, 2006 (gmt 0)

>>Google conversion to sales is poor!

"With all due respect, you should not be making blanket statements like this. Someone might mistake this for fact."

Ok... but it is fact,,, in a great many categories,,, and said by many others.

Google says it is the most relevant search engine as if it were a fact... and I can say confidently it is not....

so why are they allowed to state their facts and I shoud not be allowed to state mine?

So BillyS, if its your google stocks your worried about, I do little to effect the price I assure you.


 3:10 pm on Mar 27, 2006 (gmt 0)


keyword rankings reports are showing stability in the .com but .co.uk Google SERPS are still flipping.

Seems we could be returning to normalcy as PR has stopped it's flip flopping daily as well.


 3:15 pm on Mar 27, 2006 (gmt 0)

86 of our pages just came out of supplemental on I hope this is truly a fix happening here.

1000+ to go.


 3:16 pm on Mar 27, 2006 (gmt 0)

Are we likely to see results moving to the other DC,s soon?


 3:17 pm on Mar 27, 2006 (gmt 0)


I think that was a bit tongue in cheek by BillyS due to your post earlier regarding the Big Daddy roll out being complete comment by frakilk.

Using the available information (eg the test as confirmed by Google/MC) Frakilk was 100% correct at the time to say rollout was done (subject to rollback etc)

And using the available information you have you can say Google conversion to sale is poor of course :)

>>>Seems we could be returning to normalcy as PR has stopped it's flip flopping daily as well.

Hmmmz - facts for you.

Mozilla Googlebot crawled the Big Daddy Index.

The PR being displayed at the moment is not generated by the Mozilla Googlebot crawl.

But what is normal for Google ;).

[edited by: Dayo_UK at 3:19 pm (utc) on Mar. 27, 2006]


 3:17 pm on Mar 27, 2006 (gmt 0)

Ellio I am seeing a return after 45 days finally on that dc as well for our one site that was effected :)


 3:47 pm on Mar 27, 2006 (gmt 0)


Good points!

>>But what is normal for Google?

that one is easy

not being normal lol


 3:50 pm on Mar 27, 2006 (gmt 0)

and I still don't agree it's compete lol

I said it seems on the .com... other Google DC around the world seem a bit snafu.


 5:47 pm on Mar 27, 2006 (gmt 0)

Folks just to clarify again, I never stated that BD was completely rolled out. I simply quoted a line from jrs_66's post above me about BD being rolled out and added a 'humorous' comment to it. See msg #:22 in this thread. Sorry to be anal about it but I don't like to be misquoted ;)

This 218 message thread spans 8 pages: < < 218 ( 1 2 [3] 4 5 6 7 8 > >
Global Options:
 top home search open messages active posts  

Home / Forums Index / Google / Google SEO News and Discussion
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved