Forum Moderators: Robert Charlton & goodroi
That seems the smart thing to do, but it is really hard to stand by and do nothing; particularly as this update is taking forever.
"Sites that have remained unaffected have very high trust rank, even though some like to debate about its existence so maybe I shouldn't use that term? Whatever you want to call it, they have a lot of that. No drop."
Traffic, backlink and on-page analysis-wise, we totally match all the sites that still rank (or rather, we did), so I feel pretty strongly that "trust rank" exists. No proof basis for this statement though!
Fish don't fry in the kitchen,
Beans don't burn on the grill.
Took a whole lotta tryin'
Just to get up that hill.
Now we're up in the big leagues,
Gettin' our turn at bat!
As long as we live,
It's you and me, baby!
There ain't nothin' wrong with that!
Hooray, We're Movin' on Up!
Movin' on Up!
To the east side!
Movin' on Up!
To a dee-luxe apartment in the sky! We're Movin' on Up!
Movin' on Up!
To the east side!
Movin' on Up!
We've finally got a piece of the pie!
Thanks for your thoughts regarding Mozilla Googlebot.
MacDave - yes I am on shared hosting and site is totally database driven - so it may have contributed, if Mozilla Googlebot was attacking other sites too. I have changed my databases Index and Primary keys - Gbot has not come back to attack yet so dont know if it will survive.
AlexK - I remember your posts when you asked Mozilla Googlebot to slow down, bit worried that if I asked G to do that Googlebot will disappear. :(
Dcs - look about the same as last night. But encouraging signs on some of the DCs remain.
I dont trust Moz Googlebot - but makes me wonder if it suddenly went F**K - I need to index this site lets get going!
[webmasterworld.com...]
Trustranks calculation is based on a seed of e.g. 200 trusted websites, like government, dmoz etc.
Also whats the deal with the datacenters I listed? Are they theorized to be the 3rd stage of Jagger... or old results? or just ignore them completely? Sorry wish i had more answers than questions... just this thread is waaaaaaaaaaaaaay too long.
I can also vouch for this. We have had the same problem with this particular G-bot. It has set off our spider control many of times. Since we are also database driven this spider control is meant to prevent unnecessary load on our servers.
Most "good" bots usually slow down for pages with dynamic extensions (php, asp...) since it can put a huge strain on servers (mainly shared servers). Bots will crawls those dynamic pages hidden behind html extensions at FULL speed. This is one of the reasons why shared servers tend to downlook on mod-rewrites of dynamic pages to htm(l) extensions. Usually dedicated servers can handle this depending on size of pages, speed of database servers, amount of info being extracted and parsed...and also amount of other traffic occuring at the same time.
Slurp keeps a slow but steady pace and so does msn. I have never seen either of these bots set off our spider control.
Late spring we asked Google to slow it down just a tad bit just enough to keep M-bot from requesting 20 or so pages a second more like 5 or so pages per second. Well they sure slowed it down. It was crawling like a 90 year old woman and seemed to get lost for long periods of time. After which we seen the good ol' warning from the thread mentioned earlier. We sat and waited for a couple few months then requested they speed the bot back up (actually it was last week or so). They did. It hasn't set off our spider control yet but suspect it will set it off judging by the posts here.
[edited by: arubicus at 6:46 am (utc) on Nov. 4, 2005]
that would be a very good way to serve the best serps, according to the users interest. you can cheat machines, but not humans. thats the point, the strategic difference.
The "seed" should be selected manually. I guess some cute guys/ladies will do the selection ;)
Friday 4th November 2005! maybe the day where GG or Matt "officially" aknowledge the "visibility" of Jagger3.
Personally, it wouldn´t make any difference what the kind two gentlemen will say or not will say about the visibility of Jagger3, because that has already been settled yesterday.
What is most interesting is if GG and Matt would be kind to tell us more about the kind of the new index that they expect to emerge after Jagger3. Also to what extent canonical and supplemental issues going to be resolved.
My feeling is that the new index mightbe more "human" or "warm heart" than the old one. But lets wait and see.
Wish you all a great sunny day.
Lol - so mod_rewrite to a .php flat file just to keep Gbot slow - hmmmz (might work - not going to happen yet though)
Where? Its rainy here in germany ;)
No it wouldn't work because they don't slow it down enough for dynamic pages like they could or should. Trust me...we use flat php extensions and it does not slow down. It blasts through it like it were requesting html files. Bad bots (m-bot) gets the good ol' spider control error after so many requests and times out for a few seconds (giving out an error) before allowing further requests from that bot to be processed. This spider control is managed by our hosting company and is virtually out of our control.
I know it is not totally update related - but Mozbot coming maybe due to a change in indexing - as per the update.
Soooo does Mozilla Googlebot only visit sites that have problems though - eg Moz Bot coming to read old supplementals etc?
Anyone with a site that is Hunkey Dorey with Google and not recieve Mozilla Googlebot (eg if normal Googlebot took say 300 pages a day for a 2000 page site it would completely crawl it after a few days - nice and fresh, and then re-crawl it again after a couple of weeks - does Mozbot visit sites like that)
I am hoping that once normal Googlebot comes and indexes properly - Mozilla Googlebot might not come and visit so much.
Bad bots (m-bot) ... we use flat php extensions and it does not slow down
There was a tremendous film (had "Network" in the title) about a TV-presenter with the classic line:
I'm hopping mad, and I'm not gonna take it anymore(repeat until falls unconscious due to brain tumour, accompanied by wild studio applause)
If our attitude is "You can do anything that you want to my site" then guess what will happen? And, once again, there is an alternative control-mechanism for those with PHP-sites [webmasterworld.com].
we all like talking about broken search engines!
I can understand not liking the results if your site took a hit, but these SERPs are much better than what they were putting out.
Sites predominanently relying on link exchanges with big recip directories got pounded in this update. I'd bet a pretty penny that might be your problem. Fire away at getting some relevant one ways instead of whining on a board about Google tanking an area that most of us knew was going to be out about a year ago.
Giga>
Also whats the deal with the datacenters I listed? Are they theorized to be the 3rd stage of Jagger... or old results? or just ignore them completely?
I suggest you look at Matt Cutts comments on his blog, reference the DC's that are likely to be showing results.
I like the way you confidently talk about Jagger 3 already out there on its way, it gives me hope! :)
Deester
Not so with our site but we still got pounded. I will bide my whining till jagger 3 comes out. This is the way it went for us in June and it all came good in the end... so here's hoping!
Not in my market. At least not for the big sites. The newer, weaker sites that used that method got pounded. Especially if that was the only method for links they were using. The older, more established sites that use the same methods held ground or moved up.
There are many reasons this might be the case, age, trust rank, high rankings generating some quality linking in addition to the massive non-themed link exchanging... I'm not looking into to it too much until this is settled.
Well when it takes the DB down - it is a bit of a worry ;)
I get the impression that Mozilla Googlebot is a bit like a dead page checker, link searcher or something.
Now for my site - Google might think I have a lot of dead pages as the Canonical url bug thing led to bad crawling and pages going into supplemental.
Now if these pages were indeed dead then my server would not have a problem returning 20 odd 404 pages a second - however, these pages are not dead and are connecting to a database.....anyway just another crazy theory (but maybe it is why it is so fast as it was expecting 404/410 or 301 or something?)
>>Reseller,
I like the way you confidently talk about Jagger 3 already out there on its way, it gives me hope! :)<<
Thanks!
And I wouldn´t be surprised if GoogleGuy or/and Matt Cutts mention, late today or during the weekend, one of the 3 DCs (Jagger3 Front Troops) I mentioned previously as the place to look for Jagger3.
216.239.53.99
216.239.57.99
66.102.7.99
Of course they can also wait a little until the results of Jagger3 spread from the said 3 DCs to another DCs and chose to mention one of the other DCs as the place to look for Jagger3. And that will be a very "smart" move from GG or/and Matt "spanish eyes" sides :-)
Dear GG & Matt!
The next move is yours :-)
[vaughns-1-pagers.com...]
Just in time before I chucked it all in and got a proper job.
Yes this must be uppermost on their minds, they must be thinking hard of ways to try and prove you wrong....perhaps they will delay the update or maybe even cancel?!
Matt said
"November 3, 2005 @ 1:39 pm
Let’s see. Multiple data centers are now showing Jagger2, but I don’t think every data center is. I believe Jagger2 is at the cluster of data centers that includes 66.102.9.104.
When he says "showing" do you think he means "live"?
.....there are some Jagger1-related changes going on at 66.102.7.104."
This suggests to me that all dc's showing these results are nowhere near the final results we will eventually see.
I suspect, when Matt refers to "seeing Jagger3" that he means "live".
216.239.53.99
216.239.57.99
66.102.7.99
as highlighted by several mambers here early yesterday, seems to have been a progression of earlier developments. Although the serps look similar to pre Jagger results, there is a development going on with those datacentres. I have slowly over the last 10 hours regained more and more rankings. If these DC's were just a kick back I doubt we would have seen changes going on there. There is plenty of evidence that new data is being fed in.
I can understand members not appearing in these DC's being frustrated, I feel your pain..... and chuckle :)
A few days ago in flux, there were a few datacentres which showed yahoo style results (many pages from same domain) instead of indent, but no sign of them now... What do you say folks, I think they were temporary.
Waiting for GG / Brett for any actual confirmation of updates,
I am beginning to feel like a senior citizen at a bingo parlor just waiting to scream it out.
Granted everything has been very useful in this jagger thread, but it's funny to see everyone (myself included) predicting the results.
I wonder how many people here know DC ip's by heart now.
Good Times
