Forum Moderators: Robert Charlton & goodroi
That seems the smart thing to do, but it is really hard to stand by and do nothing; particularly as this update is taking forever.
"Sites that have remained unaffected have very high trust rank, even though some like to debate about its existence so maybe I shouldn't use that term? Whatever you want to call it, they have a lot of that. No drop."
Traffic, backlink and on-page analysis-wise, we totally match all the sites that still rank (or rather, we did), so I feel pretty strongly that "trust rank" exists. No proof basis for this statement though!
Fish don't fry in the kitchen,
Beans don't burn on the grill.
Took a whole lotta tryin'
Just to get up that hill.
Now we're up in the big leagues,
Gettin' our turn at bat!
As long as we live,
It's you and me, baby!
There ain't nothin' wrong with that!
Hooray, We're Movin' on Up!
Movin' on Up!
To the east side!
Movin' on Up!
To a dee-luxe apartment in the sky! We're Movin' on Up!
Movin' on Up!
To the east side!
Movin' on Up!
We've finally got a piece of the pie!
Thanks for your thoughts regarding Mozilla Googlebot.
MacDave - yes I am on shared hosting and site is totally database driven - so it may have contributed, if Mozilla Googlebot was attacking other sites too. I have changed my databases Index and Primary keys - Gbot has not come back to attack yet so dont know if it will survive.
AlexK - I remember your posts when you asked Mozilla Googlebot to slow down, bit worried that if I asked G to do that Googlebot will disappear. :(
Dcs - look about the same as last night. But encouraging signs on some of the DCs remain.
I dont trust Moz Googlebot - but makes me wonder if it suddenly went F**K - I need to index this site lets get going!
[webmasterworld.com...]
Trustranks calculation is based on a seed of e.g. 200 trusted websites, like government, dmoz etc.
Also whats the deal with the datacenters I listed? Are they theorized to be the 3rd stage of Jagger... or old results? or just ignore them completely? Sorry wish i had more answers than questions... just this thread is waaaaaaaaaaaaaay too long.
I can also vouch for this. We have had the same problem with this particular G-bot. It has set off our spider control many of times. Since we are also database driven this spider control is meant to prevent unnecessary load on our servers.
Most "good" bots usually slow down for pages with dynamic extensions (php, asp...) since it can put a huge strain on servers (mainly shared servers). Bots will crawls those dynamic pages hidden behind html extensions at FULL speed. This is one of the reasons why shared servers tend to downlook on mod-rewrites of dynamic pages to htm(l) extensions. Usually dedicated servers can handle this depending on size of pages, speed of database servers, amount of info being extracted and parsed...and also amount of other traffic occuring at the same time.
Slurp keeps a slow but steady pace and so does msn. I have never seen either of these bots set off our spider control.
Late spring we asked Google to slow it down just a tad bit just enough to keep M-bot from requesting 20 or so pages a second more like 5 or so pages per second. Well they sure slowed it down. It was crawling like a 90 year old woman and seemed to get lost for long periods of time. After which we seen the good ol' warning from the thread mentioned earlier. We sat and waited for a couple few months then requested they speed the bot back up (actually it was last week or so). They did. It hasn't set off our spider control yet but suspect it will set it off judging by the posts here.
[edited by: arubicus at 6:46 am (utc) on Nov. 4, 2005]
that would be a very good way to serve the best serps, according to the users interest. you can cheat machines, but not humans. thats the point, the strategic difference.
The "seed" should be selected manually. I guess some cute guys/ladies will do the selection ;)
