Forum Moderators: Robert Charlton & goodroi
Just to follow up, I'd like to say that the misbehaving website was removed, that was pretty fast great work!
However the "SEO company" (the real responsible) keeps on spreading their spam and cheats, I think that this one is the one to target because they convince their customers, not very knowledgeable, that it is ok to hide text, build cloaking pages etc...
I just submitted some more spam from them, on more competitive terms.
I suppose that it's going to take some time considering the HUGE amount of cheats only from that company across all industries and all continents, it feels a little like they are playing Google isn't it? With their URL embedded in their cloaking pages :)
Good investigation!
I think my site could handle that - but 20 a second for a sustain period.
20 hit per second for a sustain period works out at 72,000 page requests an hour.
When my site was doing well I only recieved say 500 visitors an hour.
some would say that people cut and pasting TOTALLY unrelated comments on a Google update thread are...well you get the point :)
Paul, the objective of Jagger is to improve our index results. The three stages are actually three independent launches.
urdudesamy, there are some Jagger1-related changes going on at 66.102.7.104."
[edited by: thecaptainandcookie at 9:15 pm (utc) on Nov. 3, 2005]
Even with this change it is unlikely to be able to survive that type of crawling (IMO)
Re MC Blog post - intresting so 66.102.7.104. is becoming Jagger1 - (what was it before?)
>> Stephen, I don’t think we support crawl-delay in robots.txt.
I know - lol ;)