Forum Moderators: Robert Charlton & goodroi

Message Too Old, No Replies

How To Prevent Google From Flagging Your IP Address

I keep running bulk searches; Google doesn't like it.

         

jelewis8

5:33 pm on Sep 6, 2007 (gmt 0)

10+ Year Member



So I'm running keyword searches in bulk through an unnamed program which has a bulk keyword rank checker built into it.

I used to have no problems running searches well into the thousands, but about three months ago, noticed that larger searches of around 300 keywords or more kept tripping Google's captcha mechanism, and any searches from my IP address have to go through that to actually work.

This effectively shuts down my bulk keyword searching abilities. Does anyone have any workarounds to this rather annoying issue?

youfoundjake

6:40 pm on Sep 6, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



"Don't use unauthorized computer programs to submit pages, check
rankings, etc. Such programs consume computing resources and violate
our terms of service. Google does not recommend the use of products
such as (omitted by me) that send automatic or programmatic queries
to Google."
www..google.com/webmasters/guidelines.html

Just a little heads up, may have to stick to the 100 results per page and using ctrl f to find your domain on each page.

jelewis8

7:21 pm on Sep 6, 2007 (gmt 0)

10+ Year Member



I might be naive, but with that reasoning, how does one get a comparison of one's competitors with thousands of keywords at stake?

dickbaker

10:15 pm on Sep 6, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



My employer requires me to run ranking software for various clients.

So as not to abuse Google, and to prevent any sort of penalty, I set the time between each query to forty seconds. Granted, it takes two days to run a report for about 1,000 keywords, but I haven't noticed any adverse effect.

jelewis8

10:33 pm on Sep 6, 2007 (gmt 0)

10+ Year Member



Thanks dickbaker. I'm in the same boat you are, although I'm not sure the software I'm using has adjustable time features. I'll check into that.

tedster

11:41 pm on Sep 6, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



No doubt that "throttling" the time between queries is a big help - and it removes a burden from Google. It's the same principle as throttling email blasts, so that no one ISP gets hammered in quick succession.

It's also a thoughtful thing to do - just as we expect googlebot to throttle its requests to our servers.