Why are there so many sites obviously poaching results from Google these days? Hardly a day goes by when another one doesn't popup. Many are scraping straight results (not API).
How's one do it without getting banned?
BigDave
3:56 pm on Dec 2, 2002 (gmt 0)
They could be using a different IP to search google than the one that serves the results. They could even set up a p2p scumware network to do the searches.
Brett_Tabke
3:58 pm on Dec 2, 2002 (gmt 0)
Easily spotted from Googles side. Just search for something bizzare and then look in the request logs.
DaveN
3:59 pm on Dec 2, 2002 (gmt 0)
getting feeds from someone who as an API?
DaveN
BigDave
4:04 pm on Dec 2, 2002 (gmt 0)
> Easily spotted from Googles side. Just search for something bizzare and then look in the request logs.
But much harder to ban if it's a p2p doing the searches.
Brett_Tabke
9:30 pm on Dec 2, 2002 (gmt 0)
Do you have any such tools?
ggrot
10:05 pm on Dec 2, 2002 (gmt 0)
Heh. Now what if these places were smart enough to run every search word through a dictionary first and reduce queries to 3 words searches or something. Would make oddball queries tougher.
Brett_Tabke
3:33 pm on Dec 3, 2002 (gmt 0)
Then do a chain of them. apples, oranges, fruit...etc
Googles got big enough pipes they could - umm, flood just about anyone with a pseudo dos attack.