Forum Moderators: phranque

Message Too Old, No Replies

How to make a Meta Search Engine

         

r4bet

7:22 am on Dec 25, 2011 (gmt 0)

10+ Year Member



i want make something like dogpile but with more and different arguments . i think its possible write a script to extract search from google and other engines then combine and show them to client. but there is a problem ,google recently if u search too much from same IP show you a captcha to make sure you are not a bad bot ...
how i can solve that problem ? or google never allow me to do that and i only can use bing and yahoo ?

phranque

12:20 pm on Dec 25, 2011 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



section 5.3 of the Google Terms of Service [google.com] should cover that.

r4bet

1:49 pm on Dec 25, 2011 (gmt 0)

10+ Year Member



-so how dogpile do it ?
-if google impossible its ok i use bing and yahoo ?

r4bet

4:45 pm on Dec 26, 2011 (gmt 0)

10+ Year Member



my question is with Bing and yahoo its legal ? and i can do it ?

jecasc

6:33 pm on Dec 26, 2011 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I guess dogpile has a license agreement with the search engines it uses.

And no it is not allowed to scrape Bing or Yahoo for a meta search engine without permission. Simply check the Terms of Use on the websites.

r4bet

7:17 pm on Dec 26, 2011 (gmt 0)

10+ Year Member



How i can get permission ?
because if i just send an email to them it take more than 2 years for a simple answer (specially yahoo !)

Robert Charlton

5:37 am on Dec 29, 2011 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



This is all conjecture... but I think it's usually phrased: "My people will talk to your people"... and I suspect the answer isn't simple. That's why you need intermediates. If your "people" are qualified to do the talking, they should be able to find out whom to contact.

r4bet

1:12 pm on Dec 29, 2011 (gmt 0)

10+ Year Member



as i'm a very small company i think i have no chance. so shame