homepage Welcome to WebmasterWorld Guest from 54.227.41.242
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Code, Content, and Presentation / JavaScript and AJAX
Forum Library, Charter, Moderator: open

JavaScript and AJAX Forum

    
How do I get search engine results programatically?
complete




msg:4521982
 8:28 pm on Nov 23, 2012 (gmt 0)

How do I get search engine results programatically? Some search engines use AJAX to display content and so the URL does not change. This makes it difficult to get result content from a search engine programatically.

Most search engines do not use AJAX. But two popular ones that I am interested in is YANDEX and DUCKDUCKGO. Both of these search engines use AJAX to advance beyond the first page of results. How do I find a way to programatically access these pages?

 

phranque




msg:4522081
 2:52 am on Nov 24, 2012 (gmt 0)

welcome to WebmasterWorld, complete!

you might want to familiarize yourself with the terms of service for the search engines in which you are interested.
they typically frown on scraping search results using "automated methods".

some search engines provide an API which may be sufficient for your requirements:
DuckDuckGo API - [duckduckgo.com...]
Yandex.XML - [api.yandex.com...]

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Code, Content, and Presentation / JavaScript and AJAX
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved