homepage Welcome to WebmasterWorld Guest from 54.234.60.133
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Subscribe to WebmasterWorld

Visit PubCon.com
Home / Forums Index / Code, Content, and Presentation / JavaScript and AJAX
Forum Library, Charter, Moderator: open

JavaScript and AJAX Forum

    
How do I get search engine results programatically?
complete




msg:4521982
 8:28 pm on Nov 23, 2012 (gmt 0)

How do I get search engine results programatically? Some search engines use AJAX to display content and so the URL does not change. This makes it difficult to get result content from a search engine programatically.

Most search engines do not use AJAX. But two popular ones that I am interested in is YANDEX and DUCKDUCKGO. Both of these search engines use AJAX to advance beyond the first page of results. How do I find a way to programatically access these pages?

 

phranque




msg:4522081
 2:52 am on Nov 24, 2012 (gmt 0)

welcome to WebmasterWorld, complete!

you might want to familiarize yourself with the terms of service for the search engines in which you are interested.
they typically frown on scraping search results using "automated methods".

some search engines provide an API which may be sufficient for your requirements:
DuckDuckGo API - [duckduckgo.com...]
Yandex.XML - [api.yandex.com...]

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Code, Content, and Presentation / JavaScript and AJAX
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About
© Webmaster World 1996-2014 all rights reserved