| Welcome to WebmasterWorld Guest from 22.214.171.124 |
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
|Pubcon Platinum Sponsor 2014|
|rules about using google search results|
I'm trying to research a method for running Google search and then crawl x number of pages in the search results and extract data from the pages.
My questions are
Would Google object?
Could I instead use duckduckgo or some other service?
Does anyone know something that does something like this, especially open source?
Its something like a harvester or scraper I guess.
Hope that's clear and I'm in the right place.
All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved