joined:Oct 14, 2009
I'm trying to research a method for running Google search and then crawl x number of pages in the search results and extract data from the pages.
My questions are
Would Google object?
Could I instead use duckduckgo or some other service?
Does anyone know something that does something like this, especially open source?
Its something like a harvester or scraper I guess.
Hope that's clear and I'm in the right place.