---- Search Suggestions Overhaul - Just Before the Google Instant Launch
tedster - 9:46 pm on Sep 11, 2010 (gmt 0)
My understanding was that the primary data for Suggest comes from user searches, not page spidering or potential results. Here's a section of Google's newly updated Help page.
The search queries that you see as part of autocomplete are a reflection of the search activity of all web users.
Just like the web, the search queries presented may include silly or strange or surprising terms and phrases. While we always strive to neutrally and objectively reflect the diversity of content on the web (some good, some objectionable), we also apply a narrow set of removal policies for #*$!ography, violence, and hate speech.