Welcome to WebmasterWorld Guest from

Forum Moderators: Robert Charlton & goodroi

Message Too Old, No Replies

Site search results showing in Google results

4:57 pm on Aug 23, 2011 (gmt 0)

Junior Member from US 

10+ Year Member

joined:Jan 11, 2007
votes: 1

I started to notice that Google has included search results pages of many high power websites like Ebay and Amazon.

As far as we are told this is still against their own guidelines!


Use robots.txt to prevent crawling of search results pages or other auto-generated pages that don't add much value for users coming from search engines.

Google is showing my own sites internal search pages in the SERPS as well but I've had them blocked for years.

With big sites like Amazon and Ebay its easier just to search vs. digging though their navigation. I wonder if something changed where they feel some sites search terms do indeed return valuable results and allows it to happen.

7:08 pm on Aug 23, 2011 (gmt 0)

Administrator from US 

WebmasterWorld Administrator goodroi is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:June 21, 2004
votes: 387

Googlebot is an automated computer program that seeks out data. If a search result page returns a 200 code I would not be surprised if it is crawled by Googlebot. Google has a history of penalizing big sites that did not follow the guidelines. This just might be a glitch.