Welcome to WebmasterWorld Guest from 54.159.250.110

Message Too Old, No Replies

Site search results showing in Google results

   
4:57 pm on Aug 23, 2011 (gmt 0)

5+ Year Member



I started to notice that Google has included search results pages of many high power websites like Ebay and Amazon.

As far as we are told this is still against their own guidelines!

http://www.google.com/support/webmasters/bin/answer.py?answer=35769

Use robots.txt to prevent crawling of search results pages or other auto-generated pages that don't add much value for users coming from search engines.


Google is showing my own sites internal search pages in the SERPS as well but I've had them blocked for years.

With big sites like Amazon and Ebay its easier just to search vs. digging though their navigation. I wonder if something changed where they feel some sites search terms do indeed return valuable results and allows it to happen.

Thoughts?
7:08 pm on Aug 23, 2011 (gmt 0)

WebmasterWorld Administrator goodroi is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



Googlebot is an automated computer program that seeks out data. If a search result page returns a 200 code I would not be surprised if it is crawled by Googlebot. Google has a history of penalizing big sites that did not follow the guidelines. This just might be a glitch.