Forum Moderators: open

Message Too Old, No Replies

Google Answers partially indexed

Change in robots.txt

         

robertskelton

1:08 am on Apr 14, 2003 (gmt 0)

10+ Year Member



The Google Answers robots.txt has changed

Was:

User-Agent: *
Disallow: /

User-Agent: googlebot
Disallow: /answers/main?cmd=currentquestions
Disallow: /answers/main?cmd=threadview
Disallow: /answers/main?cmd=search

Now:

User-Agent: *
Disallow: /answers/main?cmd=search&q=

Some category pages at Google Answers are showing up in search results. Just do a search for:

What was the car Eminem drove in the movie 8 Mile

Only category pages appear to be indexed, which have a static title. All I can see happening is GA topping results for the odd obscure query where they deserve to.

Regardless, someone is bound to manipulate it.

robertskelton

11:21 pm on Apr 14, 2003 (gmt 0)

10+ Year Member



I'm surprised that no-one else found this interesting. Consider the facts:

1) Google Answers has extremely high PageRank
2) For a couple of dollars anyone can post a question which in some way promotes their website
3) Google have decided this is okay