I have a subdomain (xyz.domain.com) which bots are indexing. The main site (www.domain.com) has same contents. Is there a way to put a directive in the robots.txt file of xyz.domain.com so that all bots are directed to www.domain.com?
I dont want to exclude bots from visiting xyz.domain.com, I just want to redirect them to the main site. If this is not possible with robots.txt, I am curious if this would possible with .htaccess or mod_rewrite .
Thanks.