Forum Moderators: open
I am thinking about inserting a hallway page into one of the sites I manage and including a hidden link on the home page linking to this hallway.What I am worried about is the fact that I use doorways specifically optimised for he 10 major SE's and use a robots.txt to disallow specific spiders from seeing pages that are not optimised for them(trying to avoid spam). Is there any way I can use this method so that the spiders from one engine don't see pages optimised for another.
Any help greatly appreciated.