Forum Moderators: open
The index page (eg. www.example.com) contains a script to detect visitor country and uses the Location header to redirect as follows...
www.example.com/en (English home page)
www.example.com/fr (French home page)
www.example.com/es (Spanish home page)
www.example.com/it (Italian home page)
www.example.com/de (German home page)
All other countries will automatically default to the English home page.
I am concerned that search engines will not be able to index my site because of the redirect so I am looking for a method to overcome this?
I know I could detect Googlebot etc. and serve a special index page (with crawlable links) but am I asking for trouble here?
Does anyone have any ideas?
However, I'd recommend not using redirects. Why not just serve up the different versions without a redirect? A redirect is totally unneccesary here. Instead of outputing a Location header, just output the appropriate version of the web page. Google has said that this type of "cloaking" is fine with them.
However, serving a special version for Googlebot (or other spiders) could get you penalized.
My reason for using index pages in different directories was that I wanted to find a way to maintain the visitors language on all pages throughout the visit without using session variables. My script extracts the country from the URI on each page and serves the language accordingly.
However, if search engines can follow a Location header redirect then presumably, this won't be a problem for me?