Forum Moderators: open
I plan on submitting my optimized IE pages to the search engines. My questions...
1) will this javascript redirect on my index page hurt my chances at acheiving good rankings?
2) should I include a robots.txt file that disallows spidering on the pages in the netscape folder? I'm concerned about the spiders finding duplicate pages of all the pages in my site.
Most browser detects aren't too large of a javascript file, so you should be ok with that. If you have a large .js file, you might consider linking it instead of putting the code on the actual page.
>>2) should I include a robots.txt file that disallows spidering on the pages in the netscape folder? I'm concerned about the spiders finding duplicate pages of all the pages in my site.
Not all spiders are following the robots.txt file, but when they discover a duplicate they should filter out the duplicate and work with just the one page.
I've been finding that I can use a browser sniffer and then just supply one of two different .css files. This leaves the HTML constant -- only one page needed -- and therefore no redirects are needed.
Also, even when using two different pages, I think the best plan is not to re-direct every visitor, but to make the main page the IE page and redirect only the Netscape user. If you place that redirect in an external .js file, there should be absolutely no search engine misunderstandings.
This plan allows the site's index page to be indexed as is, and just because it IS the index page, it gets a boost on most engines.
Now that Mozilla has put the source code to a pretty good js interpeter (es262 js-1.3) into the open source domain (aka: mozilla or netscape 6), at least one sarch engine from what I've heard is using it to parse some high dollar pages. At first that didn't bother, but upon further study, it sends up some red flags. It would be quite easy to hook into the routines designed to redirect or open new windows. That should be a wake up call.
Like eljefe said, your best bet is to put the code into an external file. Although a few scattered reports of se's grabbing js or css files have popped up from time to time, there's been no mass action on it. I think it is still safe. It is also friendly to non-js visitors and decreases your load time.
#3) yes yes. block the dupes. If they are close enough that a spider might detect them as identicle, don't risk it.
>>>will this javascript redirect on my index page hurt my
>>>chances at acheiving good rankings?
Not for us so far!!!
>>>should I include a robots.txt
Call me paranoid, but I am much more scared of the spider wondering what it is I don't want it to see. Since they don't have to obey and sometimes don't - well you get my drift.
Please note: My experience with Robots.txt is "zero" for the above reason. With that in mind you should consider the Robots.txt advice of Brett eljefe3 and Tedster much more solid.