Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- External Javascript and bots and robots.txt?


JeremyL - 4:42 am on Mar 12, 2003 (gmt 0)


Maybe Im parinoid but it's just my nature. I want to keep all se spiders from following sorting links on directory pages. It would basically see duplicate content on different urls if it did, just resorted.

So in an external javascript file I have
function locate(page)
{
thePage='http://www.domain.net/' +page
window.location=thePage
}

Then the url's look like this
<a href="#" onclick="locate('page.php'); return false;">Send</a>

Is there any chance that a SE spider would be able to understand that

thePage='http://www.domain.net/' +page
means
[domain.net...]

On a side not, I thought about putting all my css and js files in thier own dir and having a robots.txt file saying not to spider it. What would googlebot and other se spiders think of this? Would they think I was trying to spam with css colored text and such?


Thread source:: http://www.webmasterworld.com/robots_txt/96.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com