Forum Moderators: open
Therefore I can not use the nofollow command as that means a dead end.
I tried to use javascript:document.write but that has not worked, the links appear to have been followed ( i cant discount the possibility of a deep link but again all the links on the site are currently JS )..so its strange that since changing to JS links more of my site is now in the index.
Could anybody suggest an alternative method of making a link visible , but hiding it from the crawler?
The robots.txt trick will not work because google will distribute the PR to those pages, but those pages will not be crawled and therefore cannot pass any PR back up.
Either use JS onclick links, or cloak your page and strip out those other links from the page when you send it to googlebot. The latter is not guaranteed safe, but it probably is.
If you are only blocking these pages to conserve PR, you might be doing yourself more damage than good. More pages mean more content, which is more important than PR. On the other hand, some pages are pretty much wortless for Google to have in their index, and will only bring garbage traffic, so go ahead and block them out.
Google will follow any URL they find on your page, including text or javascript. But they will only pass PR through a regular link.
you're the first who clearly answered (me) the question what is a link? [webmasterworld.com] i asked in my first post ever, 1 1/2 years ago. thank you!
The advice is it seems other than block of the whole page there is no way ( other than cloaking which i do not want to do ) to avoid having google scour the page. Shame.
Thanks once again.
David