Welcome to WebmasterWorld Guest from 22.214.171.124
Forum Moderators: goodroi
How do you achieve this using the robots.txt file? Right now we're stumped. We can't add a "noindex" instruction for "#" in robots.txt. The symbol "#" is seen as the beginning of the comment.
Let me know if you need to see the complete code we're trying to use.
[edited by: encyclo at 1:53 pm (utc) on April 18, 2007]
[edit reason] fixed link [/edit]
If it is # as in [webmasterworld.com...] , "#someanchor" is never seen by the webserver, only by the browser, which strips it out before querying the server.
Yes, here's an example of a URL that gets created when I click on a link to be scrolled down the page:
Do you suggest I change # to something else? If so, what?
Am concerned that this will cause the SE's to index both the non "#" page and the "#" page separately, and to discount the backlinks to one of them (probably the "#" version), instead of seeing them as the same page and adding the bl's together. That's what the previous ww URL reference was about - duplicate content.