Welcome to WebmasterWorld Guest from

Forum Moderators: martinibuster

Message Too Old, No Replies

Yahoo search dropping terminal / from subdir path - known issue?

3:19 pm on Feb 4, 2005 (gmt 0)

Junior Member

10+ Year Member

joined:Jan 27, 2003
votes: 0

When I idly browsed my server logs today I noticed a number of referrals from Yahoo Search results for which the response length did not made sense. I typed the same search term into Yahoo! search and saw a directory from a site of mine


among the search results. On clicking on the link I saw a page that I did not expect: the output from a script that does certain lookup-y things, taking the file name from an URL request for files other than a directory. (the whole thing has to do with the site being for lookups of data; I wanted to provide short URLs for linking; the script is called via mod_rewrite)

It turns out that Yahoo Search has the content of


in its search index, but on clicking on the search result sends the browser to


In the standard configuration of most web servers this makes only a small difference (the web server automatically serves a redirect to the correct URL), but in some cases this behaviour breaks the functionality of Yahoo Search's result pages. Is this issue known? I'd imagine it would be readily usable for cloaking by black hats (and at the same time reduce the referrals from Yahoo Search to some white hats)


2:17 am on Feb 7, 2005 (gmt 0)

Preferred Member

10+ Year Member

joined:Feb 27, 2002
votes: 0

Yes, Yahoo does normalize URLs to remove trailing slashes. When requesting or recording specific URLs, users don’t use trailing slashes and this form is perceived to be more readable. Yahoo’s goal is a quality user experience, and so this normalization was adopted to be consistent with user expectations and prevailing standard Web usage.

This behavior requires webmasters to have their server configured to accept both requests with and without the trailing slash.