Welcome to WebmasterWorld Guest from

Forum Moderators: martinibuster

Message Too Old, No Replies

Yahoo Slurp Adding Ending Slash

Will it penalize me?

10:05 pm on Jan 11, 2008 (gmt 0)

Junior Member

5+ Year Member

joined:Jan 7, 2008
votes: 0

Our website has VERY strict url handling for what will be returned with a 200 status code. This is to remove duplicate content issues. We enforce protocol (http vs https), sub-domain (we dont use www), url case, file names (obviously), and ending slashes.

We recently launched and all bots and users handle this fine except Yahoo Slurp. For some reason it sometimes (not always) adds an extra slash to the request which is the 404-ed.


http://example.com/my-url - Right
http://example.com/my-url/ - Slurp request

There are no links pointing to the page with an ending slash. I am curious as to if this will hurt us (or perhaps help, if it is testing this)? Any ideas?

I could have the handler 301 to the non slash URL but it could result in a 301 to a 404. Is that seen as an issue?


[edited by: martinibuster at 10:30 pm (utc) on Jan. 11, 2008]
[edit reason] Fixed URL. Example.com is for examples. [/edit]

3:09 pm on Jan 12, 2008 (gmt 0)

Senior Member

WebmasterWorld Senior Member billys is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:June 1, 2004
votes: 0

You should get several opinions on this matter, some here state that Yahoo does not handle 301s correctly. I have just the opposite problem. Slurp keeps asking for:


Which I redirect (301) to:


I've been very consistent in doing this for several years, still Slurp insists on looking for the wrong page.

I could have the handler 301 to the non slash URL but it could result in a 301 to a 404.

This happens all the time on my site:


301'd to:


Then returning a 404.

[edited by: BillyS at 3:12 pm (utc) on Jan. 12, 2008]


Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members