homepage Welcome to WebmasterWorld Guest from 54.196.201.253
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Yahoo / Yahoo Search Engine and Directory
Forum Library, Charter, Moderators: martinibuster

Yahoo Search Engine and Directory Forum

    
Yahoo Slurp Adding Ending Slash
Will it penalize me?
venti




msg:3546190
 10:05 pm on Jan 11, 2008 (gmt 0)

Our website has VERY strict url handling for what will be returned with a 200 status code. This is to remove duplicate content issues. We enforce protocol (http vs https), sub-domain (we dont use www), url case, file names (obviously), and ending slashes.

We recently launched and all bots and users handle this fine except Yahoo Slurp. For some reason it sometimes (not always) adds an extra slash to the request which is the 404-ed.

Ex:

http://example.com/my-url - Right
http://example.com/my-url/ - Slurp request

There are no links pointing to the page with an ending slash. I am curious as to if this will hurt us (or perhaps help, if it is testing this)? Any ideas?

I could have the handler 301 to the non slash URL but it could result in a 301 to a 404. Is that seen as an issue?

Thanks!

[edited by: martinibuster at 10:30 pm (utc) on Jan. 11, 2008]
[edit reason] Fixed URL. Example.com is for examples. [/edit]

 

BillyS




msg:3546599
 3:09 pm on Jan 12, 2008 (gmt 0)

You should get several opinions on this matter, some here state that Yahoo does not handle 301s correctly. I have just the opposite problem. Slurp keeps asking for:

www.mysite.tld/content-page

Which I redirect (301) to:

www.mysite.tld/content-page/

I've been very consistent in doing this for several years, still Slurp insists on looking for the wrong page.

I could have the handler 301 to the non slash URL but it could result in a 301 to a 404.

This happens all the time on my site:

www.mysite.tld/does-not-exist-page

301'd to:

www.mysite.tld/does-not-exist-page/

Then returning a 404.

[edited by: BillyS at 3:12 pm (utc) on Jan. 12, 2008]

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Yahoo / Yahoo Search Engine and Directory
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved