homepage Welcome to WebmasterWorld Guest from 54.226.80.196
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Advertising / Paid Inclusion Engines and Topics
Forum Library, Charter, Moderators: Brett Tabke

Paid Inclusion Engines and Topics Forum

  posting off  
Inktomi Search doesn't do Directories
Trailing slash stripped
Critter




msg:25724
 1:41 am on Apr 7, 2003 (gmt 0)

Heya folks:

Just a short note that, if you have mod_rewrite or the like turned on, make sure that you're not *requiring* the trailing slash because Inktomi (don't know about others) will strip it off of the GET request.

Example: Your link points to [widgets.com...]

Inktomi will request [widgets.com...]

which can screw things up major if you're not careful...

Of course, this is not the proper way to do things--so in this regard Inktomi is broke ;)

Peter
<^_^>

 

Marcia




msg:25725
 2:06 am on Apr 7, 2003 (gmt 0)

I'm seeing directories ranking with the trailing slash left off, but mod_rewrite isn't being used. What kind of problems are you seeing with it, Peter?

jeremy goodrich




msg:25726
 2:12 am on Apr 7, 2003 (gmt 0)

Hm, that doesn't sound too good.

Most of my stuff doesn't invovle rewrite, but there are a few sites that I just added some host stuff to.

Guess this means I'll have to watch for some 404's perhaps. Thanks for the heads up. :)

Critter




msg:25727
 2:38 am on Apr 7, 2003 (gmt 0)

Well the problem was that I had mod_rewrite looking for a specific pattern (e.g. /hello/) and Inktomi would request /hello without the trailing slash...so I'd give out a 404 (or actually in my case a 302) to the crawler.

I fixed it in a jiffy so that the rest of the crawl would go Ok, but wanted to give the heads up anyway. It's not a problem for me now.

Peter
<^_^>

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Advertising / Paid Inclusion Engines and Topics
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved