Inktomi Search doesn't do Directories

Trailing slash stripped

[Critter]

Heya folks:

Just a short note that, if you have mod_rewrite or the like turned on, make sure that you're not *requiring* the trailing slash because Inktomi (don't know about others) will strip it off of the GET request.

Example: Your link points to [widgets.com...]

Inktomi will request [widgets.com...]

which can screw things up major if you're not careful...

Of course, this is not the proper way to do things--so in this regard Inktomi is broke ;)

Peter
<^_^>

[Marcia]

I'm seeing directories ranking with the trailing slash left off, but mod_rewrite isn't being used. What kind of problems are you seeing with it, Peter?

[jeremy goodrich]

Hm, that doesn't sound too good.

Most of my stuff doesn't invovle rewrite, but there are a few sites that I just added some host stuff to.

Guess this means I'll have to watch for some 404's perhaps. Thanks for the heads up. :)

[Critter]

Well the problem was that I had mod_rewrite looking for a specific pattern (e.g. /hello/) and Inktomi would request /hello without the trailing slash...so I'd give out a 404 (or actually in my case a 302) to the crawler.

I fixed it in a jiffy so that the rest of the crawl would go Ok, but wanted to give the heads up anyway. It's not a problem for me now.

Peter
<^_^>