Welcome to WebmasterWorld Guest from 54.234.153.186

Forum Moderators: open

Message Too Old, No Replies

Inktomi Search doesn't do Directories

Trailing slash stripped

     

Critter

1:41 am on Apr 7, 2003 (gmt 0)

10+ Year Member



Heya folks:

Just a short note that, if you have mod_rewrite or the like turned on, make sure that you're not *requiring* the trailing slash because Inktomi (don't know about others) will strip it off of the GET request.

Example: Your link points to [widgets.com...]

Inktomi will request [widgets.com...]

which can screw things up major if you're not careful...

Of course, this is not the proper way to do things--so in this regard Inktomi is broke ;)

Peter
<^_^>

Marcia

2:06 am on Apr 7, 2003 (gmt 0)

WebmasterWorld Senior Member marcia is a WebmasterWorld Top Contributor of All Time 10+ Year Member



I'm seeing directories ranking with the trailing slash left off, but mod_rewrite isn't being used. What kind of problems are you seeing with it, Peter?

jeremy goodrich

2:12 am on Apr 7, 2003 (gmt 0)

WebmasterWorld Senior Member jeremy_goodrich is a WebmasterWorld Top Contributor of All Time 10+ Year Member



Hm, that doesn't sound too good.

Most of my stuff doesn't invovle rewrite, but there are a few sites that I just added some host stuff to.

Guess this means I'll have to watch for some 404's perhaps. Thanks for the heads up. :)

Critter

2:38 am on Apr 7, 2003 (gmt 0)

10+ Year Member



Well the problem was that I had mod_rewrite looking for a specific pattern (e.g. /hello/) and Inktomi would request /hello without the trailing slash...so I'd give out a 404 (or actually in my case a 302) to the crawler.

I fixed it in a jiffy so that the rest of the crawl would go Ok, but wanted to give the heads up anyway. It's not a problem for me now.

Peter
<^_^>

 

Featured Threads

Hot Threads This Week

Hot Threads This Month