Getting a 2 year old site fully crawled in Inktomi

& making it obey that damn 301 redirect

[Imaster]

I have a 2 year old site which is fully crawled in most search engines, including google, alltheweb, etc.

I have 2 points to make:

1: Inktomi doesn't even have 10% of the site in its index, even though every month it crawls almost the whole site as is evident from the logs.

2: The site is called domain.com & I also have one more domain name from where I have provided a 301 redirect.

Thus domain1.com also redirects to abc.com

But due to inks technology which refuses to listen to any 301's, it has crawled the site not with domain.com urls, but with the domain1.com urls.

The site has decent navigation and is pretty much highly linked from many sites as I check backward links in google.

How do I get ink to crawl all the pages and how do I make it understand that the actual url is domain.com & not domain1.com

[Alternative Future]

Ditto Imaster I have the exact same problem I don't even know where it picked up my other domain from, I also have the 301 in place which dont make a d***. It also used to rank quite well in Ink!

Please let us know if you get anywhere on this one!

_gs

[Imaster]

Good to know that I am not alone, gs :)

I certainly hope that our dear friends here do provide us with some viable suggestions that may make the task easier for us and I am certain some would soon :)

[mcavic]

As for the 301's, write to slurp-help at inktomi.com and tell them that Slurp isn't obeying 301 redirects and that the proper behavior is for it to drop the old url's and index the new ones instead.

I don't know if there's any way to get it to index more pages... it has been crawling furiously lately, but I have yet to see most of those pages added to the index.

[Imaster]

I will write to ink and let you know what they say. Thanks. Btw, do they generally reply?

[Alternative Future]

Thanks everyone,

Imaster I shall wait and see how you get on it might be worth noting this post that we both participated in :)
[webmasterworld.com...]

Please keep me updated...

KR,

-gs

[Imaster]

Hey gs,

Certainly :) Good luck to you as well.

[wingslevel]

me too - slurp<>301!