Inktomi - failure to index

Has anyone seen this? If so, what does it mean?

[Canton]

I've just submitted about 35 pages to Inktomi through Position Tech and found that 5 of the pages have errors. Four of the pages have an "HTTP request timeout" error and one has a "Disallowed by robots.txt" error.

I've confirmed that the 4 pages with the timeout error are live (they are HUGE pages, but really it doesn't seem like that should matter) and I'm not even using a robots.txt file on this particular site.

I can just wait to see if this problem is rectified without any action, but I was wondering if anyone has seen this before and, if so, if waiting is the best thing to do.

Thanks in advance,

~Canton

[jatar_k]

I have seen it before, the timeout one you might have to address, the page could just be too large. In all cases for the robots.txt error there has been a robots file, clients sometimes don't realize blocking spiders from "/" might be rether less than intelligent. Since ink respiders every 48 hrs I would wait for the next one and if the problem persists then I would address it then.

[jatar_k]

It's been more than 48 hrs, did it fix itself up Canton?

[Canton]

It did indeed...I thank you for the response jatar_k. I was a bit worried there for a bit...

[jatar_k]

whenever I get an error on a page I always wait for the next spidering since it is only 48 hrs. If it is still there I run the numbers on the page/site and if I still can't find it I will contact a support person. Some of the errors are pretty vague.

glad to hear it worked fine.