Hello all - having a problem with a page not being spidered in Inktomi. I get the following error HTTP Forbidden 02/23/02. There are no errors with other similar pages. Has anyone else had same or similar error messages for no apparent reason?
stcrim
3:28 am on Feb 26, 2002 (gmt 0)
The Forbidden error is usually a directory without an index page - if I am understanding you correctly...
You may want to check with your server and see if their default page is index.html or default.html, or whatever...
-s-
coco
9:22 am on Feb 26, 2002 (gmt 0)
The page not being spidered is the index.html for that section. I know the page is ok. I've retrieved it by putting it into the address bar in the browser. I have also checked that there are no .htaccess files blocking it and robots.txt ok
mr_dredd2
8:16 pm on Feb 27, 2002 (gmt 0)
coco - maybe their server has default.htm as a default index page instead of index.html?? check??
