position tech spider error

anyone seen this?

[mr_dredd2]

all pages spider fine in position tech, except for a directory index page -i.e mydomain.com/folder/index.html

these get the message: HTTP Forbidden
but they are just like the other pages.. they are totally fine..

anyone know what this is? its driving me mad!!
:)

[click watcher]

yes i've had this,

if you submit a page /blah/blah/index.html

then it (eg index.html) must be set up as the defult page on your webserver

in my case it wasn't (for good reason) so i had to change the pages in question to

/blah/blah/differentname.html

nb. this only seems to apply to filepaths ending index.html

[Jim_Stob]

mr_dredd2 - Making the index.html a default file for the directory on the web server will correct the error. If you try accessing mydomain.com/folder/index.html as mydomain.com/folder/ you'll see that the server is displays a HTTP Forbidden.