Firewall problems when indexing

[mbt10]

Hello!

I am testing phpdig and sphider cause I want to have a search function on a web page BUT I have a problem:
Indexing process is blocked all the time. The funny thing is that I am able to index other sides than mine with phpdig as well as with sphider.

I tried working with robot.txt as well as deleting my htaccess file - without success.
Is there any other apache specific configuration that keeps robots blocked?

Thanks a lot!
markus

[jdMorgan]

If your site is commercially-hosted, ask your host if they block this spider.

Jim

[mbt10]

i asked my isp - they do not block spiders.

the funny thing is: it works on localhost with the default apache config under windows. but i've tried it in virutal box under ubuntu now. and it does not work with the default apache config under ubuntu... why is that?