Welcome to WebmasterWorld Guest from 126.96.36.199
Forum Moderators: goodroi
Would having the latter of the two improve the number of pages crawled by the spiders?
The only downside is that you will get lots of 404s in your log files. Should you want to eliminate them then use an empty file as suggested by jimbeetle.