Forum Moderators: open
No request for robots.txt... a snippet of what it's 'supposed' to be:
Vortex is a friendly and considerate web crawling robot that is part of a study I am conducting on internet link distribution. It acts very respectfully towards web servers, and unless you carefully analyze your logfiles you'll never know it was there.
No thanks...