Forum Moderators: goodroi
User-agent: whistlepig.integer.com
Disallow: /
User-agent: * # directed to all spiders, not just Scooter
Disallow: /cgi-bin/
Disallow: /sds/
Disallow: /640480/
Disallow: /connectors/
Disallow: /java/
Disallow: /tmp/
Disallow: /ddin/
Am I inadvertandly excluding all robots with that first line???? Yipes!
I think your txt file is ok. You are only disallowing whistlepig.integer.com from all your content.
here is also a tutorial