fast spider and robots

fast spider doesn't seem to respect my robots.txt

[mr_dredd]

Hello! I use different optimised pages for certain different engines, and i direct the spiders away from the pages they aren't supposed to go to. This has been working fine, but on FAST I noticed that on a recently submitted site which has just been included, ALL the optimised pages have been indexed. The robots.txt is fine - any ideas? Has the spider for FAST changed in anyway???
Any ideas would be really appreciated!

[jointventurer]

I am a newbie....You are obviously knowledgeable about SE's. Question: What is robot.txt? Can it help my site get listed? I have tried for several months now to get my site listed. :(
I apologize for inexperience - just trying to come up....

[Xoc]

See this: [searchengineworld.com...]

robots.txt won't get you indexed. It is meant for excluding parts of your web site from getting indexed.

[jointventurer]

Thanks for the quick reply. I am scourging this entire site to improve my knowledge base. Anything to get ahead. Thanks again!