More help in robots.txt

robots.txt

[sakuramy]

Dear All,
I am totally new to the robots.txt but recently i had did a lot of research about web robots. but i face some problem that need help from you guy.
My questions are as following :

- Should i need to submit my website's URL to search engine after i had write my robots.txt and place in my roof. (for your information my website never been submited to any search engine.)

- can i know how long will the spiders crawl into my webpage? because i already place my robots.txt in my root around 2 months ago but still does not have any affect until now .

Dear jdMorgan,
refer to your reply mail to jazzvn (Apr 8, 2004), can you briefly explain how we can get the links from reputable directories such as the Open Directory Project (DMOZ), what is the DMOZ refer about?

Thanks a lot for any piece of information from all of you

[walrus]

It is better to have the robot file in place before you submit as the good spiders will obey it and may index pages they wouldnt have without it.

It Can take weeks to months to get crawled and indexed.
You may also want to use .htaccess to take care of the bad spiders , do a search for htaccess in WebmasterWorld and youll find lots of great info on that.

Good Luck