If my website dont have robots.txt

robots.txt

[rusmart]

Please tell me if my website dont have robots.txt, what can be happend?

[ccam96]

Nothing. The search engine spiders will just freely visit all pages on your site. If you want to keep some pages out, then you would need a robots.txt file.

[Dijkgraaf]

You will see some 404 responses when spiders/crawlers/bots request robots.txt, but that won't cause any problems.

[larryhatch]

You could easily set up a dummy robots.txt file.
Disallow some page or directory that does not exist.
Check your error_loc or access_log files to see
who tries to get in anyway, it should cause a 404 error.
A great tool to see who isn't playing fair. -Larry

[wolfadeus]

What is the advantage of having a dummy robots.txt? I am completely new and just discovered that robots.txt files existed. I don't want to hide any pages from robots, rather the opposite.

[rusmart]

Thanks you very much for help me

[Dijkgraaf]

The only advatages to having a dummy robots.txt is
1) you don't get 404 errors in your log when it is requested.
2) you may spot a bad bot that disobeys robots.txt