New algo about Robots.txt

Is there any new algo introduced regarding robots.txt?

[Graham_Hans]

Hi,
As we all know that robots.txt stops the search engine to crawl any page. Is there any new algo introduced to find the existance of robots? Please suugegst me. :-)

[abbeyvet]

Welcome to Webmaster World!

Is there any new algo introduced to find the existance of robots?

Robots.txt is already requested by search engine spiders so they already know whether it exists or not - so I am not sure what your question means?

As we all know that robots.txt stops the search engine to crawl any page

It does not stop them - just asks them nicely not to and hopes they obey!

[Graham_Hans]

Thanks for suggestion.
My question was that is there any new in SE that bypass the robots?

[Dijkgraaf]

Any SE that bypasses the robots.txt will very quickly find themselves banned by many web masters.