Insert disallow.php to robots

is it a good idea?

[sirkei]

Hi all,
i just used mod rewrite for my website and i heard that if i write one disallow.php line in the robots.txt file then it is better for spiders to crawl deeper into my site and thus getting better placement in SE. So is this true? but my website has one forum and boards using php feature. So if i use disallow php, will this affect spider crawling to my forum and thus getting no PR?

[jdMorgan]

sirkei,

It is difficult to answer your question, as the rumor that you report is quite vague.

You should structure your directories and URLs so that resources you want to be crawled by search engine spiders are kept separate from those that you do not want to be crawled. Then use robots.txt to disallow the subdirectories that you do not want to be crawled.

Jim

[iProgram]

For example, there are 100 links on page1.html but only 80 of them linking to *content* pages of my website and the rest 20 links are to nonsignificant pages like online order form or Privacy Policy or Terms of service. I use the following code to link to these pages:
disallow.php?goto=privacy
disallow.php?goto=terms

If I disable this php script in robots.txt, will SE bot have more chance to claw the 80 content pages?