homepage Welcome to WebmasterWorld Guest from 23.22.212.158
register, login, search, subscribe, help, library, PubCon, announcements, recent posts, open posts,
Subscribe and Support WebmasterWorld
Visit PubCon.com
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library : Charter : Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

    
syntax for all php exclusion
djtaverner




msg:1528700
 3:58 pm on Mar 15, 2004 (gmt 0)

Hello,

Im new to using robots.txt and was wondering how i would exclude all .php files.

Whats the syntax?

Dave

 

ncw164x




msg:1528701
 4:29 pm on Mar 15, 2004 (gmt 0)

It works for html pages which you do not want to be spidered and also for individual images so there is no reason why it should not work for .php pages, but maybe someone who has tried it may come along and say it wont work

each page you want to disallow must be on a separate line

User-agent: *
Disallow: /nameofpage.php
Disallow: /pagename.php
Disallow: /page.php

Try it with one of your php pages first as a test and then add the rest

hope this helps

ncw164x

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About
WebmasterWorld ® and PubCon ® are a Registered Trademarks of Pubcon Inc.
© Pubcon Inc. 1996-2012 all rights reserved