homepage Welcome to WebmasterWorld Guest from 54.226.166.224
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

    
syntax for all php exclusion
djtaverner




msg:1528700
 3:58 pm on Mar 15, 2004 (gmt 0)

Hello,

Im new to using robots.txt and was wondering how i would exclude all .php files.

Whats the syntax?

Dave

 

ncw164x




msg:1528701
 4:29 pm on Mar 15, 2004 (gmt 0)

It works for html pages which you do not want to be spidered and also for individual images so there is no reason why it should not work for .php pages, but maybe someone who has tried it may come along and say it wont work

each page you want to disallow must be on a separate line

User-agent: *
Disallow: /nameofpage.php
Disallow: /pagename.php
Disallow: /page.php

Try it with one of your php pages first as a test and then add the rest

hope this helps

ncw164x

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved