Welcome to WebmasterWorld Guest from

Forum Moderators: coopster & jatar k

Message Too Old, No Replies

script that meets these needs

12:00 am on Mar 27, 2003 (gmt 0)

New User

10+ Year Member

joined:Mar 22, 2003
votes: 0


Does anyone know of a search engine that lets you restrict the directories to seach and that is php and GPL or GNU (free for redistribute)?

Thanks in advance,


5:13 am on Mar 27, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:June 3, 2002
votes: 0

That one is a good start.

PHPdig [phpdig.toiletoine.net]

It's free (GNU/GPL) and it even seems (never used it myself, simply scanned the feature page) to follow the robots.txt file which should allow you to configure all the directory exclusion based on user-agent.

hope that helps



Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members