Welcome to WebmasterWorld Guest from 54.163.158.163

Forum Moderators: coopster & jatar k

Message Too Old, No Replies

script that meets these needs

     
12:00 am on Mar 27, 2003 (gmt 0)

New User

10+ Year Member

joined:Mar 22, 2003
posts:16
votes: 0


hi,

Does anyone know of a search engine that lets you restrict the directories to seach and that is php and GPL or GNU (free for redistribute)?

Thanks in advance,

Wolter

5:13 am on Mar 27, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:June 3, 2002
posts:169
votes: 0


That one is a good start.

PHPdig [phpdig.toiletoine.net]

It's free (GNU/GPL) and it even seems (never used it myself, simply scanned the feature page) to follow the robots.txt file which should allow you to configure all the directory exclusion based on user-agent.

hope that helps

mavherick

 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members