Welcome to WebmasterWorld Guest from 50.19.57.50

Forum Moderators: goodroi

Message Too Old, No Replies

Using wild card in robots

Can you add * to ip?

     
5:28 pm on Apr 13, 2004 (gmt 0)

Preferred Member

10+ Year Member

joined:Dec 1, 2003
posts:630
votes: 0


Disallow:
User-agent:63.148.99.*
Can you do this to block all combinations of the last part of an ip?
5:37 pm on Apr 13, 2004 (gmt 0)

Senior Member

WebmasterWorld Senior Member jdmorgan is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Mar 31, 2002
posts:25430
votes: 0


walrus,

I'm afraid you have confused robots.txt with .htaccess and other methods of access control.
The objects to be disallowed in robots.txt are robot names and resources -- such as pages -- on your site.


User-agent: Scooter
Disallow: /igi-bin/
Disallow: /private/

Try a search on WebmasterWorld for "mod_rewrite user_agent" or ".htaccess Deny", or if you're on an IIS server, "ISAPI rewrite".

Jim

 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members