Welcome to WebmasterWorld Guest from 54.205.251.179

Forum Moderators: goodroi

Message Too Old, No Replies

robots.txt question

I asked whether does this, but the engine spider ip address has any to use

   
9:53 am on Nov 21, 2004 (gmt 0)

10+ Year Member



# FULL access (yahoo)
User-agent: Slurp
Disallow: cgi
11:18 am on Nov 22, 2004 (gmt 0)

10+ Year Member



Not to sure what you are asking here! Sorry! Can you explain it a little clearer please.

Regards,
Webboy