Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

robots.txt question

I asked whether does this, but the engine spider ip address has any to use

9:53 am on Nov 21, 2004 (gmt 0)

10+ Year Member

# FULL access (yahoo)
User-agent: Slurp
Disallow: cgi
11:18 am on Nov 22, 2004 (gmt 0)

10+ Year Member

Not to sure what you are asking here! Sorry! Can you explain it a little clearer please.



Featured Threads

Hot Threads This Week

Hot Threads This Month