I am writing my 1st robots.txt :) - never bothered before - Sitemaps, Meta Data, and robots.txt forum at WebmasterWorld

Forum Moderators: goodroi

Message Too Old, No Replies

I am writing my 1st robots.txt :) - never bothered before

3:45 am on Jan 12, 2002 (gmt 0)

I am writing my 1st robots.txt :)

Never really had a need to before.

Anyone know any crawlers I should add ??

Thanks !!

Dazz

4:06 am on Jan 12, 2002 (gmt 0)

Dazz,

Brett put one together sometime ago. Use the search feature and you should be able to find it.

Onya
Woz

4:11 am on Jan 12, 2002 (gmt 0)

Will do cheers.

Dazz