robots.txt

and saving on some bandwidth?

[Bendy]

I'm just about to launch a site with about 500 static pages with a host and I've got limited bandwidth per month
(altho' I do have the option to buy more if things go loopy) but I dont really wanna cough up any more money just yet . . . (just call me tight!)

• so, of what does the robots.txt file comprise?

• how does it work?

• and how can it tell the difference between a "good" spider to a bad one?

• And just how much bandwidth is actually caned by these little critters?

Thanks in advance!

[sem4u]

Why not have a look in the robots.txt forum? :)

[webmasterworld.com...]

[Bendy]

DOH!

thanks . . .