webtamers - 10:16 am on Nov 5, 2000 (gmt 0)

Thanks Guys,

Still curious id that's standard procedure for the robots
to just check the robots.txt and come back later. If anybody knows please enlighten us all!

Just FYI, there IS an "Allow" -it's something new in the standards, don't know if they all read it tho'

Following is an explanation I found somewhere, in case
it helps someone:

User-agent: *
Disallow: /org/plans.html
Allow: /org/
Allow: /serv
Disallow: /

The following shows what robots are allowed to access:

[url.com...] No
[url.com...] No
[url.com...] Yes
[url.com...] Yes
[url.com...] Yes
[url.com...] No
[url.com...] No

A note to "AIR" - I'm so embarrassed! My site is awful.
It's 5 years old, from when I first learned HTML. The amazing part is that it works. I get a lot of replies
from my "free estimate" form. Been meaning to update it,
but have been too busy with my client's sites. Like the mechanic with the broken down car...