joined:Aug 31, 2002
Does anyone know the sytax / viability of the following?
I'd like to allow indexation of example.com/sub/ and block everything deeper than example.com/sub/
example.com/sub/ = good to crawl
whilst the following - and anything else at these levels - should all be blocked