Welcome to WebmasterWorld Guest from 18.104.22.168
joined:May 19, 2015
Screenshot 2: Google search resultsYes, but what search did you perform in order to get those results to come up? If I search for "cats", search results will not include every robots.txt in the world that mentions a directory called /cats/.
or equivalent if you're not on Apache. (This is an actual rule that I have, though I wasn't especially thinking of robots.txt when I made it.)
Header set X-Robots-Tag "noindex"