Welcome to WebmasterWorld Guest from 126.96.36.199 , register , free tools , login , search , pro membership , help , library , announcements , recent posts , open posts Become a Pro Member
robots.txt file question? What's this? printlist
I am reworking an old site and found a robots.txt file in the root directory. Contents are: User-agent: * Disallow: /admin/
I don't know what this means. I definitely want this site and all its filed crawled by google and other search engines.
Is this file preventing the crawl? Would deleting it altogether be better?