Forum Moderators: goodroi
i'm new in all this and need help!
my robots.txt is
User-agent: *
Disallow: /
but search engines can still find my site
what should i do to keep all search engines out of my site?
thanx
Had search engines found your site before you put up the robots.txt? If so it may take a while for them to remove the listings, some like google will allow you to request removal.
what should i do to keep all search engines out of my site?
Search engines can include link to your site even without having crawled it by virtue of other people linking to you. If you don't want people to find your site then its probably best to take it off the Internet or requiring user authentication.
2 lord majestic: i don't want to keep people of my site, they can find me throuhg the other sites with my banner.... the thing is that the search engines using more bandwidth than users...well that's the explanation from my provider when i ask them how can it be that the US spend more bandwidth than my country.
