Welcome to WebmasterWorld Guest from 188.8.131.52
Forum Moderators: goodroi
I looked through all that stuff and I'm just not getting it. I ran my site through the Validator and got an error on every line. So I'm thinking my site is not indexable because of it. I have more content and keywords than competitors that are on the first page of Google but my site ranking is going nowhere.
Thanks for the response.
If I were you, I would forget about robots.txt and look at a couple other things:
Making your HTML validate could also be important because a spider [webmasterworld.com] could easily get confused if your HTML code is badly broken.
If your site is relatively new, you should just concentrate on getting backlinks, adding new content, and fixing any validation errors. In time, you should see your site climbing in the SERPs.
Good luck with it,