homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Visit PubCon.com
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

robots.txt / keywords

 8:53 am on Jun 16, 2010 (gmt 0)

Google is indexing my site fine but returns one of the main keywords as 'Disallow' which appears a lot but only in my robots.txt file.

Part of my robots.txt file reads as below:

User-agent: example
Disallow: /a/
Disallow: /b/
Disallow: /c/

Can the above be changed to:

User-agent: example
Disallow: /a/

Or is there another way to approach my Google keyword issue?
Many thanks in advance.



 3:34 pm on Jun 16, 2010 (gmt 0)

I'm assuming you are referring to Google Webmaster Central data.

I'm also assuming you have checked your code very thoroughly to make sure there arent any lines of hidden text or similar issues that contain disallow.

You shouldn't change your robots.txt file. Make sure you have many pages of significant text and the issue should clear itself up.

Please let me know if I misunderstood anything :)


 3:42 pm on Jun 16, 2010 (gmt 0)

Thanks for your reply.
I should have been more clear but yes, you assumed correctly.

The word 'Disallow' only appears in my robots.txt file and I have approx. 35 pages of content in which the word does not appear once, including my .css files.


 7:38 pm on Jun 16, 2010 (gmt 0)

i forgot to ask if there any links pointing to your robots.txt file?


 11:57 pm on Jun 16, 2010 (gmt 0)

No, there aren't any.

Global Options:
 top home search open messages active posts  

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved