Welcome to WebmasterWorld Guest from 174.129.163.89

Forum Moderators: goodroi

Message Too Old, No Replies

robots.txt / keywords

     
8:53 am on Jun 16, 2010 (gmt 0)

Full Member

10+ Year Member

joined:May 24, 2005
posts: 211
votes: 0


Hi,
Google is indexing my site fine but returns one of the main keywords as 'Disallow' which appears a lot but only in my robots.txt file.

Part of my robots.txt file reads as below:

User-agent: example
Disallow: /a/
Disallow: /b/
Disallow: /c/


Can the above be changed to:

User-agent: example
Disallow: /a/
/b/
/c/


Or is there another way to approach my Google keyword issue?
Many thanks in advance.
3:34 pm on June 16, 2010 (gmt 0)

Administrator from US 

WebmasterWorld Administrator goodroi is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:June 21, 2004
posts:3171
votes: 153


I'm assuming you are referring to Google Webmaster Central data.

I'm also assuming you have checked your code very thoroughly to make sure there arent any lines of hidden text or similar issues that contain disallow.

You shouldn't change your robots.txt file. Make sure you have many pages of significant text and the issue should clear itself up.

Please let me know if I misunderstood anything :)
3:42 pm on June 16, 2010 (gmt 0)

Full Member

10+ Year Member

joined:May 24, 2005
posts:211
votes: 0


Thanks for your reply.
I should have been more clear but yes, you assumed correctly.

The word 'Disallow' only appears in my robots.txt file and I have approx. 35 pages of content in which the word does not appear once, including my .css files.
7:38 pm on June 16, 2010 (gmt 0)

Administrator from US 

WebmasterWorld Administrator goodroi is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:June 21, 2004
posts:3171
votes: 153


i forgot to ask if there any links pointing to your robots.txt file?
11:57 pm on June 16, 2010 (gmt 0)

Full Member

10+ Year Member

joined:May 24, 2005
posts:211
votes: 0


No, there aren't any.