Welcome to WebmasterWorld Guest from 50.17.74.162

Forum Moderators: goodroi

Message Too Old, No Replies

robots.txt / keywords

     

cyberdyne

8:53 am on Jun 16, 2010 (gmt 0)

10+ Year Member



Hi,
Google is indexing my site fine but returns one of the main keywords as 'Disallow' which appears a lot but only in my robots.txt file.

Part of my robots.txt file reads as below:

User-agent: example
Disallow: /a/
Disallow: /b/
Disallow: /c/


Can the above be changed to:

User-agent: example
Disallow: /a/
/b/
/c/


Or is there another way to approach my Google keyword issue?
Many thanks in advance.

goodroi

3:34 pm on Jun 16, 2010 (gmt 0)

WebmasterWorld Administrator goodroi is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



I'm assuming you are referring to Google Webmaster Central data.

I'm also assuming you have checked your code very thoroughly to make sure there arent any lines of hidden text or similar issues that contain disallow.

You shouldn't change your robots.txt file. Make sure you have many pages of significant text and the issue should clear itself up.

Please let me know if I misunderstood anything :)

cyberdyne

3:42 pm on Jun 16, 2010 (gmt 0)

10+ Year Member



Thanks for your reply.
I should have been more clear but yes, you assumed correctly.

The word 'Disallow' only appears in my robots.txt file and I have approx. 35 pages of content in which the word does not appear once, including my .css files.

goodroi

7:38 pm on Jun 16, 2010 (gmt 0)

WebmasterWorld Administrator goodroi is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



i forgot to ask if there any links pointing to your robots.txt file?

cyberdyne

11:57 pm on Jun 16, 2010 (gmt 0)

10+ Year Member



No, there aren't any.
 

Featured Threads

Hot Threads This Week

Hot Threads This Month