homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Google / Google SEO News and Discussion
Forum Library, Charter, Moderators: Robert Charlton & aakk9999 & brotherhood of lan & goodroi

Google SEO News and Discussion Forum

Robots.txt marked as Supplemental Results.
Robots.txt Under Supplemental Results...

 7:17 am on Apr 18, 2007 (gmt 0)

hi folks

i am wondering but yes its true that robots.txt can be under supplemental results..

i dont know the reason, but when i was search something and i came to know about that , i checked one of my competitors site in google with command site:www.domainname.com and i found that his robots.txt is marked as supplemental results

1 what is the reason that Robots.txt marked as supplemental results?

2 how to overcome this problem?

can any body have any idea or thoughts to share on this topic...




 5:02 pm on Apr 20, 2007 (gmt 0)

I agree that it's strange to see robots.txt in any search results at all, even site: operator - but what problem is this causing you?


 6:09 pm on Apr 20, 2007 (gmt 0)

It surely shouldn't be in the main index.

It appears in Google results because someone, somewhere, once linked to it - and may still do so.


 6:39 pm on Apr 20, 2007 (gmt 0)

I have one better..my sitemap is ranking. saw it today researching long tail for this site. It is #7 for green widgets texas..lol..and the particular page for green widgets on my site is marked supplemental..go figure.


 7:25 am on Apr 21, 2007 (gmt 0)

i don't have any problem tedster if my competitors robots.txt maraked as supplemental not mine,

i think g1smd has point to say that if some one can linked to your robots.txt and it can be crawled by robots than may be marked as supplemental result

but does that mean like if i will linked your robots.txt to my site on home page and my site is under supplemental result than offcourse it will show as robots.txt supplementals

can u tell me in detail about the advantages and disadvantages of having robots.txt marked as supplementalresults



 10:06 pm on Apr 21, 2007 (gmt 0)

There are no advantages or disadvantages. It just is.


 12:06 pm on Apr 23, 2007 (gmt 0)

thanks for reply
but what if i will linked my competitores robots.txt file to my site.... its not good techniques i know, but what will be the effect on my competitors site,... it will make any change in ranking or visibility in any Engines....?



 3:50 pm on Apr 23, 2007 (gmt 0)

Ranking changes for other urls on your site are extremely unlikely - unless your robots.txt also has proper html links in it, and that's pretty non-standard.


 3:53 pm on Apr 23, 2007 (gmt 0)

10,000,000 robot.txt listings throughout various google SERP results just clutters results.


 7:37 am on Apr 24, 2007 (gmt 0)

That should be robots.txt

i see the whitehouse's ranking well for the inurl:robots.txt search :p

(sorry for being Pedantic)


Global Options:
 top home search open messages active posts  

Home / Forums Index / Google / Google SEO News and Discussion
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved