- - Google
- -- Google SEO News and Discussion
- ---- A real Google conundrum
nuevojefe - 7:24 am on Apr 6, 2005 (gmt 0)
|How could widgetville.com been ranking at all if it had a robots.txt that excluded all bots? |
Because it probably got indexed before the robots.txt excluded all bots. This would explain the url only listings, hard to get those to go away.
Thread source: http://www.webmasterworld.com/google/28756.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com