joined:Feb 11, 2004
If I search using the term Jaguar parts, my site comes up in the top 5 on most search engines EXCEPT Yahoo and Google, I get 20 Error 404 reports showing robots.txt not found and I thought I needed this file to get in these search engine listings. What's strane also is I can go to Overture.com and type in Jaguar parts and I am #5 in the free listings. Overture says it's powered by Yahoo. Shouldn't I be #5 in Yahoo. After reading some info about this robots.txt I think it is only to stop crawlers. Anyone know what I need to do to get found?