for days now I can see in my logs Yahoo spider looking to grab robots.txt and leaving without visiting any other pages - it used to come through and do a nice visit daily and then suddenly pages disappeared from serps and the visits thinned out to robots.txt only. do I have a problem? Is the spider confused? Is there something I can sprinkle onto the pages to get the action back?
