I get visited by freshbot every day. The past couple of days, freshy has requested my robots.txt file around 100 times per day. Before a few days ago, my robots file would only be requested about once a day by google. It's also pulling odd urls (/store/images/widgets_lg.jpg asp=&idItem=307), but the urls are only messing up when referring to pictures. The said url being pulled is a non-existent url, and my urls aren't even set up like that. Before you say it's a coding issue, let me assure you: it is not. I'm just wondering if anyone has ever heard of this, or know if my robots file being pulling a lot, and my erroroneous urls have anything in common? Man that was confusing... sorry. Thanks in advance.
