I went and looked back for at least six month (random checking of .log files) and I see that msnbot snatched dozens if not hundreds of pages a day. Still even a search for mydomain.com returns a no results page. Tried all kinds of combinations and see nothing!
is this "msnbot/0.3 (+http://search.msn.com/msnbot.htm)" the current spider? Nothing weird on the robtos.txt, .htaccess and the code returned for the pages it visited is 200.
any idea? Many other sites in the same server are indexed (not many pages though) and there's no interlinking.
Same here - MSNbot has been very good at crawling my site for months now. The pages come up at the beta site on a site:myhobbysite.com search, but not on any keyword search (and trust me, I got some pretty unique keyword combos). Rob