Forum Moderators: open
Ihave no robots.txt file - in my logs googlebot takes a look only at robots.txt and index.asp.
64.68.82.67 - blah blah 80 GET /index.asp - 200 0 0 227 460 HTTP/1.0 Googlebot/2.1+(+http://www.googlebot.com/bot.html)
SHould this be ok for future deep crawling or do i need to worry that it didnt work through the whole site?