tedster - 4:22 am on Sep 5, 2011 (gmt 0)

Thanks johnnie. That 2009 video does explain why an uncrawled URL can still show up in the search results. The reports in this thread are not about showing up in the SERPs, they're taken from entries showing up in the actual server logs.

I notice near the end of the video, Matt says "probably 90% of the time when someone says you violated my robots.txt" ... that does leave 10% of the time for something different.

I know that once in a while googlebot does make a burble in this area. However, given reports in this thread, it seems like it might be happening a bit more often right now.