Page is a not externally linkable
herb - 8:26 pm on Mar 1, 2004 (gmt 0)
User-agent: * 66.77.73.32 - - [01/Mar/2004:12:30:03 -0700] "GET /forum/viewforum.php?f=3& HTTP/1.0" 200 18718 "-" "Yahoo-VerticalCrawler-FormerWebCrawler/3.9 crawler at trd dot overture dot com; htXp://www.alltheweb.com/help/webmaster/crawler"
Just found ATW crawling through a spider banned forum. Grabbed the entire forum
Disallow: /cgi-bin
Disallow: /images
Disallow: /forum