enigma1 - 12:20 pm on Feb 20, 2012 (gmt 0) I use a customized spider that can check the headers and requests from links found, images and other resources in a page.
I use a customized spider that can check the headers and requests from links found, images and other resources in a page.