spider simulator

[double0seven]

Anyone familiar with a tool similar to the sim spider @ SEW that will allow me to change my user agent and referer and see the spidered page in its entire form?

[msgraph]

If you want to receive the whole page in source code then I find this program pretty useful

This 1 [indiesoft.com]
Go to the Internet Client --->HTML section and you just enter the UA, referrer, etc.

or if you want to download more than one page with your own specified user agent then try

This 2 [spidersoft.com]