Welcome to WebmasterWorld Guest from

Forum Moderators: mademetop

Message Too Old, No Replies

spider simulator

spider simulator



1:15 pm on Apr 26, 2001 (gmt 0)

Inactive Member
Account Expired


Anyone familiar with a tool similar to the sim spider @ SEW that will allow me to change my user agent and referer and see the spidered page in its entire form?
1:24 pm on Apr 26, 2001 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Nov 29, 2000
votes: 0

If you want to receive the whole page in source code then I find this program pretty useful

This 1 [indiesoft.com]
Go to the Internet Client --->HTML section and you just enter the UA, referrer, etc.

or if you want to download more than one page with your own specified user agent then try

This 2 [spidersoft.com]


Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members