Welcome to WebmasterWorld Guest from 18.207.136.184

Forum Moderators: mademetop

Message Too Old, No Replies

spider simulator

spider simulator

     

double0seven

1:15 pm on Apr 26, 2001 (gmt 0)

Inactive Member
Account Expired

 
 


Anyone familiar with a tool similar to the sim spider @ SEW that will allow me to change my user agent and referer and see the spidered page in its entire form?
1:24 pm on Apr 26, 2001 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Nov 29, 2000
posts:1425
votes: 0


If you want to receive the whole page in source code then I find this program pretty useful

This 1 [indiesoft.com]
Go to the Internet Client --->HTML section and you just enter the UA, referrer, etc.

or if you want to download more than one page with your own specified user agent then try

This 2 [spidersoft.com]

 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members