Welcome to WebmasterWorld Guest from 54.145.53.251

Forum Moderators: Ocean10000 & incrediBILL

Message Too Old, No Replies

How do I use the Sim Spider tool

to see what spiders see?

     
3:21 pm on Jul 19, 2000 (gmt 0)

Senior Member

joined:June 27, 2000
posts:1548
votes: 0


I feel so stupid asking this question.

How do I use that Sim Tool Brett has on his site? I don't understand the "referer" part.

-G

5:31 pm on July 19, 2000 (gmt 0)

Administrator from US 

WebmasterWorld Administrator brett_tabke is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Sept 21, 1999
posts:38047
votes: 11


You understand the concept of Refers? Everytime you connect to a site off a link, your browser sends that link to the next site right? follow that.

The referrer and agent part of Sim Spider just allows you to set that referrer and/or agent name that will be reported to the site you connect too.

You won't fool any cloakers into thinking you are a search engine spider by changing the agent name to a se spider. It is mainly a tool to strip the html and look at the 'naked' page with tags to see what a search engine will see.

The agent name is handy if a site is 'bigoted' and only allows certain (read: ie) browsers in the front door.

Referrer isn't all that important and probably should just be left blank.

5:36 pm on July 19, 2000 (gmt 0)

Senior Member

joined:June 27, 2000
posts:1548
votes: 0


I understand the concept of "refers", but I wasn't understanding how it was going to help me see what search engines see.

Thanks for the help.
-Heather

9:32 pm on July 19, 2000 (gmt 0)

Administrator from US 

WebmasterWorld Administrator brett_tabke is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Sept 21, 1999
posts:38047
votes: 11


Ok, some pages require a 'referrer' from an on-site link to view a page. Other still, you just may want to, umm, fake out thinking you are coming from some other link.
 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members