homepage Welcome to WebmasterWorld Guest from 54.166.100.8
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Visit PubCon.com
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
A real rookie question/approach
klaw07




msg:400681
 1:19 am on Oct 19, 2000 (gmt 0)

I know that spiders can be tracked by IP address, but is there any easier way? And is there any free way? Thanks a bunch.

 

littleman




msg:400682
 1:41 am on Oct 19, 2000 (gmt 0)

>is there any easier way
No not really if you are wanting to check them for cloaking. But if you just want to watch them, you could fallow the user agent.

>And is there any free way?
Yes plenty.
If you are interested I'll post a simple script that you could call via SSI and it will print up a record for you. But you may want to check out the Traxis if you want
something more Robust.

<edit>
I put the wrong script name in there, oops.

klaw07




msg:400683
 7:06 pm on Oct 19, 2000 (gmt 0)

I am just looking to see when certain engines visit my site???

ritualcoffee




msg:400684
 9:40 pm on Oct 19, 2000 (gmt 0)

although not free - I always keep an eye on my webtrends report - they list visiting spiders.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved