Welcome to WebmasterWorld Guest from

Forum Moderators: DixonJones & mademetop

Message Too Old, No Replies

Tracking spider come to my page

How can I tracking spider come to my page? what is software



5:48 pm on Oct 16, 2001 (gmt 0)

10+ Year Member

Dear Sir,

I woulk like to know that how can I tracking spiders come to index my web page?
What is software? Colud you help me please?

Best Regards


7:27 am on Oct 24, 2001 (gmt 0)

10+ Year Member

You can se if a spider comes by in your webserver logfile. Your ISP porb. provide you with some statistic on visitores on your website, that statistic also show spider visits. If you have your own webserver, you can use a software called webtrends that will create a readable web server statistic.
Of course you need to know the names of the spiders, but that is the easy part, I think Brett has a list, I'll post it when I find it


3:21 pm on Oct 24, 2001 (gmt 0)

Here is the link that bufferzone mentioned (I believe). It is on Brett's sister site [searchengineworld.com]



8:24 pm on Oct 24, 2001 (gmt 0)

10+ Year Member

That's the one, Thanks Brian

Featured Threads

Hot Threads This Week

Hot Threads This Month