homepage Welcome to WebmasterWorld Guest from 107.22.70.215
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor
Home / Forums Index / WebmasterWorld / Website Analytics - Tracking and Logging
Forum Library, Charter, Moderators: Receptional & mademetop

Website Analytics - Tracking and Logging Forum

    
Tracking spider indexing from logs
efrat




msg:4334761
 11:41 am on Jul 4, 2011 (gmt 0)

Hello all,

Can anyone tell me how can I see when google bots are visiting my site, how far they crawled my site, all the pages they visited from each crawl etc.

What can I do to get that data?

I heard pwiki, crawltrack.net will do that. What do you think about these products? Are they reliable?

Someone please let me know.

 

g1smd




msg:4334767
 12:24 pm on Jul 4, 2011 (gmt 0)

They are in your raw log files, often one file per day, usually in a folder accessible only via FTP. Most servers only keep the last few days data, so you need to copy or download them regularly.

I find that Google isn't so much of a "crawl" as merely pulling one URL every few minutes or so.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / WebmasterWorld / Website Analytics - Tracking and Logging
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About
© Webmaster World 1996-2014 all rights reserved