homepage Welcome to WebmasterWorld Guest from 54.205.182.45
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / WebmasterWorld / Website Analytics - Tracking and Logging
Forum Library, Charter, Moderators: Receptional & mademetop

Website Analytics - Tracking and Logging Forum

    
Spider "Clicks"?
Do spider crawls show up as "clicks" in my logs?
suga




msg:3593351
 7:31 pm on Mar 6, 2008 (gmt 0)

I have an internal script setup to keep track of how many times a visitor clicks on a specific button. This button takes them to a third-party site. Each evening, I receive a report that tells me how many "clicks" of that button occur per day. My question is, when spiders such as Googlebot crawl my site, does it act like an actual user? Is Googlebot inflating my actual number of clicks by human visitors?

The way the script is setup is when someone clicks on that button, another script is called to log the "click" in our database, then the script redirects the browser to the third-party site.

Thanks.

 

g1smd




msg:3593520
 11:08 pm on Mar 6, 2008 (gmt 0)

Search engines generally can't click buttons.

suga




msg:3593833
 8:05 am on Mar 7, 2008 (gmt 0)

But what about following the "action" when the button is clicked? Basically, action = "/script/log_and_redirect.php" and the "log_and_redirect.php" script connects to the database, inserts into our clicks table, and then redirects the user to a third-party site. So even if the bot doesn't physically "click" the button, if it goes to the next script would it log it to my database and therefore inflate the number of actual clicks on my site? Thx!

ewanfisher




msg:3593922
 9:58 am on Mar 7, 2008 (gmt 0)

There is always a possibility that some bots would see this address in the HTML, and attempt to request that page.

The best way to go about stopping this would be to 'robots.txt' exclude the script. This will stop most of the friendly bots from requesting the redirect script.

suga




msg:3594260
 5:10 pm on Mar 7, 2008 (gmt 0)

thank you!

Oliver Henniges




msg:3594427
 8:20 pm on Mar 7, 2008 (gmt 0)

In a way related to your question is probably this webmasterworld thread [webmasterworld.com], which reports googlebot trying to swallow a mysterious number of URLs with obviously arbitrary GET-Variables.

I'd second g1smd that this is quite improbable for the action-target-CGIs of POST forms. However, Receptional Andy in the above thread assumes some glitch in parts google's infrastructure as one possible cause for the mysterious behaviour in the crawl process. So you'll never know...

But may I raise a more serious question: If you are so unsure about this relatively basic knowledge on CGIs: Are you sure your script is hacker safe? Have you ever heard of mysql-injection-attacks and what did you undertake to protect against them?

suga




msg:3594505
 9:58 pm on Mar 7, 2008 (gmt 0)

most of our scripts do not call for user forms. instead, we use env variables for tracking purposes. for the forms where we do use user input, we use addslashes.

thanks for your help and patience.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / WebmasterWorld / Website Analytics - Tracking and Logging
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved