homepage Welcome to WebmasterWorld Guest from 54.227.41.242
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / WebmasterWorld / New To Web Development
Forum Library, Charter, Moderators: brotherhood of lan & mack

New To Web Development Forum

    
Identifying Robots
Are visitor Human?
TimGlad




msg:4241410
 4:45 pm on Dec 11, 2010 (gmt 0)

I am new here so although I linked in here through a google search and found a topic that did discuss this
How Do Search Engine Robots Work?
The topic was quite old. So I read all the replies but here is why I was searching about robots

I am developing my own CMS, I've be trying to figure out how to determine if a visitor to a Website was human or not at runtime?

The reason:
So I can store IP, request time, user agent, etc. in my database so that I can provide analytics for the users of my CMS.

Granted there are programs out there that do this already... but I am stubburn and want to do it myself.

Now, I could write a program to parse the access logs (and yes, I know that there are programs that do that too. See paragraph above :)

I wrote some code to inspect the user agent for key words from the database like bot, spider, crawl, etc. But if robots don't accept cookies I could simply check to see if visitor got "phpsession" cookie, then I am done and I can store the visitor info in the DB.

 

TimGlad




msg:4241424
 5:53 pm on Dec 11, 2010 (gmt 0)

I think I figured out my own answer:
When you start sessions with php the cookie isn't there the page goes to the client. Thus, you won't know if the first request is from a robot based on the fact that the session cookie isn't there!

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / WebmasterWorld / New To Web Development
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved