I have a php script which tracks users coming from search engines. It was working perfect, recently it is showing me 125K+ searches daily. This website is fairly new and I am not expecting that huge traffic from search engines within weeks of launch! (I know I am not that much lucky!).
I debugged this issue and emailed the global variables to myself. In less than 30 seconds I received over 100 emails. I am copying few snippets here.
[HTTP_USER_AGENT] => Mozilla/5.0 (Windows NT 6.1; WOW64; rv:2.0.1) Gecko/20100101 Firefox/4.0.1
[HTTP_REFERER] => http:/
/www.google.com/url?sa=t&source=web&cd=10&ved=0CH4QFjAJ&url=http%3A%2F%2_FMY_PAGE_URLs&rct=j&q=keyword1%keyword2%keyword3%20keyword4&ei=_csETpM06uKIAvqp7M0N&usg=AFQjCNGMXcID-G0b2KwV9-jqGVtSfaYmpA
[REMOTE_ADDR] => 64.146.238.151
From referral url it appears some one is searching from Google but i guess this is the Google robot. I can't understand If it is Google robot then why is it not showing in user agent?
Any clue whats cooking?
[edited by: tedster at 8:07 pm (utc) on Jun 24, 2011]