Have got the problem again, and this time it is hitting visitors. I can access robots.txt but it appears the G cannot.
My hosting company came back with this response:
"I've had a check in the error_log and it looks as though everytime Google has tried to spider your site, it's been coming up against this:
[Fri May 17 19:33:43 2013] [error] PHP Notice: Undefined variable: province2 in /var/www/vhosts/mysite.com/
httpdocs/templates/local_menu_1dir.php on line 247, referer: http
That in turn is causing a temporary IP block which would prevent it from being able to access the server.
The server itself has 100% uptime for the day. "
But this is only a notice, not a warning and I wouldn't have expected Google to be phased by it.
My robots.txt and htaccess have not changed in the last 2 years. I am working through some of the errors that are causing these notices but don't believe they are the problem
. [edited by: phranque at 10:43 am (utc) on May 19, 2013]
[edited by: Robert_Charlton at 6:35 pm (utc) on May 19, 2013]
[edit reason] unlinked referer url & fixed side-scroll [/edit]