Forum Moderators: goodroi
Also, the form posts to the following URI:
www.domain.com/?step=11&sid=34r534ydf343434 (where sid is variable)
I've tried to block all bots from accessing those pages by adding the following rule to my robots.txt
User-agent: *
Disallow: /?step=11
How come G is not abiding my rules? The IP I logged (72.14.220.136) resolves to fg-out-f136.google.com