Forum Moderators: goodroi
I think G-bot has come around 3-4 times and found itself excluded with robots.txt. If I remove the r line referring to gbot in my robots.txt, will it come back at some point, or does it only take the 'insult' so many times before it gives up? As I said, it's only been about 14 days.
I looked around and didn't find any info on this.
Cheers