Forum Moderators: open
The robots.txt is valid and I don't think I've done anything to spam, never had any problems. The url are apache re-written and fully indexed by Google.
I had blocked indexing (now it's back on) of the /cgi/ bin but I don't think that should matter since the URL were re-written anyway.
any advice, suggestion?
I just e-mailed to spamcrusader@inktomi.com as someone suggested...