Forum Moderators: goodroi
The info page says it's a distributed crawler, so just like my policy for the cronic robots.txt violater Grub, I banned the user agent and the entire IP block associated with the offending IP.
Regardless of what the bot owner said it would be in the best interest for everyone to see the file.
Again, that just shows that you either haven't read the thread or you're trolling. Already asked and answered multiple times in this thread.
I cant add any value to that statement
That would be in keeping with your previous posts considering that you haven't added anything that hasn't been previously discussed.
...you haven't added anything
I'm pretty sure he's added necessary information when prompted by forum members in previous threads.
One of us sure is in denial
Care to elaborate?
Now where is that robots.txt you so persistently denied to me?
Now you're trolling too aren't you? Already asked and answered multiple times in this thread.
.. Already asked and answered multiple times in this thread.
Now can you truly answer - Give the best answer you have the whole time being here and post the robots.txt file?
----- file starts -----
# robotz.txt (c) jazzman
Botz pleaze do not visit ma site or else u w1ll 3nter w0rld of p@1n
EOF
P.S. MJ13bot tr@p here
----- file ends -----
I am off to pub and then will get back to the drawing board!
[edited by: Lord_Majestic at 8:15 pm (utc) on June 14, 2005]
I didnt miss it, Its still not the point
On the contrary--it's exactly the point.
you had problem
I didn't have a problem. I posted about a bot the violated robots.txt.
and posted information, The bot owner asked for more information as what you had gave wasnt enough to look into it
So I offered more information which he rejected.
and also asked for the robots.txt file and any URLS.
That was already covered on the very first page of this thread and multiple times since.
You didnt post the information.
That's because he rejected my multiple offers. The offers were later rescinded due to the bot owner's sarcasm and insults.
Regardless of what the bot owner said it would be in the best interest for everyone to see the file.
Already covered multiple times in this thread.
----- file starts -----
# robotz.txt (c) jazzmanBotz pleaze do not visit ma site or else u w1ll 3nter w0rld of p@1n
EOF
P.S. MJ13bot tr@p here
----- file ends -----
Jizzguy, if this is indeed the contents of your robots.txt file, it is not valid - check Google for some validators that will help you fix this up.
post the robots.txt file
Already covered multiple times in this thread.
Jizzguy, if this is indeed the contents of your robots.txt file, it is not valid - check Google for some validators that will help you fix this up.
I think he may be on to something... worth looking into I would say.
