adamseabrook - 12:24 am on Sep 20, 2013 (gmt 0)
I am the CEO of meanpath, Inc. meanpathbot should respect your robots.txt so if you can email me the domain of the site it tried to crawl without respecting your robots.txt I can get the team to look into it. email@example.com or firstname.lastname@example.org
One common error we see with robots.txt is that web masters are not aware robots.txt will be read from top to bottom with the first applicable rule found followed. So if you had say a permission for all crawlers to crawl at the top and a specific one for meanpathbot saying no below it would follow the allow at the top not the disallow at the bottom.
This may not be the case here but we can easily figure out what the issue is once we do a test on your site.