We run an inventory listing service with 2.1 million unique items. The script we originally had, which had worked for a long time, queried the database and built a table with "pages" of the data with 10000 records each.
Something changed in the last couple of months where the bots were beginning to hit that script a lot more and it began to bring our server to its knees with the database requests.
We finally had to disable the script and find another way. We now create daily static html pages of the data just like the old script created but these are stored in one directory which I have the bots access via robots.txt.
I do not want the bots to access anything else on our site because of the database interaction.
Now could that be deemed cloaking?