Forum Moderators: Robert Charlton & goodroi

Message Too Old, No Replies

Is this cloaking?

         

MrBaseball34

5:09 pm on Mar 30, 2011 (gmt 0)

10+ Year Member



We run an inventory listing service with 2.1 million unique items. The script we originally had, which had worked for a long time, queried the database and built a table with "pages" of the data with 10000 records each.

Something changed in the last couple of months where the bots were beginning to hit that script a lot more and it began to bring our server to its knees with the database requests.

We finally had to disable the script and find another way. We now create daily static html pages of the data just like the old script created but these are stored in one directory which I have the bots access via robots.txt.

I do not want the bots to access anything else on our site because of the database interaction.

Now could that be deemed cloaking?

tedster

5:47 pm on Mar 30, 2011 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Cloaking means showing googlebot something different than what you show a human visitor requesting the same URL. Does you current situation do that?

MrBaseball34

6:04 pm on Mar 30, 2011 (gmt 0)

10+ Year Member



Essentially, no. Human users can't see the "pages" that we created in the bots dir but the data is viewable in other areas of the site by the human users.

The script we formerly used did exactly the same thing but was dynamic in nature. However this "dynamicness" made it unusable because of the interaction with the DB.

The static pages list one column from each product we list in our inventory listing service, approx 2.1 mil items.
A human user cannot see the data in that manner.

So, would it still be considered cloaking?

tedster

6:08 pm on Mar 30, 2011 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



If a human requests the exact same URL, would they see the exact same content that a bot sees? If they can, then it isn't cloaking. However, it sounds like the whole bots directory is orphaned, or not linked to from anywhere on the rest of the site.

If you let googlebot index that area, you may have human search traffic to those URLs relatively soon, and that might create other problems.