Forum Moderators: Robert Charlton & goodroi

Message Too Old, No Replies

What are the risks if I block google bot from my product pages?

         

Miop

9:50 pm on Oct 3, 2005 (gmt 0)

10+ Year Member



My site is such a mess in the serps now, and it's going to take me an aeon to sort it out, with the problem possibly due to a dupe content issue on product pages. My section pages still show up, but ranking maybe damaged by the presence of so many filtered product pages. I was thinking about blocking gbot from my product pages only, at least until I have found a solution or G relaxes a bit.
I would just like to know if I am taking any risks by blocking the product pages (which would mean 2500 product pages blocked) leaving 359 section pages.
Any advice please?

Wizard

7:04 pm on Oct 4, 2005 (gmt 0)

10+ Year Member



If a product page linked to section page with section keywords in anchor text, removing product pages will hurt section ranking for this keyword. But if product page already hurted section page being its duplicate, it will be good to block it. Block their URLs and link to them with JavaScript to ensure Gbot won't crawl them anymore.

I had similiar issue with frames. I put copy of the content into NOFRAMES and this is crawled and associated with frameset URL, but frames themselves would be duplicates, so I blocked them in robots.txt and link to them through sophisticated JavaScript almost unfollowable for crawlers. Works correctly for months.

But I would make a good list of products on section page, with product name and description, to ensure that if someone looks for this particular product, they will find your section page.