Indexing Issues and Master Suggestions

[kiransripada]

Hi Webmaster's,

Greetings !


I have a issue with my Website "Category Home page". All the url's and other internal pages present and interlinked web pages to this("Category Home page")are getting indexed now and then (on regular basis).

But why isn't this indexing since April 15th 2010.?

[raj1094]

check it out in Google webmaster tool for any sitemap errors.

[phranque]

i would check all the usual robots exclusion suspects:
- robots.txt
- meta elements, especially meta robots and meta googlebot
- X-Robots-Tag HTTP response header

check your server access log to see if that url is being crawled.

check your markup using the w3c validator to make sure there isn't a coding issue which could prevent indexing.

check GWT for any relevant messages, use the robots.txt analysis tool and fetch as googlebot.