SEO Problem: Pages not getting crawled

[Tutors]

Hai All,

For the past few weeks my website is not being crawled by google.Even i have given fetches all pages to index.But still there is no response.I dont know what to do?I am in big trouble can anyone help me out?Please

[roshaoar]

What hosting are you on? This happened to me when the load balancing on my hosting was implemented incorrectly which made google stop visiting.

Also, revert any changes that you might have made to your .htaccess, easy to make mistakes that stops bots

[Tutors]

Hi thanks for reply..Can u tell me why this happened to my website..format is http not https

[aakk9999]

We need more details on what exactly have you done.

.Even i have given fetches all pages to index.But still there is no response.

What does it mean "there is no response"? Once you do "Fetch as googlebot" in Google Webmaster Tools, do you get "Success" or something else?

If you get "Success", can you click on it and see what the response code is?

Have you checked your server logs file to see if Googlebot is visiting and if so, what URLs are being requested and what response code you are getting?

Also, as roshaoar says, check your server configuration is ok.

[Tutors]

ok thanks..actually what am trying to say is most of the pages not indexed by google for the past few days..its shows 404 error..tats wat i came to ask..

[aakk9999]

If pages show 404 then yes, they will drop from the index.
What happens when you go to the site, does the page show? If it does, could you tell what is the response code you are getting when browsing your site?

[Tutors]

All pages are in live..my site url is <snip>..if i type <EMD keyword> in search query box..it will not show my home page url..it shows some other pages like linkedin,facebook..etc..one more thing most of the sub pages not being crawled by google..

[edited by: aakk9999 at 11:30 am (utc) on Apr 25, 2014]
[edit reason] Exemplified, no URLs for New Users please [/edit]

[not2easy]

Where do you see the 404 error? Is it reported to you in your Google Webmaster Tools account or in your browser? To be able to help, people need to have a clear picture of the kind of problem it is, where it happens.

Have you been able to view your site's access logs to see where it is being crawled or not?

[CaptainWolfy]

are you talking about google webmaster tool the index part or the actual when you type in search box the site:domain...?

[lucy24]

are you talking about google webmaster tool the index part or the actual when you type in search box the site:domain...?

Anything involving a search box is google search. What do you mean by "the index part"? The "Submit to index" option that comes after "Fetch as googlebot" in wmt?

if i type <EMD keyword> in search query box

Uh-oh, Sandra, I think you may have snipped some essential information here.

"EMD keyword" = name of domain
or
"EMD keyword" = "site:" operator?

EMD as such isn't a very good test in google, unless you're something huge like amazon. In general it works much better in bing.

not indexed by google for the past few days..its shows 404 error.

This can only be in wmt, because google search doesn't say anything about 404. A link from search might lead to a 404, but the search results themselves don't give this number.

Even i have given fetches all pages to index.

Can you say this again in different words? I think there's a bit of a language problem, so we need to be very unambiguous.

Question. Do you have access to your site's raw logs? If yes, has the googlebot tried to crawl? If yes, what response did it receive?

[phranque]

please explain precisely where you saw a 404.