homepage Welcome to WebmasterWorld Guest from 50.17.7.84
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Google / Google SEO News and Discussion
Forum Library, Charter, Moderators: Robert Charlton & aakk9999 & brotherhood of lan & goodroi

Google SEO News and Discussion Forum

    
SEO Problem: Pages not getting crawled
Tutors




msg:4665795
 6:42 am on Apr 25, 2014 (gmt 0)

Hai All,

For the past few weeks my website is not being crawled by google.Even i have given fetches all pages to index.But still there is no response.I dont know what to do?I am in big trouble can anyone help me out?Please

 

roshaoar




msg:4665822
 8:28 am on Apr 25, 2014 (gmt 0)

What hosting are you on? This happened to me when the load balancing on my hosting was implemented incorrectly which made google stop visiting.

Also, revert any changes that you might have made to your .htaccess, easy to make mistakes that stops bots

Tutors




msg:4665824
 8:45 am on Apr 25, 2014 (gmt 0)

Hi thanks for reply..Can u tell me why this happened to my website..format is http not https

aakk9999




msg:4665839
 10:37 am on Apr 25, 2014 (gmt 0)

We need more details on what exactly have you done.

.Even i have given fetches all pages to index.But still there is no response.

What does it mean "there is no response"? Once you do "Fetch as googlebot" in Google Webmaster Tools, do you get "Success" or something else?

If you get "Success", can you click on it and see what the response code is?

Have you checked your server logs file to see if Googlebot is visiting and if so, what URLs are being requested and what response code you are getting?

Also, as roshaoar says, check your server configuration is ok.

Tutors




msg:4665843
 10:43 am on Apr 25, 2014 (gmt 0)

ok thanks..actually what am trying to say is most of the pages not indexed by google for the past few days..its shows 404 error..tats wat i came to ask..

aakk9999




msg:4665845
 11:03 am on Apr 25, 2014 (gmt 0)

If pages show 404 then yes, they will drop from the index.
What happens when you go to the site, does the page show? If it does, could you tell what is the response code you are getting when browsing your site?

Tutors




msg:4665846
 11:08 am on Apr 25, 2014 (gmt 0)

All pages are in live..my site url is <snip>..if i type <EMD keyword> in search query box..it will not show my home page url..it shows some other pages like linkedin,facebook..etc..one more thing most of the sub pages not being crawled by google..

[edited by: aakk9999 at 11:30 am (utc) on Apr 25, 2014]
[edit reason] Exemplified, no URLs for New Users please [/edit]

not2easy




msg:4666130
 5:55 pm on Apr 26, 2014 (gmt 0)

Where do you see the 404 error? Is it reported to you in your Google Webmaster Tools account or in your browser? To be able to help, people need to have a clear picture of the kind of problem it is, where it happens.

Have you been able to view your site's access logs to see where it is being crawled or not?

CaptainWolfy




msg:4666165
 10:19 pm on Apr 26, 2014 (gmt 0)

are you talking about google webmaster tool the index part or the actual when you type in search box the site:domain...?

lucy24




msg:4666183
 11:36 pm on Apr 26, 2014 (gmt 0)

are you talking about google webmaster tool the index part or the actual when you type in search box the site:domain...?

Anything involving a search box is google search. What do you mean by "the index part"? The "Submit to index" option that comes after "Fetch as googlebot" in wmt?

if i type <EMD keyword> in search query box

Uh-oh, Sandra, I think you may have snipped some essential information here.

"EMD keyword" = name of domain
or
"EMD keyword" = "site:" operator?

EMD as such isn't a very good test in google, unless you're something huge like amazon. In general it works much better in bing.

not indexed by google for the past few days..its shows 404 error.

This can only be in wmt, because google search doesn't say anything about 404. A link from search might lead to a 404, but the search results themselves don't give this number.

Even i have given fetches all pages to index.

Can you say this again in different words? I think there's a bit of a language problem, so we need to be very unambiguous.

Question. Do you have access to your site's raw logs? If yes, has the googlebot tried to crawl? If yes, what response did it receive?

phranque




msg:4666196
 3:30 am on Apr 27, 2014 (gmt 0)

please explain precisely where you saw a 404.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Google / Google SEO News and Discussion
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved