Welcome to WebmasterWorld Guest from 54.211.62.139

Forum Moderators: Robert Charlton & aakk9999 & andy langton & goodroi

Message Too Old, No Replies

SEO Problem: Pages not getting crawled

     
6:42 am on Apr 25, 2014 (gmt 0)

New User

joined:Apr 25, 2014
posts: 6
votes: 0


Hai All,

For the past few weeks my website is not being crawled by google.Even i have given fetches all pages to index.But still there is no response.I dont know what to do?I am in big trouble can anyone help me out?Please
8:28 am on Apr 25, 2014 (gmt 0)

Junior Member

joined:Jan 23, 2014
posts:131
votes: 0


What hosting are you on? This happened to me when the load balancing on my hosting was implemented incorrectly which made google stop visiting.

Also, revert any changes that you might have made to your .htaccess, easy to make mistakes that stops bots
8:45 am on Apr 25, 2014 (gmt 0)

New User

joined:Apr 25, 2014
posts: 6
votes: 0


Hi thanks for reply..Can u tell me why this happened to my website..format is http not https
10:37 am on Apr 25, 2014 (gmt 0)

Moderator This Forum from GB 

WebmasterWorld Administrator 5+ Year Member Top Contributors Of The Month

joined:Apr 30, 2008
posts:2628
votes: 191


We need more details on what exactly have you done.

.Even i have given fetches all pages to index.But still there is no response.

What does it mean "there is no response"? Once you do "Fetch as googlebot" in Google Webmaster Tools, do you get "Success" or something else?

If you get "Success", can you click on it and see what the response code is?

Have you checked your server logs file to see if Googlebot is visiting and if so, what URLs are being requested and what response code you are getting?

Also, as roshaoar says, check your server configuration is ok.
10:43 am on Apr 25, 2014 (gmt 0)

New User

joined:Apr 25, 2014
posts: 6
votes: 0


ok thanks..actually what am trying to say is most of the pages not indexed by google for the past few days..its shows 404 error..tats wat i came to ask..
11:03 am on Apr 25, 2014 (gmt 0)

Moderator This Forum from GB 

WebmasterWorld Administrator 5+ Year Member Top Contributors Of The Month

joined:Apr 30, 2008
posts:2628
votes: 191


If pages show 404 then yes, they will drop from the index.
What happens when you go to the site, does the page show? If it does, could you tell what is the response code you are getting when browsing your site?
11:08 am on Apr 25, 2014 (gmt 0)

New User

joined:Apr 25, 2014
posts: 6
votes: 0


All pages are in live..my site url is <snip>..if i type <EMD keyword> in search query box..it will not show my home page url..it shows some other pages like linkedin,facebook..etc..one more thing most of the sub pages not being crawled by google..

[edited by: aakk9999 at 11:30 am (utc) on Apr 25, 2014]
[edit reason] Exemplified, no URLs for New Users please [/edit]

5:55 pm on Apr 26, 2014 (gmt 0)

Administrator from US 

WebmasterWorld Administrator not2easy is a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month

joined:Dec 27, 2006
posts:2930
votes: 93


Where do you see the 404 error? Is it reported to you in your Google Webmaster Tools account or in your browser? To be able to help, people need to have a clear picture of the kind of problem it is, where it happens.

Have you been able to view your site's access logs to see where it is being crawled or not?
10:19 pm on Apr 26, 2014 (gmt 0)

New User

joined:Apr 23, 2014
posts:5
votes: 0


are you talking about google webmaster tool the index part or the actual when you type in search box the site:domain...?
11:36 pm on Apr 26, 2014 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member lucy24 is a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month

joined:Apr 9, 2011
posts:13258
votes: 362


are you talking about google webmaster tool the index part or the actual when you type in search box the site:domain...?

Anything involving a search box is google search. What do you mean by "the index part"? The "Submit to index" option that comes after "Fetch as googlebot" in wmt?

if i type <EMD keyword> in search query box

Uh-oh, Sandra, I think you may have snipped some essential information here.

"EMD keyword" = name of domain
or
"EMD keyword" = "site:" operator?

EMD as such isn't a very good test in google, unless you're something huge like amazon. In general it works much better in bing.

not indexed by google for the past few days..its shows 404 error.

This can only be in wmt, because google search doesn't say anything about 404. A link from search might lead to a 404, but the search results themselves don't give this number.

Even i have given fetches all pages to index.

Can you say this again in different words? I think there's a bit of a language problem, so we need to be very unambiguous.

Question. Do you have access to your site's raw logs? If yes, has the googlebot tried to crawl? If yes, what response did it receive?
3:30 am on Apr 27, 2014 (gmt 0)

Administrator

WebmasterWorld Administrator phranque is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Aug 10, 2004
posts:10591
votes: 21


please explain precisely where you saw a 404.