Welcome to WebmasterWorld Guest from 54.161.53.213

Forum Moderators: Robert Charlton & andy langton & goodroi

Indexed pages keep dropping in GSC

     
12:24 pm on Jul 13, 2017 (gmt 0)

New User

joined:Nov 10, 2014
posts: 5
votes: 0


Hi there,

since june 4th my indexed pages have dropped by 50%. Ive no explaination for that. I dont have thin content, nor bad links or duplicated content. Is there any chance to discover which pages were kicked out of the index to get a clue what happened?

Thanks for your help.

Regards
Manson
3:10 pm on July 13, 2017 (gmt 0)

Moderator from US 

WebmasterWorld Administrator martinibuster is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Apr 13, 2002
posts:14499
votes: 337


How many pages do you have in total?
8:47 pm on July 13, 2017 (gmt 0)

Senior Member

WebmasterWorld Senior Member 5+ Year Member Top Contributors Of The Month

joined:Sept 14, 2011
posts:809
votes: 54


Yep noticing this too
8:50 pm on July 13, 2017 (gmt 0)

Senior Member

WebmasterWorld Senior Member 5+ Year Member Top Contributors Of The Month

joined:Sept 14, 2011
posts:809
votes: 54


Actually I have a bit more info on this, can you check please Manson0711 for possible canonical links

Things like
www.example.com/page-that-has-been-dropped
Resides to with a 301
www.example.com/page-that-has-been-dropped/

Note the slash, thanks in advance
11:17 am on July 14, 2017 (gmt 0)

New User

joined:Nov 10, 2014
posts: 5
votes: 0


In total I had 12k indexed til June 6th, then lost 2k on a drop, then another 1k on June 25th, then a bigger drop July 2nd down to 6k.

@seoskunk: I indeed did some changes regarding slashes at the end of my URLs. Im pointing canonicals from the URLs without to the URLs with slashes since i has DC issues.

example:

www.example.com/page
rel=canonical to
www.example.com/page/
5:59 pm on July 14, 2017 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member lucy24 is a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month

joined:Apr 9, 2011
posts:13834
votes: 484


One thing is missing from the narrative: How many pages does your site actually have? If there were millions of pages, you could be forgiven for misplacing a million or two. But either you really have 12,000 pages or you don't.

Make that two things missing. The second is How many URLs does your site have? You did say at the outset that you don't have duplicate content. So the two numbers should be the same. Are they? For example, given /pagename and /pagename/ does one of the two redirect to the other?
7:32 am on July 15, 2017 (gmt 0)

New User

joined:Nov 10, 2014
posts: 5
votes: 0


Sorry for the the missing information.

The site has around 800k pages. Most of them are filter combinations and URLs with parameter. The filter URLs are noindex. The parameter URLs are canonicalized to the base URL. Indexable pages are 60k.

When I said I have no duplicate content I meant that I took care of it already. At least I hope so. The "/" and no "/" URLs were the latest urls I fixed.that was on may 25th.

Weird thing is that it seems that some of the parameter URLs are indexed even if canonicalized. Also a couple of hundreds filter URLs made there way in the index besides noindex tag.
4:10 pm on July 15, 2017 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member lucy24 is a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month

joined:Apr 9, 2011
posts:13834
votes: 484


Urk, then we need the other question. How many pages has Google been crawling? GSC will give you some information, but the only absolutely reliable information source is your raw access logs. Are all of your 8 lakhs of pages reachable by directly following links, or do many of them involve humans putting in search criteria? If some things require javascript, has the googlebot been crawling your scripts?

Also a couple of hundreds filter URLs made there way in the index besides noindex tag.

Hmm. Do these noindex pages have indexed (or indexable) analogues, probably involving a different set of parameters? Have those indexable versions been crawled, and if so, are they indexed? I assume you've checked a few random pages "live" to verify that the noindex tag is where it's supposed to be.

General query for people with very, very large sites: It's understood that Google may not index absolutely everything. (Coulda fooled me, based on things I find in searches.) But do they crawl everything? Do they make up parameters in the way that they make up html pagenames ("rdmtnvbyjvhgrd.html" and so on)?
2:36 am on July 16, 2017 (gmt 0)

New User

10+ Year Member

joined:Oct 2, 2006
posts:26
votes: 3


800k?

Sounds like spam to be honest. What do you expect?
8:37 am on July 17, 2017 (gmt 0)

New User

joined:Nov 10, 2014
posts: 5
votes: 0


as mentioned the 800k pages are the result of a whole lot of filter combinations and parameters. its an online shop. so no spam.

Google crawls approx 20k a day (GSC)

@lucy24: the parameter URLs that are getting indexed are product pages with EAN parameters. Somehow the canonicals are not recongnized for some pages.
8:42 pm on July 17, 2017 (gmt 0)

New User

joined:July 17, 2017
posts:1
votes: 0


I am also having the same issue. It dropped from 290K to mere 50K in recent 3 months. It happened to two of my sites, one of which is a Wordpress site which hasn't changed.

I am not clear about the canonical issue. My site pages are set up as www.example.com/company/companyname However, in my sitemap,it was created as www.example.com/company/companyname/ Will this cause an issue?
9:52 pm on July 17, 2017 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member lucy24 is a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month

joined:Apr 9, 2011
posts:13834
votes: 484


Will this cause an issue?

Possibly, but your description doesn't give enough information. Are we dealing with Duplicate Content (each page is accessible both with and without final / slash) or is it a question of Imperfect Technical Quality (internal links and/or sitemap consistently lead to a redirect)?
7:04 am on July 19, 2017 (gmt 0)

New User

joined:Nov 14, 2013
posts:1
votes: 0


I was tracking my indexed pages in GSRP, and found a sudden huge drop in index pages. There were about 300K pages were indexed but last day I checked and found that its only 80k now. I was tracking for competitors index as well they have also dropped with around 50% drop in index.

Do someone else suffer this issue? If any clue about this issue, please share.

[edited by: goodroi at 1:23 pm (utc) on Jul 19, 2017]
[edit reason] thread formatting [/edit]

4:27 pm on July 25, 2017 (gmt 0)

New User

joined:July 12, 2017
posts:15
votes: 0


If you haven't used any black-hat SEO strategies, one problem could be the freshness or the size of your pages.
Make sure to check the Crawl Rate ( the time it acquires to crawl sitemap and begins to decrease the number of indexed pages) and check if your robots.txt file isn't blocking something.
 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members