Forum Moderators: Robert Charlton & goodroi

Message Too Old, No Replies

Strange indexing in Google

Page indexing problems

         

hopechka

12:41 am on Jun 9, 2023 (gmt 0)



Hello!
Issue: Google poorly/strangely indexes the website, with some pages appearing in the search results and others not.
Description: I was asked to redesign the website using WordPress and implement SEO. I have revamped the site, with approximately 25% of the texts transferred to the new site. Some pages still retain their old names, while the majority have been updated.
On April 8th, the website was replaced with a new one on the same domain. The robots.txt file and schema were immediately updated, and everything is in order with them. It has been two months already, but search queries still display links to pages from the old version of the site that no longer exist. Some pages are still not indexed (I'm checking through the Google Search Console). However, a couple of days ago, I added a new article, and it was indexed the very next day.
Can anyone offer any advice? I haven't found anything better than manually requesting indexing through the Google Search Console."
Please note that the translation provided is in modern American English suitable for article writing. If you have any further text to translate or if you have any specific preferences, please let me know.
Thank you in advance for your potential assistance

lucy24

2:39 am on Jun 9, 2023 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



You forgot one piece of information. Well, one and a half:
-- have G and other search engines been crawling your new URLs?
-- are requests for old URLs getting 301 redirected to the equivalent new URL where appropriate?

Don't rely on GSC and GA. Some kinds of information can only be found in the site's access logs.

phranque

5:30 am on Jun 9, 2023 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



welcome to WebmasterWorld [webmasterworld.com], hopechka!

tangor

10:14 am on Jun 9, 2023 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



but search queries still display links to pages from the old version of the site that no longer exist.


The old site best exist, else 301s will not work correctly!

However, and this is not g's fault, other sites may have links to your old site and will continue to hit---thus the old site needs to be in place for the 301 to work.

If your conversion is only at 25% get the rest done as quickly as possible ... g is not sure "which is the real" until one becomes 100%. Sooner is better than later.

hopechka

2:00 pm on Jun 9, 2023 (gmt 0)



"-- have G and other search engines been crawling your new URLs?"
Thank you for your answer, yes, I checked in other search engines (yandex, bing), all pages are indexed
"-- are requests for old URLs getting 301 redirected to the equivalent new URL where appropriate?"
Just yesterday I read about the redirect, and made it for old pages. There were not so many of them in Google, about 7 pages. But about 20 pages of the new site have never been indexed. Google seems to ignore them, despite the fact that it has sent their indexing manually several times.

not2easy

2:43 pm on Jun 9, 2023 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



Unfortunately, crawling does not necessarily mean indexing over the past several months. You should be able to see which pages are indexed in the GSC account but even indexed pages may not be easily found. Google claims that it helps to submit a sitemap for the pages you would like to have indexed and they may limit the number of URLs they will accept via manually requesting indexing through the GSC.

To keep the old URLs from being shown as indexed, their old URLs need to 301 redirect to their new URL. This tells Google that this new URL is the new location of that old content.

Kendo

1:23 am on Jun 10, 2023 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Google indexes every url that is visited using Chrome browser. So it is no surprise to see broken links referred from Google search. I am still getting notices about broken links for pages that did not exist for a long time and for pages that never existed.

If want more control over which pages are indexed, try submitting a sitemap.xml file for the site from Webmaster Tools. If it doesn't have errors all links will be indexed straight away.

hopechka

2:21 pm on Jun 10, 2023 (gmt 0)



sitemap.xml the file was sent immediately along with the site. I read earlier that it is better to have it, so I prepared it right away. My mistake was that I thought if I provided a new sitemap, Google would remove the old links to the previous pages from indexing, because they are not in the new file sitemap.xml and it wasn't the right logic. But two days ago I corrected it, and reindexed it from old links.Maybe indexing will go faster now. Now I will look at the result for a week, I hope that it will be.

lucy24

5:47 pm on Jun 10, 2023 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



My mistake was that I thought if I provided a new sitemap, Google would remove the old links to the previous pages from indexing
Yup, that's a mistake. That is, it's an error of fact, not a moral shortcoming :) A sitemap doesn't mean “crawl and/or index only these URLs”; it means “be sure not to overlook these URLs.”

not2easy

6:36 pm on Jun 10, 2023 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



If your pages contained old links to the old URLs, that should be fixed before trying to index the new page where those old links are still on the pages. When it is cleaned up is when you submit a new sitemap.