Forum Moderators: Robert Charlton & goodroi

Message Too Old, No Replies

Something strange about my sitemap.xml file

Re: issues being indexed by Google.

         

asas111

6:03 am on Aug 28, 2023 (gmt 0)

10+ Year Member



Let me start off by saying that I missed this place. I had been a member for well over 15 years and last posted over 9 years ago. In fact, with life getting in the way and not bring very active on my soon-to-be 25 year old site, I had completely forgotten about this website until it came up in a Google search.

Anyway, so here is my issue: in the last 3 years or so, my website was suddenly not coming up ok Google. I never had this issue and in fact my website would often come up in Google searches for so many keywords related to my niche.

Anyway, today , I decided to dig deep into my ranking issues and why Google is no longer showing results from my website. For the record, it shows a few (less than 20) but my website has literally tens of thousand of pages and has been online since 1999 (2000 is when I got my current domain name) . I discovered something strange about my sitemap.xml file. Instead of having the usual website url between the <loc></loc> tags, there was another URL there from another website that I own (but is not related to the main website that has the issue). No idea how that came in there. Another related issue is that I have a second sitemap, but this one is compressed (gz) - but this one I didn’t get a chance to open and view its content (will do later)


Extra details in case it helps:
-Between 2018 and 2020, a big and popular section on my website was mostly down , though the rest of the website, including home page, were active. I am mentioning this in case it helps anyone with my question.
-Another change (highly doubt this is is relevant) is that in 2022, I got my .com version of my .net domain (both of them now point to my website)
-in the last 12 months , I have requests Google to crawl my website more than once.

[edited by: asas111 at 6:05 am (utc) on Aug 28, 2023]

asas111

6:05 am on Aug 28, 2023 (gmt 0)

10+ Year Member



So the two questions are:

-could this different URL in the sitemap.xml file be causing this issue with Google? For the record, I have since fixed it to the correct url
-should I delete the .GZ version of my sitemap file and leave only one?


Thanh you all in advance

tangor

7:58 am on Aug 28, 2023 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



If there is only one ... it will be far easier to debug!

If your site map is 50,000 entries or less, or less than 50mb in size you are golden. Otherwise you will have to split that up or have multiple sitemaps based on an index.

In these days of "high speed" gz is only a minor plus FOR SITEMAPS.

not2easy

12:02 pm on Aug 28, 2023 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



Welcome back asas111! Because your site started in the dark ages (pre-mobile, pre-https) I have to ask whether it has been kept up to date or operated on "if it's not broke, don't fix it"? I ask because I've seen some..

The redirects are 301 and tested, correct? I mean, if the URL is https://www.example.com does a request for http://example.net show a 301 -->200 response in the logs?

You should have one sitemap with the sitemap location listed in your robots.txt file to ensure your preferred version is used especially if you cannot easily compare the .xml and .gz files:
Sitemap: https://www.example.com/sitemap.xml 

Is there a GSC account associated with the domain to make changes easier?

There are so many possible causes for traffic loss since 1999 it is hard to pin it only on a sitemap.

RedBar

5:16 pm on Aug 29, 2023 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



As not2easy questions just how up-to-date is all the coding especially the meta tags and on-page optimisation? For instance there were lots of changes introduced by G between 2000-2005, I especially remember the title and descripton update being a very specific amount of work!