Google is not crawling my new pages.

[Swami]

Hello,

Does anyone have the problem I mentioned below.

Since the May update, Google has not been crawling the new web pages of my website. Added new URLs to the XML sitemap.

Fetched the URLs using the GSC inspection tool, but it is not indexed yet.

Any suggestion & ideas to crawl & index the new URLs.

[tangor]

Is your sitemap within limitations?

[lucy24]

Are the new pages linked from anywhere, or are they only listed in the sitemap?

Has G been successfully fetching the sitemap itself?

About how many pages are involved?

[jimsthoughts]

try creating an html sitemap (of all pages, or just the new pages), and link to that in the footer of all your pages. That should help to get those pages indexed.

[tangor]

Just a reminder, there are limitations. Your sitemap can only have 50,000 entries (or 50mb in size) before you must break it out to a new (added) 50,000. You are allowed a total of 50,000 sitemaps, potentially displaying:

2,500,000,000 (that many) urls.

Anything over 50k urls, or 50mb in size will be ignored UNLESS it is linked to a secondary sitemap extension. All too often ecommerce sites hit this brick wall---usually by too many entry points for the same product.

That said, I have never used sitemaps, then again all of my sites are way less than 50k urls ...

YMMV

(only reaon I know this stuff is I had a few clients who overstated their urls by an order of magnitude and wondered why their site was "not indexed")

You really can have "too much", and "more is not better".

Just take a look. Also keep in mind the 50mb SIZE of the sitemap. The way some urls are structured by CMS these days it is not impossible to hit that limit PDQ...

[lucy24]

50,000 entries (or 50mb in size)

:: counting on fingers ::
I make that 1k per URL, minus 25 bytes per item for XML overhead. (Yup, I counted.)

If your average URL is 1000 characters long, it is possible that Google crawls--or absence thereof--are not your only problem.

[mnraza011]

While inspecting on GSC all are okay, If Don't have any issue while inspecting then wait for some time. Sometimes it takes longer than normal

[shubhambhardwaj]

I am also facing the same issue on my website.

I think Google is facing some issues. Hope it will solve soon.

[serproc]

I have the same problem for a long time. After the investigation I was able to figure out several scenarios when this happens.

1. Page does not have enough content.
2. Page is similar to another page on the website and does not add much new info.
3. Content on the page violates search engine policies.
4. Page is too deep on the 'tree'.

Hopefully this helps.

[jayright]

Yes, You need to check sitemap, if the sitemap is correct then upload in webmasters

[tangor]

@serproc ...

4. Page is too deep on the 'tree'.

Interesting consideration. One to keep in mind going forward.

I keep content no further away than than "three" ie: /folder/folder/folder/content.html with the VAST majority as /folder/folder/content.html

CMS stuff tends to add more folders than I am willing to endure. :)

[jayright]

Your sitemap is auto-update? I also found that google crawl slowly as compared to 2019 and before that

[Nitin_Kumar]

I would like to suggest add new page links to home page header & Footer Section for internal linking. As well as you can use new page links to anchor text.



--
Regards
Nitin Kumar
<snip>

[edited by: engine at 9:11 am (utc) on Aug 26, 2020]
[edit reason] please see WebmasterWorld TOS [/edit]

[Brett_Tabke]

> try creating an html sitemap (of all pages, or just the new pages),
> and link to that in the footer of all your pages.

What Jim said. Always try to link to the new stuff from as many places as possible. While SEreps hint that page rank isn't being passed - it is clear link juice still flows.