Forum Moderators: Robert Charlton & goodroi

Message Too Old, No Replies

Google not indexing my website after each post automatically

         

Antony1997amal

5:03 pm on Aug 25, 2020 (gmt 0)

5+ Year Member



many of my recents posts are not indexed by google . say for example one of my recent <snip> was added to google only after manually indexing in google search console . its not indexing automatically

can any one help me?

[edited by: goodroi at 6:21 pm (utc) on Aug 25, 2020]
[edit reason] Welcome to WebmasterWorld, now please go read the forum rules :) [/edit]

goodroi

6:22 pm on Aug 25, 2020 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



You need backlinks. The quality & quantity of the backlinks both matter.

tangor

7:58 pm on Aug 25, 2020 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



@Antony1997amal ... Welcome to Webmasterworld!

G indexes AND THEN INSERTS INTO THE SERPS at its own speed. A manual request can speed things along, but even then that is not guaranteed immediate across all the data centers. This stuff still takes time to replicate across the entire network.

RedBar

7:12 pm on Aug 26, 2020 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



many of my recents posts are not indexed by google .

How long since you posted them?

G takes its time, weeks, nothing to worry about, 3+ months and something could be wrong.

lucy24

7:32 pm on Aug 26, 2020 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



How often does G crawl your front page? Is all new content linked from there, or from some other frequently-crawled page?

:: detour to raw logs for concrete example ::

This is probably fairly typical for a small site that doesn’t carry AdSense:
66.249.75.abc - - [08/Aug/2020:04:22:57 -0700] "GET / HTTP/1.1" 200 11765 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)" 
...
66.249.75.abc - - [08/Aug/2020:23:49:21 -0700] "GET / HTTP/1.1" 200 11802 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
...
66.249.75.abc - - [08/Aug/2020:23:54:22 -0700] "GET /directory/subdir/ HTTP/1.1" 200 847018 "-" "Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.92 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
What you see there is: G visits this site’s front page 1-2, up to 3 times a day. On one routine visit, it found a link to a page that had not existed on its previous visit, 20 hours earlier. Within pretty exactly five minutes, it had requested that newly found page.

I can’t say exactly how long it takes from crawl to index, but an exact-text search confirms that the page I was checking is definitely in the index today.

So the most important question is: Has G been discovering and crawling each new post?

jediviper

6:33 am on Aug 27, 2020 (gmt 0)

5+ Year Member Top Contributors Of The Month



You can always use more internal links from more important pages linking to these new posts.