Forum Moderators: mack

Message Too Old, No Replies

Page not getting crawled

Submitting request to crawl still not..

         

Amandip

4:49 am on Jun 18, 2020 (gmt 0)

5+ Year Member



Hi

I'm trying to crawl a page for two days, but it is not getting crawled in google all other pages in same categories and hierarchy are on google, but the page I'm trying is not.

I have checked robots.txt file, it is not blocked there. How it will get indexed?

Thanks

not2easy

5:10 am on Jun 18, 2020 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



Hi Amandip and welcome to WebmasterWorld [webmasterworld.com]

How have you been trying to crawl this page? Do you mean that you have submitted a sitemap with the new page? Or is this within the GSC, using Inspect URL? In general, your page will get indexed when Google has crawled it and adds it to their index. You can look at your access logs and check to see whether Google has crawled that page.

Amandip

5:37 am on Jun 18, 2020 (gmt 0)

5+ Year Member



Hi @not2easy, thanks for replying. I'm trying to crawl with Webmaster Inspection Tool, when I test live URL it says URL is available to Google, but in Google index (This page is not in the index, but not because of an error. See the details below to learn why it wasn't indexed. Learn more).

not2easy

6:04 am on Jun 18, 2020 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



If you use proprietary tools to see what is happening with your site in Google you may need to live with their inabilities to determine what Google is doing. You can look at your access logs and check to see whether Google has crawled that page.

Mark_A

9:11 am on Jun 18, 2020 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



I'm trying to crawl a page for two days, but it is not getting crawled in google all other pages in same categories and hierarchy are on google, but the page I'm trying is not.

Hi Amandip, I wouldn't expect a crawl in two days, G has billions of pages to crawl. As long as you have links to your new page googlebot will get there, I would be patient and just check your raw logs every few days.

JorgeV

9:43 am on Jun 18, 2020 (gmt 0)

WebmasterWorld Senior Member 5+ Year Member Top Contributors Of The Month



Hello,

This page is not in the index, but not because of an error.


Crawl and index are two different things. A page which is being crawled by Googlebot, doesn't necessarily make it to the index. There are many reasons for this, that only Google knows.

Some random example: duplicate content, too thin content, instability of the server (if a given page is not always accessible by Googlebot, it might not be indexed).

lucy24

3:25 pm on Jun 18, 2020 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



See the details below to learn why it wasn't indexed. Learn more
Well, don’t leave us in suspense. What does it say when you click Learn More? There should be a list of possible explanations, and then we can figure out which one applies to the page.

Amandip

9:42 am on Jun 19, 2020 (gmt 0)

5+ Year Member



Hi guys thanx for help, the page is on google now..

Amandip

9:45 am on Jun 19, 2020 (gmt 0)

5+ Year Member



The issue was with property, actually, the https was missing in property, I added new property and requested for crawl and it was on google after half an hour.. thanx again

engine

9:55 am on Jun 19, 2020 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



Great news, Amandip, thanks for the update.
Your journey with Google begins.

Don't forget Bing and other search services.