Forum Moderators: Robert Charlton & goodroi

Page indexing

indexing

         

novikorisnik

7:34 pm on Sep 4, 2025 (gmt 0)

Top Contributors Of The Month



So, i create a website with a cursor/chatgpt and grok. And site is great, fast, beautifull etc etc.

But, page indexing is soo bad, advices?

[ibb.co...]

Brett_Tabke

8:01 pm on Sep 4, 2025 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



You gots some waiting to do. It's in the infamous "sandbox".

Build back links while you wait.

tangor

10:48 pm on Sep 4, 2025 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



If the site is largely created WITH/BY AI the search engines (all of them) might view it as automated/non-unique content. Hopefully there is visible and viable human-created content to go along with the AI stuff.

MEANWHILE, might be six months to a year before full indexing occurs. g does NOT have unlimited resources---and the web is REALLY REALLY HUGE these days.

Kendo

1:35 am on Sep 5, 2025 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



What were the 8 reasons given for not indexing?

novikorisnik

11:41 am on Sep 7, 2025 (gmt 0)

Top Contributors Of The Month



[ibb.co...]

tangor

1:24 pm on Sep 7, 2025 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Gotta ask ... with so many errors such as listed above, how many actual pages of website are there? Why so many redirects? Why so many 404?

If this is the best that chatgpt and grok can do, it's a hot mess!

not2easy

3:34 pm on Sep 7, 2025 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



You can test your URLs using W3 tools (free) and have a report of any errors in HTML and/or CSS here:
HTML Validator: https://validator.w3.org/
CSS Validator: https://jigsaw.w3.org/css-validator/

However, they don't verify that your canonicals are appropriate or not and if you don't understand html and/or css because it was built using AI, error reports won't be much help.

It is my understanding that Google can easily recognize AI created content and more often than not, will ignore it for indexing because it is not new or unique. Google does not index duplicate content. Technical errors (4xx/5xx) don't help either.

There is much more to success online than uploading AI pages and adding a GSC account. You can search and learn a lot here, using site search in the header menu. ;)

lucy24

4:13 pm on Sep 7, 2025 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Wow, that’s a lot of errors. Once you’ve dealt with all technical issues, you are left with just 133 cases of “crawled--currently not indexed” which is presumably what your original post was about. But technical errors should always be fixed first.

Edit: It should also be noted that “crawled--currently not indexed” is very often a barefaced lie. Do an exact-text search for various phrases from the putative not-indexed pages, and generally they will come right up. (I tested this before posting to confirm it remains true.)

tangor

12:45 am on Sep 8, 2025 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



“crawled--currently not indexed”

Is another way of saying, "we got it, find it on page 1,313".

In short, not in the top 10 positions.

Still, this looks like a very malformed site---ALL ERRORS must be addressed for any hope of RANKING (not the same as INDEXING).

Kendo

1:51 am on Sep 8, 2025 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Server Error and Page not found are serious errors that need to be fixed. That should be easy enough by using Xenu to check links you can find out where the link began.

Canonical errors is something we all see a lot. What that means is that if canonical is nominated, then the link that they crawled didn't match, often by crawling http when the page is redirected to https, and when www is redirected.

How the redirection affects it is unsure, but I would expect anyone claiming that they can detect AI written articles to be able to sort that confusion.

How many pages do exist in total?