I just launched a new website using the https scheme. I have redirected all http: to https. Google GSC is showing the http: version of the home page as "Excluded" due to "crawl anomaly". Pardon the pun, but is that normal?
If I enter: http://www.example.com in the address bar it redirects to https://www.example.com.
not2easy
4:07 am on Apr 13, 2020 (gmt 0)
If I enter: http://www.example.com in the address bar it redirects to https://www.example.com.
Well, there's your crawl anomaly - you can't visit there. Really, there are so many similar peculiarities in GSC you need to steel your nerves to go there; expect silliness and you can avoid surprises. I sort of expect to leave there muttering, "whatever". ;)
NickMNS
4:15 am on Apr 13, 2020 (gmt 0)
there are so many similar peculiarities in GSC you need to steel your nerves to go there;
That is what I figured, I just wanted to be sure I wasn't missing anything.
lucy24
3:33 pm on Apr 13, 2020 (gmt 0)
Another idea: Are requests for robots.txt included in your general http>>https redirect? You might see what happens if you exempt robots.txt from canonicalization redirects; let everyone have it as originally requested, no matter how wrong the hostname and/or protocol. You don’t ever want to give robots the opportunity to say “I TRIED to read it, honestly I did”.
