joined:June 28, 2018
In the last days I have configured my site to use cloudfront as a cdn. I purchased an SSL cert for cdn.mydomain.com and everything is serving correctly etc, performance is ok.
The issue I have is that GSC started reporting that my site is blocking resources for the images at cdn.mydomain.com - it is just a few right now but i expect there to be lots start to appear as GSC take time, so want to address this asap.
My robots.txt is in the cdn cache so should be read by google BUT i had an entry in it that started host:www.mydomain.com - i have now removed this (so no host entry at all), updated the cdn cache so it has this changed version and told google about the new robots.
Would the host entry be the problem that was causing the resources to seem blocked to google on the cdn domain? There are no entries that block the directories and there was no issue with google crawling those resources when on the main domain with the same robots.txt.
update - i have just added an Allow: /media/* near the top of robots to see if that helps.