@LoganRay This was our issue. Didn't know Moz tries to retrieve the HTTP robots.txt first. Our HTTPS redirect was not working on static files only, so the HTTP path to the robots.txt was failing. We did not notice it because the HSTS policy was forcing the browser to redirect.
- Home
- jaytarr
Latest posts made by jaytarr
-
RE: Our crawler was not able to access the robots.txt file on your site
Looks like your connection to Moz was lost, please wait while we try to reconnect.