"Our crawler was not able to access the robots.txt file on your site."
-
Hi Mozzers!
I've received an error message saying the site can't be crawled because Moz is unable to access the robots.txt. I've spoken to the webmaster and he can't understand why the robot.txt can't be accessed as this seems to be fine:
https://k3syspro.com/robots.txt
and Google isn't flagging anything up to us.
Does anyone know why this may be?
Thanks,
Matthew
-
Hey K3,
Looks like you have bigger fish to fry, your host domain is throwing a 503 server error. No server = no content = no robots.txt will be able to be found until that is resolved. Error still happening as of this post: http://downforeveryoneorjustme.com/https://k3syspro.com
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Solved Site DA and PA
Hi, I'm facing an issue regarding Moz Site Explorer. When I enter my blog for check it's DA and PA. All Moz do is keep loading. I have to reload the page for two or more times for checking DA and PA. Kindly let me know is there any issue with my account. Regards.
Product Support | | BuiLungTen0 -
Moz cant crawl site?
We're getting an error saying Moz is getting an errors crawling our client's site, but when I've put this though Google Search Console I'm not seeing any issues - any suggestions?
Product Support | | Ramarketingrob0 -
I am unable to access my campaigns. Is anyone else having trouble connecting to http://mz.bundledseo.com/?
I am unable to access my campaigns. Is anyone else having trouble connecting to http://mz.bundledseo.com/?
Product Support | | jleite0 -
Can't add "Custom links" in my Moz Profile
Hi, I was trying to add a custom link to my profile but I got an error message: "There was a problem saving your custom URLs" Can somebody look into it for me? Kind Regards
Product Support | | Laurensvda0 -
I have a 404 status codesin my Moz report but the page can be accessed. I don't understand what does it mean.
Hello For all the pages of my web site i Get the following message but in fact my page exist. What's going on? Thank you for your help Best 404 : Received 404 (Not Found) error response for page. http://www.etsicamarrivait.fr/contraception/basiques/
Product Support | | cath19950 -
I have upgraded my account but I can't add another site. What to do?
Simple, I want to get out of my free trial. I need to work with two/three sites. I seem to have access to five accounts... but I can't add a site. Very frustrating.
Product Support | | SRamsey0 -
How to force MOZ crawlers to search in the right area for local SEO
We do local SEO over here and so our keywords are always followed by a city name, like so: "auto repair+Springfield". If there's ever any confusion within SERPS which "Springfield" the searcher is looking for we can depend on Google to pull query location to assume it's the nearest to them (it does, and is usually correct). And furthermore, if the office ever needs to check for rankings by hand (we're not in Springfield), we just set the query location to "Springfield" and our results match their. However, MOZ doesn't set a query location. Which makes sense, I suppose, because their crawlers are up in the Bay. What I'm saying is that oftentimes there's a discrepancy between how MOZ tells me they rank, and how I see them ranking, the business owner sees them ranking, and how the customer finds them ranking. As such, we can't send them reports through MOZ 😞 Has anyone else had this problem and found a solution? Should the keyword be followed by a zip code instead of a city name? This seems like it would solve the location query problem but it may not provide the same results as service+city name.
Product Support | | cwtaylor0