On-Page Grader supporting HTTPS?
-
Hi there,
I am getting the error "Sorry, but this URL is inaccessible" on the Moz On-Page Grader. I have tested with multiple URL's but any that link to my site give the error. I have noticed my site's URL's redirect to https so my question is..is the on-page grader in-compatible with https?
Cheers!
Ross -
Oh good! I'm glad you were able to find the source!
We actually use a set of dynamic IPs, so there's not a range that I'd be able to provide. I'm afraid the best things I could suggest would be to ask them to whitelist our user agents, dotbot and rogerbot.
-
Thanks Jordan, it didn't make a difference but what I found was that my hosting company was blocking Amazon Web Services. They said they need a range of IP's from the cloud service that Moz uses to unblock, is there anyway you can advise me on what these are and is Amazon the cloud service that Moz uses?
Cheers!
-
I would expect that to take care of the issue
-
I've changed it too:
User-agent: rogerbot
Allow: /
Would this let Moz crawl the site?
-
Hmm I thought that too! It's strange though because my site is being indexed on Google and Moz is able to crawl it for other features. When I run the robots test in Google Webmaster Tools, the one where you run a test to see if URL's are blocked and you pick a bot e.g Googlebot...it says everything is working ok and it is allowed? Wouldn't that not be the case if bots were blocked from crawling the site?
-
Ah, yep, that would do it!
That configuration is currently blocking every bot known to man from accessing every portion of your site. Here's an awesome resource to help with robots.txt setup: http://www.robotstxt.org/robotstxt.html
If you were looking to allow all robots to access all pages on your site, then this command would do the trick:
User-agent: *
Disallow:
(Without the blank line between commands. Q&A formatting be damned. )
-
Hi Jordan,
Thanks a million for your response! I am still having the same issue..my robots.txt is as follows:
User-agent: *
Disallow: /Would this be blocking those bots? I know this blocks bots from accessing ALL content, but does it block all bots from accessing my site in general? Should I be changing it and if so, what would you recommend I change to allow for optimal crawling?
Cheers and thanks for taking the time to respond!
-
Hi Ross!
On-Page Grader should definitely function for https sites, in general. For example, https://mza.seotoolninja.com looks to be working just fine.If you're getting that response from On-Page Grader, it's usually related to some sort of blockage. I'd recommend checking through your robots.txt to make sure that rogerbot and dotbot aren't being blocked, that your SSL is all looking good, and that the site isn't blocking Amazon Web Services (AWS).
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How Can I Batch Upload URLs to get PA for many pages?
Howdy folks, I'm using advanced search operators to generate lists of long tail queries related to my niche and I'd like to take the batch of URLs I've gathered and upload them in a batch so I can see what the PA is for each URL. This would help me determine which long tail query is receiving the most love and links and help inform my content strategy moving forward. But I can't seem to find a way to do this. I went to check out the Moz API but it's a little confusing. It says there's a free version, but then it looks like it's actually not free, then I try to use it and it says I've gone over my limit even though I haven't used it yet. Anyone that can help me with this, I'd really appreciate it. If you're familiar with SEMRush, they have a batch analysis tool that works well, but I ideally want to upload these URLs to Moz because it's better for this kind of research. Thanks!
Moz Bar | | brettmandoes2 -
Page Title showing Twice when I check it through Moz Bar
Hello Experts, I have a brand new website. And I know I have to do lot of things and make changes for better SEO. With that in mind, I recently installed Mozbar. I was checking one of my posts the other day and noticed Page Title is appearing twice in Mozbar.Please see the screenshot below. Could you please guide me what could be causing this? FYI, I have installed Yoast SEO Plugin. Also, I can see "Alt Text" is picking lot many words which are from other images or posts...Is there any way to customize that as well? KhP9y
Moz Bar | | techierichard0 -
I keep getting a 429 Too Many Request error for a wp-login page on my website. Is there a way to prevent that from happening, or fix outside of redirecting on the back end of WordPress?
I have a client that keeps coming up with 429 Too Many Request critical crawl errors. I re-directed some of them on the back end of WordPress, but additional keep coming in. The URL has a WP-Login and directs to back end login section. Is there a reason that would come up as an error, how can I prevent it from happening again, and how can I fix the remaining current errors outside of redirecting back to /? Thanks, Kalyn Lengieza
Moz Bar | | GrindstoneConsult0 -
Moz Crawl - 804 : HTTPS (SSL) error encountered when requesting page.
Got an issue sending a Crawl Request to https://www.usernamebuddy.com/ " "804 : HTTPS (SSL) error encountered when requesting page." I have tried to recrawl several times now same issue keeps occurring. I cannot see an error when I access the site am I missing something, if so how can I diagnose the issue and sort the problem? I have reviewed the source and cannot use any http: resources.
Moz Bar | | GrouchyKids0 -
Rankings > Landing Page > Only UK?
Hello Is it possible to use the landing Page reports for sites in Norway .no? If we define a search engine in UK, maybe it will mess up all the other data we are collecting? Regards
Moz Bar | | moggiew
Mogens Stoltz Wennersten0 -
Rogerbot will not crawl my site! Site URL is https but keep getting and error that homepage (http) can not be accessed. I set up a second campaign to alter the target url to the newer https version but still getting the same error! What can I do?
Site URL is https but keep getting and error that homepage (http://www.flogas.co.uk/) can not be accessed. I set up a second campaign to alter the target url to the newer https://www.flogas.co.uk/ version but still getting the same error! What can I do? I want to use Moz for everything rather than continuing to use a separate auditing tool!
Moz Bar | | digitalascend0 -
On page grader not working with Squarespace?
The on page grader tool does not seem to be able to access Squarespace websites. I've tried several website urls that are all hosted on square space with the same result "Sorry, but that URL is inaccessible." Is this a known incompatibility or a bug? examples: lightningjar.agency (a site I manage) flotrend.com (a site that a friend manages) ollymoss.com (a site chosen at random from SquareSpace.com featured websites list)
Moz Bar | | kevindpeckham1 -
Clarify "broad keyword usage in page title"
Hello Page grader has two different grades for page title that I want clarification on. There is "Broad Keyword Usage in Page Title" and "Exact Keyword Usage in Page Title". Googling around about and searching here I have found that "broad" seems to mean the keywords should be used throughout the page, rather than just in the title and header. Which makes sense as this is a kind of check to ensure the page IS about the keywords and not something unrelated. But what is meant by "broad" usage in the page title? This refers specifically to the page title and not the whole document. My best guess got me to this, given the keyword "Visit London Today"; "Come and visit London today" - exact match only "London - visit today" - broad match only "Visit London the city of dreams | visit London today" - matches both That could be complete nonsense, but basically is broad usage the use of keywords scattered in the page title? Thanks.
Moz Bar | | yolkcreative0