Onpage grader says site unreachable
-
It is possible the crawler is caught in the firewall. Any idea what I need to have whitelisted?
-
Thanks for the update! So glad it's working now.
-
Just to update for people that see this question in the future. The problem was caused by the lack of intermediate certificate. Everything is now working.
-
Just to add, I managed to run a site crawl (the one with the downloadable csv file) so clearly it is just related to the on-page grader.
Also, rather strangely other sites on the VPS work fine (http).
Therefore I am thinking more and more that it is an SSL intermediate certificate issue.
-
Yeh, that answer was not very helpful, although it contained useful information.
My working theory is that as I just transferred the site to one of my VPS that the SSL doesn't have a valid intermediate certificate. I will have a closer look at resolving this tomorrow.
It probably didn't help that I was not accurate with the error message which states that "sorry but that url is inaccessable".
-
Have you considered going through your server and/or firewall logs to find out the root cause of the issue? Your host should be able to help you there, even without any IP's. Just run a crawl, and tell them approximately what time you ran it - that should be enough for them to start analyzing the issue.
The first question to find an answer to is what is blocking the crawler, followed by how is it blocking the crawler and finally, why is it blocking the crawler.
Once you find an answer to those questions, it will be vastly easier to help you find a solution.
-
Well, my host cannot check without IP's and from what I read Moz doesn't give out IPs as they are dynamic.
I guess that leaves me stuck unable to use this service.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Moz Site Crawl Test 404
Crawled site a number of times using Crawl Test. Its reporting 404's from files that are actually present. What do you make of this? Justin
Moz Bar | | GrouchyKids0 -
On Page Grader inconsistent
Why does the on page grader not update it's grades based on the other factors, other then the title tag. i.e. I can have the keyword 'burger' in H1 tags, the URL, ALT attributes, in the body text a couple times and in the meta section of the site and receive an F grade from the on page grader, but as soon as I add the word 'burger' to the title I receive an A grade. Is there a reason why the only factor that has that influence is the title tag, and why is it that a keyword for a page cant get say a B or C grade if it has the other factors covered (i.e. they have a tick next to them) but not the title tag? Cheers Again
Moz Bar | | sharpleaddesign0 -
URL inaccessible for On Page Grader
I am trying to use the on page grader however it is not working with my website. The URL is as follows: https://capbeast.com. I have been trying to read in older posts to see if https is now supported or not but have not found anything. I know there is no robots.txt issue as I am able to run the crawl test on our website fine. Is the issue on my end in regards to configuration or is due to DDos attacks? Any help would be appreciated. Thanks
Moz Bar | | MisterStitches0 -
On-Page Grader is not counting H2 and H3 Keywords
I used on-page grader in one of my webpages and it showed the limit of 15 keywords used. The problem is that it counted only when the keyword appears in the Title, URL, Meta Description, H1, Body and IMG ALT. If you take into account the H2 and H3 tags, the count will go to 22. Is there a problem with the On-Page Grader Tool or it's not a problem to go above 15 keywords if they are in H2 and H3? Here's the link for the page: http://www.tororadar.com.br/acoes/bbse3-bb-seguridade/cotacoes-bovespa Keyword: BBSE3 Thanks in advance.
Moz Bar | | Guilhermealvesc0 -
How can the Moz Page Grader support a 'keyword portfolio' approach?
I used to use the Page Grader tools to support the old philosophy of one page - one keyword. With more focus now being given to a portfolio of keywords around a topic area - what would be a good approach to using the page grader tool? Obviously getting A's and B's is impossible for multiple keywords. The only way i've seen suggested in moz tools to help with keyword portfolios is to use labels in the ranking measurement and then find averages of the results. Are there other strategies that I can try?
Moz Bar | | AISFM0 -
Can't get on page grader to work properly.
Hi I'm trying to optimize my pages with the on page grader tool but it keeps returning an F grade when I know my page is very well optimized. It is like something is blocking the page crawl but I have double checked my robots.txt and can't think of anything else that is causing a problem. I am trying to do www.hydrohobby.co.uk with the keyword hydroponics for starters but it is the same problem with all other page urls on my site and keywords I try to input. This is a new site made with cscart 4.0. I've graded pages on previous versions of this software with no problems. Can anyone help? Rob
Moz Bar | | hydrohobby0 -
On Page Grader can't access my URLs
HI- I am trying to grade some specific pages for keywords with the on page grader but it keeps telling me "Sorry, but that URL is inaccessible. " I can reach them via the browser and they are not https. Any thoughts? Here is a sample: www.bulkcandystore.com/kosher-candy Any help is appreciated. Ken
Moz Bar | | CandymanKen0 -
Blocked Production Site from Search Engines - How to get it Crawled by Moz Crawler
I have an 'under development' site hosted, (which is an exact replica of live site as working on to add new functionalities & modules) - but its password protected, excluded from robots.txt (Disallow) & also marked noindex on all pages in the index - so that Googlebot & other Search Engines can not crawl the site At present the development work is almost 95% completed., Now - feel like to crawl the site through SEOMOZ Roger Bot - to know the errors and all indexed urls by Rogerbot. What's the best way to get Moz Bot crawl the site - but simultaneously continue it blocking its access to Search Engines I have gone through - https://support.google.com/webmasters/answer/93708?hl=en, it says a) Save it in a password-protected directory. Googlebot and other spiders won't be able to access the content- But this way Moz will also not be able to crawl the site b) Use a robots.txt to control access to files and directories on your server - However it also says - It's important to note that even if you use a robots.txt file to block spiders from crawling content on your site, Google could discover it in other ways and add it to our index. c) Use a noindex meta tag to prevent content from appearing in our search results - It also says that a link to the page can still appear in their search results. Because we have to crawl your page in order to see the noindex tag, there's a small chance that Googlebot won't see and respect the noindex meta tag Password Protected thus seems the best way to continue blocking. However, continuing with it will also block Moz bot to crawl the site. Any suggestions Thanks
Moz Bar | | Modi0