Getting 'Sorry, but that URL is inaccessible' error msg when trying to run On-Page Grader
-
I just signed up for MOZ Pro for the first time today. Tried to run the 'on-page grader' tool on some of my pages but I'm getting a 'Sorry, but that URL is inaccessible' error msg. I have verified against the robot.txt file that the pages are NOT blocking any crawlers.
Can anybody help?
-
Thanks David. The alpha numeric digits are generated and appended to the page by the 'addthis', a third party sharing tool (http://www.addthis.com/).
Does this mean Moz will not be able to read all pages containing this redirect behavior?
-
Hi spinoki
For your URL there is a re-direct to http://www.healthpocket.com/medicare/california-medicare#.U9qw54BdXC8 which our tool cannot follow. It will need to resolve the URL without a re-direct.
-
Thanks David. I ran this URL (http://www.healthpocket.com/medicare/california-medicare) and received the following results:
HTTP 200 OK Content-type: text/html Date: Thu, 31 Jul 2014 20:43:16 GMT Set-cookie: connect.sid=s%3Ac4wchmmEPyGNLoni5bmAKsSa.bSsaR4%2Bufe3qdZ0dO3HoMtQB2VY5w3%2BHWLCqEkrBarc; Path=/; HttpOnly Vary: Accept-Encoding X-powered-by: Express Connection: Close
What should be my next steps?
-
Hello!
Outside of robots.txt most URL errors are a result of failed HTTP responses when running a standard curl check to the site. If you can provide me with the URL you are trying to add I can run a test or you can check what the response is through http://simonecarletti.com/tools/http-checker
Other times hosting providers block AWS (Amazon Web Services) IP addresses which we use to validated URLs from.
Re-direct loops will also prevent adding an URL, if you have a 302 or 301 to more than two URLs it will fail.
And any secure HTTPs sites will need all intermediate certificates on the web server to be a valid URL.
Hope this helps!
-
Sorry this took so long to get back to you.
To answer your question. As far as "server setting" etc, it really depends on what exactly needs to be changed.
Is it displaying a code? Is there a number associated with the error? Have you been able to identify which pages are having the problem?
I would look at this systematically. Now you may not have the time to do so, considering that this is work and not always play; I completely understand if your idea of a fun Friday night isn't sitting in your basement analyzing which pages are not working with the Moz site audit.
Regardless, let's find out where the errors are.
- Can you run other Moz tools on the pages that are causing the error?
- Does the side audit display any error for those pages?
- Are you copy and pasting the entire URL into the tool?
Another thing to keep in mind is that Moz did take a hit from a few DDoS attacks so I know a few of the tools have been iffy on and on. http://health.moz.com/ is a great spot to check and see if the tool you are looking for isn't working.
I think every SEO Tool (Majestic, Raven, SEM Rush, Search Metrics) really are giving you the same data just packaged & interpreted differently. They all have a specialty of course and that being said I have my preferences. Majestic will dig for more backlinks, SEM Rush will give the best Ad data, but realistically everybody is fishing from the same pond, granted it's a big pond. With an unlimited budget I would have 3 different programs for different things.
The amount of data that these programs are trying to interpret is awesomely massive. I don't know if any SEO tool is spot on, even Google Analytics for example. I think of them all, as a guide.
I started with Search Metrics which was incredible expensive and way to in-depth for my knowledge of SEO and my projects.
Later transitioned to Raven which was great because they pulled data from Majestic and Moz, and gave some great step by step suggestions. The problem was their spider couldn't run most of the websites I needed.
Lastly I ended up on Moz. A name I remember back when it was SEOMoz. Sure there are issues, but I found not only were the tools pretty on target, but the community was INCREDIBLY helpful. Which is one of the main reasons I have stayed. And I am a N3wb in comparison to most of the guys on here!
I'm sorry you're having a bad experience with the tool!
-
While some of the moz tools are inaccurate, most are a pretty good starting point for discovering errors. We have run into the same issue, where server settings were not allowing the rogerbot to access the page or pages.
-
Thank you. But 'server settings'? 'hosting providers'?! Isn't that a little complex consider that I've used other online seo tools and have never ran into this problem.
Also, if there are settings that I need to adjust before moz can have access of all of my pages, can I assume the other moz reports are incorrect?
thanks again.
-
I have a similar issue. I would look into the server settings or contact your hosting provider and ask them.
For us, our host (private hosting) is obsessive about cyber security and has the port flood settings adjusted so tightly that our website isn't able to be properly crawled by Rogerbot.
Another problem that I have run into before is if there are aspects of your website that are not fitting for Rogerbot. I would take a look at http://moz.com/help/guides/search-overview/crawl-diagnostics/rogerbot and see if there is something about your website that Roger doesn't like.
For example, the webmaster previous to me had 45 images in our slider..... yes.... 45 images.... and not only that but the slider was on every page of our website.... which was 600 pages... So finding a bot to crawl that was not easy. Once I was brought on, I removed 40 images and BAM roger was in! We still have some server based issues, but we have determined that it is on our end and are actively looking for a new host.
Hope that helps!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Page Optimization Error
Hello.
Moz Bar | | csgosmurfcart
When I try to use 'On Page Grader' on specific site, I get an error message. "
Page Optimization Error
There was a problem loading this page. Please make sure the page is loading properly and that our user-agent, rogerbot, is not blocked from accessing this page.
"
example : https://www.csgosmurfkart.com Site's robots.txt settings are good. and I think there's no blocking factor. But On Page Grader cannot crawl the sites.
But campaign crawler is working well on the site. only On Page Grader is not working.. What should I change my server's setting or site's setting for crawling site on my site?
I'm using wordpress on google cloud Thank you.0 -
Moz Crawl only crawling the top level page (1 page)
For the past few mounts my weekly site crawl has been inconsistent. One week works fine, it crawls all of my 500 or so pages. The following week it only crawls 1 page (http://mydomain.com) and nothing else. A few weekly scan go by and the crawl is back up the the 500 or so pages.I went ahead and created several campaigns with duplicate settings and crawled the site. Most times but not all the new campaign's crawl works fine crawling all pages. But within a week or two the weekly crawl will fail again. (crawling 1 page). Currently i have four campaign's all with the same settings running weekly crawls. 2 campaign's crawled the 500 pages and two crawled only the single page. Any help will be greatly appreciated
Moz Bar | | dmaude0 -
Moz says "Title Too Long", Yoast says title is the perfect length. Who's right?
For a bunch of my pages, the MOZ Crawl Report says "Title Too Long". Yoast on my site tells me that the titles are the correct length. How can these two things be at odds with each other? Which one is right?
Moz Bar | | TeamViviRealEstate0 -
Moz Crawl - 804 : HTTPS (SSL) error encountered when requesting page.
Got an issue sending a Crawl Request to https://www.usernamebuddy.com/ " "804 : HTTPS (SSL) error encountered when requesting page." I have tried to recrawl several times now same issue keeps occurring. I cannot see an error when I access the site am I missing something, if so how can I diagnose the issue and sort the problem? I have reviewed the source and cannot use any http: resources.
Moz Bar | | GrouchyKids0 -
Title tag not registering on page optimization
I added a link to the "page optimization" section at moz. When I submit the url to be reviewed (click "optimize") it doesn't find the title tag, although it is definitely there e.g this page
Moz Bar | | digitalalchemy
http://naamanewman.co.il/photosGalleryID.aspx?id=34 Anybody as any Idea why is that? Maybe the tag placement on the DOM (it's not directly under the opening head tag).0 -
Why isn't the Moz bar data populating for Yahoo sites?
The Moz bar isn't populating information for Yahoo homepage or it's verticals (i.e. homes, autos, finance, etc.), but I can get this data for other portals like AOL or MSN. I'm specifically looking for PA, mR, and DA information, but instead I get a generic "Search Profile" bar with no page/site-specific data.
Moz Bar | | AllieBell
Is there a reason Open Site Explorer data isn't populating for this particular portal?0 -
Moz Crawler URL paramaters & duplicate content
Hi all, this is my first post on Moz Q&A 🙂 Questions: Does the Moz Crawler take into account rel="canonical" for search results pages with sorting / filtering URL parameters? How much time does it take for an issue to disappear from the issues list after it's been corrected? Does it come op in the next weekly report? I'm asking because the crawler is reporting 50k+ pages crawled, when in reality, this number should be closer to 1000. All pages with query parameters have the correct canonical tag pointing to the root URL, so I'm wondering whether I need to noindex the other pages for the crawler to report correct data?: Original (canonical URL): DOMAIN.COM/charters/search/mx/BS?search_location=cabo-san-lucas Filter active URL: DOMAIN.COM/charters/search/mx/BS?search_location=cabo-san-lucas&booking_date=&booking_days=1&booking_persons=1&priceFilter%5B%5D=0%2C500&includedPriceFilter%5B%5D=drinks-soft Also, if noindex is the only solution, will it impact the ranking of the pages involved? Note: Google and Bing are semi-successful in reporting index page count, each reporting around 2.5k result pages when using the site:DOMAIN.com query. The rel canonical tag was missing for a short period of time about 4 weeks ago, but since fixing the issue these pages still haven't been deindexed. Appreciate any suggestions regarding Moz Crawler & Google / Bing index count!
Moz Bar | | Vukan_Simic0 -
On Page Grader can't access my URLs
HI- I am trying to grade some specific pages for keywords with the on page grader but it keeps telling me "Sorry, but that URL is inaccessible. " I can reach them via the browser and they are not https. Any thoughts? Here is a sample: www.bulkcandystore.com/kosher-candy Any help is appreciated. Ken
Moz Bar | | CandymanKen0