403s: Are There Instances Where 403's Are Common & Acceptable?
-
Hey All,
Both MOZ & Webmaster tools have identified 403 errors on an editorial site I work with (using Drupal CMS). I looked into the errors and the pages triggering the 403 are all articles in draft status that are not being indexed. If I am not logged into our drupal and I try to access an article in draft status I get the 403 forbidden error.
Are these 403's typical for an editorial site where editors may be trying to access an article in draft status while they are not logged in? Webmaster tools is showing roughly 350 pages with the 'Access Denied' 403 status.
Are these harmful to rank?
Thanks!
-
Hi guys and girls,
With regards to this, ss there any problem for SEO that you can see with banning spam refers through Htaccess?
So in these instances when a spam bots comes to the site, we throw a "Forbidden You don't have permission to access / on this server.", so basically a 403 error?
We're considering this as a more permanent solution to using filters in GA.
What do you think?
Thanks,
Gill.
-
Thanks Nicolas & Ruth. I realized the reason the pages are triggering errors is because there are published pages linking to those posts in draft. I imagine those draft posts were live at some point and then put back into draft.
Im guessing if I kill all the links to those draft posts that will fix the issue.
-
I agree that it's probably not a huge problem, but still something to clean up if you can - it would be best if crawlers weren't trying to access these pages.
-
If Moz and Webmaster Tools are showing the 403 error, it means that they are able to crawl to the URLs that are returning the 403 - so somewhere on your site or on the web, pages that are accessible by bots and crawlers are linking to these pages that don't exist yet. Having a bunch of errors on your site can impact Google's ability to crawl it well, which can impact your rankings, so it's best to get those cleaned up. In Webmaster Tools you should be able to click on the pages and see which pages are linking to them, so you can remove those links; you can do the same using a tool like Screaming Frog if you'd prefer. Good luck!
-
Hello,
No problem with these URLs, Drupal returns a 403 correctly because crawlers try to get draft content. Google and other search engines will not penalized you because of that : you can think of cart URLs or account URLs for ecommerce websites that may returns 403 the same way.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Large site with content silo's - best practice for deep indexing silo content
Thanks in advance for any advice/links/discussion. This honestly might be a scenario where we need to do some A/B testing. We have a massive (5 Million) content silo that is the basis for our long tail search strategy. Organic search traffic hits our individual "product" pages and we've divided our silo with a parent category & then secondarily with a field (so we can cross link to other content silo's using the same parent/field categorizations). We don't anticipate, nor expect to have top level category pages receive organic traffic - most people are searching for the individual/specific product (long tail). We're not trying to rank or get traffic for searches of all products in "category X" and others are competing and spending a lot in that area (head). The intent/purpose of the site structure/taxonomy is to more easily enable bots/crawlers to get deeper into our content silos. We've built the page for humans, but included link structure/taxonomy to assist crawlers. So here's my question on best practices. How to handle categories with 1,000+ pages/pagination. With our most popular product categories, there might be 100,000's products in one category. My top level hub page for a category looks like www.mysite/categoryA and the page build is showing 50 products and then pagination from 1-1000+. Currently we're using rel=next for pagination and for pages like www.mysite/categoryA?page=6 we make it reference itself as canonical (not the first/top page www.mysite/categoryA). Our goal is deep crawl/indexation of our silo. I use ScreamingFrog and SEOMoz campaign crawl to sample (site takes a week+ to fully crawl) and with each of these tools it "looks" like crawlers have gotten a bit "bogged down" with large categories with tons of pagination. For example rather than crawl multiple categories or fields to get to multiple product pages, some bots will hit all 1,000 (rel=next) pages of a single category. I don't want to waste crawl budget going through 1,000 pages of a single category, versus discovering/crawling more categories. I can't seem to find a consensus as to how to approach the issue. I can't have a page that lists "all" - there's just too much, so we're going to need pagination. I'm not worried about category pagination pages cannibalizing traffic as I don't expect any (should I make pages 2-1,000) noindex and canonically reference the main/first page in the category?). Should I worry about crawlers going deep in pagination among 1 category versus getting to more top level categories? Thanks!
Moz Pro | | DrewProZ1 -
'Duplicate Page Content' for dissimilar pages
I'm using Moz's Crawl Diagnostics to try and clean up some SEO priorities for our website (http://www.craftcompany.co.uk) HOWEVER, virtually all of the pages that are being categorised as duplicate content are not the same, or indeed similar. For instance, these three pages have been deemed duplicated pages; http://www.craftcompany.co.uk/pme-rose-leaf-veined-plunger.html http://www.craftcompany.co.uk/double-faced-satin-ribbon-black-25mm-wide.html http://www.craftcompany.co.uk/double-faced-satin-maroon-10mm-wide-25mt.html Can anyone give me an insight into why this is? Many Thanks! http://www.craftcompany.co.uk/
Moz Pro | | The_Craft_Company0 -
Exact Keyword is Used in Page Title & Exact Keyword Used in Document Text at Least Once
Hi Folks, I have a page https://purplegriffon.com/courses/itil-training/itil-foundation-training/itil-foundation that grades with the 'On-Page Grader' as a B grade for the keyword 'itil foundation' but reports that there is no 'Exact Keyword is Used in Page Title' and 'Exact Keyword Used in Document Text at Least Once'. The thing is, it actually is but because of IP (intellectual property) rights we have to include a '®' (®) symbol when we mention the course title 'ITIL® Foundation'. Now I believe Google is smart enough to recognise that this symbol should not be included but it seems that for the specific criteria mentioned above, the MOZ bot isn't smart enough to recognise this, even though it recognises the keyword usage elsewhere. So my question is this. Would this constitute an issue in terms of ranking? Another question I have, is how significant are the gains with shorter URL's? For example, the URL to the page in question is: https://purplegriffon.com/courses/itil-training/itil-foundation-training/itil-foundation Would a URL such as below have a significant effect on SEO?: https://purplegriffon.com/courses/itil-foundation Thanks for your feedback.
Moz Pro | | PurpleGriffon0 -
Since July 1, we've had a HUGE jump in errors on our weekly crawl. We don't think anything has changed on our website. Has MOZ changed something that would account for a large leap in duplicate content and duplicate title errors?
Our error report went from 1,900 to 18,000 in one swoop, starting right around the first of July. The errors are duplicate content and duplicate title, as if it does not see our 301 redirects. Any insights?
Moz Pro | | KristyFord0 -
I've tried everything, and my blog still falling
Hello everyone! 🙂 I'm almost desperate, and trying to find a solution to one of my blogs. Below is it URL: http://www.xboxplus.net/ It has more than 3 years, and even so I get just around 700-1000 visitors a day. I have already applied several SEO techniques, tried several SEO plugins, tried to work with keywords, etc, but nothing changes. I see several other sites and blogs of the same niche (games), with much less content (I have more than 3800 articles, in 3 years), practicing plagiarism, stealing content, etc, and with much more visitors and revenue. I have never done nothing wrong. Never stole content. I always worked honestly, and always tried to write articles with "something more". I really don't know what happens with XboxPlus.net . And, how can, for example, Seomoz helps me, here? I would be very grateful for any help. 😄
Moz Pro | | Andarilho0 -
Why are the rankings of my keywords different to rankings from other programmes such as 'Access my Lan' and 'Firefly'? Does SEOMoz count 'Google Places and Maps' in their rank count? Im thinking this could explain the difference
Why are the rankings of my keywords different to rankings from other programmes such as 'Access my Lan' and 'Firefly'? Does SEOMoz count 'Google Places and Maps' in their rank count? Im thinking this could explain the difference
Moz Pro | | john_Digino0 -
Keyword research & how it's relevant to my site.
How do I know if I can compete on a particular keyword. Say the keyword analysis tool shows the keyword difficulty is 59%. How do I know what 59% means to my site, other than checking domain and page authority relative to my site (i.e. if sites in the top 10 are higher or lower authority than my site). Is there a way of showing what keyword difficulty percentage is a cut off point for my site? Thanks, Dan
Moz Pro | | dcostigan0 -
How many of my linked pages should I redirect (301's)
I'm moving my store to a new site and will have a much friendlier but completely different URL structure. I used Open Site Explorer to find inbound links to 513 pages and have done about half so far. The remaining pages have one link each at a page authority of 27 or less - but there are still 250+ of them. I have to manually view each old page, search for the product on the new site, and enter the redirect as there is no way to translate old URL's to new ones. How important is it for rankings to redirect the remaining 250 or so pages?
Moz Pro | | agirlandamac0