Why so many crawl errors?
-
Our site is showing it has a ton of crawl errors in the back end, mostly concerning duplicate content within our blog. The content is unique however. We know this for certain because it's done in house or put together by some of the freelance writers we work with.
The site is for an RV dealership and we're using a template-based system from a well known company.
Any ideas on what may be causing this?
-
Hi Darrin,
Can you provide your website URL or a few examples of the URLs that are getting the duplicate content error?
If you can't provide them, I would recommend referencing http://www.seomoz.org/help/fixing-crawl-diagnostic-issues which says the following about fixing duplicate page content:
"Duplicate Page Content
Duplicate Content means there are pages that are identical (or nearly identical) to content on other pages of your site, which can force your pages to unnecessarily compete with each other for rankings.
Here are some things you can do about duplicate pages:
Delete content that is similar on each page.
Add some new and unique content to each page that is on the report. This can be done by adding more information, ideas, product descriptions, or anything that can make it differ from other pages on the domain.
You can also add a rel=canonical to one of the duplicate pages. Here are a few ways to do this:
Add a rel="canonical" link in between the and elements. This should be done on the version of the page you want to be ranking or that non-canonical version of the two (or multiple) pages.
To specify a canonical link to the page http://www.seomoz.org/blog.php?item=seomoz-iscool, create a element that looks like this: <link rel="canonical"href="<a href="http://www.seomoz.com/blog.php?item=seomoz-iscool">http://www.seomoz.com/blog.php?item=seomoz-iscool"/></link rel="canonical"href="<a>
Copy this link into the section of all non-canonical versions of the page, such as http://www.seomoz.com/blog.php?item=seomoz-iscool&sort=fun.
Keep in mind that that canonicals will stop the pages from ranking against each other, but they will still show up as duplicate content from a UI perspective, so we will still count them as duplicate."
Thanks,
Mike
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Increasing in 404 errors that doesnt exist
Hi First of all I should say that I have error in the old webmaster not the new one. I have two WordPress blog in root and subfolder. Today I checked my webmaster and recognize that I had 100 errors (404) that found in few days ago. My root WordPress is OK but subfolder WordPress has error. Let me show you by example. http://example.com/subfolder/article15245 I had error for this page: http://example.com/article15245 looks like this subfolder deleted I checked my links, but all of them were OK and linked to the right URL. unfortunately this errors dont have "linked from" section
On-Page Optimization | | meysamzare7112365410 -
Can bots crawl this homepage's content?
The website is https://ashleydouglas.com.au/ I tried using http://www.seo-browser.com/ to see if bots could see the content on the site, but the tool was unable to retrieve the page. I used mobile-friendly test and it just rendered some menu links - no content and images. I also used Fetch and Render on Search Console. The result for 'how google sees the page' and 'how a visitor sees the page' are the same and only showing the main header image. Anything below isn't shown. Does this mean that bots can't actually read all content on the page past the header image? I'm not well versed with what's going on with the code. Why are the elements below the header not rendering? Is it the theme? Plugins? Thank you.
On-Page Optimization | | nhhernandez0 -
How many internal links should a (sub-)page maximal have?
What would the effect of having too much be? Does google stop crawling after a number and punish more internal links?
On-Page Optimization | | brainfruit0 -
Moz crawl
Hi, 1. Is there any way to get the moz crawl to analyse any site like the website auditor tool in seo powersuite on command. It would be good to see what keyword my competitors are using. would also like to analyse my site when i have corrected errors on command. 2. Is google adwords keyword tool still the best keyword research tool? I Don't see anything in the newbie guides to the moz pro tool regarding keyword research. Thanks! David.
On-Page Optimization | | WallerD0 -
What Is the Best company for Seo that Scan and all errors automatically For me. thanks
What Is the Best company for Seo that Scan and all errors automatically For me. thanks Give Me some Suggestion.
On-Page Optimization | | nomyhot0 -
404 error only png and bmp
hey all, i get 404 error only for png and bmp files, like this link: http://www.binaryoptionstrategy.com/guide/weekly-news/page/wp-content/uploads/2010/07/12.png any idea?
On-Page Optimization | | Xmanic0 -
Too many onpage links
We got the weekly seomoz reports and see that most of our pages and posts contain too many onpage links. I checked our website and all of our pages have a header, footer and left side menu. I did the math and there are 13 links in the header, 26 links in the footer and 76 links in the left side menu. This means that all of our post and pages have 115 links at the start. So what do I do? Do I remove the left side menu from the posts' layout and use only the footer and header? Or do I add nofollow links? Thanks!
On-Page Optimization | | Romaine0 -
Do we have too many links in our footer?
Hi guys, we have 41 links on our holiday(vacation) rental website, this seems too many when looking at best practice. 24 of these are links to community pages while 8 link to activities pages. The community and activity pages are also accessible from links on the top menu so they are not strictly necessary but do get 10% of site clickthroughs according to Google in-page analytics. I therefore do not want to remove the links if there is no good evidence that google will penalize us for this. What do you think would be best for our site? Thanks, John Tulley. footer.jpg
On-Page Optimization | | JohnTulley0