Duplicate content - Which is the other duplicate page?
-
Hi
I just ran a campaign, and I got a duplicate content warning for some of my pages. When I go into the diagnostic report, I am unable to find the page detected by google as 'duplicate' to the main page. Unless I know which 2 pages are being detected as duplicate, it'll be really difficult to actually solve the problem.
Would be great to have any kind of help here.
Thanks in advance!
-
I'm not aware of an outstanding issue with downloading CSVs. Could you go to http://moz.com/help/contact and open a ticket so we can investigate? Thanks, and so sorry for the troubles!
-
Trying to download the CSV for my campaign but it returns an empty page.
Kind of annoyed because Moz is not helping me identify the URLs with duplicate content. There's no column that Peter is referencing above and I can't download the CSV.
-
Hi Mark
Yes, login to your account. By default the system currently logs you into Moz Pro.
At the top right there should be a light green button that says "Start using Moz Analytics". Click that and if you will be logged into it.
Yesterday, there was a link which made it possible to switch back to Moz Pro, but I cannot find it now, so it may be that the only way to get back to Moz Pro is logging out and in again.
I hope that helps,
Peter
-
Hi Peter,
Could you detail exactly how to "switch to the Moz Pro interface?" Sure I'm missing something obvious but can't find a thing!
Thanks.
-
Thanks Peter! That makes sense.
-
Thanks a lot for the prompt response Jackie!
-
You are correct. For Duplicate Page Content, we are looking for pages that have 95% or greater overlap, or similarity in the content and code. If you're looking for more info, our Help Team wrote a great article about how our crawler defines each crawl diagnostic. Feel free to check it out!
Jackie
-
Hi Ravijot,
The only examples I have seen are those where the whole page is a duplicate caused by two URLs pointing to the same page.
You could though have two separate duplicate pages. The Moz report says that Duplicate Page Content is "Code and content similar or identical to code and content on other pages on your site". In the the case that the code and content is 'similar' I don't think it will tell you what is similar only the fact that the Moz crawler has found a large portion of a page that is identical and some different, thereby making the page 'similar'.
Maybe though a Moz support member could clarify my assumption on that.
Peter
-
Hi Ben
I have just been looking at this again and cab see that the report you were looking at was the duplicate page report from Moz Analytics rather than from Moz Pro.
The report in Moz Analytics is different and does not provide a link to view the duplicate pages on screen. However, having just downloaded the Crawl diagnostics export file in Moz Analytics it does now show the URL that was checked in column U of the spreadsheet and in column AF the duplicate page URL if one was found for the URL being checked. When there is more than one duplicate page found, the downloaded report has extra lines for each duplicate found for the checked URL.
Alternatively, you could switch to the Moz Pro interface and view the Duplicate Page Content report in that, which does give you a hyperlinked number (showing how many duplicate pages have been found for a URL) which if you click it you are shown the list of URLS of duplicated pages for that URL.
A screenshot of that is attached.
I hope that helps,
Peter
-
On a related note, is it possible to figure out 'what' exactly is duplicate between any 2 pages. Moz shows a lot of pages on my website that have different content, as 'duplicate pages'. Is there any way to figure out what this duplicate content is?
Thanks in advance!
-
Thanks Jackelyn. Look forward to this getting fixed.
-
Thanks for your response Peter. As mentioned by Jackelyn below, the column shows up as blank for me. Looking forward to the bug getting fixed.
Thanks again!
-
Hello!
In Moz Analytics, users should be able to download the csv to see the urls that have duplicate content. However, there is a bug that makes that column blank. Sorry about this! We realized that it somehow disappeared in those csv reports, and our Engineers are working to fix it. It should be fixed this week, and I'll update this forum when it's out!
Best,
Jackie | Product Planner
-
Same issue for me. I have the pages ID'd that have duplicated content but can't find the URL's those pages share the same content with.
In my report I DO NOT have the column of pages it reports as duplicated or a column entitled "Other URLs".
The columns in my report for "Pages with Duplicate Page Content" is as follows:
URL / Page Authority / Linking Root Domains / External Link Count / Internal Link Count / Status CodeIs there another view of the data I'm missing? BTW I'm under Search > Crawl Diagnostics > and Analyze Pages with Duplicate Page Content
-
Hi Ravijot
I assume you mean the diagnostic report in Moz and not anything you have seen in Google webmaster tools?
If the Moz report, you will see the column of pages it reports as duplicated. Alongside, you will see a number in the column which is titled "Other URLs". If you click the number, it will then show you the other URLs which are returning the duplicate page.
It's likely that these URLs are all pointing to the same page rather than you actually having duplicate pages.
Hopefully that will help you to find out what is wrong and fix it, but post back if you are still stuck.
Peter
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Crawl report shows that it gets 4xx errors for pages that work fine. Why?
On the crawl report it has all these "Critical Crawler Issues". They all say "4xx Error", yet when i click on the link from the crawler report, it goes to a perfectly functioning page, not a 404 page or anything. If i click in it actually says it's a 403 error. It's all for pages generated by the IDX solution for our real estate website. Is Moz broken or am i missing something? Here are a couple examples: <dl class="crawl-page-details-list"> <dd class="crawl-page-details-list-emphasis">https://teamvivi.com/homes-for-sale-map-search/</dd> <dd class="crawl-page-details-list-emphasis"> <dl class="crawl-page-details-list"> <dd class="crawl-page-details-list-emphasis">https://teamvivi.com/email-alerts/</dd> </dl> </dd> </dl>
Moz Bar | | TeamViviRealEstate0 -
I keep getting a 429 Too Many Request error for a wp-login page on my website. Is there a way to prevent that from happening, or fix outside of redirecting on the back end of WordPress?
I have a client that keeps coming up with 429 Too Many Request critical crawl errors. I re-directed some of them on the back end of WordPress, but additional keep coming in. The URL has a WP-Login and directs to back end login section. Is there a reason that would come up as an error, how can I prevent it from happening again, and how can I fix the remaining current errors outside of redirecting back to /? Thanks, Kalyn Lengieza
Moz Bar | | GrindstoneConsult0 -
My page cant be crawled by MOZ
Hi everyone, I have a page named zita.vn. Im using Moz to do SEO for the page, but when I use On-page grader in MOZ, I got an error that the page cant be accessed. Additionally, I got an issue with page crawling. Google search still crawl my page normally. Please help. Thanks a lot.
Moz Bar | | zita.vn0 -
Community Discussion - What's Been Your Experience With Moz Content?
When the content developed Moz Content, I was excited as can be about having another tool in the content marketing and content strategy repertoire. I knew it could and would help marketers better identify the content they should be creating and make it easier for them to move the needle for their brands. Since it's been available, I've had fun using Moz Content, seeing it as a great vehicle for flattening the learning curve for content ideation and creation. In a recent post, Here's How I'm Using Moz Content for Mining Local Link Opportunities, David Farkas described how brands can use Moz Content to better create localized content. I'd like to know how you're using it, or if you're using it: Have you tried Moz Content? And if not, what's stopping you? If you have used it, what are you really liking? What would you change? What, if any, additional features you'd like to see added? What tips can you share for helping others get the most out of the tool? Looking forward to reading the comments below.
Moz Bar | | ronell-smith3 -
Cannot Crawl ... 612 : Page banned by error response for robots.txt.
I tried to crawl www.cartronix.com and I get this error: 612 : Page banned by error response for robots.txt. I have a robots.txt file and it does not appear to be blocking anything www.cartronix.com/robots.txt Also, Search Console is showing "allowed" in the robots.txt test... I've crawled many of our other sites that are similarly set up without issue. What could the problem be?
Moz Bar | | 1sixty80 -
Moz is finding phantom pages
I suddenly have 4xx errors in my crawl diagnostics because pages with “/%3C/div” added to the end of the URL that are linked from the normal page can't be found. I didn't create the pages, and they don't exist, but Moz thinks that they do. I went back through to see if any changes in WordPress, theme or plugins versions might be the cause, but this is the only site that I have this issue, so I don't think that is it. Does anyone have an idea what causes this?
Moz Bar | | samuelldrew0 -
Comparing Competitor On-Page Grades?
When I run an advanced SERP report or even the basic keyword difficultly report it gives me competitor On-page grades. I can look directly at their code, but I'm wondering if there is a way to easily see and export a .csv or excel file of the on-page ranking factors for the top 1-10 results comparing them to a page on my site? Seems like that would be really helpful and much quicker than looking at source code to understand what on-page factors are contributing to their success. Is there any way to do this in Moz or a free tool elsewhere you would suggest?
Moz Bar | | K-WINTER0 -
MOZ crawl test is not reporting on all the pages on my site.
I've run the crawl test one of the sites I've taken over SEO for, however its only picking all the pages. For instance it indexes all the pages under xxxxx/us but none under xxxxx/au or xxxxx/uk The pages are being indexed as they're ranking in Google. Thanks.
Moz Bar | | ahyde0