Tool To Search For Duplicate Content
-
Hi
Is there such a tool that can be use to search a website for duplicate content?
Thanks
-
Although the Moz software is awesome, it only works to configure and setup campaigns if you are a PRO member which comes with a 99$ fee per month. This isn't for everyone unless they can use the software more than once.. I would suggest grabbing a few free tools online to use. You can check out : ScreamingFrog and/or Xenu Link Sleuth
Each will provide you with detailed reports to filter through and see content from your site. ScreamingFrog will provide you with data for up to 500 URL's for free. You will need to purchase the license to go deeper, depending on your site.
This one is a great for getting HTTP header checks and site wide duplicate content error notifications.
If you want to try a tool to verify online duplicate content - PageSpotter is a checking and monitoring tool.
A great post by Google Webmaster Center Blog about Duplicate Content and why you need to address it to help with your site.
If you plan to go the route of moving the site to a new domain/URL this is a great forum piece on the steps you need to plan and execute for a clean move.
Hope some of this helps you out!
-
In Moz Analytics:
Campaign > Search > Crawl Diagnostics.
That'll put you on the "Issues Overview" page, and if you go to the box with "High Priority Issues" Duplicate Page Content is one of them. You can click that, and it'll list your pages with Duplicate content, where the duplicates are, and some other useful information. If you've just set up your campaign, this might not show up for a week or so. Hope that helps.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
CTA first content next or Content first CTA next
We are a casino affiliations company, our website has a lot of the same casino offers. So is it beneficial to put the content over the casino offers, then do a CSS flex, reverse wrap, so the HTML has the page content first, but the visual of the page displays the casinos first and the content after? or just the usual i.e image the HTML as content first, and CSS makes offers come first?
On-Page Optimization | | JoelssonMedia0 -
How to fix duplicate content for homepage and index.html
Hello, I know this probably gets asked quite a lot but I haven't found a recent post about this in 2018 on Moz Q&A, so I thought I would check in and see what the best route/solution for this issue might be. I'm always really worried about making any (potentially bad/wrong) changes to the site, as it's my livelihood, so I'm hoping someone can point me in the right direction. Moz, SEMRush and several other SEO tools are all reporting that I have duplicate content for my homepage and index.html (same identical page). According to Moz, my homepage (without index.html) has PA 29 and index.html has PA 15. They are both showing Status 200. I read that you can either do a 301 redirect or add rel=canonical I currently have a 301 setup for my http to https page and don't have any rel=canonical added to the site/page. What is the best and safest way to get rid of duplicate content and merge the my non index and index.html homepages together these days? I read that both 301 and canonical pass on link juice but I don't know what the best route for me is given what I said above. Thank you for reading, any input is greatly appreciated!
On-Page Optimization | | dreservices0 -
Many have stolen our content. Rewrite vs. DMCA content removal?
Hello, We own a medical tourism website and many other sites have stolen (copied and pasted) our content. Our content is more than 2 years old, so we thought we could rewrite the content - but Which is a more wiser decision from you guys' experience? Archive our current content at a different URL and upload a fresh content in the current URL Claim our originality to Google and ask the stolen sites to remove our content. Thank you and appreciate your time.
On-Page Optimization | | joony0 -
Duplicate content penalty
when moz crawls my site they say I have 2x the pages that I really have & they say I am being penalized for duplicate content. I know years ago I had my old domain resolve over to my new domain. Its the only thing that makes sense as to the duplicate content but would search engines really penalize me for that? It is technically only on 1 site. My business took a significant sales hit starting early July 2013, I know google did and algorithm update that did have SEO aspects. I need to resolve the problem so I can stay in business
On-Page Optimization | | cheaptubes0 -
Duplicate Content - Blog Rewriting
I have a client who has requested a rewrite of 250 blog articles for his IT company. The blogs are dispersed on a variety of platforms: his own website's blog, a business innovation website, and an IT website. He wants to have each article optimised with keyword phrases and then posted onto his new website thrice weekly. All of this is in an effort to attract some potential customers to his new site and also to establish his company as a leader in its field. To what extent would I need to rewrite each article so as to avoid duplicating the content? Would there even be an issue if I did not rewrite the articles and merely optimised them with keywords? Would the articles need to be completely taken by all current publishers? Any advice would be greatly appreciated.
On-Page Optimization | | StoryScout0 -
Title Tag duplication.
Hi Guys/Gals, We do a lot of work in a very competitive space (personal injury) and are having an internal debate on the best way to implement title tags for new sites. We understand that keywords, title tags, etc., don't possess the power they once did, but we have yet to see conclusive proof of this in our space. The vast majority of competitors still rank very well for keyword focused content, title tags, etc., while having average link profiles and little content. We write a lot of content for our clients and want to know if someone can offer their opinion on the question that follows this example: "Top 5 Injuries Caused by T-Bone Collisions | Indiana Accident Lawyer" Would it seem repetitive or manipulative to construct title tags as shown, always placing "Indiana Accident Attorney" or "Indianapolis Accident Lawyer," or similar of at the end of each title tag? Thanks, gang!
On-Page Optimization | | Wayne760 -
Disavow Tool
2 Questions any help appreciated: I have had a spam url in my Disavow file with Google since last September but it still shows up as linked to my site, is this correct? If a url has say 100 pages all with your anchor text and it is a spam website do you Disavow the domain url or do you have enter all the pages in the Disavow spreadsheet?
On-Page Optimization | | Palmbourne0 -
Duplicate Title question
Thanks Mozzers in advance for any insight into what I'm sure is a basic SEO question. I'm working with a resort in the great state of Maine. Their home page title reads Maine Resorts, Resorts in Maine, (company name). The site has about 400 URL's and over half of the URL's utilize the first keyword phrase of the home page title, "Maine Resorts." Predominately, I find them used on the Accommodations pages (pages that describe each room with a picture) which I would label as deeper pages and non-conversion type pages. The page titles themselves are not exact duplicates of the Home Page Title but might read something like "Maine Resorts, Company Name, Accommodation Listing." My concern is that the heavy use of "Maine Resorts" as the first phrase in over 200 plus pages might be competing against the home page and pulling the home page ranking down. Thanks for any help given!
On-Page Optimization | | hawkvt10