Why does the moz crawl test lists page twice?
-
Hi,
I'm running into an issue where some crawlers list my pages twice, once with a trailing slash, once without. I first saw it on a few pages with screaming frog, then saw it happen on all my pages with the moz crawler.
The site is www.kidsandart.org and its on Squarespace. I grepped the sitemap.xml I submitted to google webmaster and got 167 distinct pages, all of them without a trailing slash.
Any insights on why this is happening, and how to regard moz crawler results would be appreciated.
thanks
Tom
-
One thing to note that I forgot to mention is that SquareSpace does use rel=canonical tags on their pages. So while your reporting may be off, link juice will not be split between / and no-/ pages. This also takes care of duplicate content problems, as the tag defines the source content.
-
This is a problem I have encountered with SquareSpace. SS does not automatically redirect non-trailing slash pages to the trailing slash version. This creates duplicate content issues and reporting issues, as:
and
will be recorded as two separate pageviews on your reporting.
If you want to know more about why it's recorded as two separate pages, read this blog from the Official Google Webmaster Central Blog: http://googlewebmastercentral.blogspot.ca/2010/04/to-slash-or-not-to-slash.html
Unfortunately this is just a problem with SS and since you can't use htaccess to redirect pages or use the built in Redirect Tool to do this, you are kind of just stuck until SS improves their system.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
German blog post with mutated vowel. Page optimization says keyword is not used.
Hey guys! I'm trying to optimize for a keyword that includes a mutated vowel (ä for example). In the URL I simply put it as ae (which most sites that I checked do). For whatever reason it says the keyword is not used on the site at all - which isn't true. Is this a known problem? Haven't found anything in the forums. Thanks for the help. Florian
Moz Bar | | floriannin0 -
Moz Keyword Explorer how long does it take to gather metrics
Looking at some low volume keywords, I get lots of "Gathering Metrics". These don't seem to be updating with metrics. How long does this typically take, should I set and come back in a couple of hours, overnight? Should I leave the screen open, or will this stop it working? Justin
Moz Bar | | GrouchyKids0 -
Comparing Competitor On-Page Grades?
When I run an advanced SERP report or even the basic keyword difficultly report it gives me competitor On-page grades. I can look directly at their code, but I'm wondering if there is a way to easily see and export a .csv or excel file of the on-page ranking factors for the top 1-10 results comparing them to a page on my site? Seems like that would be really helpful and much quicker than looking at source code to understand what on-page factors are contributing to their success. Is there any way to do this in Moz or a free tool elsewhere you would suggest?
Moz Bar | | K-WINTER0 -
Should I exclude prepositions in tracked keywords of moz analytics?
I'm new to Moz. Just set up my trial campaign, and it had suggested many keywords. Many of the phrases that were suggested do not contain prepositions. For example, instead of something like "sporting good stores in Chicago" it suggested "sporting good stores Chicago" Today, I looked at the on-page optimization suggestions, which are (of course) suggesting that I remove prepositions from my page to rank well. Well, as you know, that is unnatural to the reader. But I suspect people are searching in higher volume, leaving the prepositions out. I know that if I were to search for a sporting goods store in Chicago, I would probably leave out "in." What should I do? Should I remove all the suggested keywords, and make them readable (which people are less like using in their search?) Do I go back to all my pages and try to optimize it for a keyword that is natural, but does not include a preposition (such as Chicago sporting goods stores) or should I be doing something else?
Moz Bar | | osaka731 -
How Does the On-Page Grader Know about my Target Keyword? Or how can I tell it?
So we've optimized a home page for a particular keyword, "blue widgets tx". But the on-page grader is giving information about "tx blue widgets", "blue widgets in texas", etc. and telling us we are an "F" for these keywords. Is it possible to tell the on-page grader, "Hey, just worry about 'blue widgets tx', and forget about those other ones"? I know I can do it by hand, but it will take forever.
Moz Bar | | Titan5520 -
Duplicate content reported for totally different pages
Hi, The Moz report is showing just over 21,500 duplicate page issues on our site. This is more or less every page we have. However when I look at the pages it says are duplicates they are totally different (it could for example report that a news page for 2009 is the same as a product page just added which has no relation when you read the content or view the page). What sort of thing could it be picking up as duplicate content? I assume it must be something in the HTML for the site rather than the actual page content as there is no cross over at all on the pages highlighted. The only issue I can currently identify is that the menu for the mobile version of the site has a huge number of internal links which I will cut down. If the tools purely look at HTML content this could be seen as duplicate but shouldn't it be clever enough to realise what is content and what is site structure? Thanks,
Moz Bar | | TW-Steve0 -
403 Error on WMT but not on MOZ?
Hello, 2 days ago I found there are about 1200 of 403 errors by Google WMT when I tried to fetch my domain - Please see attached HTTP/1.1 403 Access Forbidden Cache-Control: private Content-Type: text/html ETag: "" Server: Set-Cookie: ASPSESSIONIDSSBARTSD=BEHMJHJBKJOEJEALECNNIPFH; path=/; HttpOnly X-Powered-By: Date: Tue, 18 Feb 2014 13:54:10 GMT Content-Length: 1233 <title>403 - Forbidden: Access is denied.</title> Server Error <fieldset> 403 - Forbidden: Access is denied. You do not have permission to view this directory or page using the credentials that you supplied. </fieldset> I ran a complete report using MOZ but I was shocked not see any 4xx , 5xx errors. Google: 246 of 404 errors No Google, Yahoo or Bing blocking HTTP status code: ALL 200 301 redirect: none? I have done about 2500 over 4 years. The website is losing indexed pages. I'm not sure what's going and which numbers to trust. Please help. Thank you. Adam
Moz Bar | | homs830 -
"Sorry! We weren't able to find that page when we crawled your site." Please help!
Can someone please explain whey I am getting this error for this link "http://lensoutloud.com/san-antonio-real-estate-photography/" when I attempt to perform an on page SEO grading? The link is indexed and ranking very well but for some reason Moz says it can't find the page when it crawled my site. This has also happened when I attempt to grade other pages on my site. Thanks in advance!
Moz Bar | | AndreGant0