Moz crawling doesn't show all of my pages
-
Hello,
I'm trying to make an SEO on-pages audit of my website.
When using the SEO crawl, i see only one page while i have much more pages in this website (200+). Is it an issue with the sitemap ? The robot.txt ?
How can i check and correct this. My website is discoolver.com
-
Hi there,
Sam from Moz's Help Team here!
So, I took a look at your site, and unfortunately I believe this is a result of our crawler's inability to work with Javascript. Any client side loaded content will not be rendered to our crawler as we are only seeing what is rendered by your server.
Our crawler works by parsing the source code of your site, looking at HTML elements. If your site is primarily Javascript, then the data you get back with regards to the crawl report won't be completely accurate because of this. There's no real workaround that I can recommend for this one, since it is a technical limitation of our tools, but there are some good blog posts and discussions in the Q&A about this if you head over to our Help Hub.
While the tools and data that rely on our crawl of your site may not return the best results because of that Javascript, your keyword rankings and link profile should work just fine.
You might also want to check out a few tools that are compatible with Javascript, like Botify or Screaming Frog.
I'm really sorry I can't be of more help here; Please let me know if there's anything else I can help with, or if there are any follow-up questions you might have!
-
Thanks for the answers.
I believe the issue is about a rel=canonical from the homepage which links to an external website...
Can this tag prevent a good website crawl ?
-
So just looking it appears you don't have a robots.txt file or a sitemap. At least one that I could easily find.
This Moz post might help when creating one.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why some of my backlinks are not showing on moz
why some of my backlinks are not showing on moz. These backlinks are profile and web 2.0 backlinks, i have tried many solutions but none of them worked for me. my site is solution4people is there any way to show all the backlinks of my site on moz . Thanks alot.
Link Explorer | | tzoubaier0 -
Give a Solution my DA is not increasing and not index my backlinks in MOZ??
DA of my site is not increasing. It seems like Moz is not indexing my backlinks. Multiple backlinks of my site [ Tech Spotty ] is not indexing in Moz that is why DA is not increasing. Backlinks of my site have indexed in both Ahref and Semrush both not showing in Moz. DR has increased to 51 but DA is still 7. If anyone has the solution please let me know.
Link Explorer | | fbowable1 -
Moz Pro Tools Inbound Links
Is there a way to get a date of when a inbound link was created from a external website. And if so is there a way to add that to the Moz Pro tools reports on a csv file.
Link Explorer | | willakawillow221 -
Open Site Explore page titles show as "No Title"
This has been asked many times but I cannot find an answer. On Open Site Explorer, most URLs I enter show as "No title" which means you have to hover over the URL to see which page is being referred to. I know you'd want an example, so here's your own site Moz.com 🙂 CWrkxZQ
Link Explorer | | clifra0 -
How many pages Google crawl in free version
I am using moz pro 30 days trial version.Can Anybody tell me how many pages moz crawl in a day or in a week.Because its two days and only 2 pages they crawled. Thanks
Link Explorer | | VarinderS0 -
[No Title] for all Top Pages at Open Site Explorer
49 out of the top 50 pages of the domain www.parallels.com shows [No Title]. I find this to be a major concern. Pages have long been established, title tags haven't changed recently. Am seeing a fair amount of 301 and 404s showing up, but actual OK 200 pages still showing [No Title]. Also seeing some decreases in organic search traffic at Google. Might there be a correlation?
Link Explorer | | ChristianMKG0 -
[No Title] in Top Pages using Open Site Explorer
Hello!
Link Explorer | | eagleleather
All of my pages contain properly formatted title tags which display in the browser. However, when I view the 'Top Pages' area of the Open Site Explorer, 99% of those pages show [No Title] in the Page Title & URL column. Does anyone know what might be causing this?0