Settings to crawl entire site
-
Not sure what happened but I started a third campaign yesterday and only 1 pages was crawled,
The other two campaigns has 472 and 10K respectively.
What is the proper setting to choose in the beginning of campaign setup to have the entire site crawled. Not sure what I did different and I must be reading the instructions incorrectly.
Thanks,
Don
-
The most common reasons for this are discussed at https://seomoz.zendesk.com/entries/409821-why-isn-t-my-site-being-crawled-you-re-not-crawling-all-my-pages. If those don't solve your problem, email [email protected] and we'll be able to sort it out at the help desk.
Thanks!
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Site Crawler not working but on-demand crawler working
Hi, In Moz pro, when using Site crawler (or recrawl), we are seeing message site is banned. But when using on-demand crawler, it could generate report successfully. I just like to know if in both these cases, it is roberbot that is used! And kindly note, site crawler was perfectly working before. So the required setup is already in place from long time. Site crawler ban issue started appearing from nov/dec 2023. . Could you please us understand how could we possibly make site-crawler work?
Moz Pro | | gilesd
I am happy to provide more details if you need any. Thanks0 -
Unsolved Site Crawl Stalled and Can't Restart
In my GreenSeed campaign, the site crawl continues to say "in progress." I can't figure out how to stop it or how to restart the site crawl. Can you please help?
Moz Pro | | Winger1 -
Site Crawl 4xx Errors?
Hello! When I check our website's critical crawler issues with Moz Site Crawler, I'm seeing over 1000 pages with a 4xx error. All of the pages that are showing to have a 4xx error appear to be the brand and product pages we have on our website, but with /URL at the end of each permalink. For example, we have a page on our site for a brand called Davinci. The URL is https://kannakart.com/davinci/. In the site crawler, I'm seeing the 4xx for this URL: https://kannakart.com/davinci/URL. Could this be a plugin on our site that is generating these URLs? If they're going to be an issue, I'd like to remove them. However, I'm not sure exactly where to begin. Thanks in advance for the help, -Andrew
Moz Pro | | mostcg0 -
SEO Crawl Report Images?
Does SEOMOZ crawl images in the report? Raven tools is showing me about 200 missing alt tags and title tags. I can not seem to find any of this information on the SEOMOZ report. Am I missing something?
Moz Pro | | jasonsixtwo0 -
Open Site Explorer Link Metrics
I'm new to SEOMOZ. I have a Pro account and have been messing with the tools available. I ran a report in Open Site Explorer on one of my prospects. I also entered in several of their competitors to see how they rank. I would like to show the report to my prospective client but couldn't figure out how to download the information. Is that info available for download? Does anyone have a recommendation for showing prospects how they rank against their competitors. Any help appreciated.
Moz Pro | | MedGroupMedia1 -
Open Site Explorer
Hi - open site explorer always showed backlinks to my site's blog for Wordpress, a couple of edu sites and others that ranked somewhat high. These are no longer being shown. However, they do show up on some other backlink check tools. Does anyone know why and if this should be a concern? Thanks. Don www.uniquegiftsanddecor.com
Moz Pro | | uniquegifts-2778790 -
BOTW links not recognized by Open Site Explorer
Hi there, I was wondering if I buy a submission to the Best of the Web directory (waiting for the new directory list promised by the seomoz team 🙂 ) but when I get to the category on BOTW website that will fit for my website, I took some links already there and put them on open site explorer to see their value, I had the surprise they are not even recognized... So I am still wondering if it is worth or not... voilà , if anybody knows if this directory still has value...
Moz Pro | | thuraminho750 -
Is there any way to manually initiate a crawl through SEOMoz?
... or do you actually have to wait a week for the next scheduled crawl date on a particular campaign? We've just made a ton of changes to our site, and it would be helpful to know if they will generate any warnings or errors sooner rather than later. Thanks!
Moz Pro | | jadeinteractive1