How do a run a MOZ crawl of my site before waiting for the scheduled weekly crawl?
-
Greetings:
I have just updated my site and would like to run a crawl immediately. How can I do so before waiting for the next MOZ crawl?
Thanks,
Alan -
-
Thanks Darin!!
I have requested the crawl. Hoping I get the report within a few hours.
Regards,
Alan Rosinsky -
Hey Alan,
Thanks for the question! You can use the crawl test if you are between scheduled crawls, but if you run test within a few days of a scheduled crawl you may end up with cached information. You shouldn't run the crawl test on a regular basis, but its fine to do every once and a while.
Cheers,
Ryan Watson
Business Development Associate | Moz -
I love the screaming frog tool that Matt recommended but we do have a crawl tester here on moz.com
http://pro.moz.com/tools/crawl-test
You can perform the crawl up to twice per day. It will tell you that you'll get results within 24 hours but I've never had it take more then 4 hours for a regular sized site.
Hope this helps.
Darin.
-
What kind of info are you looking for the crawl to provide? Moz will do a quick crawl and then a detailed crawl within a week. However, there are other things you can use.
EDIT: You can use the Moz tool - http://pro.moz.com/tools/crawl-testOne of the best on the market is Screaming Frog Spider. You can do so many things with it. There is a great post over at SEER Interactive on things to do with it:
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Moz Insights are raising alarms --Are they useful?
Hi, Moz is alerting us about URLs being too long, titles being too long, and duplicate content. These are mostly for pages with categories of content, or the author bio pages --pages that are included by default with the template we're using in HubSpot. So that there isn't a quick way to make these changes, and anyway the pages are low-value.So my question is, how much are these issues impacting our SEO and domain authority?If these are pages no one visits (like the category and author pages) is there any reason this would be harming our SEO efforts?Thanks!
Moz Pro | | ASCI-Marketing0 -
MOZ Pro - Page Grader Queries
Greetings! I started a new position last week and the extremely supportive director promised to give me anything I required to make my job easier. Of course, my first port of call was MOZ Pro. Having never used MOZ Pro before, I've just been getting to grips with it, fixing any pressing issues and giving the whole site a general SEO health check. A few fairly major issues have been flagged, which I'm in the process of fixing, and I'm currently putting our main landing pages through the MOZ Page Grader. After a little bit of tinkering, our iPhone 6 cases page has been graded B for the term 'iPhone 6 cases', but I have a few queries/concerns regarding some of the suggested fixes: **Avoid keyword stuffing in document **- The term 'iphone 6 cases' only appears thrice in the body, so it can't be that? The term, however, appears 23 times in the page's img alt tags. Could this be the issue? This is an ecommerce site that sells iPhone 6 cases, so the img alt tags are bound to contain that keyword. Each img alt tag is unique, so I don't really know what I can do here? "Show details for YouSave iPhone 6 0.6mm Clear Gel Case" is the example of the img alt tag of one of the products on that page, surely I can't remove the words 'iPhone 6 case'? Avoid too many internal links - MOZ suggests keeping the internal links to below 100 or, at a minimum, less than 100 links on the main navigation menu. I haven't counted, but I'd guess that page has more than 100 links, but not too many on the navigation menu. To me, this looks like a standard ecommerce page, with links to products and different pages via the top and bottom menus. Would I improve visibility if I reduced the amount of links by, say, reducing the number of products on the page? We currently have it set to 36, but can easily be reduced. Only One Canonical URL - We've put a fix in place for this issue and are just waiting for it to go live. For some reason rel=canonical tags have been duplicated on the majority of the pages. Like I say, this is being remedied, but I just wondered whether a duplicate tag negatively affect the page's visibility? The tags are identical and just point to the page they're on. I think that's about it for now! Thanks in advance and keep up the good work! Cheers, Lewis (Andrew is the name of the director) UPDATE Now I've sorted the rel=canonical issue, the pages are being graded A but still with the first two suggestions above.
Moz Pro | | PeaSoupDigital0 -
Crawl Diagnostics Report
I'm a bit concerned about the results I'm getting from the Crawl Diagnostics Report. I've updated the site with canonical urls to remove duplicate content and when I check the site - it all displays the right values, but the report, which has just finished crawling is still showing a lot of pages as duplicate content. Simple example: http://www.domain.com http://www.domain.com/ Both of them are in the duplicate content section although both have canonical url set as: Does each crawl check the entire site from the beginning or just the pages it didn't have a chance to crawl the last time? This is just one of 333 duplicate content pages, which have canonical url pointing to the right page. Can someone please explain?
Moz Pro | | coremediadesign0 -
Issue in number of pages crawled
i wanted to figure out how our friend Roger Bot works. On the first crawl of one of my large sites, the number of pages crawled stopped at 10000 (due to the restriction on the pro account). However after a few weeks, the number of pages crawled went down to about 5500. This number seemed to be a more accurate count of the pages on our site. Today, it seems that Roger Bot has completed another crawl and the number is up to 10000 again. I know there has been no downtime on our site, and the items that we fixed on our site did not reduce or increase the number of pages we had. Just making sure there are no known issues with Roger Bot before I look deeper into our site to see if there is an issue. Thanks!
Moz Pro | | cchhita0 -
New site on page check
hello wonderful Mozzers, I am building a new site and was wondering if any of you knew any latest " thorough" ON Page Check Lists? I want to make sure I build the site right, and do every bit of on page and new site seo right. I have access to the SEOMOZ guides as well. Have a fab day guys, Best, Vijay
Moz Pro | | vijayvasu0 -
Crawling a website with redirects
Hi, I started a campaign for a website which uses multiple redirects before showing the real content. in the crawling report only one page is crawled. Is there a way to let the crawler pass the redirects to get usefull reports? The website is www.cegeka.be Thank you
Moz Pro | | Cegeka0 -
How to get seomoz to re-crawl a site?
I had a lot of duplicate content issues and have fixed all the other warnings. I want to check the site again.
Moz Pro | | adamzski0 -
Moz Toolbar Analyzer - Links
On the moz toolbar there is an Analyze tool. The third tab is for viewing Page Attributes. That page contains a section called On Page Links. I can see the External Link count, but I need to drill down further to look at these external links. I have viewed a page and don't see the external links this tool is seeing. I have searched the page, the source code, and used other tools on the page. The numbers don't match up. Is there a tool which lists all the external links on a given page?
Moz Pro | | RyanKent0