How long should the weekly crawl take
-
Mine started yesterday afternoon and it's now almost 11pm on Sunday. 30+ hours and still not finished (and no progress indicator). 438 pages quoted as being crawled. That's not normal - right?
I have made a bunch of changes based on last weeks crawl so I have been eagerly waiting for this to finish But 30 hours?....
Thanks.
Mark
-
Hi Mark,
I've forwarded this to the crawl service team and they are looking into it.
Sorry you've had an unexpected delay, and we'll get it on track for you as soon as possible.
Walt
-
Still running and approaching two days now
My first month trial is up today. This has got me thinking about whether to continue. 40+ hours just seems too much or a small web site such as mine.
Mark
-
Thank you, Joshua. Just to clarify this is not the initial crawl (that happened a couple of weeks ago). This is the third week for me. I am pretty sure the first two were way quicker than this,
Thanks again.
Mark
-
I've had a couple instances where that has happened. It's not an answer you are going to love, but wait another 24 hours and let me know if it hasn't completed.
The first one is always the longest and after that it slots into a routine that you can bank on.
Hope that helps pal.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Have a Campaign, but only states 1 page has been crawled by SEOmoz bots. What needs to be done to have all the pages crawled?
We have a campaign running for a client in SEOmoz and only 1 page has been crawled per SEOmoz' data. There are many pages in the site and a new blog with more and more articles posted each month, yet Moz is not crawling anything, aside from maybe the Home page. The odd thing is, Moz is reporting more data on all the other inner pages though for errors, duplicate content, etc... What should we do so all the pages get crawled by Moz? I don't want to delete and start over as we followed all the steps properly when setting up. Thank you for any tips here.
Moz Pro | | WhiteboardCreations0 -
Crawl started on the 18th of December and still hasn't completed!
As the title states I started a crawl over 2 weeks ago now and it still hasn't completed. Does anyone know why this could be? Thanks
Moz Pro | | cttgroup0 -
How effective is Crawl DIagnostics in determining crawlibility?
Is Seomoz crawl diagnostics useful for determining what pages Google has a hard time indexing. One of the problems with my site is that it uses JS and Flash and I know Google isnt too keen on that. Can Crawl Diagnostics accurately tell me if there is too much of something and therefore Google is having a hard time crawling? I want to be able to know if JS or Flash is hurting any of my pages in any way. I provide good content and I want to make sure Google can pick it up.....Is this too much to ask? Is there anything out there for this?
Moz Pro | | waltergah0 -
My Website is not being crawled by Google last 15 days
Hello, Required emergency help, one of client website http://www.mediaxpress.net/ is not being crawled since last 15 days, What can be the reason. I have Checked Google Webmaster Tools, it not showing an Issue and even SEOmoz crawler is crawling it normally. I have updated some data on pages, and i want to get it crawled by Google. But Google is not crawling in anyway.
Moz Pro | | CommercePundit0 -
How Would You Plan Long Term SEO (1 year and more)?
Hi, I'm new to SEO and learning fast. Myself joined together with my friends have set up a string of websites each for different products to sell online. To start with we have finalized keywords, optimized the on-page using the on-page analysis tool and right now about to start working on link building. For the first month we have planned to do around 20 bookmarking, 3 articles each to 15 article directories, 30 directory submissions (priority to niche based), business page listing in hot frog etc, 3 articles each submitted to 10 web 2.0 properties, 1 press release to 15 pres release sites, some Q&A links and few blog comments, 10 video submission and 1 guest blogging. We have also completed setting up facebook fan page and twitter account and active in them too. For anchor text diversity we will be using keywords only in links from article submission and web 2.0. For links from other methods, the anchor text will be either website name or website url. And we will be targeting 4 keywords per website (2 keywords for home page and 2 for 2 sub-pages). The difficulty level of the keywords range from 40% to 60%. Now, I have few questions which I believe the experts over here can help. 1. For the first month we have planned the above link building, but hpw build links from different websites in coming month? 2. For web 2.0 properties we can keep adding articles to the same blog we have created or we need to create separate set of web 2.0 properties for each month. 3. Are we missing any link building methods or strategy? If so, can you please tell me the method? I know some of the questions might be silly, but being a beginner it would be a great help to know the answer for these questions from this community. Thanks, Sridhar
Moz Pro | | chosenindian0 -
Why does my crawl diagnostics show duplicate content
My crawl diagnostics show duplicate content at mysite.com and mysite.com/index.html which are essentially the same file.
Moz Pro | | MSSBConsulting0 -
Crawl Diagnostics Update
I have corrected some errors in my SEOMoz Crawl Diagnostics, however the errors are still showing. It says a crawl has happen since. Any idea's why?
Moz Pro | | petewinter0 -
Does it really take 3-7 days to crawl a site?
This is what you say on your website: Please note: depending on the size and speed of your site, it may take between 3 and 7 days to complete your crawl. Are you guys kidding? This is unacceptable for almost all of my deadlines, and I suspect 99% of the SEO world... you can fly to the moon faster.
Moz Pro | | rldonnell0