Haven't received an update on site crawl issues more than a week
-
Hello, my account has be scheduled to have the next updated report on 1st March. However, up till now, the latest data I have for our site crawl issues is made on 21st Feb. May I know if there is any issue related to this? Any way that i can draw the data for this week?
-
Thank you so much for your help.
I think the past few site crawl reports were quite on time, normally just a day later than the scheduled day. You mentioned our site appears to be large in size, may I know if our site size has been increased recently or the same as the previous time ?
-
Hi there,
Sam from Moz's Help Team here!
It appears that your site is quite large, and every week we typically crawl over fifteen thousand pages. Any site bigger than about 15k pages is going to take additional processing time. I'm looking at your historical crawls and it appears they each took around 3-4 days, rather than the usual 1 day for smaller sites. Your most recent crawl is still running, so you should expect to see your crawl information arrive within the next day or two, but I am afraid that I can't guarantee that, as the time to process the crawl data can fluctuate from week to week.
Unfortunately, we don’t have a way to force the crawler to re-crawl at a specific time right now - I'm sorry about that - if you’d like to do a mini crawl in the meantime to check up on your progress, you can run a Crawl Test! This'll allow you to crawl up to 3,000 pages of your site and evaluate the results in CSV form.
If you have any other questions, do feel free to ask away or pop a message over to [email protected]!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Site DA and PA is not increasing
Hy, My site best water softener DA is Still 1. I am Publishing the content regularly, Site age is 6 months But Still DA and PA are 1. Why its not increasing. Is there any way to increase DA and PA Of my site?
Product Support | | ikzayahot0 -
"Our crawler was not able to access the robots.txt file on your site."
Hi Mozzers! I've received an error message saying the site can't be crawled because Moz is unable to access the robots.txt. I've spoken to the webmaster and he can't understand why the robot.txt can't be accessed as this seems to be fine: https://k3syspro.com/robots.txt and Google isn't flagging anything up to us. Does anyone know why this may be? Thanks, Matthew
Product Support | | K3Syspro0 -
Rogerbot not crawling our site
Has anyone else had issues with Roger crawling your site in the last few weeks? It shows only 2 pages crawled. I was able to crawl the site using Screaming Frog with no problem and we are not specifically blocking Roger via robots.txt or any other method. Has anyone encountered this issue? Any suggestions?
Product Support | | cckapow0 -
I plan to have multiple sites/compaigns. My Question: Is there a way to set up a limited account that one client would be able to view just their campaign?
I don't want a client to be able to see all of our other campaigns, just theirs. Is there a way to set this up?
Product Support | | darylgochnauer0 -
I'd like to "pause" my account for a few months without canceling it. Is there a way to do so?
I'd like to "pause" my account for a few months without canceling it. Is there a way to do so?
Product Support | | Akufnx0 -
What's happening with my Moz Points?
Hi all, I am not getting moz points for answering the queries...earlier, I was getting points if I was answering to someone's query or if someone was giving me thumbs up. What could be the reason? Please advice. TIA
Product Support | | sachin-sv1 -
Several issues moz analytics
I have found several issues with Moz Analytics. Wondering if it is only me or am I missing something... 1. I am not able to create branded reports or reports what so ever. I need this functionality like it is advertised.
Product Support | | auke1810
2. In Search competition is not working at all. it states "not in top 50" for all keywords witch is not true.
3. In Crawl diagnostics I get this "Rel Canonical" issue even though the rel canonical tag is in the website. I have send a mail to support but no answer until today. Earlier I did receive a answer on my questions so i guess there is one way of sending questions to the moz team witch is not working.0 -
Is anyone else seeing that their keyword rankings are pending even though they've been in the campaign for quite some time? Is this a known issue?
Is anyone else seeing that their keyword rankings are pending even though they've been in the campaign for quite some time? Is this a known issue?
Product Support | | IrishTimes0