Does the Moz crawler have a static ip address?
-
We block AWS from crawling our site. Does the moz crawler use a static ip address that we could allow? I'm currently not able to add a campaign because Moz can't connect to our site.
-
James
I currently use Sitelock which disallows unwanted bots to crawl the site. The MOZ is unable to crawl however we can input a white list of ip addresses comming from MOZ. How are you guys going around this issue?
Raul
-
Hi Dustin,
Unfortunately we do not use a static IP address as we have designed our crawler to have a location agnostic approach, this means we use thousands and thousands of IP addresses which will change each time we run a crawl. This approach gives us the best dynamic view of the web and in turn your sites.
We are moving more and more away from AWS but at this time we still use AWS to crawl certain portions.
Regards - James - Moz Help Team
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Moz DA Issue
Hey Community, This is my site which is the Best Drifitng in Australia. I am getting a problem and my site's DA is unable to show using. I want to see it as soon as possible, although I am using a premium tool. Thanks
Getting Started | | jndjue40 -
Why does Moz only seem to be crawling a snap shot of the site I am working with?
I was wondering if anyone can help? I am working using Moz to help improve the SEO on a website I am working with, the website contains thousands of pages, yet for some reason Moz only seems to be crawling a small snap shot of the website. I know there are particular pages that I had added a couple of weeks ago - about 300 in total - and none of these were showing on the first crawl, so I did another on-demand crawl and some of these showed up then. Despite this, it says it crawled 700ish pages, but there are getting close to 20-30ish thousand live pages on the site. Any thoughts and guidance as to why they crawling may be stopping?
Getting Started | | dsmith8020200 -
Got a problem in using MOZ Crawl test
Hello,
Getting Started | | turkeyanaclinic
Guys i need help as i'm getting this message "**Moz was unable to crawl your site on Dec 26, 2017. **Our crawler was not able to access the robots.txt file on your site. This often occurs because of a server error from the robots.txt. Although this may have been caused by a temporary outage, we recommend making sure your robots.txt file is accessible and that your network and server are working correctly. Typically errors like this should be investigated and fixed by the site webmaster."
After i made a Campaign i'm getting this message but after i created new campaign it crawls well
can you help me to edit the old campaign ? Regards.0 -
Moz Pro Trial...."Oops! Try refreshing the page"
I am in my MOZ PRO trial. I want to add a campaign to see how I like it, but something keeps coming up saying "Oops! Try refreshing the page, if that doesn't work click here to contact our help team" And I can't find an answer to that question here. Please help ASAP Ld3rHLi
Getting Started | | WFC-Sales0 -
Why does Moz Analytics only let you look at last month / last week?
I cant think of any other reporting product that only lets you look at the last period, am I missing a setting somewhere. I need to take a look at Feb!
Getting Started | | locusm1 -
Analytics stats not showing up in MOZ Campaign report
I connected a MOZ campaign to a client's Analytics. It seems it's connected properly with the same Analytics ID # and everything, but the stats still show 0 in MOZ, even though there are thousands of visits in Analytics for the same date range. Pls help! Derek
Getting Started | | DerekM42420 -
Why there is a difference in MOz pro and analytics data?
For the same site i am finding 2 different data details under Duplicate page content,etc. Why it is happening? Which data should i consider? Kindly suggest.
Getting Started | | 1akal0 -
Moz API and license
Hi Support,We are new to SEOMOZ and would appreciate if you can answer the following:1. Can we build our own Hubspot right to our own website where members can access and see how their sites are performing using your API? If that is possible, do you have tips/suggestions on how?2. What is a crawl limit? How does that work?3. How many sites can we work on under the developers - professional license ?Looking forward to your responses.Thanks,Tony
Getting Started | | chickenjoy20130