Mozbot IP / reverse DNS
-
Hi,
due to security measures (which i imagine a lot of enterprise clients are starting to use now) we're very restrictive of automated traffic coming to our websites... however we're also blocking the mozbot.
Will Moz have a fixed IP address/range or reverseDNS look up approach that can be used in the future?
thanks!
-
thanks! Will you allow for reversDNS lookup?
similar to: https://support.google.com/webmasters/answer/80553?hl=en
-
Hello!
For our link crawler, you will want to make sure you are blocking "dotbot" specifically.
Unfortunately we do not use a static IP address or range of IP addresses or plan to do so in the future, as we have designed our crawler to have a dynamic approach. This means we use thousands of dynamic IP addresses which will change each time we run a crawl. This approach gives us the best dynamic view of the web, but it can make us incompatible with some servers or hosting providers.
The best option I'd be able to suggest would be to identify our crawler by User-agent: dotbot
I apologize for the inconvenience this causes!
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Single Sign-On setup
Looking for steps to configure the single Sign-on for MoZ system for my organization.
Feature Requests | | Sandeep_amplity0 -
Unsolved Page claiming
Can we claim the Lawrence location with only having a Topeka location and also claiming the Topeka location
Feature Requests | | KleerVue0 -
Are Monthly-Run custom reports supposed to compare against the previous month?
When I run monthly reports, it looks like keywords are down, when they are actually up compared to the previous month. Is there a way to get the monthly reports to show how many positions up or down a keyword is compared to the prior run report?
Feature Requests | | bizmarquee0 -
In Moz's Keyword Explorer/Explore By Site, Can I Exclude a Keyword From the Results?
Hypothetical question - Let's say I sell tax preparation software and I want to see the keywords that "turbotax.com" ranks highest for. Based on that list I might want to optimize for similar keywords on my site. But if I use Keyword Explorer, select "Root Domain", and enter "turbotax.com" as the root domain, the first 200 or so keywords in the list have the word "turbo". None of those interest me. Can I exclude certain keywords (like "turbo") from the list? Thanks.
Feature Requests | | CurtisB0 -
Duplicate Titles being shown for rel=prev / next paginated pages
Hello My duplicate titles report is full of paginated pages eg www.roger-bot.com/rogers-diary/sites-ive-crawled
Feature Requests | | Andrew-SEO
www.roger-bot.com/rogers-diary/sites-ive-crawled?p2
www.roger-bot.com/rogers-diary/sites-ive-crawled?p3
www.roger-bot.com/rogers-diary/sites-ive-crawled?p4
www.roger-bot.com/rogers-diary/sites-ive-crawled?p5
www.roger-bot.com/rogers-diary/sites-ive-crawled?p6 This would create 5 duplicate titles in the moz report Is there a quick way to filter these out?1 -
Feature Request: connecting to Adobe Analytics
We're moving away from Google Analytics and setting up Adobe Analytics (previous Omniture).
Feature Requests | | KBC
It would be nice to incorporate this data, so I have a complete tool again...2 -
Can I add more then 3 competitors do my SEO moz pro account?
I have a client who will need more then the three competitors tracked(possibly up to 10) is there any way to do this with one campaign or will i need to start multiple campaigns to achieve this?
Feature Requests | | BBI_Brandboost8
