Server blocking crawl bot due to DOS protection and MOZ Help team not responding

[JamesDavison]

First of all has anyone else not received a response from the help team, ive sent 4 emails the oldest one is a month old, and one of our most used features on moz on demand crawl to find broken links doesnt work and its really frustrating to not get a response, when we're paying so much a month for a feature that doesnt work.

Ok rant over now onto the actual issue, on our crawls we're just getting 429 errors because our server has a DOS protection and is blocking MOZ's robot, im sure it will be as easy as whitelisting the robots IP, but i cant get a response from MOZ with the IP.

Cheers, Fergus

[JamesDavison]

Hi dave thanks for your response ill let our server provider the user agent.

I was contacting you using the contact form, putting in my email which is the same as the one used to log into moz, but not the email that was used when creating the account, which i think might've been the issue.

[dave.kudera]

Hi Dougal!

We don't have any record of support requests coming from the email associated with your Moz Pro account. Can you let us know how you are reaching out (contact form or emailing us directly at [email protected])?

Unfortunately, we do not use a static IP address or range of IP addresses, as we have designed our crawler to have a dynamic approach. This means we use thousands of dynamic IP addresses which will change each time we run a crawl. This approach gives us the best dynamic view of the web, but it can make us incompatible with some servers or hosting providers. The best option I'd be able to suggest would be to identify our crawler by User-agent: rogerbot

You can read more about rogerbot in our guide.

Look forward to hearing back!

[RossKernez]

Hi Douglas Cawley,

Try to reach them via Twitter or Facebook.

Ross