What is the IP address of the MOZ crawlbot?
-
Our preproduction site is restricted to a specific IP range.
Prelaunch I'd like to use MOZ to check the site but this obviously isn't currently possible. Is there an IP range I can whitelist ?
-
Hi,
Moz is hosted on Amazon. See this sample log entry from today:
54.146.235.41 - - [17/Sep/2017:09:48:13 +0200] "GET /best-deals.html/page/12/ HTTP/1.0" 200 15803 "-" "rogerbot/1.2 (https://mza.bundledseo.com/help/guides/moz-procedures/what-is-rogerbot, [email protected])"[XF 54.146.235.41]
That IP is part of Amazon's ASN.
whois -h whois.radb.net -- '-i origin AS16509' | grep ^route
You can either use something like mod_authz to allow the domain amazonaws.com to connect or you can get each IP from AS16509 and allow that.
Hope it helps.
Regards
Chris
-
Just to expand on this, I found the following quote from a Moz member of staff:
"I wish I could give you IP addresses, but they change all the time since we host Roger in the cloud. There's not even a reliable range of IPs to give you. You can totally whitelist the useragent rogerbot, but that's the only reliable information about the crawler you can go off of. I hope that helps but let me know if there's any other solution you can think of. Thank you! "
From a previous question: https://mza.bundledseo.com/community/q/is-there-a-whitelist-of-the-rogerbot-ip-addresses
-
Unfortunately this is all I can find: https://mza.bundledseo.com/help/guides/moz-procedures/what-is-rogerbot with no IP range shown.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Keyword difficulty with Moz Pro
Hello, I want to know how moz pro calculates the keyword difficulty? What are the basic things which moz pro consider while calculating keyword difficulty? Whenever i check my site(Sehhaty app) it shows different keyword difficulty. why so? Thanks.
Getting Started | | emmaava60 -
Canonical url does not seem to be recognised by Moz
Hey guys, forgive me... brand new user of Moz. Moz is telling me I have duplicate url's - a lot of them. Investigating I see that it is classing http://creativedigital.co.nz/artprints/lake-tekapo-church-of-the-good-shepherd?tag=lake as a duplicate of http://creativedigital.co.nz/artprints/lake-tekapo-church-of-the-good-shepherd even though there is a canonical tag in head as follows I'm not quite sure what I am doing wrong. Any advice would really be appreciated 🙂 Mike
Getting Started | | creative.digital0 -
Moz Private Message Restriction
Why does Moz only let you send 2 private messages a day? I'm a Moz Pro subscriber! Sorry Message Not Sent You are currently over your quota of 2 threads per day.
Getting Started | | deelo5550 -
Can I upgrade my moz subscription from large to premium without getting my campaigns being deleted?Do i need to wait till the end of the month to resubscribe?
I'm planning to take a large subscription of moz..but i may need a premium account in the future.Can I upgrade it in the middle of my current subscription or will i have to wait till my subscription gets over? Also, I'm planning to take only one month currently but i'll renew it once the month completes so can i continue the same account without my campaigns being deleted?
Getting Started | | kdcdmp0 -
When connecting your Google Analytics account to your Moz account, Moz provides a drop-down of accounts & UA codes to select from. Where is Moz pulling those selection options from?
The list of Google Analytics accounts and UA codes listed are outdated. How can I update them to reflect the most up-to-date accounts (& UA codes associated with those accounts)?
Getting Started | | SearchParty0 -
Moz Analytics Campaign Landing Pages Update
Moz, Any ideas why i am not seeing my landing pages information in my analytics campaign yet ?, It has been a couple of days, i have reconnected my analytics, i have built up the keyword list a little more, But i only get page data from clicking 'Include pages with no tracked keywords' but still no keyword data, Am i miss understanding how this tool works or is there something else i need to setup ? Thanks James
Getting Started | | Antony_Towle1 -
Moz Analytics - Custom Report Question
Hello Moz Forums! I'm having problems building custom reports for my clients. So, i've managed to put together a few reports and I've set these to be scheduled for weekly automated emailing! Now, here's the problem, before sending it to my clients, I was testing this by sending it to myself. This is what I receive: http://www.freelance-seo.co.uk/images/Moz.png I don't really want my clients to see 'By Moz!' everywhere when I send this out, is there a way to change this automated mail? Or a way to just just send the PDF without a link? Alternatively, have I just failed in using this product? Edit: Just to clarify! The 'simply change your report settings' option, just takes me to an option to edit the report title, not the email in any way.
Getting Started | | Paul_Tovey0 -
Is there a way MOZ can help me get HQ links?
I'm new to MOZ, I'm on the niche sites building. Is there an easy way to find HQ pages to post to with MOZ? Like it's with Market samurai.
Getting Started | | bishop230