SEO Web Crawler IP addresses
-
What are the IP addresses for the SEO Web Crawler?
There is a firewall on my clients website before it goes live, I would like to crawl the site before it goes live, but need to provide the web crawlers IP addreses.
Thank you for your time
-
Hi Jason,
This is Megan from the SEOmoz Help Team. Unfortunately, since we crawl from the cloud, RogerBot's IP address is changing all of the time so we cannot specify a particular IP address. Also, we do need the site to be live before we can crawl it, but you could remove the firewall and block all other bots except rogerbot so it won't get indexed anywhere else before it's ready.
I hope this helps! Please let me know if you have any other questions.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Mobile SEO Rank Tracker - Hourly
Hello folks! Does anyone have a suggestion for a rank tracker that can track high-profile keywords, in mobile specifically, on an hourly basis? Thanks!
Moz Pro | | rvseo0 -
How to make Seo Tools Site serves ?
hello i want to add seo tools at my site for users i want my visitors able to use pagerank checker , link tracker , backlinks checker , etc - and keyword tools , domain tools , Analytics and Reporting. something like http://smallseotools.com/ what scripts i need ? can i do this all with wordpress ? Thanks 🙂
Moz Pro | | Wagdys0 -
SEO process suggestions / keyword analysis
hi all, we've done a bit of SEO over the years for our site, and are looking to pick things up this year and spend more time on SEO. first off, we are working on revising our keyword list & would like to view what keywords specific competitors are ranking for and try to target those keywords as well. is this possible via SEOmoz (similar to spyfu)? please let me know if you feel this is a good first step in picking up our SEO efforts for the new year. i've been looking at the research tools & is seems the Keyword Difficulty Tool hasn't been fully functional for the past week or so ("Our Keyword Difficulty Tool is having issues displaying AdWords API data. We are working with the AdWords API folks to get a fix soon!"). also, i noticed i can enter competitor sites in open site explorer & compare link metrics, but i don't see anywhere to compare keyword metrics. is there something i'm missing? thanks again everyone!
Moz Pro | | lsat0 -
Problem in doing seo for a German medical website?
Hi We have been doing seo for http://www.internetapotheke-holland.com/ since last 4 month including onpage and offpage process like link building etc. but not getting a proper output keywords are as follow: xenical holland rezeptfrei xenical Xenical Ohne Rezept Xenical Bestellen Xenical Kaufen Rezeptfrei bestellen Rezeptfrei kaufen Tramadol TropfenRezeptfrei Please could you add some more cool tips so that we can help our client. Thanks & Regards
Moz Pro | | expertvillagemedia0 -
Where to learn SEO practices, especially local
I am looking to learn SEO as I know how important it is. I have basic understandings, but I don't know where to start, or what to add. my website is viralextent.com and apparently I'm not so good at ranking. I want to rank locally for "web design". I understand that I couldn't touch the national market right now as I can't even seem to grasp the local. I know everyone's time is valuable so I'm not looking for a free assessment. Where should I go to learn what I need to do next and kind of guide me through the process of becoming #1 for local? I am obviously an SEOmoz PRO member, where should I start here, or should I be looking somewhere else? Any direction would be greatly appreciated. Thank you.
Moz Pro | | crazydirthead0 -
Conflicting Data with Open Site Explorer & SEO Moz Toolbar
Hi there, Why is my SEOmoz toolbar showing me higher linking root domains than open site explorer? For example, for this site: http://thisisouryear.com/, the linking root domains in SEOMOZ show 1,015 and in open site explorer it says it has 35. I have noticed this for other sites as well. Which one is right? And why are they different?
Moz Pro | | qlkasdjfw1 -
New to the SEO game
Hello everyone! I am fairly new to this SEO game and it all seems a little overwelming. Let me tell you a little about my experience. I have been trying for a couple years to get the ranking up on my LawnAide site and it seems at times that I keep spinning my wheels. Ive been doing blogs getting links with high ranking sites and all the other stuff. But on the local search there are still smaller companies which lower ranking sites performing better that mine. This gets very frustrating. Is there any advise out there?
Moz Pro | | lawnaide0 -
Top ranking with no SEO
I ran an SEOMoz keyword difficulty report for the term "interim CFO services" and found that all of the websites that ranked really well for that term have good page authority and domain authority scores and plenty of incoming links.....except 1. result #5 has a page and domain authority of 1 and no incoming links, however it's ranked #5 in google SERP for this highly competitive term. see screenshots: http://screencast.com/t/NJiOn8N4l http://screencast.com/t/x6tU1RhX4j Is this ranking based solely on the domain name being 100% relevant? Did they just get lucky and hit the google rankings jackpot? If this is the case, by the same logic I am trying achieve high rankings for the keyword "outsourced accounting firm" and purchased the domain name outsourcedaccountingfirm.com and am not even ranked in the top 50 with google for that keyword. (it's very new though) any feedback on either questions above would be greatly appreciated. Thanks!
Moz Pro | | texmeix0