Welcome to the Q&A Forum

Hey Kalen! Rogerbot is the crawler we use to gather data on websites for Moz Analytics and the Mozscape link index. Here's his info: http://moz.com/help/pro/what-is-rogerbot-.

I wish I could give you IP addresses, but they change all the time since we host Roger in the cloud. There's not even a reliable range of IPs to give you. You can totally whitelist the useragent rogerbot, but that's the only reliable information about the crawler you can go off of. I hope that helps but let me know if there's any other solution you can think of. Thank you!

I'm really sorry you have to deal with all this. Please let me know how that goes!

Sure thing! Good to hear. Good luck!

That does sound really annoying. I know that clearing cookies does help most users, but there might be something else going on with Chrome. What types of extensions are you using in Chrome? Do you have any security or antivirus software installed on the workstation? If you have another computer that you use OSE in, do you have the same problem on there? I suspect it's local to the computer but it's hard to tell with these types of issues.

Hey Andrew! Sorry you're having this issue. I tried to find your API key using this account that you posted from, but it doesn't look like it has an API key associated with it. Are you using the API key from a different account? Let me know and I'll be able to see if it's specific to your account. If you can post the code that you're using (you can remove the account-specific details), that might help us, too. Thanks!

Woops! Keri's right - I read that response "Thanks for the reply, customer services." and thought that you meant you received an answer via email. I made an assumption there. Sorry!

Anyways, can you please send us an email by going here and following the instructions under the search bars? http://moz.com/help/contact. It sounds like there's enough issues here that we should look into each one one-by-one. Again, I'm sorry for misreading your post earlier.

Great to hear! Thanks for letting us know.

I'm really sorry that you had a rough time reaching us over chat! The launch of Moz Analytics has increased our average reply time from a few hours to a day, and in some cases that's meant we haven't had as much time to provide live chat. If someone requests a call over email, we'll try to offer an answer in the reply email, but then also offer to schedule a call so you get service the way you want it.

Unfortunately, hiring enough people to provide good phone support for every customer is expensive and makes scaling our product to a lot of people very difficult. We needed to limit phone support to billing-related issues in order to provide faster service to everyone, not just those who called in. We should have clear messaging about our phone number on invoices and in the billing area of an account. I'll investigate and make sure it's still there!

Again, I'm sorry for the hassle. Thank you for letting us know and let me know if you have any other questions.

Hi Eric! Did you end up emailing us? I think we thought you were going to email us your specific information and issue. Sorry for that confusion! We'll get right on it as soon as you email in.

Thanks!

Really sorry about that Brett! I mentioned this in another thread here, but it's clear that our new move to funnel customers to self-help and then contact us through there isn't intuitive enough. I'll work on making a better flow that makes it clear how you can contact us easily. We do want people to post to the Q&A forums so they can get answers that might be of value to everyone, but there are certainly some issues that you need direct contact for. For those cases, visit http://moz.com/help/contact

We'll work on it. Thanks Brett!

Thanks for the feedback, guys! First off, we're working on fixing the email issue. We should be able to receive emails again shortly, but in the meantime, the contact form at is working.

I'm really sorry that the contact form seems to be hidden. We'll get to work on some redesign that will make contacting us easier. We want to make it easy to find self-help since it's the fastest way to get answers, but we don't want that to be at the expense of contacting us when you want to. Thanks for letting us know!

Since August, we've had intermittent access to the Google Adwords API. Like others in this space, they've let us know that our access has been revoked. We've been working to restore this access, but unfortunately, we have not been able to do so. In the meantime we are working hard to find a suitable replacement that is both stable and a good fit for our customers’ needs.

We wanted to let our PRO members know, first to apologize, and second to explain how this has impacted your PRO access. We understand how important it is to have all your keyword data in one place, and we're sorry for any disruptions you've experienced from not having this data source in our app.We do want to clarify that this change does not affect your data from Google Analytics. The products affected by this change are our **Keyword Analysis tool and the keyword details and **keyword analysis pages within our web app. We removed this keyword query volume data within PRO a little earlier this year. You can still generate reports, but the metrics previously pulled from the Google Adwords data source is no longer there.The good news is, we don't actually use the Google AdWords data in our calculation of keyword difficulty, so these reports are still 100% accurate—they're just missing the information we usually pull from the API, which you can find on the Google AdWords Keyword Tool here.

We're so sorry about this, and understand how frustrating the loss of this data is. We're hoping to have an alternative data source soon, and we will keep you posted as we make progress. Please feel free to comment, ask questions, and get help by replying to this post. Thank you!

Hey William! I'm the manager of our customer service team. I'm sorry that you had a poor impression of our team; I think they actually did a darn good job of resolving your issue. It sounded like your account was accidentally set to free for the Rank Tracker feature, which is why you were only getting 5 searches for pages instead of 200. However, the rest of the account was set at PRO. We reset the PRO status over the phone, which worked, so the issue was resolved.

At that point you abruptly ended the call with Chiaryn and called again to speak to Kenny, who talked to you about why the issue occurred in the first place and what our company's plans for the Rank Tracker are (we plan to either integrate or replace it with the Rankings tab in the PRO Web App, as we indicate on the Rank Tracker tool page. We pride ourselves in being transparent about our tools and their status, so when they're not optimal, we'll tell you. Check out our TAGFEE values: http://www.seomoz.org/blog/what-we-believe-why-seomozs-tagfee-tenets). I believe you and Kenny completed the call amicably, but if not, let me know more about what we can do to help.

I hope this helps explain the Rank tracker tool situation. As the page says, we're soliciting feedback on the tool and hope to have a better version soon. Check out the survey at the top of that page: http://ranktracker.seomoz.org/. As I said, please let me know if there's anything else I can do to help.

That is a tough one, but I'm no SEO expert - I work on our customer service team. I'd follow the advice of other SEOs here and see if you get more responses. It does sound like building more pages might be the route you want to take if you're not ranking under all four version of a term (singular/accent, singular/no accent, plural/accent, plural/no accent). I'm surprised that these four different queries yield such different results. If you can, I'd also check to see that it's worth spending time on these variations. Sorry I don't know more about this, but hoped this helped explain our tool!

Hey Julien! As Alan says, our On-Page tool is an exact match, so just as Google may give you different results for plurals and accents, so will our tool. I've seen plurals and accents be marginally different in SERPs, but I've also seen them be drastically different, which is why we do the exact match thing. I hope that helps explain! Perhaps we can let the user choose exact or partial sometime in the future...

Hey Antony! I checked out your account and can't replicate the issue that you're seeing. I think you're talking about running an On-Page report for a URL/keyword combination. As far as I could tell, the only type of cannibalization you could get a warning for is keyword self-cannibalization, where it looks like keywords are being targeted for multiple pages instead of a single page on your site. As you probably read, we suggest staying away from linking internally to another page with the target keyword(s) as the exact anchor text, as well.

We should be crawling a full path URL in the same way we crawl a relative URL, so if it's changing solely based on you modifying the URL in your search, I'll need to see what's going on. Can you either post an example of the URLs and keywords you're seeing this for or send that information over to help ([email protected])? The more information and screenshots you can send, the better. Thanks Antony!

Well, our crawler is supposed to respect all standard robots.txt rules, so you should be good just adding them all back in as you normally would and seeing what happens. If it doesn't go through properly, I'll ask our engineers to take a look and find out what's happening!

Hey Michael! Sorry that Kenny wasn't able to communicate well with you; was there a misunderstanding or can you go over the issue in more detail? The Help Team can't help with SEO questions, but the Q&A definitely can!

It sounds like you're trying to find out why you're not ranking in the local vertical like you used to be - is that correct? Or are the PRO tools not properly representing your rankings? If you can give us or Kenny examples of keywords that are one way in Google, but another way in the Web App, we can certainly check it out. From what I can tell, Kenny already verified a lot of the rankings, but perhaps he missed something. The more examples you can give, the better.

If this is more of a question of why you're not ranking for the local verticals, hopefully someone here in Q&A can get you an SEO-based answer. Thanks for your understanding!

Hey! Sorry you didn't have a good experience with your help ticket. I talked with Chiaryn and it sounds like there was some confusion over what you wanted removed from your crawl; it had mentioned that you wanted only one particular page blocked. I think she found something different in your robots.txt - the rules you outline above - so she tried to help you with that situation. Roger does honor all robots.txt parameters so the crawl should only be limited in the way you define, though the wildcards do open you up to a lot of blockage.

It looks like you've since removed your restrictions from roger. Chiaryn and I spoke about it and we'll try to help with your specific site over your ticket. Hope this helps explain! If you want to re-add those parameters and then see what pages are wrongly blocked, I'd love to do that with you - just let us know when you've changed the robots.txt.

@sk That is definitely one of the solutions! There are a few reasons this might be happening. Usually, if you have the correct account and profile already selected, the only fix is to disconnect the GA account and then reconnect it. While it does say that you'll lose some data by doing this, the data loss is temporary because we'll repopulate it all when you reconnect from historical data in GA the entire re-population could take a few days though since we won't have it cached anymore). Also, make sure that you have selected the correct account and profile in GA.

You can verify this by going to your GA account, going to the profile that corresponds with your campaign, finding the number of that profile, and checking it against the profile number embedded in your homepage you're tracking. If they match up, you're gold! GA accounts and profiles can sometimes get mixed up so if you have more than one of either, try changing it to another profile. It might work that way.

You may have to wait for traffic data to repopulate but the current data in the Traffic Data tab will repopulate pretty quickly (immediately most of the time). Hope that helps! If you're still not able to get it to work, send us an email at [email protected] with your PRO email address, the campaign that's having issues, and examples/screenshots of your GA account if you can! We'll try to get you running ASAP.

Hey David! Sorry to hear that you hit that limit in the Keyword Difficulty tool when you were trying to run reports before your deadline. We should definitely look into adding language to the homepage of that tool so this limit isn't as ambiguous. We've had the 300 keyword limit for a while (maybe a year or two?) and mention it in the FAQ, but you'd have to look at the FAQ to know about it, so if you never do then it's not helpful there. Here's a link: http://pro.seomoz.org/tools/keyword-difficulty/faq.

As I mentioned, I'll talk to the team about adding clear language about the limit to the homepage of the tool. Thanks for letting us know and sorry for the inconvenience! In the future, if you need help with technical issues with the tools, please email us at [email protected]. We can usually give quicker service there. Thank you! Let me know if you have any other questions.

Hey Laurent,

The mozbot is different from the Linkscape Index, so while we are able to crawl a website or domain, it's a different set of sources that comprise the Linkscape Index. Check out that message I wrote above for the reason your site's links might not be indexed yet.

Hope this helps explain! Let me know if you have any other questions that aren't addressed in that message I wrote above. Thanks Laurent!

Hey Jérémie! Sorry that you're bumping into that error. If your site's homepage is returning a 200 response code, you should be okay with continuing the process and ignoring that message. We have a lot of customers using a .co.uk address and I don't think there's an issue with those sites, but if you continue to notice this error with other .co.uk sites, let me know! For now, though, I think this is an isolated incident. Send us an email at [email protected] if you continue having issues after setup and your first crawl. Hope this helps!

Hey Frank! This definitely sounds like an issue with relative links on the page; if the crawler sees it, he'll follow it, and continue to do so indefinitely, causing a super-long URL with the same sub-page listed over and over in the URL. I actually see this bug a fair amount. I'd recommend you look at your page code, try to find relative link tags, and then fix them on that side of things.

If you think it's a bug and nothing in your code, you can always send an email to us at [email protected] - we'll be able to take a look and make sure it's not a bug on our side (make sure to send your PRO email address, the campaign with the issue, the URL with the issue, and any relevant screenshots/examples to help us diagnose). In my experience, though, this is always because of a relative link I find in the source. If you need help with how to fix that, you may want to start another thread here in the Q&A and post your page's source or URL. Hope this helps!

Hey all!

So, we recently released a fix for our tools that solves this issue of counting those site links towards the top 10. If you do see this happening in your rankings in SEOmoz, though, feel free to email us at [email protected] any time. Thanks again for the heads up Jamie!

Hey Alex,

Sorry that you're having that issue with Keyword Difficulty! These new in-site results do seem to have thrown off our tools, so we need to consider how to address them. Obviously, in-site links take up a lot of real estate in the SERPs, so the fact that they're there does add a lot of competition. However, I'm not sure if we've decided yet how we're going to treat them in the KWD tool, so stay tuned for that. Also, if you could send an email to [email protected] with your PRO email address, the KWD search you're doing, and the example SERP, we'll take a look for you ASAP. Thanks Alex!