Welcome to the Q&A Forum

Browse the forum for helpful insights and fresh discussions about all things SEO.

Your browser does not seem to support JavaScript. As a result, your viewing experience will be diminished, and you have been placed in read-only mode.

Please download a browser that supports JavaScript, or enable it if it's disabled (i.e. NoScript).

What user agent is used by SEOMOZ crawler?

Moz Pro

5092

Locked

eseider last edited by

We have a pretty tight robots.txt file in place to only allow the major search engines. I do not want to block SEOMOZ.ORG from being able to crawl the site so I want to make sure the user agent is open.
1 Reply Last reply
Reply Quote 0
Martijn_Scheijbeler last edited by

Hi Eric,

The useragent of SEOMoz is: rogerbot.
1 Reply Last reply
Reply Quote 4

Browse Questions

View

From

Sorted by

With category

Explore more categories

Related Questions

What SeoMoz tool am I thinking of?

A few months ago I found a tool on Moz that did keyword link research. It is not keyword analysis either. It took a word and turned it into links such as dir:cabinet. I can't find it or remember or it. Does anyone else know? (I know this description sucks, sorry about that)
Moz Pro | | EcommerceSite

0
Is SEOmoz spider ignoring my redirect?

My client was previously serving their website from both a .co.uk and a .com domain. The DNS for each of these domains was pointing to the same place, rather than redirecting. I saw this as a potential duplicate content problem so I set the .co.uk to 301 redirect on to the .com. As a user, the 301 seems to be working correctly. However, now that I have done this, SEOmoz is picking up thousands of "inbound" links from the .co.uk domain. Essentially, every single link on the internal site, is being duplicated in my stats as an inbound link as well. It appears that the spider is ignoring the redirect. I'm not sure if it's a legitimate issue that will upset Google too, or if it's just a bug with SEOMoz's spider.
Moz Pro | | MadisonSolutions

0
Question #3) My last question has to do with Some SEOmoz crawl diagnostics -

I recently fixed (or well, I am asking to make sure that this was the right thing to do in my first question posted a few minutes ago), a problem where all of my internal main sidebar category pages were linking using https://, which to my knowledge means SECURE pages. anyways, OSE, and google seem to be not recognizing the link juice. but my rank fell for one of my main keywords by 2 positions about a week after i made the fix to have the pages be indexable. Making my pages properly linked can't be a bad thing right? That's what I said. So I looked deeper, and my crawl diagnostics reports showed a MASSIVE reduction in warnings (about 3,000 301 redirects were removed by changing the https:// to http:// because all the secure pages were re-directing to http:// regular structure) and an INCREASE, in Duplicate Page Titles, and Temporary redirects... Could that have been the reason the rank dropped? I think I am going to fix all the Duplicate Page Title problems tonight, but still, I am a little confused as to why such a major fix didn't help and appeared to hurt me. I feel like it hurt the rank, not because of what I did, but because what I did caused a few extra re-directs, and opened the doors for the search engine to discover more pages that had problems (which could have triggered an algo that says hey, these people have to much duplicate problems) Any thoughts will be GREATLY appreciated thumbed, thanked, and marked as best answers! Thanks in advance for your time, Tyler A.
Moz Pro | | TylerAbernethy

0
Is there a good SEOMoz training for a new user to learn how to use the software?

Is there a good SEOMoz training for a new user to learn how to use the software?
Moz Pro | | IBS-DCM

0
Not able to find Do follow Link as shown in Seomoz Toolbar

SEO Moz Toolbar showing 1 do follow link in every forum question page Have checked source twice thoroughly - not able to trace that do follow link - to which site is that do follow link going to Some sample links - http://www.mycarhelpline.com/index.php?option=com_easydiscuss&view=post&id=426&Itemid=78 - http://www.mycarhelpline.com/index.php?option=com_easydiscuss&view=post&id=63&Itemid=78 Facebook & Google plus - both are no follow can some one help please so as to know this mysterious do follow link as shown in as letted know by SEOMOZ Toolbar
Moz Pro | | Modi

0
Can SEOMOZ Pro suggest me the best keyword to work for?

Hi, how SEOMOZ PRO can suggest me the best keyword to rank easily in the first position of Google's SERP? Is there a tool to find good keyword and got some ideas? Regards
Moz Pro | | jadlib

0
Seomoz crawling filtered pages

Hi, I just checked an seo campaign we started last week, so I opened seomoz to see the crawl diagnostics. Lot's of duplicate content & duplicate titles showing up, but that's because Rogerbot is crawling all of the filtered pages as well. How do I exclude these pages from being crawled? /product/brand-x/3969?order=brand&sortorder=ASC
/product/brand-x/3969?order=popular&sortorder=ASC
/product/brand-x/3969?order=popular&sortorder=DESC&page=10
/product/brand-x/3969?order=popular&sortorder=DESC&page=11
Moz Pro | | nvs.nim

0
For those using Omniture instead of Google Analytics

Instead of connecting Google Analytics into the SEOMOZ campaign monitor, is there a way to link Omniture or alter their output to plug into SEOMOZ?
Moz Pro | | Dekoda_Jones

1