Seomoz Spider/Bot Details
-
Hi All
Our website identifies a list of search engine spiders so that it does not show them the session ID's when they come to crawl, preventing the search engines thinking there is duplicate content all over the place.
The Seomoz has bought a over 20k crawl errors on the dashboard due to session ID's. Could someone please give the details for the Seomoz bot so that we can add it to the list on the website so when it does come to crawl it won't show it session ID's and give all these crawl errors.
Thanks
-
An old answer to an old question, but one which has just helped me out tremendously. A true credit to the Q&A system!
-
Thanks Alan. much appreciated.
-
3 dots placed before last bracket, need to be removed,
-
Mozilla/5.0 (compatible; rogerBot/1.0; http://www.seomoz.org/dp/rogerbot)
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Our main competitor is/was doing some Black Hat tactics....
Our main competitor Royal Cases, a custom case manufacturer and designer, has some really shady links and some dummy domains with duplicate content, yet they are ranking #1 organically for some of the industry's top search terms. Let me give you some examples. First off, they have multiple dummy domains with the same exact same content as their main website. One of these is casescasescases.net. They have a couple more that are just as bad. Secondly, their link profile is so shockingly black hat, I can't figure out why/how they haven't been deindexed or hit with a filter. I'll give you some examples. I ran a link analysis through Moz, and found multiple links from many websites that have absolutely NOTHING to do with custom cases. Here are a few of the linking domains: http://moneysourceonline.com/ ; www.lemons2lemonade.com/ ; http://jenaesboutique.com/ ; These are just a few. Now here is what I don't understand, when I go to explore the individual inbound links, I can't find the links to Royal anywhere on the pages. They have dozens from different pages on these obviously completely unrelated websites, but when you go to those pages, the links themselves are nowhere to be found. Yet, they are showing up as inbound links....I am lost. Does anyone have any idea what in the world is going on here? Is there a way to report this to Google? Normally I wouldn't resort to this sort of "tattle-tailing" but this company has a history of scheming and just horrendous business practices, and they recently had to pay a large settlement for pirating software for their company.
Moz Pro | | Sean_Gutermuth0 -
Is www.domain.com/page the same url as www.domain.com/page/ for Google? (extra slash at end of url)
Dear all, in open site explorer there is a difference the url's 'www.domain.com/page' and 'www.domain.com/page/' (extra slash at end). There can be different values in pageauthority etc. in the open site explorer tool, but is this also the case for Google? Thanks for replying, Regards, Ben
Moz Pro | | HMK-NL0 -
Where do I get started with SEOMoz? Seems really hard to use?
I operate a medical website and am confused on how ot get started with SEO - how can SEOMoz really help me? This tool seems complicated to use. I am looking for a simple step by step plan? Any takers on this question. Thanks in Advance. NS
Moz Pro | | nshah0020 -
SEOMoz Tool Bar
Can google put a temporary ban on my IP using the SEOmoz Toolbar too many times? TY!
Moz Pro | | TP_Marketing0 -
SEOMOZ Stats dont work out
Hi, When I check my mozstats for the homepage it says the PA is 50 but the DA is 30, how can that be? I would expect them to either be the same or at least the DA to be higher then the PA. Cheers
Moz Pro | | activitysuper0 -
Hello I am new to SEO. Does SEOMoz have a to do list or can you send me one.
I just need to know what steps I should take to improve my site. My website url is : http://nuscopemed.com Thanks
Moz Pro | | NinaGraham0 -
Why does SEOMoz Pro only do Rankings Once a Week?
Not sure I understand why the SEOMoz PRO report of rankings only occurs once a week? Any ideas? Seems like it would be easy to just pull that ranking report at any time.
Moz Pro | | findachristianjob0 -
Are the Ranking Changes on SEOmoz ranking reports weekly or life of the keyword?
I am referring to the area where it says ranking changes and where it has a green and a red arrow for improved and declined.
Moz Pro | | JGar-2203710