Seomoz Spider/Bot Details
-
Hi All
Our website identifies a list of search engine spiders so that it does not show them the session ID's when they come to crawl, preventing the search engines thinking there is duplicate content all over the place.
The Seomoz has bought a over 20k crawl errors on the dashboard due to session ID's. Could someone please give the details for the Seomoz bot so that we can add it to the list on the website so when it does come to crawl it won't show it session ID's and give all these crawl errors.
Thanks
-
An old answer to an old question, but one which has just helped me out tremendously. A true credit to the Q&A system!
-
Thanks Alan. much appreciated.
-
3 dots placed before last bracket, need to be removed,
-
Mozilla/5.0 (compatible; rogerBot/1.0; http://www.seomoz.org/dp/rogerbot)
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
SEOMOZ Campaign Query
In SEOMOZ price plan if i select $99 for 1 month . Can i campaign 3 different websites using this one month Paid plan. Is this advisable?
Moz Pro | | Rajesh.Chandran0 -
How accurate is SEOMoz's keyword analysis tool?
For the most part, SEOMoz's keyword analysis tool has been in line with other tools like Adwords keyword tool with regards to competitive level. I have just encountered a keyword though that a client may choose to compete on that seems to be far off. keyword phrase: online math games Adwords competitive level: Low SEOMoz competitive level: 80 This seems like a sizeable difference (I know the two compare all results vs first page authority's, but typically they are in line with each other). With other related keywords for the industry in question, SEOMoz and Adwords seem to be in line. This one just got me thinking. I know the SEOMoz score is a sign of the strength of the top results and that the "low" score from Adwords may be a sign of much weaker results on the following pages (with a higher number of weaker pages vs fewer high authority outliers). **Question: ** How accurate is SEOMoz keyword analysis tool and what other keyword analysis tools are you guys/gals using that you like? I have tried others but many provide duplicate insights.
Moz Pro | | mattylac0 -
Has SEOMoz considered making it possible to follow a specific Q & A thread via Twitter and/or Email?
I think it would be great if there was a way to follow a particular Q & A thread without having to post a comment. There are so many great topics and discussions in here and sometimes I lose track of some that I'd like to continue following as people post, without having to post in the thread myself. Have you guys (Mozzers) ever considered adding a "Follow this thread on Twitter" or "Follow this thread by email" function? Or is there already a way to do this (without posting), that I just haven't found?
Moz Pro | | danatanseo1 -
SEOMoz ranking reports inaccurate for Google?
So I have notice that, at least for some searches, the rankings shown in SEOMoz's ranking reports are meaningless. I assume this is due to blended search results including local search. For example, I have a client, who is ranked 3rd overall for one of his most important search terms, but his ranking is based upon his local result (there are 2 organic search results and then he is the first local result). The SEOMoz report shows him being ranked 12th. Anyway I count down to the 12th ranked site (including local search, not including local search) his site is not there. In fact the only place it is in the top 3 pages is in the local result. As a local marketing consultant, almost all of my clients are looking to be found for "Jackson Hole" this or that, or "Jackson, WY" this or that, so this is a pretty critical issue to me. I would appreciate feedback. Thanks!
Moz Pro | | farlandlee0 -
404 errors in SEOMoz crawl tool
I currently have several 404 errors in the latest crawls from SEOMoz. Here is an example of the error. http://dealerplatform.com/blog/2011/10/23/videos-for-auto-dealers/www.dealerplatform.com/ In all cases the error is a result of www.dealerplatform.com being added to the real url. Anyone seen this before? The site is a wordpress mutlisite. I don't see where this incorrect link is showing up anywhere on the website. Any advice would be helpful. Thanks
Moz Pro | | Chris_Gregory0 -
Could SEOMOZ make a tool thats connected directly to Webmaster Tools?
Could SEOMOZ make a tool that Crawls Internal Links that's connected (or crawls) directly from Webmaster Tools? (So link metrics on our domains would get updates more often) This would eliminate the cost of crawling the entire internet. I hate having to wait a month to see updates on my domain metrics and links. I would like to see updates regularly on my own domain. I understand you can just look at Webmaster tools to see your latest links but they don't have any link metrics. So it’s difficult to see your best links. If this already exists please refer me? Otherwise please show your support for this being developed?
Moz Pro | | charles10 -
What happened to OSE/Linkscape data?
Can any member of the Moz team or of the community comment on the most recent OCE/linkscape update as of 09/08/2011. It appears that the link data capture for one of our platform is dramatically different than previously and that there are some huge discrepancies? Any update on the change would be appreciated as we use all these updates as benchmarks. Thanks
Moz Pro | | OlivierChateau0 -
How do i get to know th pages crawled by SEOMOZ?
My SEOMOZ campaign says that "n" number of pages were crawled. How do i get access to the list of the pages crawled by SEOMOZ?
Moz Pro | | IM_Learner0