Seomoz Spider/Bot Details
-
Hi All
Our website identifies a list of search engine spiders so that it does not show them the session ID's when they come to crawl, preventing the search engines thinking there is duplicate content all over the place.
The Seomoz has bought a over 20k crawl errors on the dashboard due to session ID's. Could someone please give the details for the Seomoz bot so that we can add it to the list on the website so when it does come to crawl it won't show it session ID's and give all these crawl errors.
Thanks
-
An old answer to an old question, but one which has just helped me out tremendously. A true credit to the Q&A system!
-
Thanks Alan. much appreciated.
-
3 dots placed before last bracket, need to be removed,
-
Mozilla/5.0 (compatible; rogerBot/1.0; http://www.seomoz.org/dp/rogerbot)
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Canonicalisation/ Moz/ WP.
Hi, I've recently put a new site live using Wordpress, and have hooked it up to Moz Analytics. Moz is reporting >1000 pages with 'missing meta description page', and >250 with 'duplicate page content'. The issues seem to be being flagged by pages with '?sort=asc&view=main', ?show=paged&view=main, '?sort=ratedup&show=all&view=list', etc. I have a number of category pages, which users can filter by etc to give them the information in the way they want to see it. I have this ' I haven't got many pages indexed by Google yet, so can't see if they're hitting the same issues as Moz. Any help/ advice appreciated.
Moz Pro | | newstd1000 -
Duplicate page titles in SEOMoz
My on page reports are showing a good number of duplicate title tags, but they are all because of a url tracking parameter that tells us which link the visitor clicked on. For example, http://www.example.com/example-product.htm?ref=navside and http://www.example.com/example-product.htm are the same page, but are treated as to different urls in SEOMoz. This is creating "fake" number of duplicate page titles in my reports. This has not been a problem with Google, but SEOMoz is treating it like this and it's confusing my data. Is there a way to specify this as a url parameter in the Moz software? Or does anybody have another suggestion? Should I specify this in GWT and BWT?
Moz Pro | | InetAll0 -
Is it me or is SEOMOZ Q&A slow
I try and answer many questions here on SEOMoz Q&A, but the page load speed seems so slow I think my browser is going to time out. I don't remember it being this slow. Anybody else noticing slow loading (especially when asking, answering, or replying to questions)?
Moz Pro | | Francisco_Meza1 -
Why is it that certain keywords in my seomoz report card are for the wrong urls
Hi Guys, why is it that seomoz's On Page Optimization Reports for Google TH are attributing certain keywords with certain urls which are wrong? What mean is an example keyword - 'chiang mai villas for rent' has been scored an F against my home page url rather than using our 'Chiang Mai' url, why is this, is there a coding issue on my site? Is it that seomoz is finding something on my home page to suggest I want it to rank for this keyword?
Moz Pro | | ewanTHH0 -
SeoMoz and incorrect results?
Just recieved my weekly Rankings and On Page report. First thing i noticed is that an important keyword dropped big time. "Rejser til Cypern" dropped from #3 to #40 ... So i checked google.dk myself (using impersonal.me) and saw i was still #3 in SERP. I ran SeoMoz's own Keyword Difficulty Report-tool. It showed me i was #3 in SERP. Now im thinking: Did i just loose my trust in Seomoz, to whom i give access to all my GA-data? What to do? Have anyone else experienced this?
Moz Pro | | alsvik0 -
Tried to find correlation between SEOMOZ statistic and google ranking.
I've made Google US search and than tried to compare SEOMOZ data for first few result. I've used Open Site Explorer and On-Page Report Card. On attached picture you can find this statistic. Pages are sorted in order as they appear in Google search. For me is big question why position 2 and 4 is so hight and 6 is only 6. And what position 6 should do to go up. Thank you. 2s9zlu8.jpg
Moz Pro | | ctam0 -
Could SEOMOZ make a tool thats connected directly to Webmaster Tools?
Could SEOMOZ make a tool that Crawls Internal Links that's connected (or crawls) directly from Webmaster Tools? (So link metrics on our domains would get updates more often) This would eliminate the cost of crawling the entire internet. I hate having to wait a month to see updates on my domain metrics and links. I would like to see updates regularly on my own domain. I understand you can just look at Webmaster tools to see your latest links but they don't have any link metrics. So it’s difficult to see your best links. If this already exists please refer me? Otherwise please show your support for this being developed?
Moz Pro | | charles10