How to set the crawler or reports to ignore
-
I have a mobile version of a site with a URL string that disables the mobile view on smartphones (view full site), string is like this example.com/page-name.html?mobile=off
I need the seomoz pro reports or crawler to ignore it because the crawler visits both versions of the site then reports them as duplicate content. Is there a setting page I haven't visited yet that will set this?
-
Thanks for the confirmation. I hadn't wanted to put that in the robots file because if inquisitive, non-robot traffic if you get my meaning, but in it goes; can't stand seeing errors.
-
Got it, thanks for jumping in so quick.
-
Hey Str8,
Donford is correct. You would need to specifically block our crawler from the mobile pages in your robots.txt file. Unfortunately, we don't currently have a way to disregard specific pages or errors in the web app, but we are looking to add that function sometime in the future.
I hope this helps. Please let me know if you have any other questions.
-
Hi Str8
**user-agent: rogerbot disallow: /*mobile=**I think may do the trick... somebody may need to confirm this.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Setting up MOZ to run on Staging
Hi Moz, We would like to setup Moz to run on our Staging Server. This would be extremely valuable as it alerts us to new SEO issues/risks in a controlled and secure environment that is not exposed to production. Our internal team has recommended potentially setting up a reverse proxy server that will validate either via Moz's/Rogerbot's http header or IP and allow Moz access to our Staging environment to crawl. Is this something that we can setup with Moz? Are there other ideas to enable Moz to crawl our Staging server?
Moz Pro | | kriskunisch0 -
Is the Moz Ranking Report correct?
Hello here, today I got my weekly report from Moz by email and it reported a strong decline of rankings on some of our major keywords. Then I went to check on Google personally, and instead I found my pages ranked much higher than reported by Moz (please note that my results wasn't personalized...). I also use a desktop program to check my rankings, and what I found personally on Google corresponded to what my desktop program reported me. Here is an example: my website is virtualsheetmusic.com, and Moz reported a rank NOT in top 50 for the following keyword: "moonlight sonata sheet music" Whereas we are actually on the 19th spot. Another example for the keyword "czardas violin sheet music", Moz reports NOT in top 50, whereas we are actually at the 5th spot on the first page of Google results! Why's this? Anyone can explain? Is there anything wrong with Moz ranking report?
Moz Pro | | fablau0 -
Simply Report for new requests with Moz Pro Plus
Hi all I'd like to know how can I construct a brief report to send to my potential customers when they first write me asking for general informations and evaluation about their websites and certain keywords for which they want to have a great rank. I'd like to reply them with a short email, with a basic report attached, in which showing them some little details about their (and eventually their competitors) ranking and/or their website situation. It's just a brief professional introduction to our seo and web marketing services. Now I'm doing it manually or with other seo tools, but I have just bought a Moz Pro Plus annually version and I'd like to use Moz for this activity. For example, when I first insert a new campaign, I don't see ranking for days so I can't send rankinh report. Do you have any advice? Thanks.
Moz Pro | | Penny10 -
How do i get the crawler going again?
The initial crawl only hit one page. Set up another campaign for another site and it crawled 260 pages. How can I get the crawler started up again or do I really have to wait a week ?
Moz Pro | | martJ0 -
Why the discrepancy in organic traffic - monthly report vs analytics
I've been going through my monthly reports, and noticed something odd in the SEO Moz report section showing the visits from organic (non-paid) search engine results. When checking this data against the same data in Google Analytics, everything for the most part seems to line up with the exception of two dates: Jan 09 and Jan 23 of the SEO Moz report show 0 visits, but Analytics shows I do have visits on those days. Any ideas why this would be in the report or what I'm missing? IsePEAS hWBASOd
Moz Pro | | EEE30 -
In report section I don't see the last ranking : (
The image I see is like this http://pro.seomoz.org/campaigns/81837/rankings Nromally I was able to see the last report. Tanks for your help Fabio
Moz Pro | | Fabiosca630 -
Cities in Keywords Ranking Reports
So I've been in the habit of creating a master list of keywords concatenated with the city name so I can track my local rankings versus competitors. 1. Is this the correct thing to do to help hone in on who competitive my sites are ranking in the local market? 2. If so, by doing this the On Page reports seem to be totally screwed, because the searches I'm tracking (with city) vs the keywords I want to analyse for on-page ranking (without city), are different. What is the solution?
Moz Pro | | justlawonline0 -
Is there a way to pull ALL rankings for a site for a set of keywords?
I'm fairly new to SEOMoz, and am looking for a way to pull all rankings for a site with the keywords I've listed, not just the top ranking. So for instance if my site ranks for the keyword "widget maker in MO" in two spots. The current rank report will only show me the top result. I know I can click on each keyword individually and see a full list of the top 50, but I'm looking for a more automated way of doing this (I'm the only SEO at my agency and time is an issue). I previously used Advanced Web Ranking and the tool would like me pull a CSV of the top 30 sites for each keyword I was tracking and then I could just search for my site and pull those results easier. Anyone know of a shortcut or report I should use? Thanks!
Moz Pro | | OsbornBarr0
