How to set the crawler or reports to ignore
-
I have a mobile version of a site with a URL string that disables the mobile view on smartphones (view full site), string is like this example.com/page-name.html?mobile=off
I need the seomoz pro reports or crawler to ignore it because the crawler visits both versions of the site then reports them as duplicate content. Is there a setting page I haven't visited yet that will set this?
-
Thanks for the confirmation. I hadn't wanted to put that in the robots file because if inquisitive, non-robot traffic if you get my meaning, but in it goes; can't stand seeing errors.
-
Got it, thanks for jumping in so quick.
-
Hey Str8,
Donford is correct. You would need to specifically block our crawler from the mobile pages in your robots.txt file. Unfortunately, we don't currently have a way to disregard specific pages or errors in the web app, but we are looking to add that function sometime in the future.
I hope this helps. Please let me know if you have any other questions.
-
Hi Str8
**user-agent: rogerbot disallow: /*mobile=**I think may do the trick... somebody may need to confirm this.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Lag time between MOZ crawl and report notification?
I did a lot of work to one of my sites last week and eagerly awaited this week's MOZ report to confirm that I had achieved what I was trying to do, but alas I still see the same errors and warnings in the latest report. This was supposedly generated five days AFTER I made the changes, so why are they not apparent in the new report? I am mainly referring to missing metadata, long page titles, duplicate content and duplicate title errors (due to crawl and URL issues). Why would the new crawl not have picked up that these have been corrected? Does it rely on some other crawl having updated (e.g. Google or Bing)?
Moz Pro | | Gavin.Atkinson0 -
Occurrences of Keyword - Report card
Hi WHen I run the report card for a particular keyword - URL its says "Occurrences of Keyword 0" however I there is the keywords in the page at least twice and exact match of keywords x1 ? any help would be appricated. For some reason google is just not indexing any keyword that I have optimized page for either. I have checked and they are all "follow" thanks
Moz Pro | | summer3000 -
Crawl report shows Title Element too long but they aren't
Hi, My latest crawl report says that I have a stack of pages with Title Element Too Long on them - e.g. Build My Ride - charity team building event with real purposeBuild My Ride - charity team building event with real purpose http://www.teamelevate.co.nz/events/build-my-ride1.html You can see that it shows the title element as doubled-up. When I look at the title element on the live page it is not double. GWT shows that there are no issues with long title elements. Any ideas anyone...? Chris
Moz Pro | | chris.elevate0 -
Rankings Report not working
Hi (What happened to the User Voice feedback in PRO campaign reports? Another cutback because of scalability?) I'm getting sent here for Help on the reports It's Friday morning here in France ; I'm preparing a meeting with a client and as part of this I want their Rankings Report from the campaing I set up for them month's ago Half the keywords are showing up as "SAT" ; the message at the top says "Your keywords are updated weekly on Saturday. The last update was January 26th, 2013" They're not new keywords, if I click on them I get historic data up untill January 19th I'm guessing you had a problem on January 26th but why not put January 19th rankings rather than SAT ? The report is now useless. Here's the url if useful http://pro.seomoz.org/campaigns/54444/rankings Neil
Moz Pro | | NeilInFrance0 -
Optimization report card says "F" but I'm ranking #1
Using the SEOMoz pro tools and several of the terms I have listed get a report card of "F" but they also show Google rank of #1, #2. Is this unusual? And should I spend a lot of time "fixing" this if we're already ranking high?
Moz Pro | | schof0 -
What are followed vs non-followed links in Domain Analyis report?
I'm new to SEOMoz and wondering if some nice person can put this into plain English for me? 🙂 On the Competitive Domain Analysis report there are green follow / no-follow links and blue followed / non-followed linking root domains? what is the context of the green & blue circles? is there a better or worse visual representation that I should aim for - more dark green, more light green or about half & half. thanks in advance
Moz Pro | | seanuk0 -
Do crawl reports see canonical tags?
Greetings, I just redesigned my site, www.funderstanding.com, and have the old site pointing to the new site via canonical URLs. I had a new crawl test run and it showed a large amount of duplicate content. Does the SEO Moz crawl tool validate canonical urls and adjusts the duplicate content count or is this note considered? FYI, I sent from no duplicate content to having 865 errors since the redesign went up so that seems suspicious. I would think though that assuming the canonical tag were used properly, and I hope it is?, that this would not be a problem?? All help with this is most appreciated. Eric
Moz Pro | | Ericc220 -
How long does it take a full SERP report to finish?
I am just wondering if anyone has had a full SERP Report in the keyword difficulty tool finish for them or if they know how long these take to populate?
Moz Pro | | MarloSchneider0