How to set the crawler or reports to ignore

[Str82u]

I have a mobile version of a site with a URL string that disables the mobile view on smartphones (view full site), string is like this example.com/page-name.html?mobile=off

I need the seomoz pro reports or crawler to ignore it because the crawler visits both versions of the site then reports them as duplicate content. Is there a setting page I haven't visited yet that will set this?

[Str82u]

Thanks for the confirmation. I hadn't wanted to put that in the robots file because if inquisitive, non-robot traffic if you get my meaning, but in it goes; can't stand seeing errors.

[Str82u]

Got it, thanks for jumping in so quick.

[ChiarynMiranda]

Hey Str8,

Donford is correct. You would need to specifically block our crawler from the mobile pages in your robots.txt file. Unfortunately, we don't currently have a way to disregard specific pages or errors in the web app, but we are looking to add that function sometime in the future.

I hope this helps. Please let me know if you have any other questions.

[donford]

Hi Str8

**user-agent: rogerbot
disallow: /*mobile=**

I think may do the trick... somebody may need to confirm this.