Moz crawl showing up ?s=keyword pages as errors
-
Hi all,
Hoping someone can she some light on a fix with ref to wordpress and the search function it uses as Moz is craling some pages which reference the search
Errors showing up are duplicate pages, descriptions and titles.
The search function is not important on this site and I have tried to use a plugin which disables the search page which it does but these errors still show up. Can anyone assist as this is the final piece of the puzzle and then we're down to 0 issues on the site.
-
I have implemented the robots method for the moment and I will look at the exclusion of parameters too. thanks , i will now wait the next crawl from Moz .
-
Hi there,
I am not sure which fix will stop Moz from flagging this, but just in case it is also being picked up by Google, are you able to serve the canonical tag on domain.com/?s=keyword and any search query pages, pointing to a generic page?
You can remove parameters from Google in Webmaster Tools as well: https://support.google.com/webmasters/answer/1235687?hl=en
This ensures that Google does not crawl pages with the parameter you specify, meaning they won't be an issue in its index.
-
Different ways to do this - best way would be to eliminate the search from your template in the editor files. If you want Moz to stop crawling your internal search pages add this to your robots.txt file:
User-agent: RogerBot
Disallow: /?s=*?
This should block Moz's crawler from any page beginning with _/?s= _after the root domain. Do a regex test just to double check your internal search URL and that piece of regex.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
What are the downsides and/or challenges to putting page paths (www.example.com/pagepath) on a different server?
Hi, Our company is organized into three different segments and our development team recently needed to switch a portion of the business to subdomain because they wanted to move to a different server platform. We are now seeing the impact of moving this segment of the business to a subdomain on the main domain. SEO is hurting and our MOZ score has dropped significantly. One fix they are debating is moving everything back to one domain, but place segments of the business on different page paths and hosting specific paths on different servers. I.e. the main domain could be www.example.com hosted in one location and then www.example.com/segment1 would be hosted on a different server. They are hoping to accomplish this using some sort of proxy/caching redirection solution. The goal of this change would be to recapture our domain strength. Is this something that is a good option or no? If not, what are the challenges and issues you see arising from doing something like that as I don't know of any other site set up like this. Thanks in advance.
Web Design | | bradgreene0 -
Do you know any tool(s) to check if Google can crawl a URL?
Our site is currently blocking search bots that's why I can't use Google Webmaster Tools' URL fetch tool. In Screamingfrog, there are dynamic pages that can't be found if I crawl the homepage. Thanks in advance!
Web Design | | esiow20130 -
May I know what's the "CSS Class" here?
ul.nav a#homelink { text-indent: -9999px; background: url('http://www.elegantthemes.com/preview/MyProduct/wp-content/themes/MyProduct/images/home-icon.png') no-repeat center 6px; padding: 0px; } ul.nav a#homelink span { display: block; padding: 5px 9px 8px 5px; width: 16px; } I'm having problems in adding back the "house" icon instead of a "Home" text in my menu. I don't what "CSS class" should I use to be added in the Home menu button (Appearance>Menu). I'm currently using a "MyProducts" Wordpress theme by ElegantThemes. Thanks in advance!
Web Design | | esiow20131 -
Home page redirect - will this cause an SEO problem
Hello, We are using Wordpress to build a wiki site. The wiki plugin we're using (Wordpress Wiki lite) can only be set up on an internal page like nlpwiki(dot)org/wiki Can we redirect the home page to the /wiki subdirectory and use nlpwiki(dot)org/wiki as our home page? I've never done that, just wondering if it will be indexed as the home page or if there are any connonical issues. Thanks!
Web Design | | BobGW0 -
Are links from main page to inner pages will affect on ranking?
About 3 weeks ago I converted index.html to index.php. Both are 301 redirect to main url. Also I have about 70 links on main page pointing to internal pages. The Website is about 11 years old,and was on active link building . Is this conversion from html to php and also 70 links pointing to inner pages will affect on ranking?Since all links are passing juice to inner pages.
Web Design | | LosAngelesLimo0 -
Buying mutliple keyword rich domain names and directing them to one site
I've noticed some folks buying keyword rich domain names and pointing them to one site to try to rank for those keywords. An example of this is a plumbing business that buys domains like austinplumber.com, localaustinplumbingservice.com, bestplumberinaustin.com and then pointing these domains to their main website. Does this help the site rank for these key phrases? How does google see this? Thanks mozzers! Ron
Web Design | | Ron100 -
Landing Page/Home Page issues
Hi. I was speaking with my designer last night (we are setting up a new website) and we were discussing the design of our homepage, now the designer said he wanted the first page of the website to be a sort of landing page page were the visitor has to click and enter, im sure everyone has all come across these before. However, I am concerned as to the SEO implications of this? Any help guys?
Web Design | | CompleteOffice0 -
Is my company's privacy policy diluting our SEO efforts?
Good morning! I'm new to the SEOmoz community. This morning, I spot checked a couple pages using the Term Extractor. When looking at the results, I noticed that we're ranking for many of the terms contained in our privacy policy. Our privacy policy is set up in the footer of our page templates and appears as a light box that pops up over the page you're viewing, so it looks like every page (from a search engines perspective) contains every word of our 900-word privacy policy. Since several of our legal terms are showing up as "targeted terms" within the tool, would it benefit me to change the privacy policy link from a light box to something else? Perhaps a link to a static page that contains our privacy policy instead? Are the search engines smart enough to see the repeating text and ignore it from page to page, or am I just diluting all of my SEO efforts here? I'm after big wins here, and don't want to be too nitpicky, but concerned this could be a big SEO no-no that I might want to correct. Thanks in advance for your expertise! Ben Culbert
Web Design | | SheriGolla0