I'm doing a crawl analysis for a website and finding all these duplicate URLs with "null" being added to them and have no clue what could be causing this.
-
Does anyone know what could be causing this? Our dev team thinks it's caused by mobile pages they created a while ago but it is adding 1000's of additional URLs to the crawl report and being indexed by Google. They don't see it as a priority but I believe these could be very harmful to our site.
examples from URL string:
uruguay-argentina-chilenullnull/days
rainforests-volcanoes-wildlifenullnull/reviews
of-eastern-europenullnullnullnull/hotels -
Hi there,
This looks to be something to do with a URL generator that is dynamically creating URLs based on certain categories being present.
The downside being that those categories look to have been removed, hence the 'null' values being passed through.
I would push this back to your developers as a serious issue, there could be a large amount of duplication occurring if you're not careful.
All the best,
Sean
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Making a website menu + structure + hierarchies + kw research
When making a new website structure I assume we all think about SEO but at the same time as we can't forget UX.
Web Design | | ceranoktan
How much of your KW research would you implement in menu \ website structure?
What do you think is important to think about when making a website structure? Thank you in advance, BR,
Ceran0 -
Free websites that are good with SEO?
Dear members, I am looking for a free/ almost free website which is good for SEO. For example i am looking at WIX right now but i keeping reading that they aren't optimal for SEO. Does anybody has some tips which website is can use, example weebly, strato, etc?? Many thanks!
Web Design | | rijwielcashencarry0400 -
Live website is an addon domain - Need site old development url inaccessable from live domain
Hi everyone, I have a website which is built in Joomla 2.5. The development site is located at www,abc.com/subdomain/. We have set the site live using an addon domain which is www.xyz.com. The problem is, www.abc.com/subdomain/ is still accessible and being crawled by Google. How is the best way to make the development url inaccessible? Any help would be appreciated!
Web Design | | DougHosmer0 -
How serious is duplicate page content?
We just launched our site on a new platform - Magento Enterprise. We have a wholesale catalog and and retail catalog. We have up to 3 domains pointing to each product. We are getting tons of duplicate content errors. What are the best practices for dealing with this? Here is an example: mysite.com/product.html mysite.com/category/product.html mysite.com/dynamic-url
Web Design | | devonkrusich0 -
Should I Remove URL extentions for SEO?
We are having a developer design our website with Magento. I noticed the main pages such as About Us have no file extention in the URL. But the product pages have a .html file extention. I was once told to remove the file extentions. Are there benefits to removing the .html file extension and if so, is there a way we can do this using Magento?
Web Design | | hfranz0 -
New URL Strucutre
Hello all! I'm new to SeoMoz and would like to introduce myself and say thanks for all of the great content. This is definitely the premium website I have been looking for. My question is regarding a new URL structure that will be implemented with our website redesign. We are looking to make our URL's more user and SEO friendly. We will be using 301 redirects to reroute our existing structure when the site goes live. Background
Web Design | | kauffmantire
I work in a company that retails automotive tires. I would consider class (performance, off-road, highway, etc.) to be the most important category, but based on our analytics we receive much more traffic from brand terms. This is most likely because our customers are not educated on specific tire classes and generally do head term searches or search by brand / product name. Ultimately the will have to buy from a certain class based on driving habits. Link and URL Structure
(Parameters) The model page includes links to individual tire size specific pages. We are using the model page as our primary SEO page because the only difference from the 5 - 60 tire size specific pages per model will be the tire size itself. This means that all of the remaining content will be duplicated multiple times over. All links to the tire size specific page from the model page will have a rel="nofollow" attribute attached to it. All tire size specific pages will have a rel="canonical" tag pointing back to the model page Out of the following structures, which would you consider to be the best format: 1. http://www.company.com/category/brand/model
or
2. http://www.company.com/brand/category/model
or
3. http://www.company.com/tires/category/model We will append the specific tire-size to the URL on the item specific pages. Any other options or strategies will be greatly appreciated. Thanks in advance for your help!0 -
Multilingual Website. Best SEO Strategy
Hello.
Web Design | | teconsite.com
We have a client that will extend his business to severak countries in Europe.
So far its main market was the Spanish one. In this market it works with his own domain that is the same that its brand name. The domain does not contain any important keyword but it has been working for 11 years: www.efutgol.com. In Spain has a good ranking. It ranks number 1 or number 2, it fluctuates. But it also sells to France and Portugal. In the France market they used a domain with exact match with the French keyword that they are interested in: www.equipementsfootball.com/. The same strategy www.equipamentosfutebol.com in Portugal. Both have number 1 for the main keyword in those Countries for that keyword Now they are going to sell in more countries.
The problem is that each website have a different CMS what makes necessary double maintenance. We are going to unificate in only one domain, one single design, one single CMS all websites. But were have doubts about SEO consequences of doing that What is the best thing for URLs?
www.efutgol.com/fr/ .....
www.efutgol.com/es/
www.efutgol.com / pt What should we do with the domains that are so well positioned in france and portugal? 301 redirect will work? What should we expect? What would you do? What things we should consider to keep the current position?0 -
Do iFrames embedded in a page get crawled?
Do iFrames embedded in a page get crawled? I have an iFrame which prints a page hosted by another company embedded in my page. Their links don't include rel=nofollow attributes, so I don't want Google to see them. Do spiders crawl the content in iFrames, or do I have to ensure that the links on this page include the nofollow attribute?
Web Design | | deuce1s0