Having possible problems with rankings due to development website
-
Hi all,
I've got an interesting issue and a bit of a technical challenge for you.
It's a bit complicated to explain, but please bear with me.
We have a client website (http://clientwebsite.com) which we are having a hard time ranking in the past few months. Main keywords simply don't show up in Top100 searches, even though we are constantly building backlinks through Guest Posts, Citations, Media mentions, Profile links etc.
Normally, we use ahrefs to look at the client's website backlinks, but just today we used Majestic to look at the backlink profile and one backlink stood out.
This is a backlink from a development server (http://developmentwebsite.com) which redirects to http://clientwebsite.com
The developers who were working on the redesign of the client website, put it up on their server and forgot to delete it.
Also, the content inside the development website is almost identical with the client website.We then checked to see if http://developmentwebsite.com is indexed.
It's not.Although, inside the robots file http://developmentwebsite.com/robots.txt there's:
User-agent: *
Allow: /
The funny (and weird thing) is that http://developmentwebsite.com/ and all development website inner pages are not indexed in Google.But if we go to http://developmentwebsite.com/inner-page, it doesn't redirect to the corresponding http://clientwebsite.com/inner-page, it's the same development website page URL and the pages even have links to the client website, but like I said, none of the pages of the development website are indexed, even though crawlers are allowed in the robots.txt's development website.
In your opinion, could this be the reason why we are having a hard time to rank the client website?
Second question is:
How do we approach in solving this issue?
Do we simply delete the whole http://developmentwebsite.com with all the inner pages?
Or should we do 301 redirrects on a per-page basis? -
the problem, might be about your template .
-
Thank you Jake, will definitely give this some thought.... Appreciate the help.
-
Recommending link development would be difficult without knowing more about your specific industry, competitive advantages, etc.
Generally speaking, you want to focus first on ensuring you have valuable assets capable of justifying new links to your site. This would be a variety of content types depending upon your business, but can range from Free Advice and How To Guides, Data Insights, Tools/Widgets, Detailed comparison/reviews, Interviews and insights from industry through leaders, etc. You can use methods like broken link building to identify new content opportunities that you can capitalize upon, or look at top linked pages on competitor sites to see the types of content that has earned their links.
Once you have established your linkable assets, you can begin the process of outreach and amplification to bring attention to those assets and earn natural links. Of course, you can always reach out to other thought leaders, cited sources, etc... to encourage some additional sharing, linking, etc.
You can also do link profile comparisons to see if there are reputable outlets citing your competitors but not mentioning you.
Those are just a few examples off the top of my head. If you have the resources to do link dev internally and just need strategy guidance, you should check out the Moz recommended list, as many of those agencies (I know ours does) will offer ad-hoc consultation to help your team get the systems in place to be successful with your link dev efforts.
Cheers,
Jake
-
Thanks, Jake. We've had the dev site removed.
As a side note, what link-building would you recommend if you think we should not be doing outreach / guest posting?
Cheers!
-
You have to search and replace the new sites URLs with the same consistent URL not from the dev server then block the dev server.
- search and replace the URLs in the new site.
- block the developer site with a password
First things first take Make sure you have all the images and code on the http://clientwebsite.com/
Then go to the new site and do a search and replace on all the URLs including the database.
Search for http://developmentwebsite.com & replace with http://clientwebsite.com
- https://www.funduc.com/search_replace.htm
- https://interconnectit.com/products/search-and-replace-for-wordpress-databases/
After doing this.
Go on to the development site and block URLs by password-protecting your server directories
Place a password on the site preventing it from being indexed by anything or even accessed without using the password.
- https://support.google.com/webmasters/answer/93708
- https://blogvault.net/how-to-block-google-from-indexing-your-wordpress-site/
You might want to check the header tags in the development site URLs. This would only be for curiosity you really want these things gone.
Did you check for
_(…)_ **X-Robots-Tag: noindex** _(…)_
Or no index meta tag in the section of your page:
Lastly, remove the offending URL's from Google if you must & follow this guide when launching sites.
I hope this helps,
Tom
-
You can also use Moz's Open Site Explorer to look at the spam scores of your incoming links.
-
Zakkyg, as previously mentioned, the problem may be the "building backlinks through Guest Posts and Profile links, and the type of links that you're building to the site. I would take one step further and run the site's links through Link Research Tools' Link Detox to make sure that the links to the site are good links and you're not building any toxic links.
I would also immediately take down the development site completely. Make it deliver 404 error pages, with all URLs. There's no need to set up redirects at all. Since it is an old dev site, it really shouldn't have any traffic or links to it--so I would just remove it.
-
Great question..
First... some of your rankings problem may be around this - "Guest Posts, Citations, Media mentions, Profile links etc."... at least 2 of those items carries some decent risk, the consequences of which would be "not ranking". Have you checked search console to see if any manual actions exist? Did you have rankings and they disappeared, or have you been unable to secure rankings in general? Does the site currently get organic traffic, but just maybe on terms that you aren't targeting?
As far as the development site, this could easily be a separate issue from your rankings, and I would doubt this would cause significant rankings drops if the dev site isn't being indexed by Google. Would you be lucky enough to have any type of access to this through a CMS login? If so, you could easily verify the site in search console and see where things stand in terms of indexing. Additionally, if you could access through the CMS, you might be able to change a few settings, such as canonical tags, "website" or discourage indexing (if wordpress), etc. .that would cause the site to begin redirecting to your clientwebsite.com or at least give the indication that it is a known copy.. Did you check the individual pages of the site to see if a meta tag is in place on the pages blocking robots?
Ultimately the easiest thing regarding the dev site would be to simply ask the dev company to remove the site...
Cheers,
Jake
-
I would do the redirect to be safe then in the future make sure you run noindex on any development sites.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why is my website not ranking for it's brand name in SERPs but has been indexed by Google?
The website https://christchurch.crowneplaza.com has been live for a couple of months but is not being found in Google search results - even when searching for it's own brand name 'crowne plaza christchurch.' Google has indexed the site - but we are still not showing - https://www.google.co.nz/search?q=site%3Ahttp%3A%2F%2Fchristchurch.crowneplaza.com&rlz=1C1NHXL_enNZ735NZ735&oq=site%3A&aqs=chrome.0.69i59j69i57j69i58j69i59l2j69i65.896j0j7&sourceid=chrome&ie=UTF-8 Any ideas as to why? I think it may be because their are two versions of the site, http and https, both with their own rel=canonical tags. Could this be the cause? Any help much appreciated.
Intermediate & Advanced SEO | | Timmy30 -
Should my website be accessible by IP?
I have been doing some digging in to this today essentially triggered off by looking at the secure certificate on my site and comparing it to others as i have been seeing some security warnings on a random basis. I noticed that on all instances none of the other sites IP addresses re-direct to the website, whereas on my site it does. is re-directing the IP address to the website a big no-no?
Intermediate & Advanced SEO | | WAWKA1 -
Ranking problems with international website
Hey there, we have some ranking issues with our international website. It would be great if any of you could share their thoughts on that. The website uses subfolders for country and language (i.e. .com/uk/en) for the website of the UK branch in English. As the company has branches all over the world and also offers their content in many languages the url structure is quite complex. A recent problem we have seen is that in certain markets the website is not ranking with the correct country. Especially in the UK and the US, Google prefers the country subfolder for Ghana (.com/gh/en) over the .com/us/en and .com/uk/en versions. We have hreflang setup and should also have some local backlinks pointing to the correct subfolders as we switched from many ccTLDs to one gTLD. What confuses me is that when I check for incoming links (Links to your site) with GWT, the subfolder (.com/gh/en) is listed quite high in the column (Your most linked content). However the listed linking domains are not linking at all to this folder as far as I am aware. If I check them with a redirect checker they all link to different subfolders. So I have now idea why Google gives such high authority to this subfolder over the specific country subfolders. The content is pretty much identical at this stage. Has any of you experienced similar behaviour and could point me in a promising direction? Thanks a lot. Regards, Jochen
Intermediate & Advanced SEO | | Online-Marketing-Guy0 -
Help! The website ranks fine but one of my web pages simply won't rank on Google!!!
One of our web pages will not rank on Google. The website as a whole ranks fine except just one section...We have tested and it looks fine...Google can crawl the page no problem. There are no spurious redirects in place. The content is fine. There is no duplicate page content issue. The page has a dozen product images (photos) but the load time of the page is absolutely fine. We have the submitted the page via webmaster and its fine. It gets listed but then a few hours later disappears!!! The site has not been penalised as we get good rankings with other pages. Can anyone help? Know about this problem?
Intermediate & Advanced SEO | | CayenneRed890 -
3 Pages Ranking Beside Each Other | How do I consolidate so one ranks better?
An ecommerce website I own called backyardGamez.com sells outdoor games, for example cornhole boards, bags, etc. One such product is a cornhole board carrying case. If you search the above phrase, my site has three pages that rank on the first page. The term isn't high volume, so I'm assuming that is part of the reason. Is this a good, normal thing or does this mean I have inadvertently broken up my ranking power from one powerful page to 3 OK pages? Does anyone know how I can take two of these pages and use them to make the 3rd page more powerful? For example, I would prefer 1 page ranks higher on page 1 in the serps and the other two fall a bit from supporting the other. Thanks, Adam
Intermediate & Advanced SEO | | Soft-Lite0 -
Recovering from index problem
Hi all. For a while, we've been working on http://thewilddeckcompany.co.uk/. Everything was going swimmingly, and we had a top 5 ranking for the term 'bird hides' for this page - http://thewilddeckcompany.co.uk/products/bird-hides. Then disaster struck! The client added a link with a faulty parameter in the Joomla back end that caused a bunch of duplicate content issues. Before this happened, all the site's 19 pages were indexed. Now it's just a handful, including the faulty URL (<cite>thewilddeckcompany.co.uk/index.php?id=13</cite>) This shows the issue pretty clearly. https://www.google.co.uk/search?q=site%3Athewilddeckcompany.co.uk&oq=site%3Athewilddeckcompany.co.uk&aqs=chrome..69i57j69i58.2178j0&sourceid=chrome&ie=UTF-8 I've removed the link, redirected the bad URL, updated the site map and got some new links pointing at the site to resolve the problem. Yet almost two month later, the bad URL is still showing in the SERPs and the indexing problem is still there. Any ideas? I'm stumped!
Intermediate & Advanced SEO | | Blink-SEO0 -
Links on My website
I am looking to create some more trust on my website by subscribing to BBB. I have heard that my site is penalized and loses "link juice" if I place the BBB logo link in my page footer on every page of my website. Does anyone know how much I am penalized? Should I only put it on my conversion pages and maybe my main 10 sub pages? My main goal is to assist in getting conversions but I don't want to do it at the expense of getting a penalty. Any help is greatly appreciated. Thank you, Boo
Intermediate & Advanced SEO | | Boodreaux0 -
How does a competing website with clearly black hat style SEO tactics, have a far higher domain authority than our website that only uses legitimate link building tactics?
Through SEO Moz link analysis tools, we looked at a competing websites external followed links and discovered a large number of links going to Blog pages with domain authorities in the 90's (their blog page authorities were between 40 and 60), however the single blog post written by this website was exactly the same in every instance and had been posted in August 2011. Some of these blog sites had 160 or so links linking back to this competing website whose domain authority is 49 while ours is 28, their Moz Trust is 5.43 while ours is 5.18. An example of some of the blogs that link to the competing website are: http://advocacy.mit.edu/coulter/blog/?p=13 http://pest-control-termite-inspection.posterous.com/\ However many of these links are "no follow" and yet still show up on Open Site Explorer as some of this competing websites top linking pages. Admittedly, they have 584 linking root domains while we have only 35, but if most of them are the kind of websites posted above, we don't understand how Google is rewarding them with a higher domain authority. Our website is www.anteater.com.au Are these tactics now the only way to get ahead?
Intermediate & Advanced SEO | | Peter.Huxley590