Launching Website
-
We are developing a new website and thinking google would not find it because of the directory we put it in (no homepage yet) and because there are no links to it. For example, we are building it in this directory example.com/wordpress/ but somehow google found it and indexed pages not ready to be indexed.
What should we do to stop this until we are ready to launch? Should we just use a robots.txt file with this in it?
User-agent: *
Disallow: /Will this create repercussions when we officially launch?
-
Thank you
-
Thanks!
-
You are correct with your approach.
And as Paddy states, once you launch, remove the disallow and the crawlers will find you.
I would also suggest that once you launch that you submit a sitemap to all of the major search engines to be found even quicker and to help ensure that all of your site pages are crawled.
Mike
-
yes, use the robots file to deindex, once your ready to launch remove the disallow, and the next time google crawls your site you should get indexed.
you must have been linked from somewhere for google to find you, so it means google will find you quicker once you ready to launch ( you already have a backlink)
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Suggestions on Website Recovery
Hello Mozzers! I have been tasked with recovering a site from partial link penalty that was previous brought to my attention for this website www.active8canada.com. Upon reviewing the site backlinks and reporting info in Google webmaster tools, I found there was no penalty showing, could it have expired? We spent the last few months doing link cleanup as we recognize that there was some bad links that needed to be addressed. We requested removal of all the bad links after spending time categorizing all of them. Targeting commercial anchor text and bringing those numbers back to acceptable levels. Following this we did a disavow of the bad links which could not be removed through requests. We are actively building out additional content for the website as we recognize that some pages have thin content. We have earned some links as well to show some positive signals during the cleanup but have seen no change for better or worse. My question is, does anyone else see anything else we could be missing here? Should I revisit links again? Some of the links we disavowed are still showing in our backlink reports, but I cross referenced our disavows with the existing backlink profile to try and get an accurate sense of the remaining links. We never saw a decline in ranks further after the disavow, so I'm lead to believe that the links we removed had little, if any impact. I am a little hesitant to begin earning new links through content and partnership outreach as I still feel something is off that I can't quite put my finger on. It was previously confirmed that there was a penalty, but without that showing now in Google webmaster tools I'm grasping at any possible angle I may have missed. If anyone had a couple minutes to spare to shed some light on this situation, it would be greatly appreciated!
Technical SEO | | toddmumford0 -
Development Website Duplicate Content Issue
Hi, We launched a client's website around 7th January 2013 (http://rollerbannerscheap.co.uk), we originally constructed the website on a development domain (http://dev.rollerbannerscheap.co.uk) which was active for around 6-8 months (the dev site was unblocked from search engines for the first 3-4 months, but then blocked again) before we migrated dev --> live. In late Jan 2013 changed the robots.txt file to allow search engines to index the website. A week later I accidentally logged into the DEV website and also changed the robots.txt file to allow the search engines to index it. This obviously caused a duplicate content issue as both sites were identical. I realised what I had done a couple of days later and blocked the dev site from the search engines with the robots.txt file. Most of the pages from the dev site had been de-indexed from Google apart from 3, the home page (dev.rollerbannerscheap.co.uk, and two blog pages). The live site has 184 pages indexed in Google. So I thought the last 3 dev pages would disappear after a few weeks. I checked back late February and the 3 dev site pages were still indexed in Google. I decided to 301 redirect the dev site to the live site to tell Google to rank the live site and to ignore the dev site content. I also checked the robots.txt file on the dev site and this was blocking search engines too. But still the dev site is being found in Google wherever the live site should be found. When I do find the dev site in Google it displays this; Roller Banners Cheap » admin <cite>dev.rollerbannerscheap.co.uk/</cite><a id="srsl_0" class="pplsrsla" tabindex="0" data-ved="0CEQQ5hkwAA" data-url="http://dev.rollerbannerscheap.co.uk/" data-title="Roller Banners Cheap » admin" data-sli="srsl_0" data-ci="srslc_0" data-vli="srslcl_0" data-slg="webres"></a>A description for this result is not available because of this site's robots.txt – learn more.This is really affecting our clients SEO plan and we can't seem to remove the dev site or rank the live site in Google.Please can anyone help?
Technical SEO | | SO_UK0 -
Question for experts - a website is ranking defying all google rules
Hi all Today I saw a strange result in google's search page. When I typed a keyword: Rezeptfrei bestellen, it gave me results like number 1- http://www.rezeptfreibestellen.com/ If I check this site in opensiteexplorer, this is nothing but a new site with no backlinks, or any other offpage work. Onpage work is simply keyword stuffing and domain name is also same as keyword. Now why google ranked this website above others? Where are google EMD and Penguin, Panda? Amit
Technical SEO | | expertvillagemedia1 -
Website Redirects
Background information: We have a website (devicelock.com) which is currently our corporate website. The company use to operate under (ntutility.com) which is now being redirected to devicelock.com via a DNS Forward - 302 Redirect. The IT admin (a founder of the company) is reluctant to change it to a 301. The current flow is ntutility.com redirects to protect-me.com then redirects again to devicelock.com. When i search up Devicelock on google, it shows up as ntutlity.com. There is no devicelock.com homepage on google search. Question: Are there any negative implications about this? Is this hurting our SEO in any way? When i do link building, will this have any negative affects? Will my links for devicelock be attributed to devicelock.com?
Technical SEO | | Devicelock0 -
How can i improve alexa rank of my website
www.meetuniversities.com Meet Universities - Get connected to your dream university
Technical SEO | | debal0 -
Things to consider with regards to SEO when redesigning a website
I will be redesigning a website in wordpress. currently the website is html/css based My concern is i dont want to lose any of the Search engine rankings. what should i put in place to avoid that situation
Technical SEO | | mancmusicman0 -
URL specific websites with i-framed application
I have 300 URL specific websites that rank well in Yahoo and Bing. Unfortunately I don't have access to the websites due to a previous marketing agreement (before my time). I do have access to the application that is i-framed into the websites. I was thinking about adding a paragraph below the application with a link to the primary website. How does google look at these links. If I add the link, there will be an additional 300 links showing up at the same time. Not what they want to see from my personal knowledge base. At the same time, its not black hat SEO, I am just trying to link to the other websites which I own which are related. What are people thoughts.
Technical SEO | | FidelityOne0 -
Google website-links changing back and fourth
Thought I might ask you guys if you have ever seen anything similar, 'cause I sure haven't. 🙂 I have a client who stumbled across a problem with his website links. Google change them back and fourth. one day one of the links will be called "iPhone 4 accessories" and some weeks pass and then it changes to " 4 accessories". Weeks pass again and then the iphone is back. First I thought to myself that Google might have expanded the AdWords filter to include website-links.. But then I remembered that they were ordered by the EU courts to size that practice.. so that can't be it. Plus allot of his competition doesn't seem to have the same problem. I have checked everything, the links, title tags, page titles exc.. and I acn't realt find any reason why this should be happening to him and I must admit I have never seen anything similar. Any hints and pointers would be most welcome 🙂
Technical SEO | | ReneReinholdt0