IP address URLs being indexed, 301 to domain?
-
I apoligize if this question as been asked before, I couldnt' find in the Q&A though.
I noticed Google has been indexing our IP address for some pages (ie: 123.123.123.123/page.html instead of domain.com/page.html). I suspect this is possibly due to a few straggler relative links instead of absolute, or possibly something else I'm not thinking of.
My less-evasive solution a few months back was to ensure canonical tags were on all pages, and then replaced any relative links w/ absolutes. This does not seem to be fixing the problem though, as recently as today new pages were scooped up with the IP address.
My next thought is to 301 redirect any IP address URL to the domain, but I was afraid that may be too drastic and that the canonical should be sufficient (which it doesn't seem to be). Has anyone dealt with this issue? Do you think the 301 would be a safe move, any other suggestions?
thanks.
-
KT I think you are telling us that you have a static domain. As in your domain is the only domain on that IP address here is an example of what I'm talking about http://www.whatismyip.com/faq/difference-between-static-ip-address-and-dynamic-ip-address.asp if that is what you meant "by some sites (who do things well) 301 on the IP, others don't so I wasn't sure if I was missing something"
I would say the only chance of any site doing well in the search engine world is if it is a static domain obviously gone over that still there are very many security reasons to have a DHCP over static IP if somebody decides to attack your site for whatever reason you are a sitting duck with a static IP at least a DHCP can change it and the way all the search engines are set up now a virtual IP domain name or DHCP is treated just as if it were a static IP to Google there is no difference the DNS domain name service has to take those numbers and turn them into a readable user friendly word we can remember I think you're confused about the difference between an IP and a domain regardless of what you do your site will suffer greatly if you do not do a 301 redirect or some sort of mapping as I suggested and please understand that is a guess I don't know that a robot.txt would be sufficient I would strongly suggest because you're putting so much time and effort into making a website that you want to rank well on the search engine's using a 301 redirect whether or not use static IP or domain on a DHCP here is some more info as well http://en.wikipedia.org/wiki/URL_redirection
I wish you the best with this please do inform me of any way that you have of knowing you will not be victim to the same issues everyone else's when it comes to duplicate the links duplicated content. I do know Google bots don't just stop when they see no follow they go on and they indexed everything then they decide what they wanted for you to rank well. I think it would be more than confusing when you type site:example.com and site: www.example.com into Google only to find you spent time building links for one of your two websites.
Regardless I wish you the best on your endeavor,
Thomas
-
-
Hi Ryan,
Unfortunately English is not my first language I am a German (I live in the states as well but primarily English is not my strong point) I am telling you this because when I had written that reply I used voice recognition system and unfortunately have not been able to find the data I will reinvestigate where I was saying so that it makes more sense. I do know this 301 redirects to slow things down and I am saying this without expert knowledge so please take what I'm saying with a grain of salt. My understanding is the reason you need a 301 redirect is to eliminate the double content issue Google will from what I understand punish you for trying to use your same old content more than once especially if it is in a setting that is absolutely identical. I have been told blogs are held to different standards. The main problem I can definitely understand is most people I believe don't think www. is a subdomain when in fact it is much like three days www.example.com and blog.example.com are very much alike in fact one could make the argument if it wasn't for what the W. stands for World Wide Web and people just getting used to typing them in me might be better off as almost every hosting platform/webmaster platform or tools allows you to redirect your personal preference. For instance http://twitter.com has no www.and that makes sense for them they are trying to use the least amount of keys and is a web app. Where someone like Acme huge corporation would never dream of not having the address be written with www.acme-huge-corporation.com because the average web user believes website start with four things www. and unless you're using a CMS or CDN (that essentially does what the 301 redirect does) you will create duplicate content and be penalized when you build links because some will go to the non-WW W. and others to the root by making them more in the same all year SEO efforts go towards the same thing and don't forget by duplicating pages Google will most likely punish you. I do have a theory about how to get around using a 301 redirect and still keep the speed you deserve and not be punished for the things I spoke about earlier.I would like this to be confirmed before any of you spend your time trying what I'm guessing might work in the situation. You would design your robot.txt file to only include URLs ending with / so when you run your sightmap.xml or sightmap.aspx believe it or not they both use XML overall ASP just hangs out on server-side. You will see that there are two of every page like http://www.ColdFusionisstillmyfavorite.com/ Then under it or above you should see http://www.ColdFusionisstillmyfavorite.com the way I theorize you can make this work is tell the robots.txt to no follow the links without / it is my opinion they will follow them anyway but relay to Google that the information you're site map I wanted to take allowing for Google to hopefully not include your duplicate content and all is right in the world. This time to let everyone know fire host is a fantastic host however if the price is steep which if you're running one site or two obviously it's more than you need to pay I want to share with you a couple alternatives first media Temple V.E very fast but I'm not a lie media Temple gets bad rap from their GS server primarily and having been a customer of theirs only on the DV & VE I can assure you there still is a lot of bugs in GS because every time I would log in there were something about GS being down or worse. Having said that I do like media Temple as a company I know they are replacing GS with CS that has been in work the works for while and I believe it will fix the problems I know most of you guys here unless thinking of VE or DV our saying thanks a lot for the tip, well I did my best and I would strongly suggest http://vps.net/ they have everything media Temple has including a larger CDN in addition to having a full data center in England and the United States and an excellent uptime rating were talking the same service better speed and uptime of rack space there cost is around $20 and up but they offer huge at least to myself good reason to try them out one being cloud VPS Beta with unheard of speed okay I'll tell you outside their network according to them there over 1 Gb if that's not enough the owner of woohoo templates is a investor and you guessed it you get a free professional WordPress template with all the bells and whistles along with SEO as an option. I do know the high-end word press templates are extremely well optimized so my recommendation for the is out right now is if you don't have a good host and please feel free to correct me if I'm wrong I'm not stating anything meant to offend but I do believe you get what you pay for and I would pay for this http://vps.net/ is going to give you I believe the best thing for your buck where else can you get the elasticity of Amazon with excellent free service 24 seven cloud backup and an interface just as pretty as media temples that's saying a lot. Just to let you know I have nothing to do with any of these companies I see no profit by telling you what I know. ◦ Smart Hosting - The latest Cloud technology packaged up in an easy to understand web hosting or VPS package.
- 100% Uptime - Auto-healing and auto-scaling for your website or VPS ensures 100% availability.
- Ready to Run Templates - Deploy one of the 100's of ready rolled VPS templates or create your own in minutes.
- No contracts - Pay daily or monthly and only for what you want to use, be in control of your billing.
Try us for $1 - Sign up for a daily VPS node now!
In the near future we will introduce the ability for users to download/upload these templates (for local testing and modifications), and migrate/copy them to another Cloud, also at the moment all accounts are limited to 1 FREE custom template slot, the ability to purchase additional slots will also be added soon.
. I think you can get it the same or better performance out of mediatemple.net/ V.E it has solid state hard drive standard but you must be very comfortable with out a GUI you login using SS H. that's it and there's not much support but it's probably the fast site for $30 a month and if you want to add Media Temple'sPro CDN it is in fact hosted by edge network and I believe that $29 month an outstanding deal. However I know I mentioned I would bring this up my last post I am glad I'm able to give it to you here CloudFlare keep in mind they are company that allows for basic domestic US only CDN you are in no way forced to use media Temple you can add it for free to any web host you can control the DNS on at no cost at all unless like there their higher packages ( I think it uses openDNS.com which is another fantastic program that is free I highly recommend to everyone) so much like OpenDNS.com you get it free virus, spam bots you name it protection along with faster overall download speeds especially to people using slower connections. Remember just because somebody isn't running fiber does not mean they're not worth giving the best experience to and advertising just as much to. Most people run somewhere in the middle of what the fastest possible ISP provides for their area of the world. I'm running fiber at 40 Mb symmetrical right now but that's new and for the past five years I paid more money just to get 25 Mb download and nearly 3 Mb up. What I'm saying is if you optimize your site correctly then either use Google to rewrite your site for speed or not you are going to get in much quicker website than taking something that you bought that is not optimized at all and paying Google to magically rewrite then pushed the site. You only get a 10% improvement in less the site is fundamentally sound. If you need to rewrite depending on your side of course some of these high-end WordPress templates are free with http://vps.net/I hope I've hope someone. I am extremely sorry if I got off track a little bit I am chemical engineering on German time so I must go thank you all so much for taking my opinion into consideration please leave me feedback about your thoughts on my theories or if you do turn out how they went I will do the same. I do ask if you don't like what my opinion is you can just say it's not your thing I am not opposed to hearing anything that gets to the bottom line having said that I have years of this under my belt have worked with many companies Web trends Adobe Omniture & HubSpot. Please don't think I am ranking companies as SEOMOZ is the backbone of some of the best SEO's in the world.
Hope this helps people also check out http://builtwith.com/ their free services ability to tell you exactly what's running on your website is amazing. I also would like to tell every one at SEO moz thank you for the new keyword tip it has not hurt been my raking not having them in addition you are very right all I can really do with them is show my competitors what I've been working on.
Respectfully,
Thomas
PS
http://mediatemple.net/cloudflare/#about
Whats is CloudFlare?
It’s a free CDN (content delivery network) with a security layer that ’just works‘ in conjunction with your existing hosting service. When we learned about it, we knew our customers had to have it.
-
How does it work?
CloudFlare re-routes your sites’ traffic through its global network; blocking threats and caching content. This saves your bandwidth & resources while speeding up load times.
-
Will it work for any of my services?
It will work for any (mt) hosting service. Not a customer yet? Get started with Media Temple web hosting.
-
How do I enable it on my (mt) service?
Quick & simple set-up via the AccountCenter will have you up and running in 5 minutes! Step-by-step instructions can be found in the How do I enable CloudFlare? article.
-
Does CloudFlare support SSL?
Yes, however, in order to use SSL (https://) you’ll need to upgrade to a paid service through CloudFlare.
-
Where do I put my files?
You upload all your files to your (mt) hosting service as usual.
-
What happens when I update my website?
(mt) will serve any new files while CloudFlare updates its global network. You also have control over your cache settings.
-
Can I turn CloudFlare off?
That’s simple. Just disable it in your AccountCenter. Step-by-step instructions here: How do I disable the CloudFlare service?
-
-
mtipolyexe, your reply seems very thought out and helpful, but I can't tell for sure as something went wrong when you added it and it breaks the horizontal frame of a normal Q&A reply. Can you please fix your response so we can all read it?
-
I feel like a lot of people are told 301 redirects are a must. There is a downside most of it involves slowing your page response time. I do believe firmly though at this time we must use 301 redirects or risk putting all of our work into what could amount to only one half before we did as it is split between the two pages created when we make a domain. The other huge problem without 301 redirects is Google will bring down the hammer so to say for duplicate content. You can have a good amount of duplicate content special in a blog but exact is going to hurt you. I dealt with this same issue I strongly strongly suggest making up for the speed difference with two Links I’m adding that have different ways that should be applied to everyone’s site elements one be and compensate http://code.google.com/speed/articles/ next is an excellent tool to tell you what you can improve under site http://developer.yahoo.com/yslow/ this is were my personal favorites as people around the world don’t always have the same Internet connection speeds I can tell you with absolute certainty the money is just as green from a person who uses dial up as it is for a person using fiber http://www.webpagetest.org/
my most valuable thing I can probably gift to you is this link http://www.readwriteweb.com/archives/15_tools_to_help_speed_up_your_website.php
they are nothing short of true wealth of information on how to handle 301 redirects and the speed difference I have for sites and currently use CDN's include Akamai, Limelight Networks their goals our as fast as you can there are others listed in the readwriteWeb.com above and
now if you are thinking God Tom you just told me a lot of stuff that could be very expensive and a lot of work and you would be right. So if you want the totally turnkey option please been introduced Google's new system http://code.google.com/speed/pss/index.html FYI Google uses http://tools.pingdom.com/ so should you it's free media Temple is an excellent host that offers a free CDN in addition to a proceed in for $25 a month. I use http://www.firehost.com and they come with a free CDN that is excellent it handles video overall worst-case scenario you have a poorly written website is and effect and might need it to be completely rewritten with. I think that readwriteweb.com is your best bet. Sorry I was so long-winded I really hope this is viable information to somebody hopefully you and best of luck to you.
Don't let this happen to you
Every day, more than 99 human years are wasted because of uncompressed content. Although support for compression is a standard feature of all modern browsers, there are still many cases in which users of these browsers do not receive compressed content. This wastes bandwidth and slows down users' interactions with web pages.
One of the great things about using a popular JavaScript library like JQuery or Dojo is that Google offers a content distribution network and loading architecture, which means the scripts load very quickly. But what about smaller JavaScript libraries?
That’s where CDN JS comes in. The newish site offers CDN hosting for less popular, but still useful JavaScript libraries. The site uses Amazon CloudFront, along with Amazon S3 for DNS, making it, in all likelihood, faster than serving the same scripts off your own server. You can check out the uptime stats for CDN JS on Pingdom.
CDN JS doesn’t have everything, but they do have one script many developers use all the time these days — Modernizr. If there’s a library you’d like to see hosted, be sure to let CDN JS know.
We’d like to see the site make it possible to combine scripts — say, load Modernizr and respond.js (not currently available at all) — into a single, minified script, but even as it stands, loading two scripts from a CDN is often faster than a single script from your own server.
[edited by KeriMorgret so it won't scroll horizontally]
-
I typically use this in an .htaccess file:
RewriteCond %{HTTP_HOST} ^[0-9]+(.[0-9]+){3} [OR]
RewriteCond %{HTTP_HOST} !^www.yourdomain.com$ [OR]
RewriteCond %{HTTP_HOST} ^yourdomain.com [NC]
RewriteRule ^(.*)$ http://www.yourdomain.com/$1 [L,R=301]Explanation: If it is an ip, doesn't start with www, or doesn't have the www, rewrite it to the http://www.
-
Thanks Ryan, not too concerned about the process of performing a 301, just looking more for agreement on if it's the best practice in this scenario. Some sites (who do things well) 301 on the IP, others don't so I wasn't sure if I was missing something.
thanks again.
-
A 301 is definitely preferable over a canonical. I would recommend a simple regex expression to 301 redirect any IP related traffic to the relative page on your chosen domain.
Example: 123.123.123.123/welcome would be redirected to mysite.com/welcome
This can be achieved with a single rule. The code for the rule would vary based on your server setup. If you are on managed hosting, your host can set this up for you.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
301 Domain Redirect from old domain with HTTPS
My domain was indexed with HTTPS://WWW. now that we redirected it the certificate has been removed and if you try to visit the old site with https it throws an obvious error that this sites not secure and the 301 does not happen. My question is will googles bot have this issue. Right now the domain has been in redirection status to the new domain for a couple months and the old site is still indexed, while the new one is not ranking well for half its terms. If that is not causing the problem can anyone tell me why would the 301 take such a long time. Ive double and quadruple checked the 301's and all settings to ensure its being redirected properly. Yet it still hasn't fully redirected. Something is wrong and my clients ready to ditch the old domain we worked on for a good amount of time. backgorund:About 30 days ago we found some redirect loops .. well not loop but it was redirecting from old domain to the new domain several times without error. I removed the plugins causing the multi redirects and now we have just one redirect from any page on the old domain to the new https version. Any suggestions? This is really frustrating me and I just can't figure it out. My only answer at this point is wait it out because others have had this issue where it takes up to 2 months to redirect the domain. My only issue is that this is the first domain redirect out of many that have ever taken more than a week or three.
Technical SEO | | waqid0 -
Changed domains, saw significant drop in domain authority
Hello, A little over a month ago we switched our domain from A to B. The original was .com and the new one is at a .tech for good measure. We have meticulously done 301 redirects page by page but there has been a massive drop in traffic and I checked here to see that we've gone from a 30 domain authority to a 9. The company is a few months over 1 year old, but we're really looking at traffic accumulated in just about 8 months for the old domain. Is there any way to recover some of the old juice in this one other than the re-directs? Our number of backlinks have also severely dropped despite re-directs.
Technical SEO | | SteveSaf0 -
Choice of domain
Hi. I want to build a new site that is optimised for a training product that we have. We have an existing domain which I'm considering pointing at this new site. This domain is one of the new .training TLDs. Let's call this domain foo.training where my main keyword to optimise for will be "foo training". I've also looked and can see that foo-training.com is available. I read up on best practices for domains here : https://mza.seotoolninja.com/learn/seo/domain My question is will the .training domain be seen as "spammy" in any way? Am I better to just go ahead and register the .com?
Technical SEO | | rmcatalyst0 -
High DA url rewrite to your url...would it increase the Ranking of a website?
Hi, my client use a recruiting management tool called njoyn.com. The url of his site look like: www.example.njoyn.com. Would it increase his ranking if I use this Url above that point to njoyn domain wich has a high DA, and rewrite it to his site www.example.com? If yes how? Thanks
Technical SEO | | bigrat950 -
Redirecting domain to the main domain (hosting cost?)
Hello Everyone, I have the following situation. There is main domain and a secondary domain that is related to the page on the main domain. I want to integrate the content of the secondary domain into the page on the main domain and redirect the secondary domain via 301 to that specific page. As i understand I can do it via .htaccess using rewrite mechanism. http://www.seomoz.org/learn-seo/redirection But the question is does it mean I have to keep paying for the hosting for the secondary domain? Because htaccess has to be located on the web server so I would need a hosting plan for it? Is that true? Is there any way around it? P.S. to avoid any confusion - I am talking about hosting plan - not domain registration fees
Technical SEO | | SirMax0 -
301 redirect blog posts from old URL to new one
I moved a wordpress blog from domain.com to domain.com/blog . I want to redirect the links in google from the old domain.com to the new one, but I also want to put a new site/application at domain.com..so I'm thinking an .htaccess 301 redirect at the root wouldn't work. Any tips?
Technical SEO | | callmeed0 -
Domain authority not showing on root domain?
I was going through our site earlier w/ the mozBar (still learning the tools, new here) and saw the attached image. There were far more links to the subdomain (#s on the left) than the root domain (#s on right). This is strange to me, because we are not using any subdomains. All links point to either our root domain or subfolders off our root domain. Is this hurting our ranking for the root domain? Not sure what's up with this. Zz9j0.jpg
Technical SEO | | askotzko0 -
How to 301 multiple domain names to a single domain
Hey, I tried to find and answer to this seemingly simple question, but no luck. So, I have one domain name with a website attached to it. I also registered all the other domain names that are similar to it or have different extensions - I want to redirect all the other domain names to my one main domain name without getting penalised by the big G. It looks like this: www.mainsite.com - this is my main domain I also have www.mainsite.com.au, www.mainsite.org, and www.mainsite.org.au which I all want to just redirect to www.mainsite.com I have been told that the best way to do this is a 301 redirect, but to do that you need to make a CNAME for all the other domains that points to www.mainsite.com. My problem is that I cannot seem to create a CNAME record for http://mainsite.com - I have it working for http://www.mainsite.com but not the non www record. What should I be doing differently? Is it just my DNS provider is useless? Thanks, Anthony
Technical SEO | | Grenadi0