How to make google crawl our repository to make our site rank but make sure users dont go to our repository ?
-
We have a website that has links to documents related to various sectors. But the challenge is we do not have the documents on the website itself and they are linked to our document repository that has been blocked to google. We have put nofollow and noindex to the repository. Since Google can not read those documents, it has resulted in an impact in our SEO ranking. What would be the best way to make Google crawl the PDF documents in the repository at the same time make it invisible the "repo" not appear in the search engines. Would dofollow and noindex sequence work ?
-
Playing with indexation tags can be dangerous (same goes for robots.txt). Google should still be able to read the repo even if it is no-indexed, as long as you haven't also blocked the repo in robots.txt. Robots.txt is telling Google what to crawl, no-index is telling Google what it can or can-not put in its search results
Of course, if your docs were ranking because of PageRank passed from the repo, the no-index tag will kill the PageRank of the repo (and thus all the docs which it links to, as they are not being 'fed' any more). If a page is no-indexed, it's seen as unimportant for Google and the PageRank is often nullified. Although Google can crawl no-indexed URLs, they crawl them WAY slower as they're seen as really unimportant with no PageRank (at the bottom of the internet)
Why not just put all your PDF docs in a PDF sitemap ans submit to Google in Search Console:
https://stackoverflow.com/questions/1072880/should-i-list-pdfs-in-my-sitemap-file
This will let Google see them all. But if their parent is no-indexed with no PageRank, they may still not rank as well as before...
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Can you check my Quran site and its technical issues?
Hi, Hope you are doing good, I saw many Quran websites working fine. I have a blog that has online Quran classes of Arabic and Tajweed related courses as well. Can you please check that if all is okay in terms of technical issues? Here is the website: https://learnquran.academy
SEO Learn Center | | ShirleyLemons0 -
Is The Moz Community Rankings broken?
Not as active as I would have liked recently but still visit and login, answering a question now and again, yet I can see my profile is still listed as unranked. until recently I was somewhere around 45-49 and have been for many years - the criteria appears to be what it has for the last ten years or so. I see people with lower moz points outranking members with far more points. I can even see one with 0 points now appearing in the top 50 so my question is - is the moz community rankings broken or have I missed something? I know once before I pointed it out and it had to be fixed...input from all welcome 🙂
SEO Learn Center | | Matt-Williamson2 -
Backlink From Different Language Sites Will Spoil My Ranking?
Hi there! Excited to joining this community. The main question is that if I get backlinks from different language sites then that backlink will be worthy or non-worthy in the eye of search engine? I know if I target international market by presenting my content in different languages then of course it will be worthwhile for me. But what will be happened if I do not represent content in different languages on my site but get the backlines from other language sites such as: Chinese, Russian or any other? Also I have seen many sites which are getting backlinks from different language sites and they are just getting high authority. Is there any expert?
SEO Learn Center | | mianarfan3331 -
Google Analytics setup tips and tricks?
I want to see (and possibly compile) other marketers tips and tricks when it came to setting up their Google Analytics. I feel like I sometimes get into a rut when I setup GA for clients and I want to make sure that I'm not getting rusty with it. Some of the things I'm interested in (but not limited to): How do you use dashboards? What funnels do you setup? How do you utilize goals? What are your favorite metrics to report to clients? What are the top items on your checklist when setting up GA? And many others I could include here... I'd be interested in seeing what other marketers include in their GA setup and reporting. These can be super simple or expert level tips and tricks. It's a personal curiosity I have so that I make sure I'm staying up to date with everything but if there is enough participation I will compile everything into a YouMoz post or something as a guide for us to use and share. So please share this question with others if you can. Thanks!
SEO Learn Center | | HashtagJeff2 -
What should I place in the code to connect my html 5 website to Facebook, Google+ etc...?
I know most people use a CMS these days but I created a html 5 website for my small business using Dreamweaver. I'd like to know what, if anything, I should place in the code to link my website with my social media accounts like Facebook, Google+, Twitter, and Pinterest? I've found information about plugins that are useful if you're using a CMS but I'm not. I placed social media buttons on all of the pages of my website already, and when you click on those buttons they go to my social media accounts. But is there anything that should be placed in the code? Thanks for your help
SEO Learn Center | | Ophelia6190 -
Site for my clients to log in and see their traffic, etc.
I have done a ton of research and I am struggling to find an easy to use, easy to understand site / tool that will allow my clients to log in and see basic information about their website traffic, rankings, referring sites, etc. in an ATTRACTIVE, EASY TO UNDERSTAND layout. Any suggestions would be greatly appreciated! Seomoz (my true favorite) Raven, webceo, and so many others are powerful tools - I don't need that, just looking for an attractive place to log in and view their stats, that's it. Thank you - have a great rest of the week! Matthew
SEO Learn Center | | Mrupp440 -
Why did one of our keyword score an F but is first place on Google search? The key word is "Barista Classes Los Angeles"
We're working with an SEO company that provides monthly details on what keywords have improved and needs work. One of our keyowords (Barista Classes Los Angeles) climbed up to number one on Google's search box. However, on SEO Moz, the same keyword got an "F" under the On-Page category. Can someone help us out and define why this is happening? This way, we can adjust and see how we can improve. Thanks!
SEO Learn Center | | ckroaster0 -
Machine Learning - Randomness in Search Engine Ranking Algorithms
I believe, sometimes you may 'deserve' the first position, but get #3. And of course, sometimes you may deserve #3 and instead be #1. All due to a 'randomness factor' in search engine algorithms. I've been holding this hypothesis for quite sometime. Really, it started when I learned about SEOmoz using machine learning to better investigate SEO best practices. I suddenly found myself wanting to learn more about machine learning, and the implications of using it for SEO. I'm by no means able to utilize machine learning myself, but I it appears unsupervised learning would have a real chance of cracking search engine algorithms. Hey, even Stuxnet was cracked! Surely Google/ Bing would know (and account for) this, right? We can agree they'd obviously prefer a highly skilled mathematician not be able to crack the code. Therefore, I'm led to believe that search engines use some sort of randomness in their rankings. Maybe not much. Perhaps not all the time. But if a random percentage of search results, had a random variable of sorts included in their calculations... wouldn't that be enough to prevent the vast majority of cracking attempts? Thoughts, opinions, criticism? Thanks.
SEO Learn Center | | DonnieCooper0