How to make google crawl our repository to make our site rank but make sure users dont go to our repository ?
-
We have a website that has links to documents related to various sectors. But the challenge is we do not have the documents on the website itself and they are linked to our document repository that has been blocked to google. We have put nofollow and noindex to the repository. Since Google can not read those documents, it has resulted in an impact in our SEO ranking. What would be the best way to make Google crawl the PDF documents in the repository at the same time make it invisible the "repo" not appear in the search engines. Would dofollow and noindex sequence work ?
-
Playing with indexation tags can be dangerous (same goes for robots.txt). Google should still be able to read the repo even if it is no-indexed, as long as you haven't also blocked the repo in robots.txt. Robots.txt is telling Google what to crawl, no-index is telling Google what it can or can-not put in its search results
Of course, if your docs were ranking because of PageRank passed from the repo, the no-index tag will kill the PageRank of the repo (and thus all the docs which it links to, as they are not being 'fed' any more). If a page is no-indexed, it's seen as unimportant for Google and the PageRank is often nullified. Although Google can crawl no-indexed URLs, they crawl them WAY slower as they're seen as really unimportant with no PageRank (at the bottom of the internet)
Why not just put all your PDF docs in a PDF sitemap ans submit to Google in Search Console:
https://stackoverflow.com/questions/1072880/should-i-list-pdfs-in-my-sitemap-file
This will let Google see them all. But if their parent is no-indexed with no PageRank, they may still not rank as well as before...
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Backlink From Different Language Sites Will Spoil My Ranking?
Hi there! Excited to joining this community. The main question is that if I get backlinks from different language sites then that backlink will be worthy or non-worthy in the eye of search engine? I know if I target international market by presenting my content in different languages then of course it will be worthwhile for me. But what will be happened if I do not represent content in different languages on my site but get the backlines from other language sites such as: Chinese, Russian or any other? Also I have seen many sites which are getting backlinks from different language sites and they are just getting high authority. Is there any expert?
SEO Learn Center | | mianarfan3331 -
Google AdWords Grant Samples?
Can anyone direct us to an actual sample of the 500 word essay required and a list of all the documents required once the client is accepted as a Google for nonprofit community member? Thanks, Jim
SEO Learn Center | | jimmyzig0 -
What keywords will this page possibly rank for ... tool?
Hi all, I'm looking for a tool that will look at a web page that you submit to it and tell you what keywords it thinks the page is targetted towards and thus hopefully rank for. Does anyone have any suggestions please? Hopefully this type of tool will help us understand why page A is being ranked for keyword X when page B is actually the page that should be being ranked for that keyword. The only tool I have really found so far is http://www.ranks.nl/tools/spider.html I dont want to tell the tool what keywords I am looking at, as with Moz On page grader. Background reason (and possibly some one maybe able to shed some light on this also). We list a group of products... Nextbase Click 9 Lite, Nextbase Click 9 Lite Duo and Nextbase Click 9 Lite Duo Deluxe. All 3 are similar but very different products and each has its own page on our site. For the keyphrase "Nextbase click 9 lite" currently in Google we are listed for the pages containing the "Nextbase Click 9 Lite Duo" and "Nextbase Click 9 Lite Duo Deluxe"... but not the actual specific product page that targets the "Nextbase Click 9 Lite" product. Thus my reason for wanting to try such a tool that may help me understand why this is. Thanks for any hints, tips or pointers.
SEO Learn Center | | jasef0 -
Why did one of our keyword score an F but is first place on Google search? The key word is "Barista Classes Los Angeles"
We're working with an SEO company that provides monthly details on what keywords have improved and needs work. One of our keyowords (Barista Classes Los Angeles) climbed up to number one on Google's search box. However, on SEO Moz, the same keyword got an "F" under the On-Page category. Can someone help us out and define why this is happening? This way, we can adjust and see how we can improve. Thanks!
SEO Learn Center | | ckroaster0 -
Google's weighting of Page Load speed
Hey, we recently optimised our website page load speed as part of our overall optimisation. Page load speed according to the Google Developers Page Speed test was previously 51 out of 100 and is now 92 out of 100 and this was improved within the last seven days gradually, cached half way through the improvement process. I appreciate this is regarded as only a small part of the whole process, however, I’d be interested to know if anyone has a concrete opinion/proof on whether such a big improvement would actually make a difference to our rankings in the SERPs.
SEO Learn Center | | tdsnet0 -
Location of Rand's Webinar "Using Open Site Explorer to Uncover New Marketing Opportunities"
Aug 26th Archive of Rand's Webinar "Using Open Site Explorer to Uncover New Marketing Opportunities" I don't see this in the archive, anyone know how to get it? Thanks
SEO Learn Center | | josey0 -
Subdomain Structure vs Top Level Domain Site; An Actual Case
A major non-profit with 360 locations just completed a new program. The non-profit has updated its site at URL www.mysite.com. Each of the 360 locations has a subdomain site with URL http://mylocation.mysite.com which reflects the branding of www.mysite.com and has a Drupal content management system. The company is asking each location to transition the top level domain of each location ( example www.mysite.com to http://mylocation.mysite.com). The subdomain location sites are tied to a CRM system, which initially hasn't worked. But the long term objective is to gather CRM data via the subdomain location sites. The main site has an Alexa Global Rank of 30,400 and a US Rank of 7900. The main site has 2600 backlinks, and is a pretty powerful site. Some individual locations in large metropolitan areas have decent backlinks, but most don't. The PR of most local sites is 3 to 6. The SEO experts at www.mysite.com have maintained that the power and authority of the main site www.mysite.com would propel the local rank of each location to a position of high visibility. Using Market Samuari and Majestic SEO, a test on each of the 360 location subdomains was performed. It was determined that Page Rank did pass from the main site to the local site in 15% of the cases. However, 85% of the subdomain sites had 0 Page Rank. Page Rank did vary from 2 to 5 on the 15% that passed rank, but there was no cross checking to see if the subdomain location had the same page rank as the locations top level domain. Referring Domains Domain (RDD) was usually -1; Referring Domains Page (RDP) was usually 0; Page Backlinks (BLP) was usually 0; Back Links to Domain (BLD) was usually 0; Google Cache age was all over the map from unknown to 58 days. Questions: Anyone suspect why some sites pass Page Rank and others don't; Should we continue on the path towards using the subdomain sites, or should each location keep its top level site and work on improving their local search visibility there? There is no way to check Google Analytics (GA) on the subdomain sites without having to access GA on the main site www.mysite.com. Right? Will Google Places and Bing Local honor the subdomain URLs for their respective Local Search pages. Would there be a compelling reason or reasons to abandon the subdomain sites? Thanks much for your comments!!
SEO Learn Center | | VernonWanner0