How to make google crawl our repository to make our site rank but make sure users dont go to our repository ?
-
We have a website that has links to documents related to various sectors. But the challenge is we do not have the documents on the website itself and they are linked to our document repository that has been blocked to google. We have put nofollow and noindex to the repository. Since Google can not read those documents, it has resulted in an impact in our SEO ranking. What would be the best way to make Google crawl the PDF documents in the repository at the same time make it invisible the "repo" not appear in the search engines. Would dofollow and noindex sequence work ?
-
Playing with indexation tags can be dangerous (same goes for robots.txt). Google should still be able to read the repo even if it is no-indexed, as long as you haven't also blocked the repo in robots.txt. Robots.txt is telling Google what to crawl, no-index is telling Google what it can or can-not put in its search results
Of course, if your docs were ranking because of PageRank passed from the repo, the no-index tag will kill the PageRank of the repo (and thus all the docs which it links to, as they are not being 'fed' any more). If a page is no-indexed, it's seen as unimportant for Google and the PageRank is often nullified. Although Google can crawl no-indexed URLs, they crawl them WAY slower as they're seen as really unimportant with no PageRank (at the bottom of the internet)
Why not just put all your PDF docs in a PDF sitemap ans submit to Google in Search Console:
https://stackoverflow.com/questions/1072880/should-i-list-pdfs-in-my-sitemap-file
This will let Google see them all. But if their parent is no-indexed with no PageRank, they may still not rank as well as before...
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Should you Move To HTTPS? Google Thinks So!
Just wanted to share some information that HTTPS is now a positive ranking factor. Here is an article about the fact that it can give a small boost in Rankings: http://searchengineland.com/explainer-googles-new-ssl-https-ranking-factor-works-200492 Here is also a video by Google Saying they think "every site should have a security certificate" and how to employ it. https://www.youtube.com/watch?v=cBhZ6S0PFCY People may already know about this; just thought it was important to share and couldn't find it thoroughly addressed anywhere on the site.
SEO Learn Center | | photoseo13 -
Best practice to consolidate two Google accounts
Hello, I have two Google accounts. Account1 is [email protected] - This account is used for Gmail, Blogger, Google Photo etc... Account2 is [email protected] - This account is where Adword, Google Analytics, Webmaster etc.. I'd like to know the SEO best practice and how to use these two accounts. I know that Google currently don't have account consolidation feature. What are my options to merge these two account? I already have the blogger site in GA and webmaster.
SEO Learn Center | | LCEComm0 -
I changed the {Site Name} of our domain by capitalizing a letter. 48 hours later our SEO rankings are bad. How long does it take to rebound our prior rankings. The {site name} was at the end of every page title.
I changed the {Site Name} of our domain slightly and capitalized a letter. The impact 48 hours later on SEO is really, really bad. How long does it take to recapture our prior rankings and should I change the site name back to the original? The {site name} was at the end of every page title. Thanks for any help/advice on this. We worked so hard to get our business on the first page for many keywords and "POOF" we are gone now.
SEO Learn Center | | LinckB0 -
SEO Stratergy for new ecom site
Hello Experts, I need expert advice for my ecom site. My site is www nsale dot in , domain is 2 years old, we just revamped the site. Its currently under testing. Dev activity will be complete in another 2-3 day and product addition will start in a week. we are targeting all major categories of product. I am not sure about how to start the SEO and social media marketing. Can someone help on how to plan and execute inorder to get targeted traffic and also steady increase in traffic ? Targetted traffic is India. PR is currently 0. Thanks in advance.
SEO Learn Center | | nsale0 -
How can I detect Google Webmaster tools without asking my client?
Hi Guys, I am running an audit for a client and one of the things I investigate is if they have a Google and BING webmaster tools . Also I am trying to detect if they have submitted any XML sitemaps. Is there a way for me to be able to detect these by making a simple search on google or not? Thank you Mozzers!
SEO Learn Center | | Ideas-Money-Art0 -
Best way to utilize an infographic...... do I have the makings of one?
I have read the REALLY great post on YouMoz about HOW to push an infographic but I wanted to throw this out for discussion: I operate an seo / Internet marketing company but I am also a partner in a party rental business here in Wichita. I have the material for a GREAT infographic (I think) a copy of our party rental yellow page ad with a tracking # in the ad (provided by yellowbook to see how many calls we receive every month) a report from yellowbook showing we received 277 calls in a YEAR from that ad a screenshot of Google analytics showing we received 16,000 visits during the same time period. (12k unique visits) 300 calls vs 12,000 unique visits Of those 12,000 contacts we had 3,700 of them get online quotes and provide their name, address, email and phone number. Yellow pages = 300 calls / 150-200 actual sales Internet = 12,000 unique visits, 3700 leads and ... ? ... probably 800 sales This proves in black and white right from yellowbook themselves what an AMAZING difference there is in the value of SEO vs old school phone book ads. Does this have the making of a good infograph? Can you see where this would be helpful to show potential clients? How would you use this to promote your business? Thanks for your thoughts and opinions. If this can help others I would be happy to share more specifics. Matthew
SEO Learn Center | | Mrupp440 -
For Newbies! | Matt Cutts on "How does Google use human raters in web search?"
I answer many questions here in Q&A. Instead of helping one individual, I thought this would help many newbies understand how Google uses human raters for web search. Watch Matt and learn why you should not SPAM or make sorry titles. http://youtu.be/nmo3z8pHX1E?hd=1 I hope this short video helps you! Leave a comment if you wish.
SEO Learn Center | | Francisco_Meza2 -
How do I get google to crawl white papers that displays a form for human visitors?
How do I get Google to crawl white papers that displays a form for human visitors? I have been looking into this and understand that I need to set the form up as a GET form which has been done. Google said they want you to "avoid" forms that require personal information but to what extent do they want you to do that? The form is used as a lead generator so we need to collect information such as name, company name, email, ect.The information we require currently is: Name, Company name, Email, Phone Number and Number of employees. Once a user puts in their information they have access to the rest of the content and they don't need to re-enter the information in so I assume once Google gets past this feature they can gain access to the rest of the content. I understand that I need to have a form that doesn't ask for personal information which is the dilemma. So what should we do to work around this? Is there a solution that will allow me to obtain some personal information while still allowing Google to crawl the pages? Thoughts and any feedback is much appreciated, TJ
SEO Learn Center | | SEO_com0