Some web 2.0 sites blocked by robot
-
I had created some web2.0 sites, google also indexed those sites but those sites robots.txt are disallow, this mean Google will not give any credit on ranking ? I have seen in google, those sites meta description was written - A description of this site is not available due to the robot.txt file. I checked that file, it is written disallow. Can google still count those sites for the ranking purpose ?
-
Hi,
Pages blocked by robots.txt file will not be considered for ranking. You still see those pages in Google's index is because of their mentions on other websites. Google has been doing link discovery from websites other than these Web2.0 sites of yours. So to stop Google completely from indexing these pages, you should go in for page-levelrobots meta tag. Here you go for more: https://support.google.com/webmasters/answer/93710?hl=en
Once you implement the page-level robots meta tag to block those pages, Google will remove them from the index after the next crawl. You can expedite this process by using the link removal procedure in webmaster tools account.
Here you go for more: https://support.google.com/websearch/troubleshooter/3111061?rd=1
Good Luck to you my friend.
Best regards,
Devanur Rafi
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
External links - link to third party sites
Greetings! Actually, got an doubt on linking to external site. The thing, i have working for roof marketers site. They have covered roof products. Each of the products have a page along with major keyword. Actually, i do link from other pages[internally]. Meaning,if i see any main keywords in different page then will link that to corresponding page/product[internally].This is what i am doing to get page rank. Now, my doubt. Some of the pages are having link with main keywords which directs to the third party site those who are really producing the products. But, i remove the third party-link which has with main keywords. Since already the site/my client site having pages for that main keywords. But client really want that link. meaning the links which they have given to direct to third party[product producer] site. So what should i do at this case. Can i just past RAW link like [http://www.thirdpartysite.com] or what do i do. But my client wants that link to be in content area. Hope you would understand my long explanation and case Please help us. Thank you
Link Building | | Webworld_Norway0 -
Directory listing and open site explorer
As per my previous post regarding my new client. I am dissecting all the previous seo companies docs and basically there are hundreds of directory listings on paper however site explorer does not show any. my question is this does site explorer not list directories site or are they worthless?
Link Building | | Shuffled0 -
Someone not removing a link to our site
Hi Mozzers, We recently worked with an SEO company that bought a few sitewide links without our permission which caused us to get a huge slap by the last panda/penguin update. We managed to remove most of the links except one site (The biggest one).
Link Building | | Ouzan
He simply doesn't reply to our emails etc... What should I do in such case? Thanks.0 -
Link Buildinf for new sites
Hello friends, I would like to know what link building strategies you recommend for a newly created websites? Thanks a lot!
Link Building | | pasape0 -
Adding a directory and aggregated content to my ecommerce site
I'd like to add a directory of websites to my ecommerce site. We operate within a nice niche both in terms of products and demographics. The directory would be specific to our verifical and market. My concern is how Google will see these external links. A reciprocal link won't be required to be in our directory, but I suspect many sites would like back to us as we outreach to them with content ideas, their directory links, and as we share them with our social network on twitter and facebook. The directory would be broken down into categories so each page may have 1-20 external links on it. Our architecture already incldes category links (all internal) so these would be in additional the links you would normally see on our site. I'd also like to aggregate some content - again, mostly external links. Will Google have take poorly to that aggregation?
Link Building | | DenverKelly0 -
1 million links can harm your site?
I have a client that bought a link for his site on a non related site with the anchor text for main KW. That site brought over 1 million links to my client's site. Now what should i do? Should i let the link there? Or should i remove it? The age of the link is more than 1 year, and the link is placed in top menu, under the header.
Link Building | | maldiniii0 -
One client, one b2b site and one b2c site - linking relationship
I have a client that has 2 websites in a particular industry. The first website concentrates on advertising services and products to other organisations/companies but does not sell anything online. The second website is an ecommerce site with many products from the same industry and is more a b2c operation. Would it be considered ok to add maybe 5 footer links from one to the other and vice versa? considering that they are footer links and will ultimately increase total links pointing to both site exponentially. Both sites are hosted in the same location.
Link Building | | Gareth_Cartman0 -
Is there way to identify all back links throughout a site or do I have to check one site page at a time? Thanks!
Sorry if it is obvious, but I can't seem to figure it out. I'd like to be able to run a report that will list all of the back links on every page of my site.
Link Building | | TRCCommunications0