Some web 2.0 sites blocked by robot
-
I had created some web2.0 sites, google also indexed those sites but those sites robots.txt are disallow, this mean Google will not give any credit on ranking ? I have seen in google, those sites meta description was written - A description of this site is not available due to the robot.txt file. I checked that file, it is written disallow. Can google still count those sites for the ranking purpose ?
-
Hi,
Pages blocked by robots.txt file will not be considered for ranking. You still see those pages in Google's index is because of their mentions on other websites. Google has been doing link discovery from websites other than these Web2.0 sites of yours. So to stop Google completely from indexing these pages, you should go in for page-levelrobots meta tag. Here you go for more: https://support.google.com/webmasters/answer/93710?hl=en
Once you implement the page-level robots meta tag to block those pages, Google will remove them from the index after the next crawl. You can expedite this process by using the link removal procedure in webmaster tools account.
Here you go for more: https://support.google.com/websearch/troubleshooter/3111061?rd=1
Good Luck to you my friend.
Best regards,
Devanur Rafi
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Can piracy sites linking to you hurt your SEO?
Hello, Our website sells software that we have developed, but there are piracy websites that offer a crack/keygen to our software and are linking to our site. From an SEO perspective, are those sites hurtful to us if their spam score is below 30 and their DA is not 1? We'd like to understand if there is any action we need to take from an SEO point or if our site's SEO is not affected by it. Thank you!
Link Building | | marynau0 -
Do you know worthy web directories
Does somebody know editorial web directories where it is still worth posting your link (like Dmoz)?
Link Building | | MichaelJanik0 -
Will our website traffic be adversely affected by Google by allowiing other sites to post our content on their sites?
Hi, We're a radio station posting original content each day. We belong to a sector of similar radio stations. It's been proposed that we all contribute content to this group
Link Building | | Hope-Media
so any radio station can grab this content and post it on their own websites. As the site with the most content and web traffic, could this potentially harm us?1 -
Linking to sites that link to porn or casinos, my site getting penalized?
I have some link exchanges with some sites to get web traffic but when i ran the bad neighborhood link checker, i found that one site links to some casinos and another site has one link to a porn site. Is this getting me penalized? should i remove the links to these sites? Thanks, Ron
Link Building | | Ron100 -
Open Site Explorer
Open Site Explorer has a link profile for my web page twice. pensacolarealestate.com and www.pensacolarealestate.com/ I don't know if I am getting the link juice from the weaker of the two (pensacolarealestate.com). If I am not, I desperately need it. I am ranked 3rd on my SERP which I have always ranked 1st. I need to go back to one asap. Please help me guys 🙂 I need as much of an explanation to accomplish my goal as you can muster! Get this solved and I will be a subscriber after my free period (lol).
Link Building | | JML11790 -
Are link exchanges bad for SEO these days? Also, is adding my site to free yet relevent directory sites a bad idea?
I operate a computer services company in Eugene, Oregon called "Eugene Computer Geeks". We do a lot of web design, and need incoming links to my site very badly. Lately I've been asking clients if they would link to me, but they almost always ask for a link in return. If we exchange links, does Google penalize my site? Would the incoming link be better for SEO if I'm not linking back to the other site? ALSO Is it possible that manually submitting my site to free, yet relevant web directories would hurt my rankings? It's not a big deal to me if it doesn't help my rankings, as I see a benefit to having my site listed, but wanted to make sure there wasn't a chance that it would hurt my rankings. As far as I know all the directories are free from SPAM, porn, warez, or anything like that. Thanks!
Link Building | | eugenecomputergeeks0 -
List of links pointing out of my site?
What is the best way to produce a list of links pointing out of my site and the web page they appear on?
Link Building | | MiroAsh0 -
Best Way to Analyse Linking Structure of My Site
My site http://www.taxproblem.org is now undergoing many changes due to bad report card scores from this site. I've had people tell me that my linking structure was obviously artificial, especially if most of my links are from "Mr. Wong - social site" O.K. stop laughing 🙂 Yes we use bookmarking demon and rss feed wp plug ins, etc. But haven't discovered how to best get links yet, although reading a lot and waiting on seomoz's DVD's I ordered. 1. What is the best way to analyse our sites linking structure to determine if Google will consider it bad (my site was trashed by Google twice in the last two years) probably for link farms and the like. I know the obvious, but I was looking for a program with guidelines to judge by. 2. The best source to review the many strategies for getting back links so I am not a victim of rehashed b/s based on someones fears of Google, but actually good methods that work. We offer something of value. (CPA firm doing IRS rep. and we have a free download so people can do their own IRS rep and save thousands, and know it's done right) I need to know the bast way to market this. I need good souces for info and for keeping up. Thanks in advance to all that can help.
Link Building | | joemas990