Some web 2.0 sites blocked by robot
-
I had created some web2.0 sites, google also indexed those sites but those sites robots.txt are disallow, this mean Google will not give any credit on ranking ? I have seen in google, those sites meta description was written - A description of this site is not available due to the robot.txt file. I checked that file, it is written disallow. Can google still count those sites for the ranking purpose ?
-
Hi,
Pages blocked by robots.txt file will not be considered for ranking. You still see those pages in Google's index is because of their mentions on other websites. Google has been doing link discovery from websites other than these Web2.0 sites of yours. So to stop Google completely from indexing these pages, you should go in for page-levelrobots meta tag. Here you go for more: https://support.google.com/webmasters/answer/93710?hl=en
Once you implement the page-level robots meta tag to block those pages, Google will remove them from the index after the next crawl. You can expedite this process by using the link removal procedure in webmaster tools account.
Here you go for more: https://support.google.com/websearch/troubleshooter/3111061?rd=1
Good Luck to you my friend.
Best regards,
Devanur Rafi
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Spammer sites brining my DA score down
A disgruntled web developer registered my domain with a dozen spammer sites, so my score plummeted. Is there a way to get these removed?
Link Building | | generuble0 -
Linking back to a high authority site
I have an odd situation. One of our most powerful links comes from a not-for-profit whom we have an advertisement with. That ad gets us half of our business. Recently, they slipped for the term that got them the traffic that flowed to our site. I was thinking of linking back to that page to boost them up a bit. Their page is a deep page on a high authority domain with only a few links. I am an authority site for my niche. I'd like to boost them up without diminishing my rank for other related terms. I'm willing to consider linking to them from my homepage, blog or link page. To play it safe I could just link build to them from outside my domain. Can I just link to them and its not a big deal?
Link Building | | JDP0 -
Pagerank 0 vs Page Authority 53....?
I sometimes see sites with PageRank 0 but Page Authority 50+. For instance http://auto.beginthier.nl/: PageAuthority = 53
Link Building | | PrizeWize
mozRank = 4,64
mozTrust = 5,69
Root domain links = 42
PageRank = 0 How should i interpret these stats? If or instance i'm optimizing for a car related website (a site about: car parts, car insurrance, classic cars), would these be a good place or a bad place to get links from (ignoring the benefits of direct traffic)? PA = 53 (very good) Vs. PR = 0 (very bad)?0 -
PR web anchor text
We are submitting a press release today for a contest we are doing and it is actually news worth compared to a lot of things on PR web. Our question is PRweb.com still worth using? If we use them should we put an anchor text in it? We have one link to our home page and one to the contest page and we were going to have one link to a different page. But will linking to the third page with an anchor text be to much?
Link Building | | DoRM0 -
Open Site explorer shifting results - which to trust and not to trust?
I was doing a search on Open Site Explorer, comparing my site with competitors in the field. When looking under the Page Specific Metrics tab I first got the results that I had no internal links whatsoever, and 8 external links in total. I had a page authority of 34, and so on. Then I saw it suggested that my domain was redirecting to www.mydomain.com/ (a slash at the end), even though this is wrong. But I clicked the "see this url instead" and now the results changed a lot. It now shows that I have 72 internal links, and 6 external links. And also a lower page authority of 28. Now you might say it is because I changed the url to the one with a slash, but I changed back to the one without a slash (and now I don't get the message about the redirect). What's up with open site explorer? What results should I trust?
Link Building | | danielpett0 -
How to Earn Links to Boring Pages on Your Site
We do great in earning links to our homepage, articles, linkbait, and resource pages but we get few links to our product pages which are honestly pretty boring. Do you have any advice for increasing links to these important "money" pages? (we are trying to add useful content to make them less boring and unremarkable)
Link Building | | ProjectLabs0 -
When rebuilding a site, when should you start building links?
We are in the process of completely rebuilding our web presence. We went ahead and started a blog using Hubspot while we are redesigning everything and writing all new content. The new site will be live in early August. The question is when do we start making a big push with Linkbuilding? I am currently trying to promote the Blog but I'm wondering about linkbuilding for the rest of the site? Do we wait until the new site is live or do we start doing it now? The new site will be completely different from the old site?
Link Building | | emcadoo0 -
How do you find out what (and when) new websites are linking to your site?
I may be missing the obvious here, but is there any way (a programme or site) of seeing what new links come into your site? Obviously as anyone who works in SEO, I like to see which links we have got with the work we put in contacting webmasters, etc. But is there a better way than just manually looking through ALL the links? Any help will appreciated.
Link Building | | Weerdboil0