Some web 2.0 sites blocked by robot
-
I had created some web2.0 sites, google also indexed those sites but those sites robots.txt are disallow, this mean Google will not give any credit on ranking ? I have seen in google, those sites meta description was written - A description of this site is not available due to the robot.txt file. I checked that file, it is written disallow. Can google still count those sites for the ranking purpose ?
-
Hi,
Pages blocked by robots.txt file will not be considered for ranking. You still see those pages in Google's index is because of their mentions on other websites. Google has been doing link discovery from websites other than these Web2.0 sites of yours. So to stop Google completely from indexing these pages, you should go in for page-levelrobots meta tag. Here you go for more: https://support.google.com/webmasters/answer/93710?hl=en
Once you implement the page-level robots meta tag to block those pages, Google will remove them from the index after the next crawl. You can expedite this process by using the link removal procedure in webmaster tools account.
Here you go for more: https://support.google.com/websearch/troubleshooter/3111061?rd=1
Good Luck to you my friend.
Best regards,
Devanur Rafi
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
My All Site Spam Score Increase 0 To 72
I am having 7-8 Sites there were no spam score on my sites before today, But Now When I Logged in today I got that there is lots of spam score on my all sites, and I did not do nothing like spammy content, or get spammy links. Why This Increased? Can anybody here Describe it.
Link Building | | Nishantkumarss0 -
Iframed data on external sites
Hi all, I am looking to create som widgets for external sites with some of my data, off course with links to my site. But if i make a php file with some content, and another site iframes that php file, would I get link juice from this? If not, any suggestions to how i could get my data on to another site AND get the juice? -Rasmus
Link Building | | rasmusbang0 -
When does Google Webmaster update your links to site??
Hi everyone We removed a load of links from a site over 2 months ago but they still show in Google webmaster tools. I understand Google will not be reading this links as they were removed so long ago. However I just was interested when Google might update these as not showing as linking to us anymore. I like to try and keep things tidy and its a bit frustrating it would be good to be 100% sure what Google is counting at any given time. Cheers James
Link Building | | tempowebdesign0 -
Guest Posts on Sites With Irrelevant Outbound Links
Suppose you came across a website in your niche with solid domain authority that accepts guest posts. However you notice some of the guest posts are linking out to somewhat off-topic sites. If you already have an article that you think would be accepted easily and all you have to do is spend 10 minutes to craft an email pitch, would you do it? Why?
Link Building | | ProjectLabs0 -
New PDF Guide. On My site or linked by blogs?
Hi experts, I created a new worth guide about food. Its purpose it to improve backlink by adding website's URL on PDF's footer (spider crawls that one, is it true?). I want send my guide to trusted blogs so users can download new pdf guide on the web. Is it the best way to gain popularity and let my backlinks grow? I've seen that seomoz published is guide such as html pages.
Link Building | | Greenman
Could it be the worth way for me? Thanks a bunch in advance! G.0 -
Getting into DMOZ for my coaching site
Hello, Before I submit to DMOZ, I'm wondering if my site is one that would get indexed: www.bobweikel.com Also, if you have any hints beyond what I can read at DMOZ I'd really appreciate it. I don't want to submit and then after several months get rejected.
Link Building | | BobGW0 -
Links per Site vs. Domain Authority
Here's a quaint one: 1. Posting follow links on another site helps increase one's domain authority. 2. If I post to the same site/forum with followed links each week, would my domain authority reap a domain authority increase benefit? In short, is there any domain authority benefit to continually post links to a site to which I've already posted a follow link?
Link Building | | GreenCupboards0 -
When rebuilding a site, when should you start building links?
We are in the process of completely rebuilding our web presence. We went ahead and started a blog using Hubspot while we are redesigning everything and writing all new content. The new site will be live in early August. The question is when do we start making a big push with Linkbuilding? I am currently trying to promote the Blog but I'm wondering about linkbuilding for the rest of the site? Do we wait until the new site is live or do we start doing it now? The new site will be completely different from the old site?
Link Building | | emcadoo0