Some web 2.0 sites blocked by robot
-
I had created some web2.0 sites, google also indexed those sites but those sites robots.txt are disallow, this mean Google will not give any credit on ranking ? I have seen in google, those sites meta description was written - A description of this site is not available due to the robot.txt file. I checked that file, it is written disallow. Can google still count those sites for the ranking purpose ?
-
Hi,
Pages blocked by robots.txt file will not be considered for ranking. You still see those pages in Google's index is because of their mentions on other websites. Google has been doing link discovery from websites other than these Web2.0 sites of yours. So to stop Google completely from indexing these pages, you should go in for page-levelrobots meta tag. Here you go for more: https://support.google.com/webmasters/answer/93710?hl=en
Once you implement the page-level robots meta tag to block those pages, Google will remove them from the index after the next crawl. You can expedite this process by using the link removal procedure in webmaster tools account.
Here you go for more: https://support.google.com/websearch/troubleshooter/3111061?rd=1
Good Luck to you my friend.
Best regards,
Devanur Rafi
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
What you think is thje best way to build links for my site?
I heard different opinions all over the web, some people said don't do 100% just anchor texts with the keywords you want to rank with, and they suggest 60% brand anchor text and the rest for the keywords i want to rank for. what do you guys suggest?
Link Building | | arango200 -
Do links from such sites as TripAdvisor give any weight or support for SEO
And what about other sites like quora or other niche forums/blogs where one might leave answers, with a link to their profile, which has a link back to the owner's website? _Cindy
Link Building | | cceebar1 -
Instructables site - follow and nofollow
Hi, I haven't been able to find a clear answer to this issue yet, so I'm posting here for help. I have just created a profile on the site Instructables - http://www.instructables.com/ as well as an article. The issue is that I could find most of the published articles there have follow links in them - e.g links under materials: http://www.instructables.com/id/How-to-Make-a-Reclaimed-Industrial-Coffee-Table/ - however mine is attributed nofollow links. I simply don't know why this is or if there is a way around it to get the links followed. This question only relates to the links in the articles, not the profile links - which are followed. Anybody knows? Thanks, Alex
Link Building | | alexddseo0 -
Are these sites spammy links or should I just let it go?
I have a new client who had an old SEO firm that I believe was putting spammy links together for them. The firm has very good links mixed in with them so I am wondering if it even matters. They are ranked 4/10 and have a DA of 47. So it doesn't seem it is really hurting them too badly. Below are some examples of some of the sites I found in the Open SIte Explorer. I wanted to get another opinion on if the below hurt/help/does nothing. I was thinking it hurts more than helps. Topic of his website is a marketing firm. http://directoryol.com/united-states/page-17.html http://360surfcamp.com/links-37 http://www.kdbx.rojo.jp/kdbx/index.cgi?action=kategorie&k_no=1&mk_no=0&page=10681 Thoughts? Should we use Google's disavow tool or just leave it alone?
Link Building | | blackrino0 -
Host a wordpress blog as a folder or external site?
I've been speaking to our developers as I want to introduce a blog. My intention is to host the blog as part of our existing site, so the url becomes www.example.com/blog I have a personal wordpress blog and I love it, the amount of plugins, themes and ease of use makes it a fantastic platform. I spoke to my developers and requested if they could install Wordpress within a folder of our existing website. This gives me control to do plugins, custom themes etc. Straight forward I thought, but I didn't get a straight forward reply. They went on that it would require two linux php servers, a load balancer between them, and set up and configuration would take 5 days. Their day rates are high, so 5 days is a lot of money. This got me thinking, what if I hosted it externally and linked from our website, so the blog URL would be www.myblog.com This gives me the power to have a wordpress blog for cheap and use all the fantasic plugins to optimise the site (Yoast, Schema plugins etc). I know for SEO, it's better to host it as part of your existing site, the ranking juice remains in your area and it further helps strengthen the site. But then i'm thinking, if the wordpress stand alone blog works out, it will end up being a great external linker, further boosting my existing site's presense. Have any of you faced any similar problems? Thoughts?
Link Building | | Bio-RadAbs0 -
What benefit does a site with a low DA get from someone guest posting who links to a site with a high DA?
I'm relatively new to link building and although this may be an obvious question I can't seem to find an answer anywhere even after searching Google.
Link Building | | JoshED0 -
Please have a look at the SEO of our site
Hi, Could you look at nlpca(dot)com and give me feedback and hints about the on -page SEO of our site, as well as any suggestions of link building strategies to move us up to first for the head term "NLP" as well as the long tail Thank you, Bob
Link Building | | BobGW0
