Working around Dev Site
-
I am working around development site. All pages are 'nofollow'. What can I advice on, when it come to SEO and is there any good article or checklist that I can go through.
One thing I wanted to know is how can I check for broken links or meta data or any other SEO analytics if the page is 'nofollow' and I cannot crawl it with screaming frog or any other tools.
-
As for an SEO checklist, I'd suggest the Web Developer's Cheat Sheet. It's a good idea to read the Beginner's Guide to SEO, too.
-
Hi George,
Maybe in addition to that make sure you have to enter HTTP Authentication to make sure that none of the pages on the domain are being crawled. Besides that I would indeed go with the recommendation from Lynn.
-
HI,
For screaming frog there is an option in the config -> spider menu that says 'follow internal nofollow'. Checking that box should allow you to crawl the site.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How much SEO damage would it do having a subdomain site rather directory site?
Hi all! With a coleague we were arguing about what is better: Having a subdomain or a directory.
Intermediate & Advanced SEO | | Gaston Riera
Let me explain some more, this is about the cases: Having a multi-language site: Where en.domain.com or es.domain.com rather than domain.com/en/ or domain.com/es/ Having a Mobile and desktop version: m.domain.com or domain.com rather than domain.com/m or just domain.com. Having multiple location websites, you might figure. The dicussion started with me saying: Its better to have a directory site.
And my coleague said: Its better to have a subdomain site. Some of the reasons that he said is that big companies (such as wordpress) are doing that. And that's better for the business.
My reasons are fully based on this post from Rand Fishkin: Subdomains vs. Subfolders, Rel Canonical vs. 301, and How to Structure Links for SEO - Whiteboard Friday So, what does the community have to say about this?
Who should win this argue? GR.0 -
Has this site been a victim of negative seo?
The rankings for our client's site - www.yourlifeprotected.co.uk fell off the face of the earth back in June. Despite trying a huge number of things to try and help the site recover, we've seen no real positive improvements since then. Examples of things we have tried: Disavowed & manually removed poor quality Links Removed any internal Duplicate Content Removed any broken links Re-written all website content to ensure unique & high quality No-Followed all outbound links Added any missing title tags changed hosting Rewritten content to ensure no duplication internally or externally The most recent issue we've picked up is that some highly spammy sites seem to have copied extracts of text from the website and hidden them in their pages. This is a rather puzzling one, as there aren't backlinks, pointing to our site - just the copy. For example - Cancer Page and Diabetes Page.It feels very much as though this could be a negative SEO attack which could be responsible for the drop in rankings and traffic the site has experienced. If this is the case, what can we do about it?! Having already re-written the copy on the site, we obviously dont want to do this again unnecessarily - especially if this could just happen again in future! Any help or advice would be hugely appreciated.
Intermediate & Advanced SEO | | Digirank0 -
Why Did My Site Go Limp On Me?
One of my clients was once in the #1 position for "Philadelphia interior designer" and other related terms, but her site has dropped significantly. Still it is on the first page, but far from its former glory. http://www.interiorsbydonnahoffman.com is the site. What really confuses me is why in her home turf search of "Bucks County Interior Designer" a competitor, http://www.miriamansellinteriors.com, is above her in the SERPS. According to OSE her competitor has a PA of 32 vs my client's 39. My client has 35 Linking Root Domains (and some of high quality) compared to just 11 for the competition. In all aspects her competitor looks weaker and less relevant to me. Her site has been weak in the SERPs since May/June. We are redesigning her site- she has a high bounce rate compared to my other interior design clients, something like 55%. Any insights from y'all?
Intermediate & Advanced SEO | | dfhytrwy0 -
Development site crawled
We just found out our password protected development site has been crawled. We are worried about duplicate content - what are the best steps to take to correct this beyond adding to robots.txt?
Intermediate & Advanced SEO | | EileenCleary0 -
Any SEO suggestions for my site?
Site in question: http://bit.ly/Lcspfp Does anyone have any suggestions for any on-site SEO that would benefit my website? Any recommendations, big or small are appreciated.
Intermediate & Advanced SEO | | RichardTaylor1 -
Critique My Site For SEO
Hi Everyone, I was wondering if someone might critique my site and let me know what you think. I've done pretty much everything I know to do proper seo for my site. I'd love to hear some critiques about what I am doing wrong. I'm not sure if my titles are okay, being that they are similar amongst pages. The other thing is that for all the javascript buttons on the top I have no followed them since they don't have any anchor text. The way google will crawl my page is through the links in the footer. I was thinking of moving them throughout the body of the page since I hear google isn't giving as much weight to footer links. I also wanted to hear what you think about putting a blog on my site and updating with fresh content as opposed to creating a separate blog and then linking back to my website with anchor text. Thanks for all the help. And glad to be a member Bill
Intermediate & Advanced SEO | | wsh150 -
One site or five sites for geo targeted industry
OK I'm looking to try and generate traffic for people looking for accommodation. I'm a big believer in the quality of the domain being used for SEO both in terms of the direct benefit of it having KW in it but also the effect on CTR a good domain can have. So I'm considering these options: Build a single site using the best, broad KW-rich domain I can get within my budget. This might be something like CheapestHotelsOnline.com Advantages: Just one site to manage/design One site to SEO/market Better potential to resell the site for a few million bucks Build 5 sites, each catering to a different region using 5 matching domains within my budget. These might be domains like CheapHotelsEurope.com, CheapHotelsAsia.com etc Advantages: Can use domains that are many times 'better' by adding a geo-qualifier. This should help with CTR and search Can be more targeted with SEO & Marketing So hopefully you see the point. Is it worth the dilution of SEO & marketing activities to get the better domain names? I'm chasing the longtail searchs whetever I do. So I'll be creating 5K+ pages each targeting a specific area. These would be pages like CheapestHotelsOnline.com/Europe/France/Paris or CheapHoteslEurope.com/France/Paris to target search terms targeting hotels in Paris So with that thought, is SEO even 100% diluted? Say, a link to the homepage of the first option would end up passing 1/5000th of value through to the Paris page. However a link to the second option would pass 1/1000th of the link juice through to the Paris page. So by thet logic, one only needs to do 1/5th of the work for each of the 5 sites ... that implies total SEO work would be the same? Thanks as always for any help! David
Intermediate & Advanced SEO | | OzDave0 -
Working out exactly how Google is crawling my site if I have loooots of pages
I am trying to work out exactly how Google is crawling my site including entry points and its path from there. The site has millions of pages and hundreds of thousands indexed. I have simple log files with a time stamp and URL that google bot was on. Unfortunately there are hundreds of thousands of entries even for one day and as it is a massive site I am finding it hard to work out the spiders paths. Is there any way using the log files and excel or other tools to work this out simply? Also I was expecting the bot to almost instantaneously go through each level eg. main page--> category page ---> subcategory page (expecting same time stamp) but this does not appear to be the case. Does the bot follow a path right through to the deepest level it can/allowed to for that crawl and then returns to the higher level category pages at a later time? Any help would be appreciated Cheers
Intermediate & Advanced SEO | | soeren.hofmayer0