Only 11 pages being crawled
-
Hi,
Can some one have a look and see why out of 400+ pages we only have 11 being crawled on here??
http://www.lifetimelegal.co.uk
Kind Regards
Elissa
-
When I search your site in Google it shows me 82 results against my query “site:domain.com” so it seems like Google is slowly crawling your site but you are right the rate of crawling pages is quite slow and to increase this here are few things that you should follow
- Strong Internal Linking
It is important to have a strong internal linking between the pages if you want Google and other search engine to crawl your page. Please check if you have a strong and powerful internal linking between the pages
- Xml Sitemap
The other thing that is missing on your site is xml sitemap. The idea is to add an xml sitemap and add it in Google webmaster tool and this will indicate Google to crawl different areas of your website with no hassle
Hope this will help!
-
Just looking around your site, the code seems ok - to a large extent.
But you are missing a sitemap (handy to point to all urls) and a robots.txt file
Also just clicking around i don't see 400 pages? is there a subdomain or folder you aren't linking to from the main site?
-
Hi Elisa,
It looks like it's pretty simple, when I crawl your Web site with Screaming Frog I only found 11 pages too. The reason is that the other pages aren't linked from the 11 pages found during a crawl. I would recommend to link to your other pages as well so these pages are found.
Hope this helps!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google not giving ranking to the intended page of my website.
Hello friends, This is my very first question, I hope I will explain my issue correctly. I have created two pages related to SSC CGL keyword on my website: https://www.ibtindia.com/ssc-cgl-notification-exam-date 2) https://www.ibtindia.com/ssc-cgl-apply-online I want to target the keyword SSC CGL Apply Online on the 2nd URL but Google is only considering the 1st page for all the "apply" related keywords as well. Can anyone suggest to me how to get the second page in rankings for its intended keywords? I will be very thankful for this help. I tried adding image but its showing dummy. Please you can check it op GOOGLE SERP Second page
Search Behavior | | namitathakur0 -
Google Index Issue - Indexing pages that don't exhist
Hi All, I have noticed a weird issue when performing a search on Google to show me all the pages it is indexing of our site. site:www.one2create.co.uk It brings up most of our website pages but then is also brings up a few HTTPS urls (our site has not been converted to HTTPS yet) but also the URL path, Title, and Meta Description are from one of our clients websites (an Automotive Job site). When clicked they take you to a generic 404 server error page, not our branded 404 page. The site that it has taken the url, title and meta description from is on a different server completely so I don't see how it has even managed to get that information and linked it to our site? Has anyone seen anything like this before? And what is the best way to fix it? We have asked Google to re-index the site but still no luck.
Search Behavior | | Jvickery0 -
Location Pages
Hi. A client of mine offers multiple services and covers a region of the UK. They want to target each major town/city within this area. However, there are 20 cities and services offered range from 5-15 services. I am in the process of creating a location page for each city, so it can be optimised separately however I am not sure if there is a better way to do it? Or should I create a page for each city & service. So I for example I end up with 10 London pages with each one offering a different service? These can all be optimised for different services within London then? Any suggestions? Thanks
Search Behavior | | YNWA0 -
Google site: search showing twice amount of indexed pages. why?
I have around 50k pages indexed on my site but when I do a google site: of my site it shows around 100k pages indexed. Why is it showing so much more? It is also only showing around 700 pages indexed in my web masters account for the site. Background: We have a custom site map being generated automatically. Let me know if you would like more info, Thanks.
Search Behavior | | Nicktaylor10 -
Page ranking in .com but not in .co.uk
Hi there, I tried to search the Q&A but couldn't find any answers to my issue. We have a page that is ranking #2 for the term "translation memory" in google.com, but it doesn't show in Google.co.uk. This has been like this for weeks now. We are not targeting any specific country in GWT. Does anyone know a possible explanation for this? Thank you.
Search Behavior | | SDLOnlineChannel0 -
All pages were returning 404 for an hour. Will it impact the SERPS?
Hi, Due to a bug in my website system, all the pages were returning an 404 default page for a period of 1 hour. Can this event impact the SERPs of this site? (the site is heavily visited, more than 500k users coming from google every day, so I assume google crawls my pages every moment)
Search Behavior | | lucasms0 -
Looking for something better than Googles in page analytics
Buongiorno from 12 degrees C wetherby UK 🙂 I'm interested in measuring content engagagement, things like what gets clicked on mouse tracking beahaviour etc. Google Analytics in page analytics does a good job but is there another product able to guage user interactive behaviour with content (Yes ive added event tracking). Thanks in advance,
Search Behavior | | Nightwing
David1 -
Irratic page rank results - why?
Hi, Hi- I've changed the title and reposted this question as I didn't get any insight. I really am going around in circles for this; so any help that can be given would be really appreciated.I know that you guys have the knowledge so really hoping you can share it! Thanks - background: I run two sites: www.ragsmetals.com and www.yourgoldfund.com: They offer similar products but to different markets: one is predominently trade, one predominently customer focused. They vie for the same keywords.e.g. Buy Gold My Issue: I have been trying to build www.yourgoldfund.com up from an SEO point of view; it is FALLING in the rankings; I am doing NOTHING with www.ragsmetals.com and it is rising in the rankings. I checked webmaster to see if there were any warnings as a result of penguin (found out how to do this on here - thanks for that!) there are none. I have optimized the pages a lot. I have put time into getting in bound traffic, and even more excitingly some experts (from reputable domains) have just linked to our site because they like our content! So to me things should be improving . NOTE: My OSE listed inbound links are incredibly diferent from google Webmaster. What can I do. I am a scientific person so I love the fact that I have 2 sites to compare...interested to hear your thoughts. Many thanks in advance
Search Behavior | | girlie0