My crawl is only crawling only the 1st page. What’s going wrong?
-
When I crawl the website kmtstore.com usiing the moz tool , it crawls the product urls only the fist page and skips the rest of the products on the remainaing pages .
Here are the produclist page urls which has the products on many pages but on crawling only the 1st page products show up . I have crawled this website kmtstore.com yesterday and all the details being given is as per the latest crawl report generated yesterday./
http://kmtstore.com/pl/11099/H2O-Jet-Parts-Flow-Style.aspx
http://kmtstore.com/pl/11103/Pneumatic-Control-Valves.aspx
http://kmtstore.com/pl/11104/Swivel-Joint-Assemblies.aspx
http://kmtstore.com/pl/11105/Cutting-Head-Components/Cutting-Head-Replacement-Parts.aspx
http://kmtstore.com/pl/11106/Cutting-Head-Components/Focusing-Tubes.aspx
http://kmtstore.com/pl/11107/Cutting-Head-Components/Cutting-Heads.aspx
http://kmtstore.com/pl/11108/Cutting-Head-Components/Orifice.aspx
http://kmtstore.com/pl/11109/HP-Valves-Fittings-and-Tubing/Tubing.aspx
http://kmtstore.com/pl/11110/HP-Valves-Fittings-and-Tubing/Inline-Water-Filter.aspx
http://kmtstore.com/pl/11111/HP-Valves-Fittings-and-Tubing/High-Pressure-Fittings.aspx
http://kmtstore.com/pl/11112/HP-Valves-Fittings-and-Tubing/Gauges.aspx
http://kmtstore.com/pl/11113/Intensifier-Parts/Electrical.aspx
http://kmtstore.com/pl/11114/Intensifier-Parts/Low-Pressure-Water-Systems.aspx
http://kmtstore.com/pl/11115/Intensifier-Parts/Topworks-Replacement-Parts.aspx
http://kmtstore.com/pl/11116/Intensifier-Parts/Hydraulic-System.aspx
http://kmtstore.com/pl/11117/Intensifier-Parts/Sealing-Head-Replacement-Parts.aspx
http://kmtstore.com/pl/11118/Maintenance-Tools-and-Lubricants/Maintenance-Tools-Coning-and-Threads.aspx
http://kmtstore.com/pl/11119/Maintenance-Tools-and-Lubricants/Maintenance-Tools-Topworks.aspx
http://kmtstore.com/pl/11120/Maintenance-Tools-and-Lubricants/Maintenance-Tools-Lubricants.aspx
http://kmtstore.com/pl/11121/Maintenance-Tools-and-Lubricants/Maintenance-Tools-Pneumatic-Valves.aspx
http://kmtstore.com/pl/11122/Maintenance-Tools-and-Lubricants/Manuals.aspx
http://kmtstore.com/pl/11123/Pneumatic-Control-Valves/Pneumatic-Control-Valve-Replacement-Parts.aspx
http://kmtstore.com/pl/11124/Pneumatic-Control-Valves/Cutting-Head-Nozzle-Tubes.aspx -
Hi there!
Thanks for reaching out! My name is Erin, and I'm on the Moz Help Team. I appologize for any confusion here. I downloaded your crawl CSV for kmtstore.com, and everything looked fine. From what I can tell Google has 296 pages indexed for your site, and we crawled 241.
Our crawler starts with your home page and uses recursive crawling to find pages on your site through the links we find. Thus, your homepage is the only seed we use to crawl your site. We know that Google uses multiple seeds, so it could be possible Google is indexing more pages that way. Since we use recursive crawling, if these product pages aren't linked to your homepage, our crawler won't be able to pick them up.
I hope this helps, and if you have any other questions, please reach out to us at [email protected]! We'll be able to take this conversation offline and answer any other questions for you from there!
Cheers!
Erin
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Our SEO agency has substantially moved back within Google’s SERP’s, but we can't figure out why.
We have followed the guidance of [Google EEAT] and Google’s Webmaster Guidelines. However, our [Cardiff SEO company] has moved back substantially in the SERPs; the links and content marketing are good, yet we substantially back on Google’s SERPS by over 30 places and we have no clue why. We don’t know why; we are an SEO agency with over ten years of SEO experience, we never have had this happen to us, and can't figure out why our business has moved back to Google. If there are any SEO experts here, we would appreciate your help. We called Walsh and Partners, we are a white hat seo company based in Cardiff, South Wales, any help we would be so grateful.
Moz Local | | sarahwalsh0 -
How long do Facebook and Google pages have to be published before Moz can verify them?
Hi there. I've checked the forums and have seen similar questions, but couldn't find an answer in them. I have a listing that I imported from my Google My Business account, but it comes up as unverified for both Facebook and Google. Both pages exist, but have only been published for about 3 weeks. Both sites contain the accurate business information and are the appropriate types of pages, so the best I can determine from what I've read in the other posts is that "newly" published Facebook and Google pages may not be able to be verified by Moz Local. So the question is, what is considered "newly published"? The Facebook business page is: https://www.facebook.com/JTBentonConsulting/ The Google+ page is: https://plus.google.com/b/114469171569907148968/+JTBentonConsultingAdamstown?pageId=114469171569907148968&hl=en The name registered for Google My Business is: J T Benton Consulting - Mobile Notary Public Any ideas?
Moz Local | | monicastuckey0 -
Trying to connect my moz local to my facebook page - says it isn't found
Trying to connect my moz local to my facebook page - says it isn't found even though it is. I don't want to create another listing for this. Cheers Claire
Moz Local | | blenkiseo0 -
How do I claim a YP listing with the wrong number listed?
I have a listing in Moz Local associated with a YP listing. Most items on the listing are correct but the number listed is not one of our numbers. When I try to claim the listing they want to call the number listed and give them a code. Of course we can't answer the phone because it doesn't ring on our end. How do I either change the number or claim the listing in another way?
Moz Local | | PSLab0 -
Facebook page not appearing in the Moz Local listing report
Hello, We recently set-up a Moz local account and have submitted our data about the business to it. However for some reason our Facebook page is not showing up in the listing report. The Facebook page is active and has all the NAP details but in the listing report, it only gives the option of creating a listing. Is there any way I can link our Facebook page in the listing report.
Moz Local | | greenguy11 -
Difference between 'City' and 'Province' on Moz Local business listing page
Sorry, I'm stuck on this one. I'm trying to clean up my business address on Moz Local as I have a duplicated version that ranks better than my verified listing (which is Fulham Nannies). I'm wondering if the problem arises from my entry on Moz Local's business listing for which I've entered 'London' in both the 'City' and 'Location' fields.. I'm not entirely sure that's correct, or what I should in fact enter in the 'province' field other than what I've got at the moment, I.e. London. Should I put something like 'South West London' for province and keep the city entry as London? I'd really appreciate any guidance anyone might have, thanks in advance.
Moz Local | | Moira_Walsh0 -
Why is Moz local showing my google plus page as incomplete when it is 100% complete
Hi all, New to using Moz Local and so far I like it - but some information is a bit confusing. Specifically the "Incomplete" listings. When I click on it - it shows my Google Plus page (which is verified) as being incomplete. The reason provided is that Moz Local thinks I need to add 3 more categories, when in fact there are no more categories available on Google Plus. Any idea why? Thanks in advance.
Moz Local | | Muskrat371 -
You have exceeded your rate limit error while trying to add listing to Mozlocal. What's wrong?
I get the error You have exceeded your rate limit when trying to add my first listing to the MozLocal tool. Can you let me know what's the problem?
Moz Local | | arkenea1