Increase number of pages crawled
-
Only one page is being crawled, how do I increase the number to include most of our site?
-
Hi! I am guessing that you're referring to SEOmoz only crawling one page of your site? The list of possible reasons for that is at https://seomoz.zendesk.com/entries/409821-why-isn-t-my-site-being-crawled-you-re-not-crawling-all-my-pages. If none of those are applicable, go to the help hub at http://www.seomoz.org/help and contact our help team and we'll work on figuring it out with you.
-
make sure you are not unintentionally blocking pages in your robots.txt or meta robots tags and that the links on your site are search engine friendly links that the crawlers can follow.
submit the URL(s) to be crawled in google webmaster tools to tell the bots to come around again.
increase the crawlrate manually in WMT
-
Hi Lisa,
OSE will crawl enough pages of your site that are found/relevant at the time of the last crawl.
OSE is not up to date at any one time.
This FAQ shows that some data may be delayed up to 60 days, however in my experience listing new websites, this has been more like a couple of weeks.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google Analytics - Tracking multiple thankyou pages?
Hi Guys, I want to track email opt-ins for multiple thank you pages. The setup is as follows: http://image.prntscr.com/image/57632e05a15f42fda0b8ffec2d176460.png I have not yet built the thank you pages, so i was wondering what the URL should be to make it easy to track them in GA? I'm thinking: domain.com/thankyou-page/page1 Then using regular expression in GA to track /thankyou-page/ Would this be a good way to go about it? Cheers. f6c7r0
Reporting & Analytics | | spyaccounts110 -
What determines the page order of site:domain?
Whenever I use site:domain.com to check what's index, it's pretty much always in the same order. I gather from this, the order is not random. I'm also reasonably certainly it isn't related to any page strength signals or ranking results. So, does anyone know why the pages are displayed in the order they are? What information does the order of the pages tell me? Thanks, Ruben
Reporting & Analytics | | KempRugeLawGroup1 -
GA visitor number inconsistencies?
Hey Mozzers Recently a client of ours undertook a paid campaign using Taboola and have a vast difference between reported clicks and visitors reported by GA. On further investigation the _utm.gif event is sent to google-analytics.com 50% of the time and stat.g.doubleclick.net the remaining 50% of the time Is this likely to be the cause of the discrepancy and if so is it possible to resolve this without removing the remarketing tag (which seems to be responsible for stats.g.doublelclick.net). Many thanks Justin
Reporting & Analytics | | JustinTaylor880 -
Wordpress site with increase number of Crawl(400 response Code) errors in Others section of GWT
I have a wordpress site http://muslim-academy.com/I check in Google Webmasters tool today and I see the increase number of errors in Others area of Google webmaster Tool.The error code is 400http://muslim-academy.com/%D8%B3%D9%8A%D8%B1%D8%A9-%D8%AA%D8%A7%D8%B1%D9%8A%D8%AE%D9%8A%D8%A9-%D9%84%D9%84%D8%B1%D8%A6%D9%8A%D8%B3-%D8%AC%D9%85%D8%A7%D9%84-%D8%B9%D8%A8%D8%AF-%D8%A7%D9%84%D9%86%D8%A7%D8%B5%D8%B1-2/%D8%B3%D9%....%3Cbr%20/%3E________________%3Cbr%20/%3E___________%3Ca%20href=?lang=zhOne of the example link of this error.Can you guide me why the number of errors are increasing and how to fix the existing errors.
Reporting & Analytics | | csfarnsworth0 -
How do you handle a "too many inbound links" notice on your crawl diagnostics report?
How do you handle a "too many inbound links" notice on your crawl diagnostics report? The url's identified come from our blog....is it reading all the blog post URL's and giving me a notice? Is this ok to leave all the links? Or would anyone recommend no follow tags on all of our blog posts?
Reporting & Analytics | | cschwartzel0 -
X2 Google Analytics affect page rank ?
Hi there, If you had 2 Google Analytics Accounts one to the main site and another to the blog, could this affect the page position in Google? We've suddenly noticed a drop in our KWs and it was shortly after we added another Google Analytics Account. The blog has 68% Bounce rate and the main site has always been about 48%. Any help would be much appreciated. Many thanks Paul
Reporting & Analytics | | webdesigncwd0 -
Should I delete a page that gets search traffic, that I don't care about?
I have a page on my site that consistently gets traffic, every month. Googlers seems to love it. But I don't like it at all. Webmaster tools shows that google allows us a certain number of search impressions each day. - it flatlines, they are limiting the impressions we get. We also getthe same number of clickthroughs each day. So my question is for anyone who has this same experience, who may have experimented by deleting a page you don't care about. Did you just lose that number of clicks each day or did other pages on your site get displayed and clicked through instead?
Reporting & Analytics | | loopyal0 -
Ranking on page 1 position 3 but hardley any visits
in one of my projects the expected vistors is around 23000 weve got the keyword onto the first page position 3 and weve only recieved 30 vistits this month, my qustion is why? are the local searches from google analtics that tell you thier are 23000 searches for that keyword false please can someone shed some light on this, my client is totally over the moon with his ranking but cant believe that hes only recieving 30 visits this month from what we thought was a million dollar keyword
Reporting & Analytics | | Westernoriental0