I've hit a wall. What's next?
-
I've been working on creating content and optimizing my website for the past 18 months, and have seen decent gains in organic traffic. Recently my keyword ranking increases have slowed dramatically, despite adding additional content. I'm hoping a fresh set of eyes can spot something that may be holding me back. I appreciate any feedback the MOZ community is able to provide.
One area of concern/confusion is the number of pages indexed according to GSC. The number tends to go up and down, and I can't figure out why. Of the roughly 8,000 pages that are submitted through the sitemap, it says only around 1,100 are indexed (sitemap page). The index status page says I've got 7,500 pages indexed. Kind of confused on that one.
Anyway, my website is MetroAtlantaHome dot com. Thanks everyone!
-
Matt,
Thank you for taking a look at my site. I really appreciate the feedback.
I had noticed the search results with parameter tags being indexed as well. I tried limiting Google's crawler to non-parameter pages about 8 months ago, but didn't seem to do much. I was afraid one of my settings was messing things up so I deleted it and selected let GoogleBot decide for all of them. Not sure why the paginated pages are being indexed too. I thought I'd read where the paginate tag was similar to the canonical tag and Google would treat it as a signal not to index. I would think if GoogleBot can crawl and index the paginated search pages, it could also crawl the listing results on all those pages. I do have a large portion of listing pages on my site no-indexed since they don't fall within my service area and I used to get a ton of calls about them. Maybe that is causing issues for all the listing results pages to not be indexed.
In regards to Screaming Frog, which settings did you use? I use the preset user agent GoogleBot Regular and have thousands of pages that it crawls. Wish I could replicate your scan to see what might be holding things up.
Regarding the Wistia sitemap, I put it in the robots.txt file to try and get the videos embedded on my site indexed. I didn't realize this was hurting more than helping.
Thanks again for your feedback and taking the time to review my site.
-
As far as the discrepancy in numbers, Google is indexing a lot of ?search= parameter results (as well as /listing/ results) but the search ones are not in your sitemap. Your site doesn't crawl all the way very well - I put it in ScreamingFrog twice and only came up with about 400 pages - some listings pages but not the thousands Google has in the index.
You have a number of paginated pages:
- http://www.metroatlantahome.com/contemporary-style-homes/300000-400000/?p=5
- http://www.metroatlantahome.com/contemporary-style-homes/300000-400000/?p=3
Your canonicals take care of this issue for the search index but your search page results seem to be "indexed" even though they aren't in your sitemap. See the attachment.
So I think you're gaining indexed pages from the search parameter but losing them from /listings/ that aren't indexed and harder to crawl. I would suggest submitting sitemap_0.xml directly to Search Console as a start. Then trying to figure out why those pages don't crawl very well.
The Wistia sitemap in your robots.txt is also NOT something I'd want Google to ever see but having it in robots.txt ensures they do. I'd try to remove that from robots.txt
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Track PDF's in Google Analytics
Hi Mozzers, Is it possible to track PDF's via Google Analytics/Google tag manager? I'm not only looking for PDF downloads but for the actual activity when someone opens an interactive PDF document. So would it be possible to have onclick events on buttons in the PDF etc... Many thanks!
Reporting & Analytics | | WeAreDigital_BE
Sander0 -
Referral Data Q's
1. We recently ran a promotion on both FB and Reddit, which is https, linking to our non-https site. We utilized UTM links to our landing page. Our GA campaign data returned extremely low hits in comparison to what we actually received (and recorded via FB/Reddit dashboard). Obviously our Direct traffic spiked during these times, caused by a secure to nonsecure referral, I'm sure. I'm also noticing a spike in referral traffic from lm.facebook.com that correlates to the ad times. Does this mean Facebook's link shim is stripping away my UTM data? My question is why we receive SOME properly UTM-tagged referral traffic in our campaigns? What's allowing some of it to go through? 2. I've tagged our email signature links with UTM as well, hoping to clean up some of our Direct traffic. I understand that external clients like Outlook and Thunderbird likely won't pass referral data, but do hosted clients like Gmail, Yahoo, and such? And if so, would the https to http difference obstruct this again? I'd love some insight onto these questions, especially if I'm off the mark with a few of my assumptions there.
Reporting & Analytics | | kirmeliux0 -
Keyword ranking with competitors with lower #s
When analyzing a keyword ranking, our term is consistently on P1 P3-5. Looking more closely, I find that the numbers don't make sense to me. Our competitors have lower Page Authority 3s, lower # Root Domains Linking to Page, Lower Domain Authority 3#s and lower Root Domains linking to the Root Domains Linking to the Root Domain #s. What explains the consistent_ ranking discrepancy? Any ideas?_
Reporting & Analytics | | Chermak1 -
Yahoo and Bing Ranking Hits
Morning, Has anyone else in the UK seen a massive ranking shift on Bing and Yahoo over the last week? One of our eccommerce client's main keywords was ranking #3 and #11 on Bing and Yahoo respectively last week, but today they've dropped to #32 and #35. It seems rather strange as pretty much all of the main keywords have increased on Google. In fact, pretty much all of the Google rankings are the highest they've been since the SEO campaign commenced in October/November! Cheers, Lewis
Reporting & Analytics | | PeaSoupDigital0 -
Blog Analytics broke for two weeks. How do I account for these hits in my monthly report?
The Analytics on my blog broke for about two weeks before I realized it. I need to come up with some estimated numbers for total pageviews, referrals, direct hits, etc to add to my monthly SEM report. I took the average of the past four 2 week periods to come up with the number of hits. Should I just add this number to the total hits on my site? Or are these hits being counted twice if they went on to the main site? http://www.howlatthemoon.com
Reporting & Analytics | | howlusa0 -
Homepage disappeared from Google's index
The Title says it all..I just discovered that the Homepage is not in Google's index anymore. Homepage rankings have plummeted, our top keywords are nowhere to be found but most of keywords from deeper pages have dropped just one or two places. We just change the website design and some content but I strongly believe this is definitely something else due to the fact that it all happened so fast! There is one thing that I have to mention that might have been caused all this..our email client (Outlook) is using a lot of resources from our server and for the last couple of days the website was down quite a lot.
Reporting & Analytics | | echo1
There are some crawling errors in GWT but the homepage has been crawled because is not there, no other messages. Where should I look for?0 -
Where have the 'most changed keyword rankings' gone from the weekly summary emails?
Since the change to Moz we have noticed that the weekly summary emails do not show the 'most changed keyword rankings' table. We found these extremely helpful and would be disappointed to see these go. Are these going to make a come back?
Reporting & Analytics | | RedAntSolutions2 -
Why isn't Google showing the first keyword result in Analytics anymore?
Just checked my Google Analytics traffic sources under organic search and it dosen't display the first keyword, it says "not provided" is there another way of determining the #1 organic searched keyword that my site was found under?
Reporting & Analytics | | Randog0