Problem with indexing
-
Hello, we've changed our CMS recently, everything seems to work well, but for some reason google, and other crawlers can't see or index other pages than main. There is no restriction in robots, nor any other visible issue. Please help if you can.
Website: http://www.design-glassware.com/
-
I just want to clarify what I was saying above. In my case, even though I put brand spanking new posts on my blog they weren't getting indexed. I had about 6 duplicate posts and 4 new ones and none of them were getting indexed. But, when I dealt with the duplicate content issues for those 6 (i.e got rid of the original copies and redirected the old site to the new) then all of my content suddenly got indexed. Just sayin'
-
Thank you. I'm sure it's not a duplicate content problem. For example even when I try to put new URL as destination in Ad words, and it didn't took as working.
I think it's more of a technical issue, not SEO, probably was a wrong question here.
Thank you again everyone for helping me out.
-
In my case above, I had new pages as well that weren't being indexed, but they did get indexed once I dealt with the duplicate content. Perhaps Google put some sort of block on my whole blog because of the duplicates? If your information is duplicated anywhere you need to check this.
Also, do you have webmaster tools set up? This will tell you a lot about what is happening with your domain. Have you submitted a sitemap? This will help as well.
It may also help to build a few external links to some of the new pages. This will help Google find them.
-
You may have to resubmit your site through webmaster tools AFTER fixing the forementioned issues.
-
good catch bootleg. I think if you get the dupe content and 301's working correctly google will love you a little more.
-
Yes, I've tried Xenu (right after you asked me), it shows broken links.
-
There are some new pages we've made, and still no indexing. Google visited our page quite often, and it's been almost 1 month since we've changed the URLs.
-
Thank you for the heads up. We know about the duplicate content problem, just our webmaster is somewhat slow.
The URLs are new, and we will do 301 redirect and "canonical".
-
How long has it been since you've had the new CMS? It can sometimes take weeks to get a site crawled and indexed.
I'll share with you something that happened to me recently that may be applicable. I recently started a new site and wrote a few blog posts. Then I changed my mind and decided that those posts would be better suited to another site I had. So, I added them to another site I had. But, they wouldn't index! I realized that I hadn't deleted the content off of my first site. So, when Google came across the new blog I'm assuming they saw all the content as duplicate and didn't index it. I immediately took the content off of the original domain and I 301'd the original domain to the new one and within hours all of my posts were indexed.
-
There's nothing wrong with the links and with your robots.txt. But ...
You obviously have a huge duplicate content problem. Just look at the search result the site: query returns. There are a lot of old links (from the old CMS I suppose). Click through the links and you'll always get to the main page, but the URL remains the same. I.e. no redirect to the correct page with the new URL or to the Homepage.
You should have a look at your old URLs and redirect them with a HTTP 301 redirect to the new URL.
As a quick fix add a rel="canonical" tag to your new pages. This way google will index the correct page (and only the correct page) on its next crawl. Setting up the redirects should have happened prior to switching the CMS ...
-
Have you tried crawling it with Xenu?
-
are you using the exact same URL's with the new CMS as the old cms? if not have you done 301's?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
What should i do to index images in google webmaster?
My website onlineplants.com.au. It's a shopping cart website. I do have nearly 1200 images but none of the images are indexed in google webmaster? what should i do. Thanks
Technical SEO | | Verve-Innovation1 -
Some URLs in the sitemap not indexed
Our company site has hundreds of thousands of pages. Yet no matter how big or small the total page count, I have found that the "URLs Indexed" in GWMT has never matched "URLS in Sitemap". When we were small and now that we have a LOT more pages, there is always a discrepancy of ~10% or so missing from the index. It's difficult to know which pages are not indexed, but I have found some that I can verify are in the Sitemap.xml file but not at all in the index. When I go to GWMT I can "Fetch and Render" missing pages fine - it's not as though it's blocked or inaccessible. Any ideas on why this is? Is this type of discrepancy typical?
Technical SEO | | Mase0 -
Duplicate Content Problems
Hi I am new to the seomoz community I have been browsing for a while now. I put my new website into the seomoz dashboard and out of 250 crawls I have 120 errors! So the main problem is duplicate content. We are a website that finds free content sources for popular songs/artists. While seo is not our main focus for driving traffic I wanted to spend a little time to make sure our site is up to standards. With that said you can see when two songs by an artist are loaded. http://viromusic.com/song/125642 & http://viromusic.com/song/5433265 seomoz is saying that it is duplicate content even though they are two completely different songs. I am not exactly sure what to do about this situation. We will be adding more content to our site such as a blog, artist biographies and commenting maybe this will help? Although if someone was playing multiple bob marley songs the biography that is loaded will also be the same for both songs. Also when a playlist is loaded http://viromusic.com/playlist/sldvjg on the larger playlists im getting an error for to many links on the page. (some of the playlists have over 100 songs) any suggestions? Thanks in advance and any tips or suggestions for my new site would be greatly appreciated!
Technical SEO | | mikecrib10 -
Canonical: Is this a problem?
Hi!!
Technical SEO | | petrospan
I am running a small wordpress website and i have a question because i am a litle confusic about Rel Canonical notices in the crawl diagnostics! I have the seo by yoast and i have fix all the canonical url for my page, but i take notices. I must worried about it or is something that inform me that everyting is ok? rel.jpg rel.jpg0 -
Spider Indexed Disallowed URLs
Hi there, In order to reduce the huge amount of duplicate content and titles for a cliënt, we have disallowed all spiders for some areas of the site in August via the robots.txt-file. This was followed by a huge decrease in errors in our SEOmoz crawl report, which, of course, made us satisfied. In the meanwhile, we haven't changed anything in the back-end, robots.txt-file, FTP, website or anything. But our crawl report came in this November and all of a sudden all the errors where back. We've checked the errors and noticed URLs that are definitly disallowed. The disallowment of these URLs is also verified by our Google Webmaster Tools, other robots.txt-checkers and when we search for a disallowed URL in Google, it says that it's blocked for spiders. Where did these errors came from? Was it the SEOmoz spider that broke our disallowment or something? You can see the drop and the increase in errors in the attached image. Thanks in advance. [
Technical SEO | | ooseoo](<a href=)" target="_blank">a> [
](<a href=)" target="_blank">a> LAAFj.jpg
0 -
Wordpress Problems.. SEO-Yoast is Toast?
Hello; I have installed the WP Yoast Widget in my Blog, and 2 weeks, after my issues went away, they came back X's 300! lol So I uninstalled it, and my issues obviously got worse, and then I re-activated, and reset everything, and still got the 300+ issues. Is there a secondary plug in you would suggest, to run at the same time as Yoats, or theat will fix all issues? Ever think of making an SEOmoz Widget for WP since it is gaining so much popularity?? Thank you Great work by the way! Loved the Webinar today!
Technical SEO | | smstv0 -
Google News not indexing .index.html pages
Hi all, we've been asked by a blog to help them better indexing and ranking on Google News (with the site being already included in Google News with poor results) The blog had a chronicle URL duplication problem with each post existing with 3 different URLs: #1) www.domain.com/post.html (currently in noindex for editorial choices as showing all the comments) #2) www.domain.com/post/index.html (currently indexed showing only top comments) #3) www.domain.com/post/ (very same as #2) We've chosen URL #2 (/index.html) as canonical URL, and included a rel=canonical tag on URL #3 (/) linking to URL #2.
Technical SEO | | H-FARM
Also we've submitted yesterday a Google News sitemap including consistently the list of URLs #2 from the last 48h . The sitemap has been properly "digested" by Google and shows that all URLs have been sent and indexed. However if we use the site:domain.com command on Google News we see something completely different: Google News has indexed actually only some news and more specifically only the URLs #3 type (ending with the trailing slash instead of /index.html). Why ? What's wrong ? a) Does Google News bot have problems indexing URLs ending with .index.html ? While figuring out what's wrong we've found out that http://news.google.it/news/search?aq=f&pz=1&cf=all&ned=us&hl=en&q=inurl%3Aindex.html gives no results...it seems that Google News index overall does not include any URLs ending with /index.html b) Does Google News bot recognise rel=canonical tag ? c) Is it just a matter of time and then Google News will pick up the right URLs (/index.html) and/or shall we communicate Google News team any changes ? d) Any suggestions ? OR Shall we do the other way around. meaning make URL #3 the canonical one ? While Google News is showing these problems, Google Web search has actually well received the changes, so we don't know what to do. Thanks for your help, Matteo0 -
Some site pages are removed from Google Index
Hello, Some pages of my clients website are removed from Google Index. We were in top 10 position for some keywords but now I cannot find those pages neither in top 1000. Any idea what to do in order to get these pages back? thank you
Technical SEO | | besartbajrami0