Why isn't Google indexing this site?
-
Hello, Moz Community
My client's site hasn't been indexed by Google, although it was launched a couple of months ago.
I've ran down the check points in this article https://mza.seotoolninja.com/ugc/8-reasons-why-your-site-might-not-get-indexed without finding a reason why.
Any sharp SEO-eyes out there who can spot this quickly?
The url is: http://www.oldermann.no/
Thank you
INEVO, digital agency -
Yeap it's really rare. Even more rare that WMT doesn't scream any error.
To check my mistake, i've run a screaming frog too. Sorry.
-
It shouldn't do as its just an iframe, if that were the case then every site that that used addthis would have a problem (which I know for a fact isn't true as two large sites I work with use it and have no issues).
As far as I'm aware, iframes do not pass on any of their attributes through to a website showing an iframe. The main reason I was curious about your reply was that screaming frog hadn't had any issues, I can understand myself having a small slip up, but a bit of software rarely does.
Back to the original question though, it is curious why there's no indexing by Google, Bing seems to have picked it up, and three days ago atleast. i can't see reason (in my brief look earlier) as to why it shouldn't be. So I came to the conclusion it hadn't been crawled or it had incredibly poor content (which I can't verify as I don't know Norwegian)
-
Damn it. You're right.
I'll retract my self.
Dispite my mistake, is there a chance that the add this iframe may be harming that site?
-
A friend just confirmed it, as you're using developer tools, what you're seeing is actually the fully loaded page, including iframes. So the noindex you have found is addthis. https://gyazo.com/abbdecc7e3d6a2d1f4d3acf65a48e65b
To actually check the source code, right click then click view source. That's the code for the specific site instead of loading all of the extra code you've been seeing. I would strongly advise you do like that from now onwards as the way you are doing is incorrect.
-
You know what, I don't think I am wrong.
Have a look at this source code from Bing's cache, can you see it there? http://cc.bingj.com/cache.aspx?q=site%3Ahttp%3A%2F%2Fwww.oldermann.no%2F&d=4558460857156532&mkt=en-GB&setlang=en-GB&w=Zicz6YAWVXgY8u0BPAR9qKRHF8OEn7o5 (Disclaimer I got my friend to check as I'm on a mobile)
This gyazo was just taken for example: https://gyazo.com/93c71c3767c57b74cb9f8b482c23c38
Just ran it through this too, showing the same thing: http://www.seoreviewtools.com/bulk-meta-robots-checker/
oh oh and so you know I think I know why you've found the noindex, you're looking at the for addthis.
-
I disagree Thomas. You're wrong.
I retract myself. Thomas has it right.
I've chequed 2 pages and both have the meta robots to nofollow and noindex.
http://www.oldermann.no/
http://www.oldermann.no/kompetanseCheck the image attached
To check that, go to the page source (F12 in chrome) and make a search (clicking in the source code then crtl+F) of 'robots' there you'll find your problem. Just erase that line of code and you'll be just fine.
Best Luck.
GR. -
I've had a quick look, I've been able to crawl it without any issues, the meta robots and robots.txt doesn't seem to be conflicting with anything at all.
It just doesn't look like it's even been found by Google.
Bing doesn't look to be having any issues indexing it: http://www.bing.com/search?q=site%3Aoldermann.no&go=Submit&qs=n&form=QBLH&pq=site%3Aoldermann.no&sc=0-17&sp=-1&sk=&cvid=B677970FF39F4A62A9B040806CF19EE0
What's the quality of the content on the site like? Have you "fetched as google" in the search console?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Pages excluded from Google's index due to "different canonicalization than user"
Hi MOZ community, A few weeks ago we noticed a complete collapse in traffic on some of our pages (7 out of around 150 blog posts in question). We were able to confirm that those pages disappeared for good from Google's index at the end of January '18, they were still findable via all other major search engines. Using Google's Search Console (previously Webmastertools) we found the unindexed URLs in the list of pages being excluded because "Google chose different canonical than user". Content-wise, the page that Google falsely determines as canonical instead has little to no similarity to the pages it thereby excludes from the index. False canonicalization About our setup: We are a SPA, delivering our pages pre-rendered, each with an (empty) rel=canonical tag in the HTTP header that's then dynamically filled with a self-referential link to the pages own URL via Javascript. This seemed and seems to work fine for 99% of our pages but happens to fail for one of our top performing ones (which is why the hassle 😉 ). What we tried so far: going through every step of this handy guide: https://mza.seotoolninja.com/blog/panic-stations-how-to-handle-an-important-page-disappearing-from-google-case-study --> inconclusive (healthy pages, no penalties etc.) manually requesting re-indexation via Search Console --> immediately brought back some pages, others shortly re-appeared in the index then got kicked again for the aforementioned reasons checking other search engines --> pages are only gone from Google, can still be found via Bing, DuckDuckGo and other search engines Questions to you: How does the Googlebot operate with Javascript and does anybody know if their setup has changed in that respect around the end of January? Could you think of any other reason to cause the behavior described above? Eternally thankful for any help! ldWB9
Intermediate & Advanced SEO | | SvenRi1 -
'Nofollow' footer links from another site, are they 'bad' links?
Hi everyone,
Intermediate & Advanced SEO | | romanbond
one of my sites has about 1000 'nofollow' links from the footer of another of my sites. Are these in any way hurtful? Any help appreciated..0 -
How long does google index old urls?
Hey guys, We are currently in the process of redesigning a site but in two phases as the timeline issues. So there will be up to a 4 week gap between the 1st and 2nd set of redirects. These urls will be idle 4 weeks before the phase content is ready. What effect if any will this have on the domain and page authority? Thanks Rob
Intermediate & Advanced SEO | | daracreative0 -
Being Outranked But Don't Know Why!
My client, Comprehensive OBGYN of the Palm Beaches, is being outranked by two sites that have lower DA/PA and seemingly inferior on-page work for the term "palm beach obgyn". https://www.google.com/search?q=palm+beach+obgyn&ie=utf-8&oe=utf-8&aq=t&rls=org.mozilla:en-US:official&client=firefox-a Our site is comprehensiveobgyn.net The two sites beating us are "obgynpalmbeach.com" and "obgynspb.com" My only thought is the exact match domain factor may be coming into play a bit, but It doesn't seem like it should make THIS much of a difference. Any thoughts?
Intermediate & Advanced SEO | | RickyShockley0 -
Getting out of Google's Penguin
Hi all, my site www.uniggardin.dk has lost major rankings on the searchengine google.dk. Went from rank #2-3 on important keywords to my site, and after the latest update most of my rankings have jumped to #12 - #20. This is so annoying, and I really have no idea what to do. Can it cause bad links to my site? In that case what will I have to do? Thanks in advance,
Intermediate & Advanced SEO | | Xpeztumdk
Christoffer0 -
How can I see all the pages google has indexed for my site?
Hi mozers, In WMT google says total indexed pages = 5080. If I do a site:domain.com commard it says 6080 results. But I've only got 2000 pages in my site that should be indexed. So I would like to see all the pages they have indexed so I can consider noindexing them or 404ing them. Many thanks, Julian.
Intermediate & Advanced SEO | | julianhearn0 -
Changing Hosting Companies - Site Downtime - Google Indexing Concern
We are getting ready to switch to a new hosting company. When we make the switchover, our sites will be offline for a couple of hours and in some cases perhaps as long as 12 hours while DNS is configured -- should we be worried about Google trying to index pages and finding them unavailable? Any fear of Google de-indexing pages. Our guess was that Google would not de-index anything after just a short period of not being able to find pages -- it would have to be over an extended period of time before GOOGLE or BING would de-index pages -- CORRECT? Just want to gut check this before pulling the trigger on switch over to new hosting company. We appreciate input on this and/or any other thoughts regarding the switch over to new hosting company that we may not have thought of. Thanks, Matt
Intermediate & Advanced SEO | | MWM37720 -
Does Google crawl the pages which are generated via the site's search box queries?
For example, if I search for an 'x' item in a site's search box and if the site displays a list of results based on the query, would that page be crawled? I am asking this question because this would be a URL that is non existent on the site and hence am confused as to whether Google bots would be able to find it.
Intermediate & Advanced SEO | | pulseseo0