Why bing is not indexing our website?
-
We are up almost a six month already, google indexed 46,900 pages.
We have decent traffic and a lot of real external links to us.
No single page has been indexed by bing or yahoo.
I have submitted sitemap to bing's webmaster tool two weeks ago and still it is in Pending stage.
here is our address: www.showme.com
and here is site map: http://www.showme.com/sitemapxml.php
What can be the reason of that?
Thanks for your help.
Karen Bdoyan
-
GET 200 = All good
GET 304 =
<a id="sec10.3.5">10.3.5</a> 304 Not Modified
If the client has performed a conditional GET request and access is allowed, but the document has not been modified, the server SHOULD respond with this status code. The 304 response MUST NOT contain a message-body, and thus is always terminated by the first empty line after the header fields.
The response MUST include the following header fields:
- Date, unless its omission is required by section 14.18.1
If a clockless origin server obeys these rules, and proxies and clients add their own Date to any response received without one (as already specified by [RFC 2068], section 14.19), caches will operate correctly.
- ETag and/or Content-Location, if the header would have been sent in a 200 response to the same request
- Expires, Cache-Control, and/or Vary, if the field-value might differ from that sent in any previous response for the same variant
If the conditional GET used a strong cache validator (see section 13.3.3), the response SHOULD NOT include other entity-headers. Otherwise (i.e., the conditional GET used a weak validator), the response MUST NOT include other entity-headers; this prevents inconsistencies between cached entity-bodies and updated headers. If a 304 response indicates an entity not currently cached, then the cache MUST disregard the response and repeat the request without the conditional. If a cache uses a received 304 response to update a cache entry, the cache MUST update the entry to reflect any new field values given in the response. Hope I helped, Info http://www.w3.org/Protocols/rfc2616/rfc2616-sec10.html Thomas
-
I found 115,029 301 redirects, i have software from Bing that shows the same violations as Bing sees.,
most are trailing slash issues from “/” to without trailing slash
Here is a sample
The link to "http://www.showme.com/learn/" has resulted in HTTP redirection to "http://www.showme.com/learn".
Each page I check has a huge number of requests mostly to js files and files from other domains
this page for instance Subtracting Negative Numbers
http://www.showme.com/sh/?i=47657
Resulted in all the request you see below, nott that besides js files of wich you have way too many, they ar alomost all from other domains.I cant say what bing thinks, but its not normal when you look at it, there is not much content that does not come from other domains, it may be that bing sees this as a thin site, an affiliate site or some sort of spam.
URL Method Result Type Received Taken Initiator Wait?? Start?? Request?? Response?? Cache read?? Gap??
http://www.showme.com/sh/?i=47657 GET 200 text/html 17.10 KB 2.40 s click 0 15 2340 47 0 78516
http://cdn.optimizely.com/js/6084057.js GET 304 text/javascript 276 B < 1 ms -
Thank you for responses,
Now I have very simple static SiteMap : http://www.showme.com/sitemap.xml
And as far as I checked with Screaming Frog tool, there is no urls with 301 redirections
Still no single page been indexed by Bing, I also added manually few pages... no result, There is just 0 files indexed for our domain.
What can be the reason of such strike by bing?
-
Hi Karen,
There are a long list of URLs in your site which, although they do (eventually) load in a browser, appear to be returning a Status of 0 - Connection Timeout.
It is well recognized that Bing crawlers are very sensitive to URLs in sitemaps that return significant numbers of errors. In this case it appears that the crawler may be encountering pages in the site that it sees as unfetchable.
The majority of these URLs are in the following format - http://www.showme.com/sh/?i=36999 (this is one of them), although this one also returns the same result http://www.showme.com/topic/Geography
If you download the Screaming Frog tool from screamingfrog.com and run it, you will see the list of files that are returning this status.
It appears that the amount of time these pages are taking to load is causing a problem for some crawlers.
Hope that helps,
Sha
-
2 things.
your site map takes for ever to load,
and the links in site map have a trailing "/" but then 301 redirect to a non traling "/" url
http://www.showme.com/careers/ redirects to http://www.showme.com/careersalso Duane Forester from bing states , you should not places every url into your site map, nut only the most important pages, he also states that if your sitemap is not acurate Bing will ignore it.
but anyhow in bing WMT you can submit pages directly to the index, in the index section look for submit urls.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Only half of the sitemap is indexed
I have a website with high domain authority and high quality content and blog. I've resubmitted the sitemap half a dozen times. Search console getr half way through and then stops. Does anyone know any reason for this? I've seen the usual responses of 'google is not obligated to crawl you' but this site has been fully crawled in the past. It's very odd Does anyone have any ideas why it might stop half way - or does anyone know a testing tool that might illuminate the situation?
Algorithm Updates | | Andrew-SEO0 -
Meta robots at every page rather than using robots.txt for blocking crawlers? How they'll get indexed if we block crawlers?
Hi all, The suggestion to use meta robots tag rather than robots.txt file is to make sure the pages do not get indexed if their hyperlinks are available anywhere on the internet. I don't understand how the pages will be indexed if the entire site is blocked? Even though there are page links are available, will Google really index those pages? One of our site got blocked from robots file but internal links are available on internet for years which are not been indexed. So technically robots.txt file is quite enough right? Please clarify and guide me if I'm wrong. Thanks
Algorithm Updates | | vtmoz0 -
A page will not be indexed if published without linking from anywhere?
Hi all, I have noticed one page from our competitors' website which has been hardly linked from one internal page. I just would like to know if the page not linked anywhere get indexed by Google or not? Will it be found by Google? What if a page not linked internally but go some backlinks from other websites? Thanks
Algorithm Updates | | vtmoz0 -
Sub-domain with spammy content and links: Any impact on main website rankings?
Hi all, One of our sub-domains is forums. Our users will be discussing about our product and many related things. But some of the users in forum are adding a lot of spammy content everyday. I just wonder whether this scenario is ruining our ranking efforts of main website? A sub domain with spammy content really kills the ranking of main website? Thanks
Algorithm Updates | | vtmoz0 -
Training - How Google Crawls & Indexes Websites
Hi Does anyone know of any online training resources/webinars/training UK based that will cover the following for SEO: Why monitoring how search engines crawl and index content is important and how this can improve your SEO performance Using Google advanced operators to evaluate website indexation How to use log file data to gain insight into how search engines crawl and index content Techniques to control how search engines crawl and index content How search engines deal with JavaScript, common frameworks and SEO considerations I'm trying to develop my technical knowledge - I have always been more focused on content/KWD research/optimisation. Thank you
Algorithm Updates | | BeckyKey0 -
Best length for a video on a website
Most of us deal with UI/UX questions and SEO questions from clients on a daily basis. I was discussing video length with a client recently and I realized that he was in his video. This made me think about the thrill of seeing yourself in video might cause someone to make their video longer at the expense of UX. So, I thought I would put it to the Moz community. If a company is doing a "typical" home page "Explainer" video that tells about a company. This can be in the B2B or B2C sectors. I want to withhold my opinion at this point for the discussion.
Algorithm Updates | | RobertFisher0 -
Not a mobile friendly website, will it hurt my rankings?
Unfortunately my website is not mobile friendly. As it is based on clickable links within an image there is no way to adapt it either. Now, I have heard Google is getting serious about mobile friendly design, how will this impact my ratings? My current analytics show 57% desktop, 24% mobile and 19% tablet. I really like the design of my site with the clickable images and would hate to have to change it because Google says so :-(. My website is http://tamarindobeachinfo.com
Algorithm Updates | | ijb0 -
Bing Update?
With all of the talk about Panda V2 I am just curious as to whether Bing has also updated their algorithm in the past month. I have seen some reports about the number of indexed pages dropping in half on June 10th as reported in bing's webmaster tools, as well as experiencing that drop on our websites, and a significant decrease in rankings do to them dropping some high performing pages out of their index. So Just wondering if anyone else had seen this or had any info on an algorithm update rolled out from bing. Cheers, Josh
Algorithm Updates | | prima-2535090