Bing seriously hitting our website
-
Hi
I have a strange query, Bing in the last four weeks have been seriously crawling our site, and while at the moment this isn't affecting our servers, coming into the busy time of the year I am just wondering if anyone else is seeing this.
They are basically crawling the entire site (including nofollow pages) even though according to Bing Webmaster tools, they know our sitemap.
Is anybody else seeing any unusual activity with the Bing bot.
Thanks
Andy
-
long time ago I saw that on a client website - as german we could block bingbot in robots.txt with no risk to loose traffic.
I don't know why but the server was highly stressed by bing bot.
So yes I saw something like that - a little bit more than a year ago - but I wasn't interested in the "why?" - I just blocked the bot.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Penalty for duplicate content on the same website?
Is it possible to get a penalty for duplicate content on the same website? I have a old custom-built site with a large number of filters that are pre-generated for speed. Basically the only difference is the meta title and H1 tag, with a few text differences here and there. Obviously I could no-follow all the filter links but it would take an enormous amount of work. The site is performing well in the search. I'm trying to decide whether if there is a risk of a penalty, if not I'm loath to do anything in case it causes other issues.
Intermediate & Advanced SEO | | seoman100 -
Redirecting M Dot Mobile Website to Responsive Design Website Questions
Hi amazing Moz community 🙂 Couldn't find this question anywhere, and knew this was the place to ask! We are helping a client redirect an M Dot website to a Responsive Design website. We want to retain our mobile rankings for keywords. Three questions - We should use 301 redirects from the M Dot website to the new website correct? (not 302s?) How long does it take for Google to understand that we have launched a responsive website? Can we remove the 301 redirects after a few days (if the M Dot website interferes/breaks the new Responsive website)? We have verified an account on Google Search Console for the M Dot website, along with a mobile sitemap that has been submitted and verified. What should we do with this M Dot GSC account? Just delete it? Or keep it and upload the NEW XML Sitemap with the new WWW links (because the website is responsive). THANK YOU!
Intermediate & Advanced SEO | | accpar0 -
Penguin 3.0 hit caused by Pinterest?
I've read the FAQs and searched the help center. My URL is: http://www.weplann.comHello there,Since 10/24 we've seen a critical impact in organic results in our site. At first, only taking a look at the date of when it all started made us think about a Penguin 3.0 hit and then we went to take a look at our linking data to find we had more than 14,000 links from Pinterest (significantly more than any other source). Then, another thing that made us think about that dramatic organic drop is the anchor text: an exact match (www.weplann.com) is at #1 in our anchor text ranking but we're not 100% sure if this could affect our organic results because of the Penguin update.So our questions are:- A lot of Pinterest links could affect dramatically our organic results (understanding that Google may find that huge difference between linking sources as a bad practice)?- The anchor text exact match could really affect our ranking? If none of this points could cause that drop, then what would be causing it? We're sure it has to do with the Penguin update.Thank you very much in advance for your help!!
Intermediate & Advanced SEO | | WePlann0 -
Buying a domain and redirecting it to your website (improves seo?)
hello everyone, imagine that I have a website with Pagerank 7, PA50 DA59... and there is another website who is my competitor... so I decide to buy them... Pagerank3 PA30, DA25.. So I redirect this website to my domain...Using google webmasters I say to Google that it was redirected... So does this improve my SEO or no? Do I get part of the link juice and so on? Can this really improve my rankings?
Intermediate & Advanced SEO | | FCRMediaLietuva0 -
301 Redirect Dilemma - Website redesign
Hi Guys, We are redesigning a clients ecommerce site. As part of the process, we're changing the URL structure to make it more friendly. I have put together a provisional 301 redirect plan but I'm not sure just how far I need to go with it. So far I have extract all the pages from the existing site that Google Webmaster Tools says have links pointing at them - this totals 93 pages. I have matched each page like for like to the new website structure. My next step was to pull the landing pages report from Google Analytics, I have extracted the pages that received entrances over the last 6 weeks. This totals 553, less the redirects I have already done and cleaning up some Google Translate pages I have circa 410 pages left. Many of these pages has more than 1 URL pointing to that page. I'm debating how important it is that that all of these remaining 410 pages have individual redirects set up for them one by one. I have to rule out regex because there is no pattern that makes sense given that I have already set up redirects for the first 93 pages that have external links. My question therefore is how important are 301 redirects on pages that have no external links and receive less than 10 entrances over a 6 week previous period? Do I need to 301 every single product on the old site to it's corresponding page on the new site? Also, I'm not sure how to treat pages that have mutliple URL's on the old site, the existing URL structure is such a mess that in some instances I have 5 URL's for one product page? I could feasibly create 5 seperate redirects but is this necessary? Also what about speed considerations, the server is going to have to load these redirects and it may slow the site down. I'm sitting at 100 odd so far. Any answers are most appreciated. Thanks Derek.
Intermediate & Advanced SEO | | pulseo0 -
Hit by Google updates; Some good advice needed
Hi, Here`s my domain http://www.kent-website-designer.co.uk/. Registered in 2007. We have took a big hit from the updates in the last 6 months and its really affecting revenue. I know when you look at the site you may well think WOW this is 2007 SEO and youre right it hasnt been updated in some time as of last year we ranked very highly and it gave us enough business to concentrate on. However up until last year many of my competitors were using same onpage and offpage strategies....and probably a few of you were too! So now the inquiries and income is drying up. However, I provided myself with an income from my efforts, rather than be unemployed, so I want to get it back on track. I visited the Google webmaster forums to query a couple of webmaster account queries and basically got beat up by the rude and arrogant google forum admins. Basically they said I was a spam site who shouldnt be in business. How very nice! 1. I have EMD - but domain age should mean something? 2. I lost a few links from https://www.getsafeonline.org/partners-and-supporters/ in the last year which hasnt helped when they reorganised their content. Same with other trusted sites we lost links. We are left with low quality links. 3. Some CMS sites have replicated our footer links on a large scale, which wasnt intentional but may look as link spam, plus they arent no followed as G prefers. 4. Google seems to have become intelligent? Apparently it can detect content which is negative in outdated seo advice. How, can it understand context and meaning so older seo advice isdetected as spam content? 5. No pages are de indexed just a rank drop to 30 - 60 positions. 6. Over optimised H1`s? 7. Is Pipe command in titles now negative? So its sink or swim time I guess. The siteand domain is honest but neglected and probably should re align the business with what we can offer. We got away with that SEO but clearly things have changed. However with no grey or black hat at least we arent overly worried by removing links. Also looking for an SEO company who we can outsource with a white label solution in order to offer SEO. I dont need beating up, short and to the point critiques please. Pros and Cons Many thanks.
Intermediate & Advanced SEO | | xtopher661 -
How to find all of a website's SERPs?
Was wondering how easiest to find all of a website's existing SERPs?
Intermediate & Advanced SEO | | McTaggart0 -
Why was I hit by the above the fold algo?
I cannot find any decent information on this update. Everybody appears to reiterate what Matt Cutts posted. I understand what the update was 'supposed' to combat and achieve. I also understand what those abusing ads above the fold, are supposed to do. But I need to know what to do, when you don't have too many ads above the fold. One of my websites was hit. Several professionals have tried to convince me it was Panda, that was released on 18th January. But I am now 99.9% certain it wasn't. I'm in the UK, traffic on the 18th was normal, little better than expected actually. Traffic on the 19th was normal until around 10pm GMT and there as a noticeable dip, compared with previous days and weeks. January 20th continued this decline and at the end of the day, there was a 25% loss. I have 1 Google ad, that is above the fold. Most of the pages have no ads at all. No affiliates or anything else. I have always prided myself in keeping my website clean and ad free. We also have the lowest bounce rates in the niche, by a mile, as far as I can tell, from speaking to other webmasters. I cannot remove this 1 ad, the servers alone, cost a couple of grand. The advertising supports the website. Nothing I can find online, gives me any indicators, as to what might be tripping this filter. But I need to figure it out, as traffic has now reached a 50% loss, which equates to about 15,000 visitors per day. I have tore my pages apart, removed functionality, added functionality and yet traffic has continued to decline. Can anybody shed light on this? I worry that perhaps Google is seeing the images on my website as ads. The images open a bigger preview in lightbox, but with JS turned off, opens a new page, with nothing but the image on it. I am at my wits end. Any help would be greatly appreciated. Paul
Intermediate & Advanced SEO | | seo-wanna-bs0