Welcome to the Q&A Forum

Hi everyone,

Description of test: We're a lead gen site trying to add more value by providing users with real, live quotes after they submit a lead. However, we don't want showing the quotes to tank our lead conversion rates. So we're running a test where 50% of leads see quote results and 50% don't, and we compare the lead conversion rates for each. The best possible outcome is to show that showing the quotes DIDN'T negatively affect conversion rates.

My issue: When do we conclude the test? In the end, we're hoping to see that the change didn't cause a statistically significant difference between the control and version B, which is the opposite of every other test I've ever run. So, at what point do we conclude that the changes in version B didn't have a significant effect on lead conversions? Currently the control is doing 5% better than the variation with a p-value of .379

Yes, just desktop. And the change happened across multiple browsers, not just Firefox.

I hadn't used Bing in a while but when I tested it out after the drop seems like there's way more ads that I remember there being before. (Of course, that's not the most scientific of observations.)

I looked in Bing Webmaster Tools and it definitely looked like something funky was going on.

We still use http on our site, but Bing was picking up a flawed https version of the home page. I had the tech team redirect https to http using a 301. When I fetched with Bingbot, it initially returned an error. After a couple of re-tries, though, it worked fine. Very strange. I submitted the URL for bing to re-crawl.

I imagine this has something to do with it, although I can't say exactly how.

Another funky thing: Almost all of our Bing/Yahoo traffic is from one keyword. According to Bing Webmaster tools, we rank the same for that keyword after the drop in traffic as we did before. Maybe there has been a change to Bing/Yahoo SERPs?

Has anyone else noticed any flux in Bing/Yahoo desktop search rankings in the start of March?

Our weekly MSN search traffic was steady and then starting dropping off around March 3 or 4. Weekly desktop traffic now down about 20%

Anyone see anything similar or have any resources for learning more about this?

Yes, just desktop. And the change happened across multiple browsers, not just Firefox.

I hadn't used Bing in a while but when I tested it out after the drop seems like there's way more ads that I remember there being before. (Of course, that's not the most scientific of observations.)