Bing: Large Scale Experimentation

[engine]

You can read some snippets from the forthcoming paper titled, Online Controlled Experiments at Large Scale.

Dr. Ronny Kohavi describes our broader online experimentation efforts at large scale and includes compelling examples that illustrate the power of these efforts, e.g., he shows how a controlled experiment at large scale of a relatively small feature change can lead to many millions of dollars in revenue. Ronny’s blog is a brief summary of a research paper titled Online Controlled Experiments at Large Scale which will he will present next week at the international conference on Knowledge Discovery and Data Mining (KDD 2013). Bing: Large Scale Experimentation [bing.com]

[SEOPTI]

This is just plain old A/B testing.