#29Hard
Design an A/B Testing System (like Optimizely)
Asked by:AffirmSome FAANG
Recommended Solutions from the Web
Good design
https://chuan-zhang.medium.com/building-a-trustworthy-a-b-testing-platform-practical-guide-and-an-architecture-demonstration-332446724ba0
High level overview
https://xhinliang.medium.com/how-to-design-an-a-b-test-system-1450b06933f
Building a small homemade A/B test engine
https://medium.com/studocu-techblog/recipe-for-implementing-a-homemade-a-b-testing-engine-2e95c97c8020
Key Details & Edge Cases You Should Know
•
How will you store and retrieve different treatment UI?
•
How will you measure the success metrics for each treatment?
•
How will you assign a treatment to a user and maintain it for that user across sessions?
•
How will the company admin see the treatments?
•
How will you store the information for the tests? Or, how will you structure the database?
•
How will you easily turn the test on and off?