AB-tests analysis Statistical significance, power and further reading on AB-testing

212. Statistical significance, power and further reading on AB-testing

In this lesson let’s try to zoom out from AB-test funnels and metrics and talk about the process of running AB-tests. From the very beginning.

Any AB-test starts with a hypothesis. Actually, it starts even earlier. For example, when someone notices a problem in the product funnel and a company or a team decides to work on it. Like “This month we’ll be focusing on improving our purchase rate”.

Once this decision is made, we make research to really understand a problem. Why users drop out at this point? Of course, we can brainstorm some ideas and...

“well worth the money”
Sign up and check out 37 free lessons and exercises.

Anatoli Makarevich, author of SQL Habit About SQL Habit

Hi, it’s Anatoli, the author of SQL Habit. 👋

SQL Habit is a course (or, as some of the students say, “business simulator”). It’s based on a story of a fictional startup called Bindle. You’ll play a role of their Data Analyst 📊 and solve real-life challenges from Business, Marketing, and Product Management.

SQL Habit course is made of bite-sized lessons (you’re looking at one atm) and exercises. They always have a real-life setting and detailed explanations. You can immediately apply everything you’ve learned at work. 🚀

“well worth the money”

Fluent in SQL in a month

Master Data Analysis with SQL with real life examples from Product Management, Marketing, Finance and more.
-- Type your query here, for example this one -- lists all records from users table: SELECT * FROM users
Loading chart... ⏳
Previous lesson: Looking at AB-test performance in time
Next lesson: AB-test analysis recap