The impact of violating assumptions of independence on AB Tests and changing the primary metric for your company — Changing the primary metric for any company is not a straightforward thing to do. Why you may ask? There are dozens of reasons but here are some of the ones that come to my mind: The company has been using that metric for a long time Forecasts have been made…

Since joining LeanConvert, I’ve been leading a weekly discussion with the team where we delve deep into the philosophical layers of experimentation and analytics — we call this session AB Wisdom. This week we discussed the ethics of pricing experiments. I’ve seen a few posts on this on LinkedIn over…

Without scrolling down any further, can you guess where this famous stone sculpture is located? — Congratulations if you guessed Paris. This incredibly detailed piece of art is one of the many stone sculptures carved into the Arc de Triomphe (see below).

Let’s explore how to use the Fermi Problem Approach in estimating the impact of new products. — Over the years, one question I’ve been asked frequently is “what is the potential impact of a new product feature?” More often than not, this question aims to help product managers prioritize their roadmaps. If you are a product manager, analyst, or conversion optimiser, you’ve likely found yourself grappling with…

I’ve often heard analysts talk about work they’ve done not being actioned, recommendations being ignored or proposed changes falling by the wayside. Most analysts understand what I’m referring to — that, “OK, thanks” moment with no follow-up or the JIRA ticket in the “awaiting feedback” column for weeks on end. …

Is mild user discomfort an acceptable goal? — Recently, I stumbled upon something called “The Region-Beta Paradox” (apparently I’m not the only one — image 1). However, I’m probably one of the few who upon discovering this phenomenon, hunted down and read the original paper. I really wanted to read and understand this over some watered down interpretation.

Look at the image above. Sound familiar? The rest of the article is in relation to the image above so please do make sure you read it. From Value Creation to Value Realisation! Breaking the “Cycle of Doom” is a hard thing for an Analytics team to do as it…

The hottest roles in data — Every year, Harnham publishes their Data Salary Guide. I’ve been reading this on and off for about 7 years and recently I got curious about how much salaries have changed in that time at different levels. …

Providing clarity is one of the most undervalued skills at work in my opinion. Being able to eliminate ambiguity from a situation can have an immeasurable positive effect on everyone. Clarity saves time, allows for better prioritisation, empowers everyone to do their best work and has a positive impact on…