Here's a great Reddit thread discussing this—with many commenters pointing out bits that I overlook (especially re: assumptions I'm making about the distribution of the "standard deviation of the mean-difference" as well as when we can actually rely on asymptotic behavior given by the Central Limit Theorem).

I will incorporate these into the article over the coming days.

Engineer. Focused on experimentation, causal inference, and good software design.

Love podcasts or audiobooks? Learn on the go with our new app.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store