Here's a great Reddit thread discussing this—with many commenters pointing out bits that I overlook (especially re: assumptions I'm making about the distribution of the "standard deviation of the mean-difference" as well as when we can actually rely on asymptotic behavior given by the Central Limit Theorem).

I will incorporate these into the article over the coming days.

--

Engineer. Focused on experimentation, causal inference, and good software design. naimkabir.com

Love podcasts or audiobooks? Learn on the go with our new app.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Naim Kabir

Naim Kabir

Engineer. Focused on experimentation, causal inference, and good software design. naimkabir.com