51 items
A/B Testing: Power, p-values, and CUPED
Simpson's Paradox: Aggregating Stratified Rates
Simpson's Paradox and Confounding
A/B Testing: Power, P-values, CUPED
Confounding and Simpson's Paradox
Two-Proportion Z-Test for A/B Test
Peeking at A/B Test Results
Confidence Interval From Sample Mean
Interpreting a 95% Confidence Interval
Simpson's Paradox and Confounders
Confidence Intervals & the Sampling Distribution
Hypothesis Testing in A/B Experiments
Distributions, Sampling & Confidence Intervals
Hypothesis Testing & A/B Design
Interpreting the p-value Wrong
Interpreting P-values Correctly
Buggy Standard Deviation Function
Mean vs Median in Skewed Data
P-value Significance Check Bug
Understanding P-values and Correlation
Population Variance Bug
Hypothesis Testing, P-values & Causation
P-values and Correlation vs Causation
Hypothesis Testing, p-values & Intervals
P-values & Confidence Intervals
Extracting an Eigenvector from np.linalg.eig
Data as Vectors and Matrices
Gradients and Partial Derivatives
Singular Value Decomposition Basics
Matrix Transpose and Inverse
Linear Independence, Span, and Basis
Vector Norms and Distance Metrics
Dot Product and Vector Similarity
Matrix Multiplication in AI
Matrices and Matrix Operations
Vectors and Vector Operations
Confidence Intervals
Hypothesis Testing and p-values
Sampling and the Central Limit Theorem
Descriptive Statistics: Center and Spread
Maximum Likelihood Estimation
Joint, Marginal, Conditional Distributions
Covariance and Correlation
Expectation, Variance, Standard Deviation
Bayes' Theorem in AI
Conditional Probability and Independence
Gaussian, Bernoulli, Binomial Distributions
Discrete vs Continuous Distributions
Random Variables and Distributions
Eigenvalues and Eigenvectors Basics
Understanding why repeatedly checking p-values inflates false positive rates in A/B tests.
A team runs an A/B test with a fixed significance level of α = 0.05, but they check the p-value daily and plan to stop as soon as it drops below 0.05. Why does this practice inflate the actual false positive rate well above 5%?