109 items
Ranking Metrics on Imbalanced Data
Code QuizPR vs ROC on Imbalanced Fraud Data
QuizPR vs ROC on Imbalanced Data
FlashcardMetrics for Imbalanced Data
Slides / VideoCross-Validation on Time-Series Data
Code QuizMetric & Validation Strategy Selection
QuizChoosing Metrics and Validation Strategy
FlashcardChoosing Metrics and Validation
Slides / VideoCross-Validation Data Leakage Bug
Code QuizCross-Validation on Imbalanced Data
QuizMetrics & Cross-Validation
FlashcardEvaluation Metrics & Cross-Validation
Slides / VideoData Leakage in Model Evaluation
Code QuizRecognizing Overfitting
QuizOverfitting & Bias-Variance Tradeoff
Slides / VideoOverfitting & Bias-Variance Tradeoff
FlashcardCore Evaluation Metrics at a Glance
Slides / VideoSplits and Cross-Validation Basics
Slides / VideoCommon Evaluation Metrics Overview
FlashcardData Splits and Cross-Validation Basics
FlashcardLearning Curves for Model Diagnosis
Slides / VideoBias-Variance Tradeoff
Slides / VideoStratified Cross-Validation for Imbalanced Data
Slides / VideoK-Fold Cross-Validation
Slides / VideoTrain/Validation/Test Split Purpose
Slides / VideoRegression Metrics: MAE, MSE, RMSE, R2
Slides / VideoROC Curve and AUC
Slides / VideoPrecision-Recall Tradeoff
Slides / VideoPrecision, Recall, and F1 Score
Slides / VideoConfusion Matrix Structure and Interpretation
Slides / VideoWhy Accuracy Alone Is Insufficient
Slides / VideoChoosing the Right Metric
Slides / VideoBaseline Models for Comparison
Slides / VideoEvaluating Models on Imbalanced Data
Slides / VideoData Leakage and How to Avoid It
Slides / VideoHyperparameter Tuning with Validation Set
Slides / VideoGrid Search Parameter Grid
Code QuizTime-Series Split Ordering
Code QuizBias-Variance Diagnosis
Code QuizNested Cross-Validation Estimate
Code QuizLeave-One-Out Setup
Code QuizOverfitting Gap From Curves
Code QuizUnderfitting Detection Logic
Code QuizThree-Way Split Proportions
Code QuizPrecision-Recall Curve Use
QuizMacro vs Micro vs Weighted Averaging
QuizOverfitting to the Test Set
QuizStratified Cross-Validation
QuizCross-Validation for Small Datasets
QuizChoosing the Right Metric
QuizHyperparameter Tuning with Validation
QuizF1 Score Basics
QuizChoosing a Classification Threshold
QuizBaseline Models
QuizUnderstanding Recall
QuizReading a Confusion Matrix
QuizK-Fold Cross-Validation
QuizSpecificity and False Positive Rate
QuizHoldout vs Cross-Validation
QuizDefinition of Precision
QuizR-squared vs Adjusted R-squared
QuizDetecting Overfitting
QuizLog Loss as a Metric
QuizMetrics for Imbalanced Classification
QuizBias-Variance Tradeoff
QuizROC Curve and AUC
QuizAccuracy on Imbalanced Data
QuizLeave-One-Out Cross-Validation
QuizMAE vs MSE vs RMSE
QuizBaseline Dummy Classifier Comparison
Code QuizAggregating Cross-Validation Scores
Code QuizComputing MAE
Code QuizMacro vs Weighted F1 Average
Code QuizR-squared Interpretation
Code QuizAccuracy on Imbalanced Data
Code QuizThresholding Probabilities to Labels
Code QuizK-Fold Cross-Validation Setup
Code QuizStratified K-Fold for Balance
Code QuizComputing RMSE
Code QuizAccuracy From a Confusion Matrix
Code QuizROC Curve and AUC Interpretation
Code QuizSpecificity and False Positive Rate
Code QuizF1 Score Computation Bug
Code QuizPrecision-Recall Curve Baseline
Code QuizReading a Confusion Matrix Layout
Code QuizRecall (Sensitivity) Calculation Bug
Code QuizPrecision Calculation Bug
Code QuizBias-Variance Tradeoff
FlashcardClassification Threshold Selection
FlashcardMetric Selection Based on Problem Type
FlashcardRegression Metrics: MAE
FlashcardEvaluation on Imbalanced Datasets
FlashcardRegression Metrics: MSE and RMSE
FlashcardLearning Curves for Diagnosis
FlashcardBaseline Model for Comparison
FlashcardR-Squared (Coefficient of Determination)
FlashcardHyperparameter Tuning with Validation Set
FlashcardPrecision-Recall Tradeoff
FlashcardK-Fold Cross-Validation
FlashcardStratified K-Fold Cross-Validation
FlashcardF1 Score
FlashcardSpecificity
FlashcardPrecision
FlashcardTrain/Validation/Test Three-Way Split
FlashcardHoldout Validation vs Cross-Validation
FlashcardROC Curve and AUC
FlashcardLeave-One-Out Cross-Validation (LOOCV)
FlashcardRecall / Sensitivity
FlashcardConfusion Matrix
FlashcardHyperparameter Tuning with Validation Set
Learn how a separate validation set lets you tune hyperparameters without cheating on your test data.
