ML0016 AUC

AUC (Area Under the Curve) measures a binary classifier’s ability to distinguish between the positive and negative classes, computed as the area under its ROC curve, the curve that trades off true positive rate against false positive rate across all thresholds. Its value ranges from 0 to 1: 1.0 is a perfect classifier, 0.5 is random guessing (the diagonal), and below 0.5 is worse than random, which rarely happens and can be flipped into a better model. AUC’s advantages: it is threshold-independent, summarizing performance over every decision threshold at once; it handles imbalanced data well because it evaluates the ranking of predictions rather than absolute counts; and it gives an intuitive single number for comparing different models.

(1) Definition: The area under the ROC curve: one scalar summarizing threshold-free discrimination.
(2) Probabilistic Meaning: AUC equals the probability that a random positive scores higher than a random negative.
(3) Reading The Scale: 1.0 perfect, 0.5 random, below 0.5 inverted.

Figure 1: AUC is literally the shaded area under the ROC curve; the wider the curve bows toward the top-left corner, the larger the area.

Mathematical Formulation:

Where:

• is the model’s score (e.g., predicted probability) for sample .
• is a randomly chosen positive sample and a randomly chosen negative one.
• is the ROC curve itself, true positive rate as a function of false positive rate.
• The two lines are equivalent: the geometric area (integral) equals the pairwise-ranking probability, which is why AUC measures ranking quality.