The term “Receiver Operating Characteristic” (ROC) originated in the field of signal detection theory during World War II. Initially, it was used to analyze and measure the performance of radar receivers.

The ROC curve, in Machine Learning, is a graphical representation that illustrates the trade-off between true positive rate (sensitivity) and false positive rate (1 – specificity) across different thresholds for a binary classification model. AUC represents the degree or measure of separability, while ROC is a probability curve.

The ROC-AUC curve indicates how well the model can distinguish between classes. The greater the AUC, the better the model predicts correct classes (0 classes as 0 and 1 classes as 1). Similarly, the higher the AUC, the better the model distinguishes between patients with and without the disease.

The ROC curve is displayed with True Positive Rate (TPR) versus False Positive Rate (FPR), with TPR on the y-axis and FPR on the x-axis.

Tips: Classification error rate = 1 – Accuracy

GO ONE LEVEL DEEPER

What ROC-AUC does—and does not—tell you

The ROC curve shows sensitivity against false-positive rate as the classification threshold changes. AUC summarizes ranking ability across those thresholds.

From scores to a decision
01

Score

The model assigns each case a probability or decision score.

02

Sweep

Move the threshold and record true- and false-positive rates.

03

Choose

Select an operating point using the real cost of each error.

Keep in mind

  • AUC measures ranking, not probability calibration.
  • With rare positive classes, also inspect precision-recall curves.
  • The best threshold depends on business consequences, not a universal rule.