Preporato

Model evaluation

Is the model any good? Metrics, thresholds and honest splits.

Start 6 problems

Problems

  1. 1Confusion counts for a spam filterEasy · 8 min · 10 hidden testsSolution free
  2. 2Precision, recall and F1 with the zero casesEasy · 8 min · 10 hidden tests
  3. 3Precision and recall at review capacityMedium · 12 min · 10 hidden tests
  4. 4ROC AUC by rankingHard · 20 min · 11 hidden tests
  5. 5Stratified k-fold assignmentMedium · 12 min · 11 hidden tests
  6. 6Expected calibration errorMedium · 14 min · 11 hidden tests

Practice it at full scale

Hands-on labs on real tooling, in your browser.

Metrics That Match the BusinessOverfitting and Cross-Validation

Where interviews test it

Cases from our interview prep that lean on this step.

Claims intake for an insurer