In this lesson, you'll debug a real-world ML problem* related to cancer
prediction.
Real World Example: Cancer Prediction
Real World Example: Cancer Prediction
Model was trained to predict "probability patient has cancer" from medical records
Real World Example: Cancer Prediction
Model was trained to predict "probability patient has cancer" from medical records
Features included patient age, gender, prior medical conditions, hospital name, vital signs, test results
Real World Example: Cancer Prediction
Model was trained to predict "probability patient has cancer" from medical records
Features included patient age, gender, prior medical conditions, hospital name, vital signs, test results
Model gave excellent performance on held-out test data
Real World Example: Cancer Prediction
Model was trained to predict "probability patient has cancer" from medical records
Features included patient age, gender, prior medical conditions, hospital name, vital signs, test results
Model gave excellent performance on held-out test data
But model performed terribly on new patients -- why?
Real World Example: Cancer Prediction
Why do you think the model was unable to perform well on
new patients? See if you can figure out the problem, and
then click the Play button ▶ below to find out if
you're correct.