To manage rising medical costs, an insurance company is using a computer AI model to predict which customers are most likely to develop cancer. The goal is to find high-risk patients early using their medical records and insurance data.
Using this data, the computer automatically sorts patients into two groups: standard risk (no extra testing) or high risk (requires expensive cancer screenings and higher monthly insurance prices).
In our sample data, 30% of people are high risk
In a perfect world, the computer would only flag patients who are
But computer models aren't perfect.
Mistake 1: The computer misses a patient who actually has high cancer risk
Mistake 2: The computer flags a healthy patient as high risk
One approach is to set the computer to flag people very cautiously. Any borderline case is marked "high risk" so the computer rarely misses anyone who might develop cancer.
We can check how well this works by counting how many patients are flagged correctly vs. by mistake:
On the other hand, flagging too many people wastes money on unnecessary tests, forces healthy people to pay higher insurance bills, and causes huge emotional stress.
Finding the right balance between catching cancer early and avoiding false alarms is a major challenge when setting up the AI model.
Adding more personal data can help the computer make better predictions.
But does every piece of data actually help? And is it fair or private to collect such personal details?
Now it's your turn! Choose (1) which personal data sources the computer can use, and (2) how cautious the computer should be when flagging someone as high risk.
Adopted from AI Explorable by PAIR, made by Adam Pearce, licensed Apache License 2.0.
Silhouettes from ProPublica's Wee People.