the problem with using ai to detect skin cancer
artificial intelligence is trained to detect skin cancer using photos — but they're mostly photos of white people.
3 minute read
artificial intelligence has a lot of potential to detect skin cancer — but there are also some significant drawbacks. (getty)
at a time of limited access to burned-out doctors, mass exodus of nurses, increasingly long patient waitlists, and an ongoing pandemic, the use of artificial intelligence in the medical system has massive potential. being able to diagnose — or at least flag — significant issues before setting foot in a doctor’s office would help thousands of people. and the possibility of ai diagnosing something with visible physical symptoms would be a natural place to start.
but unfortunately, with skin cancer, the existing ai just isn’t good enough.
that’s what researchers from the u.k.’s national cancer research institute (ncri) discovered when they examined the way ai learns about skin cancer, in a study published this week in the lancet.
“ai programs hold a lot of potential for diagnosing skin cancer because it can look at pictures and quickly and cost-effectively evaluate any worrying spots on the skin.” dr. david wen of university of oxford told the ncri’s news outlet. “however, it’s important to know about the images and patients used to develop programs, as these influence which groups of people the programs will be most effective for in real-life settings.”
ai learns what it’s looking for through “training”: being fed thousands of images of skin lesions and other abnormalities that have already been determined as either cancerous or non-cancerous. in theory, the program can then track and flag the similarities that may lead to a cancer diagnoses in new photos.
advertisement
researchers found and examined 21 sets of training material data that the ai had received, which together included more than 100,000 pictures. but they realized a lot was missing in how the ai was trained: few photos were taken in the highly specific way that would be most helpful (one photo of the potentially cancerous lesion, along with a photo taken with a special hand-held magnifier). and there was no information provided about how or why the images were chosen to be included.
and, more significantly, they didn’t have sufficient racial data for the program to recognize what skin abnormalities might look like on a diverse range of skin tones.
most of the photos — 14 of the 21 data sets — provided information about the country the photos came from, but few of them were specific about the patients’ skin colour or ethnicity. and the images that did specify skin colour were overwhelmingly white: out of 2,436 photos with that information, only 10 were of people with brown skin, and there was only one single photo of dark brown or black skin. even fewer photos (1,585) — specified ethnicity. there were no photos of people whose ethnicities were african, afro-caribbean or south asian.
when it comes to something as specific as skin cancer, that’s a significant problem, wen explained.
advertisement
“research has shown that programs trained on images taken from people with lighter skin types only might not be as accurate for people with darker skin, and vice versa,” he said. “this can potentially lead to the exclusion or even harm of these groups from ai technologies. although skin cancer is rarer in people with darker skins, there is evidence that those who do develop it may have worse disease or be more likely to die of the disease. one factor contributing to this could be the result of skin cancer being diagnosed too late.”
dr. neil steven, who was not involved in the research, but who is a member of the ncri skin group, said it’s worrying that many non-white people have essentially been left out of the ai skin cancer training so far.
“the findings of this review… raise concerns about the ability of ai to assist in skin cancer diagnosis, especially in a global context,” he said. “we already know that there are not enough pictures of people from black and asian backgrounds in the textbooks we use to train doctors… i hope this work will continue and help ensure that the progress we make in using ai in medicine will benefit all patients, recognizing that human skin colour is highly diverse.
advertisement
wen added that he and his colleagues plan to improve the standards used in training and developing ai for medical use, with an emphasis on the importance of including a wide variety of skin colours and ethnic backgrounds in the patients whose images are used.
share story
