The international study led by Philipp Tschandl and Harald Kittler (Department of Dermatology, MedUni Vienna) and Christoph Rinner (CeMSIIS/Institute for Medical Information Management, MedUni Vienna) now debunks the idea of this alleged competition, highlighting instead the enormous potential of combining human expertise with Artificial Intelligence. The study published in “Nature Medicine” examines the interaction between doctors and AI from various perspectives and in different scenarios of practical relevance. Although the authors restrict their observations to the diagnosis of skin cancers, they stress that the findings can also be extrapolated to other areas of medicine where Artificial Intelligence is used.

AI does not always improve diagnosis
In an experiment created by the study authors, 302 examiners and/or doctors had to assess dermoscopic images of benign and malignant skin changes, both with and without the support of Artificial Intelligence. The AI assessment was provided in three different variants. In the first case, AI showed the examiner the probabilities of all possible diagnoses, in the second case the probability of a malignant change and, in the third case, a selection of similar images with known diagnoses, similar to a Google image search. As a main finding the authors observed that  only in the first case did collaboration with AI improve the examiners’ diagnostic accuracy, although this was significant, with a 13% increase in correct diagnoses.

“Interestingly, less experienced examiners benefit more from AI support than experienced ones. Less experienced examiners trusted AI more than did the experienced ones. The latter only accepted the AI suggestions to change their original diagnosis in cases where they themselves were unsure,” emphasised the study authors. A second experiment showed that all examiners, even acknowledged experts, can be misled by AI, if the output was changed to indicate false diagnoses. “The study therefore shows that a certain amount of trust in AI is required in order to benefit from it but that this trust can also have a downside.”

AI could ease doctors’ workloads and improve quality
In a further step, the authors showed that good quality AI is able to filter out benign skin changes in a telemedicine scenario. This could significantly reduce the number of cases needing to be examined by a human expert. It was then demonstrated using real, prospectively gathered data that even inexperienced examiners can make expert-level telemedicine diagnoses with AI support. It was also shown in a final experiment that people can learn to use AI-generated concepts as diagnostic pointers in order to improve their own skills independently of AI.

Collaboration is the way forward
The conclusion: “In future, human and artificial intelligence will supplement each other and jointly improve patient care. We should stop focusing on the contest but rather on the collaboration between human expertise and AI. “Since not all users benefit equally from AI support and since the form of support plays a role, AI-based medical systems should not only undergo practical testing as stand-alone applications but also always in interaction with the typical user.”

New Source: www.meduniwien.ac.at

Authors: “Human–computer collaboration for skin cancer recognition.” Philipp Tschandl, Christoph Rinner, Zoe Apalla, Giuseppe Argenziano, Noel Codella,  Allan Halpern, Monika Janda, Aimilios Lallas, Caterina Longo, Josep Malvehy, John Paoli, Susana Puig, Cliff Rosendahl. H. Peter Soyer, Iris Zalaudek and Harald Kittler. Doi: 10.1038/s41591-020-0942-0. https://rdcu.be/b46tc.