A process for evaluating Machine Learning models for Healthcare Applications
Abstract
Machine Learning (ML) has been advancing in the most diverse areas of knowledge. Among those, ML for Healthcare and Decision Support of Medical applications present specific challenges in evaluating, monitoring, and maintaining ML models. Once deployed, models are subject to performance degradation (drift). Therefore, continuous monitoring and evaluation are essential to establish minimum performance guarantees over unknown, real-world data. In medical applications, incorrect decisions can lead to life-threatening situations and irreversible outcomes. The present work proposes a process for ML model evaluation designed for Healthcare applications running on real-world data. To that end, a conducted Systematic Literature Review (SLR) aimed at determining the state-of-the-art techniques and methods for ML evaluation (detailed in another paper) and a case study applied the proposed process to ML models in an oncology ICU. The Case Study produced positive outcomes in establishing a feedback loop for models in use against real-world data.
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Copyright (c) 2024 Cezar Miranda Paula de Souza, Cephas Alves da Silveira Barreto, Bruna Alice Oliveira de Brito, Victor Vieira Targino, Ramon Santos Malaquias, Itamir de Morais Barroca FilhoAuthor(s)
-
Cezar Miranda Paula de Souza
-
Cephas Alves da Silveira Barreto
-
Bruna Alice Oliveira de Brito
-
Victor Vieira Targino
-
Ramon Santos Malaquias
-
Itamir de Morais Barroca Filho
-
Amanda Gomes de Oliveira Pereira