Skip to main content

Table 1 Checklist of steps required for management of project involving deep learning

From: Deep learning workflow in radiology: a primer

Scope

❏ Define scope of project: detection, segmentation, classification, monitoring, prediction or prognosis.

Team building

❏ Project manager (e.g, physician, data scientist)

❏ Clinical expertise (e.g., surgeon or hepatologist)

❏ Imaging expertise (e.g., radiologist)

❏ Technical expertise (e.g., data scientist)

Ethics

❏ Obtain IRB approval

Cohorting

❏ Selection process (e.g., by target population vs. database)

❏ Definition of eligibility criteria

❏ Identification of data source

Data

De-identification

❏ Data anonymization vs. pseudonymization

Collection and curation

❏ Data collection

❏ Data exploration and quality control

❏ Labeling = markup and annotations

❏ Reference standard (synonyms: ground truth or gold standard)

Sampling

❏ Creation of training, validation and test datasets

❏ Alternative: cross-validation

Model

❏ Defining performance metrics

❏ Selection of model (convolutional, recurrent, fully connected) and librairies

❏ Running the experiment followed by hyperparameters fine tuning

❏ Testing: assessing performance on separate test dataset

Hardware

❏ Determine best configuration based on model architecture and memory requirements

❏ Local (CPUs vs. GPUs) vs. cloud computing (GPUs vs. TPUs)

Regulatory

❏ Market research to inform decision to commercialize

❏ Quality management system

❏ Compliance with local regulatory jurisdictions

Clinical adoption

❏ Integration in distribution platform

❏ Clinical validation of performance

❏ Deployment in clinical practice