Access the full text.
Sign up today, get DeepDyve free for 14 days.
Loading next page...
/lp/arxiv-cornell-university/review-of-artificial-intelligence-techniques-in-imaging-data-0U3WrkKn4C
References
References for this paper are not available at this time. We will be adding them shortly, thank you for your patience.
- ISSN
- 1937-3333
- eISSN
- ARCH-3345
- DOI
- 10.1109/RBME.2020.2987975
- Publisher site
- See Article on Publisher Site
Abstract
This paper was submitted as an invited paper to IEEE Reviews in Biomedical Engineering on April 6, 2020. Review of Artificial Intelligence Techniques in Imaging Data Acquisition, Segmentation and Diagnosis for COVID-19 † † † Feng Shi , Jun Wang , Jun Shi , Ziyan Wu, Qian Wang, Zhenyu Tang, Kelei He, Yinghuan Shi, Dinggang Shen Abstract—The pandemic of coronavirus disease 2019W e particularly focus on the integration of AI with X-ray (COVID-19) is spreading all over the world. Mediacnd al CT, both of which are widely used in the frontline imaging such as X -ray and computd e tomography (CT) hospitals, in order to depict thel atest progress of medical plays an essential role in the global fight against COVID-19, imaging and radiology fighting against COVID-19. Index Terms—COVID-19, artificial intelligen,c e image whereas the recently emerging artificial intelligence (AI) acquisition, segmentation, diagnosis technologies further strengthen the power of the imaging tools and help medical specialists. We hereby review the I. INTRODUCTION rapid responses in the community of medical imaging HE coronavirus disease 2019 (COVID-19), caused by (empowered by A) I toward COVID -19. For example, Ts evere acute respiratory syndrome coronavirus 2 AI-empowered image acquisition can significantly help automate the scanning procedure and also reshape the (SARS-CoV-2), is an ongoing pandemic. The number of workflow with minimal contact to patients, providing the people infected by the virus is increasing rapidly. Up to April 5, best protection to the imaging technicians. Also, AI can 2020, 1,133,758 cases of COVID-19 have been reported in over improve work efficiency by accurate delination of 200 countries and territories, resulting in approximately 62,784 infections in X-ray and CT images, facilitating subsequent deaths (with a fatal rate of 5.54%) [1]. This has led to great quantification. Moreover, the comput-earided platform s public health concern in the international community, as the help radiologists make clinical decisions, i.e., for disease World Health Organization (WHO) declared the outbreak to be diagnosis, tracking, and prognosis. In this review paper, we a Public Health Emergency of International Concern (PHEIC) on January 30, 2020 and recognized it as a pandemic on March thus cover the entire pipeline of medical imaging and 11, 2020 [2, 3]. analysis techniques involved with COVID -19, including Reverse Transcription-Polymerase Chain Reaction (RT-PCR) image acquisition, segmentation, diagnosis, and follow-up. test serves as the gold standard of confirming COVID-19 This work was supported in part by the Shanghai Science and Technology patients [4]. However, the RT-PCR assay tends to be Foundation (18010500600, 19QC1400600), National Key Research and inadequate in many areas that have been severely hit especially Development Program of China (2018YFC0116400), and Natural Science * during early outbreaks of this disease. The lab test also suffers Foundation of Jiangsu Province (BK20181339). ( Corresponding author: Dinggang Shen) from high false-negative rates, due to many factors, such as F. Shi, J. Wang, and J. Shi contributed equally to this work. sample preparation and quality control [5]. In clinical practice, F. Shi and D. Shen are with the Department of Research and Development, easily accessible imaging equipments, such as chest X-ray and Shanghai United Imaging Intelligence Co., Ltd., Shanghai 200232, China thoracic CT, provide huge assistance to clinicians [6-11]. (e-mail: feng.shi@united-imaging.com; Dinggang.Shen@gmail.com). J. Wang and J. Shi are with Key Laboratory of Specialty Fiber Optics and Particularly in China, many cases were identified as suspected Optical Access Networks, Shanghai Institute for Advanced Communication of COVID-19, if characteristic manifestations in CT scans were and Data Science, School of Communication and Information Engineering, observed [5]. The suspected patients, even without clinical Shanghai University, Shanghai 200444, China (e-mail: wangjun_shu@shu.edu.cn; junshi@shu.edu.cn). symptoms (e.g., fever and coughing), were also hospitalized or Z. Wu is with United Imaging Intelligence, Cambridge, MA 02140, USA quarantined for further lab tests. Given the high false-positive (e-mail: ziyan.wu@united-imaging.com). rate of the nucleic acid tests, many suspected patients have to be Q. Wang is with the Institute for Medical Imaging Technology, School of tested multiple times several days apart before reaching a Biomedical Engineering, Shanghai Jiao Tong University, Shanghai 200030, China (e-mail: wang.qian@sjtu.edu.cn). confident diagnosis. Hence, the imaging findings play a critical Z. Tang is with Beijing Advanced Innovation Center for Big Data and Brain role in constraining the viral transmission and also fighting Computing, Beihang University, Beijing 100191, China (e-mail: against COVID-19. tangzhenyu@buaa.edu.cn). K. He is with the Medical School of Nanjing University, Nanjing, China. He The workflow of imaging-based diagnosis for COVID-19, is also with National Institute of Healthcare Data Science at Nanjing University, taking thoracic CT as an example, includes three stages in Nanjing 210093, China (e-mail: hkl@nju.edu.cn). general, i.e., 1) pre-scan preparation, 2) image acquisition, and Y. Shi is with the National Key Laboratory for Novel Software and Technology, Nanjing University, Nanjing, China. He is also with the National 3) disease diagnosis. In the pre-scan preparation stage, each Institute of Healthcare Data Science at Nanjing University, Nanjing 210093, subject is instructed and assisted by a technician to pose on the China (e-mail: syh@nju.edu.cn). 2 patient bed according to a given protocol. In the image A. Conventional Imaging Workflow acquisition stage, CT images are acquired during a single Chest X-ray and CT are widely used in the screening and breath-hold. The scan ranges from the apex to the lung base. diagnosis of COVID-19 [6-11]. It is important to employ a Scans are done from the level of the upper thoracic inlet to the contactless and automated image acquisition workflow to avoid inferior level of the costophrenic angle with the optimized the severe risks of infection during COVID-19 pandemic. parameters set by the radiologist(s), based on the patient’s body However, the conventional imaging workflow includes shape. From the acquired raw data, CT images are inevitable contact between technicians and patients. Especially, reconstructed and then transmitted through picture archiving in patient positioning, technicians first assist in posing the and communication systems (PACS) for subsequent reading patient according to a given protocol, such as head-first versus and diagnosis. feet-first, and supine versus prone in CT, followed by visually Artificial intelligence (AI), an emerging technology in the identifying the target body part location on the patient and field of medical imaging, has contributed actively to fight manually adjusting the relative position and pose between the COVID-19 [12]. Compared to the traditional imaging patient and the X-ray tube. This process puts the technicians in workflow that heavily relies on the human labors, AI enables close contact with the patients, which leads to high risks of viral more safe, accurate and efficient imaging solutions. Recent exposure. Thus, a contactless and automated imaging workflow AI-empowered applications in COVID-19 mainly include the is needed to minimize the contact. dedicated imaging platform, the lung and infection region B. AI-Empowered Imaging Workflow segmentation, the clinical assessment and diagnosis, as well as Many modern X-ray and CT systems are equipped with the pioneering basic and clinical research. Moreover, many cameras for patient monitoring purposes [13-16]. During the commercial products have been developed, which successfully outbreak of COVID-19, those devices provided chance to integrate AI to combat COVID-19 and clearly demonstrate the establish a contactless scanning workflow. Technicians can capability of the technology. The Medical Imaging Computing monitor the patient from the control room via a live video Seminar (MICS) , a China’s leading alliance of medical stream from the camera. However, from only the overhead imaging scholars and start-up companies, organized this first view of the camera, it is still challenging for the technician to online seminar on COVID-19 on Febuary 18, 2020, which determine the scanning parameters such as scan range. In this attracted more than ten thousands of visits. All the above case, AI is able to automate the process [17-25] by identifying examples show the tremendous enthusiasm cast by the public the pose and shape of the patient from the data acquired with for AI-empowered progress in the medical imaging field, visual sensors such as RGB, Time-of-Flight (TOF) pressure especially during the ongoing pandemic. imaging [26] or thermal (FIR) cameras. Thus, the optimal Due to the importance of AI in all the spectrum of the scanning parameters can be determined. imaging-based analysis of COVID-19, this review aims to One typical scanning parameter that can be estimated with extensively discuss the role of medical imaging, especially AI-empowered visual sensors is the scan range that defines the empowered by AI, in fighting the COVID-19, which will starting and ending positions of the CT scan. Scan range can be inspire future practical applications and methodological identified by detecting anatomical joints of the subject from the research. In the following, we first introduce intelligent images. Much recent work [27-29] has focused on estimating imaging platforms for COVID-19, and then summarize popular the 2D [30-35] or 3D keypoint locations [28, 36-39] on the machine learning methods in the imaging workflow, including patient body. These keypoint locations usually include major segmentation, diagnosis and prognosis. Several publicly joints such as the neck, shoulders, elbows, ankles, wrists, and available datasets are also introduced. Finally, we discuss knees. Wang et al. [40] has shown that such an automated several open problems and challenges. We expect to provide workflow can significantly improve scanning efficiency and guidance for researchers and radiologists through this review. reduce unnecessary radiation exposure. However, such Note that we review the most related medical-imaging-based keypoints usually represent only a very sparse sampling of the COVID-19 studies up to March 31, 2020. full 3D mesh [41] in the 3D space (that defines the digital human body). II. AI-EMPOWERED CONTACTLESS IMAGING WORKFLOWS Other important scanning parameters can be inferred by AI, Healthcare practitioners are particularly vulnerable including ISO-centering. ISO-centering refers to aligning the concerning the high risk of occupational viral exposure. target body region of the subject, so that the center of the target Imaging specialists and technicians are of high priority, such body region overlaps with the scanner ISO center and thus the that any potential contact with the virus could be under control. overall imaging quality is optimal. Studies have shown that, In addition to the personal protective equipment (PPE), one with better ISO-centering, radiation dosage can be reduced may consider dedicated imaging facilities and workflows, while maintaining similar imaging quality [42]. In order to which are significantly important to reduce the risks and save align the target body region to the ISO center, and given that lives. anatomical keypoints usually represent only a very sparse sampling of the full 3D mesh in the 3D space (defining the digital human body), Georgakis et al. [43] propose to recover human mesh from a single monocular RGB image using a http://www.mics.net.cn/ 3 parametric human model SMPL [44]. Unlike other related 1(c)). Once the patient is deemed ready, either by the technician studies [45], they employ a hierarchical kinematic reasoning for or the motion analysis algorithm, the patient positioning each kinematic chain of the patient to iteratively refine the algorithm will automatically recover the 3D pose and estimation of each anatomical keypoint to improve the system fully-reconstructed mesh of the patient from the images robustness to clutters and partial occlusions around the joints of captured with the camera [41]. Based on the 3D mesh, both the the patient. Singh et al. [18] present a technique, using depth scan range and the 3D centerline of the target body part of the sensor data, to retrieve a full 3D patient mesh by fitting the patient are estimated and converted into control signals and depth data to a parametric human mesh model based on optimized scanning parameters for the technician to verify. If anatomical landmarks detected from RGB image. One recent necessary, the technician can make adjustments. Once verified, solution proposed by Ren et al. [41] learns a model that can be the patient bed will be automatically aligned to ISO center and trained just once and have the capability to be applied across moved into CT gantry for scanning. After CT images are multiple such applications based on dynamic multi-modal acquired, they will be processed and analyzed for screening and inference. diagnosis purposes. With this framework in application with an RGB-depth input sensor, even if one of the sensor modalities fails, the model III. AI IN IMAGE SEGMENTATION above can still perform 3D patient body inference with the Segmentation is an essential step in AI-based COVID-19 remaining data. image processing and analysis. It delineates the regions of interest (ROIs), e.g., lung, lobes, bronchopulmonary segments, C. Applications in COVID-19 and infected regions or lesions, in the chest X-ray or CT images During the outbreak of COVID-19, several essential for further assessment and quantification. contactless imaging workflows were established[17, 40, 41], CT provides high-quality 3D images for detecting from the utilization of monitoring cameras in the scan room COVID-19. To segment ROIs in CT, deep learning methods are [13-15, 27], or on the device [46], to mobile CT platforms [17, widely used. The popular segmentation networks for 46-49] with better access to patients and flexible installation. COVID-19 include classic U-Net [50-55], UNet++ [56, 57], A notable example is an automated scanning workflow based VB-Net [58]. Compared with CT, X-ray is more easily on a mobile CT platform empowered by visual AI technologies accessible around the world. However, due to the ribs projected [17], as shown in Fig. 1(a). The mobile platform is fully onto soft tissues in 2D and thus confounding image contrast, the self-contained with an AI-based pre-scan and diagnosis system segmentation of X-ray images is even more challenging. [46]. It was redesigned into a fully isolated scan room and Currently, there is no method developed for segmenging X-ray control room. Each room has its own entrance to avoid any images for COVID-19. However, Gaal et al. [59] adopt an unnecessary interaction between technicians and patients. Attention-U-Net for lung segmentation in X-ray images for After entering the scan room, the patient is instructed, by pneumonia, and although the research is not specified for visual and audio prompts, to pose on the patient bed (Fig. 1(b)). COVID-19, the method can be applied to the diagnosis of Technicians can observe through the window and also the live COVID-19 and other diseases easily. video transmitted from the ceiling-mounted AI camera in the Although now there are limited segmentation works directly scan room, and correct the pose of the patient if necessary (Fig. related to COVID-19 , many papers consider segmentation as a Fig. 1. (a) A mobile CT platform equipped with AI-empowered automated image acquisition workflow; (b) An example image captured by patient monitoring camera of CT system; (c) Positioning and scanning of patient operated remotely by a technician. 4 TABLE I SUMMARY OF IMAGE SEGMENTATION METHODS IN COVID-19 APPLICATIONS Literature Modality Method Target ROI Application Highlights Weakly-supervised method Zheng et al. [50] CT U-Net Lung Diagnosis by pseudo labels Lung Cao et al. [51] CT U-Net Quantification Lesion Lung Huang et al. [52] CT U-Net Lung lobes Quantification lesion Lung lobes Qi et al. [53] CT U-Net Quantification Lesion U-Net/ Lung Combination of 2D and 3D Gozes et al. [54] CT Commercial Diagnosis methods Leson Software Li et al. [55] CT U-Net Lesion Diagnosis Chen et al. [56] CT UNet++ Lesion Diagnosis Lung Joint segmentation and Jin et al. [57] CT UNet++ Diagnosis classification Lesion Lung Lung lobes Shan et al. [58] CT VB-Net Quantification Human-in-the-loop Lung segments Lesion Lung Lesion Commercial Tang et al. [60] CT Quantification Software Trachea Bronchus Threshold-based Shen et al. [61] CT Lesion Quantification region growing [62] necessary process in analyzing COVID-19. Table I summarizes lesions or nodules is required and has often been considered a representative works involving image segmentation in challenging detection task. Notably, in addition to COVID-19 studies. segmentation, the attention mechanism is reported as an efficient localization method in screening [59], which can be A. Segmentation of Lung Regions and Lesions adopted in COVID-19 applications. In terms of target ROIs, the segmentation methods in B. Segmentation Methods COVID-19 applications can be mainly grouped into two categories, i.e., the lung-region-oriented methods and the In the literature, there have been numerous techniques for lung-lesion-oriented methods. The lung-region-oriented lung segmentation with different purposes [63-67]. The U-Net methods aim to separate lung regions, i.e., whole lung and lung is a commonly used technique for segmenting both lung regions lobes, from other (background) regions in CT or X-ray, which and lung lesions in COVID applications [50-53]. The U-Net, a is considered as a pre-requisite step in COVID-19 applications type of fully convolutional network proposed by Ronneberger [50-54, 57, 58, 60]. For example, Jin et al. [57] propose a [68], has a U-shape architecture with symmetric encoding and two-stage pipeline for screening COVID-19 in CT images, in decoding signal paths. The layers of the same level in two paths which the whole lung region is first detected by an efficient are connected by the shortcut connections. In this case, the segmentation network based on UNet++. The network can therefore learn better visual semantics as well as lung-lesion-oriented methods aim to separate lesions (or metal detailed contextures, which is suitable for medical image and motion artifacts) in the lung from lung regions [51-58, 60, segmentation. 61]. Because the lesions or nodules could be small with a Various U-Net and its variants have been developed, variety of shapes and textures, locating the regions of the achieving reasonable segmentation results in COVID-19 5 applications. Çiçek et al. [63] propose the 3D U-Net that uses enrollment, and visualization of lesion distribution using the inter-slice information by replacing the layers in percentage of infection (POI). Cao et al. [51] assess conventional U-Net with a 3D version. Milletari et al. [64] longitudinal progression of COVID-19 by using voxel-level propose the V-Net which utilizes the residual blocks as the deep learning-based CT segmentation of pulmonary opacities. basic convolutional block, and optimize the network by a Dice Huang et al. [52] segment lung region and GGO for loss. By equipping the convolutional blocks with the so-called quantitative evaluation, which is further used for monitoring ] use a VB-Net for more bottleneck blocks, Shan et al. [58 the progression of COVID-19. Qi et al. segment lung lesions of efficient segmentation. Zhou et al. [65] propose the UNet++, COVID-19 patients using a U-Net based algorithm, and extract which is much more complex than U-Net, as the network radiomics features for predicting hospital stay [53]. inserts a nested convolutional structure between the encoding In summary, image segmentation plays an important role in COVID-19 applications, i.e., in lung delineation and lesion and decoding path. Obviously, this type of network can measurement. It facilitates radiologists in accurately improve the performance of segmentation. However, it is more identification of lung infection and prompting quantitative difficult to train. This network is also used for locating lesions analysis and diagnosis of COVID-19. in COVID-19 diagnosis [56]. Recently advanced attention mechanisms can learn the most discriminant part of the features IV. AI-ASSISTED DIAGNOSIS in the network. Oktay et al. [67] propose an Attention U-Net that is capable of capturing fine structures in medical images, In outbreak areas, patients suspected of COVID-19 are in thereby suitable for segmenting lesions and lung nodules in urgent need of diagnosis and proper treatment. Due to fast COVID-19 applications. acquisition, X-ray and CT scans are widely performed to Training a robust segmentation network requires sufficient provide evidences for radiologists. However, medical images, labeled data. In COVID-19 image segmentation, adequate especially chest CT, contain hundreds of slices, which takes a training data for segmentation tasks is often unavailable since long time for the specialists to diagnose. Also, COVID-19 as a manual delineation for lesions is labor-intensive and new disease has similar manifestations with various other types time-consuming. To address this, a straightforward method is of pneumonia, which requires radiologists to accumulate many to incorporate human knowledge. For example, Shan et al. [58] experiences for achieving a high diagnostic performance. Thus, integrate human-in-the-loop strategy into the training of a AI-assisted diagnosis using medical images is highly desired. VB-net based segmentation network, which involves Table II lists the most relevant state-of-the-art studies on this interactivity with radiologists into the training of the network. direction. Qi et al. [53] delineate the lesions in the lung using U-Net with A. X-ray based Screening of COVID-19 the initial seeds given by a radiologist. Several other works X-ray images are generally considered less sensitive than 3D used diagnostic knowledge and identified the infection regions chest CT images, despite being the typical first-line imaging by the attention mechanism [57]. Weakly-supervised machine modality used for patients under investigation of COVID-19. A learning methods are also used when the training data are recent study reported that X-ray shows normal in early or mild insufficient for segmentation. For example, Zheng et al. [50] disease [71]. In particular, abnormal chest radiographs are propose to use an unsupervised method to generate pseudo found in 69% of the patients at the initial time of admission, and segmentation masks for the images. As lacking of annotated in 80% of the patients some time after during hospitalization medical images is common in lung segmentation, unsupervised [71]. and semi-supervised methods are highly demanded for Radiological signs include airspace opacities, ground-glass COVID-19 studies. opacity (GGO), and later consolidation. Bilateral, peripheral, and lower zone predominant distributions are mostly observed C. Applications in COVID-19 (90%). Pleural effusion is rare (3%) in comparison to Segmentation can be used in various COVID-19 applications, parenchymal abnormalities [71]. among which diagnosis is frequently reported [50, 54-57, 69, Classification of COVID-19 from other pneumonia and 70]. For example, Li et al. [55] use U-Net for lung healthy subjects have been explored. Ghoshal et al. [72] segmentation in a multi-center study for distinguishing propose a Bayesian Convolutional Neural network to estimate COVID-19 from community-acquired pneumonia on Chest CT. the diagnosis uncertainty in COVID-19 prediction. 70 lung Jin et al. propose an AI system for fast COVID-19 diagnosis X-ray images of patients with COVID-19 are obtained from an [57]. The input to the classification model is the CT slices that online COVID-19 dataset [73], and non-COVID-19 images are have been segmented by a segmentation network. obtained from Kaggle’s Chest X-Ray Images (Pneumonia). Another application of image segmentation is quantification The experimental results show that Bayesian inference [51-53, 58, 60, 61], which further serves for many medical improves detection accuracy of the standard VGG16 model applications. For example, Shan et al. [58] propose a VB-Net from 85.7% to 92.9%. The authors further generate saliency for segmentation of lung, lung lobes and lung infection, which maps to illustrate the locations focused by the deep network, to provide accurate quantification data for medical studies, improve the understanding of deep learning results and including quantitative assessment of progression in the facilitate a more informed decision-making process. follow-up, comprehensive prediction of severity in the 6 TABLE II RELATED STUDIES WITH MEDICAL IMAGES FOR AI-ASSISTED DIAGNOSIS OF COVID-19 Literature Modality Subjects Task Method Result 70 COVID-19 Classification: COVID-19/ Ghoshal et al. [72] X-Ray CNN 92.9% (Acc.) Others Others (# of subjects not available) 50 COVID-19 Classification: COVID-19/ Narin et al. [9] X-Ray ResNet50 98.0% (Acc.) Normal 50 Normal 70 COVID-19 96.0% (Sens.) Classification: COVID-19/ Zhang et al. [74] X-Ray ResNet 70.7% (Spec.) Others 0.952 (AUC) 1008 Others 45 COVID-19 Classification: 931 Bac. Pneu. COVID-19/ Wang et al. [11] X-Ray Bac. Pneu./ CNN 83.5% (Acc.) 660 Vir. Pneu. Vir. Pneu./ Normal 1203 Normal 51 COVID-19 95.2% (Acc.) Classification: COVID-19/ Chen et al. [56] CT UNet++ 100% (Sens.) Others 93.6% (Spec.) 55 Others 313 COVID-19 90.7% (Sens.) Classification: COVID-19/ U-Net Zheng et al. [50] CT 91.1% (Spec.) Others CNN 0.959 (AUC) 229 Others 496 COVID-19 Classification: COVID-19/ 94.1% (Sens.) Jin et al. [69] CT CNN Others 95.5% (Spec.) 1385 Others 723 COVID-19 Classification: COVID-19/ UNet++ 97.4% (Sens.) Jin et al. [57] CT Others CNN 92.2% (Spec.) 413 Others 44 COVID-19 Classification: COVID-19/ Wang et al. [75] CT CNN 82.9% (Acc.) Vir. Pneu. 55 Vir. Pneu. 88 COVID-19 Classification: COVID-19/ Ying et al. [70] CT 100 Bac. Pneu. Bac. Pneu./ ResNet-50 86.0% (Acc.) Normal 86 Normal 219 COVID-19 Classification: COVID-19/ Xu et al. [76] CT 224 Influ.-A Influ.-A/ CNN 86.7% (Acc.) Normal 175 Normal 468 COVID-19 Classification: COVID-19/ 90.0% (Sens.) Li et al. [55] CT 1551 CAP CAP/ ResNet-50 96.0% (Spec.) Non-pneu. 1445 Non-pneu. 1658 COVID-19 87.9% (Acc.) Classification: Shi et al. [77] CT RF 90.7% (Sens.) COVID-19/CAP 83.3% (Spec.) 1027 CAP 87.5% (Acc.) Tang et al. [78] CT 176 COVID-19 Severity assessment RF 93.3% (TPR) 74.5% (TNR) Bac. Pneu.: Bacterial pneumonia; Vir. Pneu.: Viral pneumonia; Influ.-A: Influenza-A; Non-pneu.: Non- pneumonia Narin et al. [9] propose three different deep learning models, [56] employ chest CT images from 51 COVID-19 patients and i.e., ResNet50, InceptionV3, and Inception-ResNetV2, to 55 patients with other diseases to train a UNet++ based detect COVID-19 infection from X-ray images. It is worth segmentation model. This model is responsible for segmenting noting that the COVID-19 dataset [73] and Kaggle’s Chest COVID-19 related lesions. The final label (COVID-19 or non- X-Ray Images (Pneumonia) are also used to form the dataset in COVID-19) is determined based on the segmented lesions. The this study. Chest X-ray images of 50 COVID-19 patients and 50 evaluation results of COVID-19 classification using the normal chest X-ray images are included. The evaluation results proposed model are 95.2% (Accuracy), 100% (Sensitivity), and show that the ResNet50 model achieves the highest 93.6% (Specificity). In an additional dataset including 16 viral classification performance with 98.0% accuracy, compared to pneumonia and 11 non-pneumonia patients, the proposed 97.0% accuracy by InceptionV3 and 87% accuracy by model could identify all the viral pneumonia patients and 9 of Inception-ResNetV2. non-pneumonia patients. The reading time of radiologists is Zhang et al. [74] present a ResNet based model to detect shortened by 65% with the help of AI results. COVID-19 from X-ray images. This model has two tasks, i.e., A U-Net+3D CNN based model (DeCoVNet) is proposed in one task for the classification between COVID-19 and [50]. The U-Net is used for lung segmentation, and the non-COVID-19, and another task for anomaly detection. The segmentation result is used as the input of the 3D CNN for anomaly detection task gives an anomaly score to optimize the predicting the probability of COVID-19. Chest CT images of COVID-19 score used for the classification. X-ray images from 540 subjects (i.e., 313 with COVID-19, and 229 without 70 COVID-19 patients and 1008 non-COVID-19 pneumonia COVID-19) are used as training and testing data. The proposed patients are included from these two datasets. The sensitivity model achieves a sensitivity of 90.7%, specificity of 91.1%, and specificity are 96.0% and 70.7%, respectively, along with and AUC of 0.959. an AUC of 0.952. Jin et al. [69] use chest CT images from 496 COVID-19 Also, Wang et al. [11] propose a deep convolutional neural positive cases and 1385 negative cases. A 2D CNN based network based model (COVID-Net) to detect COVID-19 cases model is proposed to segment the lung and then identify slices using X-ray images. Similarly, from these two datasets, the of positive COVID-19 cases. Experimental results show that dataset includes 5941 chest X-ray images from 1203 healthy the proposed model achieves sensitivity of 94.1%, specificity people, 931 patients with bacterial pneumonia, 660 patients of 95.5%, and AUC of 0.979. with viral pneumonia, and 45 patients with COVID-19. The In another work, Jin et al. [57] include chest CT images of COVID-Net obtains the testing accuracy of 83.5%. 1136 cases (i.e., 723 COVID-19 positives, and 413 COVID-19 In general, most current studies use X-ray images to classify negatives) in the study. Their proposed model contains a between COVID-19 and other pneumonia and healthy subjects. UNet++ based segmentation model and a ResNet50 based The images are mainly from two online datasets, in which there classification model. The segmentation model is used to are only 70 images from COVID-19 patients. With this limited highlight lesion regions for the classification model. In the number of COVID-19 images, it is insufficient to evaluate the experiment, the sensitivity and specificity using the proposed robustness of the methods and also poses questions to the UNet++ and ResNet50 combined model are 97.4% and 92.2%, generalizability with respect to applications in other clinical respectively. centers. Also, the severity of subjects remain unknown; the 2) Classification of COVID-19 from other pneumonia. future work could emphasize on early detection of COVID-19. Given that the common pneumonia especially viral pneumonia has similar radiological appearances with COVID-19, their B. CT-based Screening and Severity Assessment of COVID-19 differentiation would be more useful in facilitating the Dynamic radiological patterns in chest CT images of screening process in clinical practice. Thus, a CNN model is COVID-19 have been reported and summarized as 4 stages [79]. proposed in [75] to classify between COVID-19 and typical Briefly, 0-4 days after onset of the initial symptom is viral pneumonia. Chest CT images from 99 patients (i.e., 44 considered as the early stage. GGO could be observed COVID-19 and 55 typical viral pneumonia) are used. Slices subpleurally in the lower lobes unilaterally or bilaterally. The derived from each 3D CT image are used as the input of the progressive stage is 5-8 days where diffuse GGO, crazy-paving proposed CNN. The testing dataset shows a total accuracy of pattern, and even consolidation could be found distributing in 73.1%, along with a specificity of 67.0% and a sensitivity of bilateral multi-lobes. In the peak stage (9-13 days), dense 74.0%. consolidation becomes more prevalent. When the infection Ying et al. [70] proposea deep learning-based CT diagnosis becomes controlled, the absorption stage appears (usually after system (called DeepPneumonia, using ResNet50) to detect 14 days). Consolidation and crazy-paving pattern are gradually patients with COVID-19 from bacteria pneumonia patients and absorbed and only GGO is left. These radiological patterns healthy people. Chest CT images from 88 patients with provide important evidences for CT-based classification and COVID-19, 101 patients with bacterial pneumonia, and 86 severity assessment of COVID-19. healthy persons are used as training and testing data. Slices of 1) Classification of COVID-19 from non-COVID-19. There complete lungs are derived from chest CT images, which are are a number of studies aiming to separate COVID-19 patients the inputs of DeepPneumonia. The model achieves promising from non-COVID-19 subjects (that include common results with an accuracy of 86.0% for pneumonia classification pneumonia subjects and non-pneumonia subjects). Chen et al. (COVID-19 or bacterial pneumonia), and an accuracy of 94.0% 8 for pneumonia diagnosis (COVID-19 or healthy). COVID-19, we notice that the works for studying the follow-up Xu et al. [76] use chest CT images from 219 patients with for COVID-19 are still very limited. There are only few COVID-19, 224 patients with Influenza-A, and 175 healthy attempts according to our knowledge. For example, the persons. A deep learning model based on V-Net is first used to researchers of Shanghai United Imaging Intelligence (UII) segment out the candidate infection regions. The patches of attempt to use the machine learning-based method and infection regions are sent to the Resnet-18 network together visualization techniques to demonstrate the change of the with features of relative infection distance from edge, and the volume size, density, and other clinical related factors in the output is one of these three groups. The model achieves an infection regions of the patient. After that, the clinical report is overall accuracy of 86.7%. automatically generated to reflect these changes as a Li et al. [55] used a large chest CT dataset, which contains data-driven guidance for clinical specialists to determine the 4356 chest CT images (i.e., 1296 COVID-19, 1735 following procedure (Fig. 2). In addition, the team from community-acquired pneumonia, and 1325 non-pneumonia) Perception Vision Company (PVmed) provided another from 3322 patients. A ResNet50 model (COVNet) is used on follow-up solution for COVID-19. They tried to build a 2D slices with shared weights and combined with max-pooling contrastive model to reflect the change of different CT images to discriminate COVID-19 from community-acquired of the same patient, by aligning the infection regions and pneumonia (CAP) and non-pneumonia. Results show a observing the changing trend of these quantitative values. sensitivity of 90%, specificity of 96%, and AUC of 0.96 in Several other companies and institutes are also developing the identifying COVID-19. follow-up function in their software platforms currently. Shi et al. [77] employed chest CT images of 2685 patients, of Subsidiarily, Huang et al. [52] collect and analyze 126 patients which 1658 patients are of COVID-19 and 1027 patients are of by calculating the CT lung opacification percentage. They find common pneumonia. In the preprocessing stage, a VB-Net [58] the quantification of lung involvement could be employed to is adopted to segment the image into the left/right lung, 5 lung reflect the disease progression of COVID-19, which is helpful lobes, and 18 pulmonary segments. A number of hand-crafted for the follow-up study. features are calculated and used to train a random forest model. It is worth noting that clinical specialists are taking their Experimental results show a sensitivity of 90.7%, specificity of efforts to the diagnosis and treatment of COVID-19. Thus, the 83.3%, and accuracy of 87.9%. Also, testing results are works for studying the follow-up of COVID-19 are still in the grouped based on infection sizes, showing that patients with early stage and remain an open issue. We believe the previous small infections have low sensitivity to be identified. techniques and work developed in segmentation, diagnosis, 3) Severity assessment of COVID-19. Besides early quantification, and assessment could be used to guide the screening, the study of severity assessment is also important for development of AI-empowered follow-up study for treatment planning. Tang et al. [78] proposed an RF-based COVID-19. model for COVID-19 severity assessment (non-severe or severe). Chest CT images of 176 patients with conformed VI. PUBLIC IMAGING DATASETS FOR COVID-19 COVID-19 is used. A deep learning method VB-Net [77] is Data collection is the first step to develop machine learning adopted to divide the lung into anatomical sub-regions (e.g., methods for COVID-19 applications. Although there exist lobes and segments), based on which infection volumes and large public CT or X-ray datasets for lung diseases, both X-ray ratios of each anatomical sub-region are calculated and used as and CT scans for COVID-19 applications are not widely quantitative features to train a RF model. Results show a true available at present, which greatly hinders the research and positive rate of 93.3%, true negative rate of 74.5%, and development of AI methods. Recently, several works on accuracy of 87.5%. COVID-19 data collection have been reported. In summary, a variety of studies have been proposed for Cohen et al. [73] creates COVID-19 Image Data Collection CT-based COVID-19 diagnosis with generally promising by assembling medical images from websites and publications, results. In the next step, the research on screening of and it currently contains 123 frontal view X-rays. The COVID-19 could facilitate early detection to help with the COVID-CT dataset [80] includes 288 CT slices for COVID-19 diagnosis uncertainty of radiologists. Also, the prediction of confirmed cases thus far. It is collected from over 700 severity is of great importance that could help the estimation of preprinted literature on COVID-19 from medRxiv and bioRxiv. the ICU event or clinical decision of treatment planning, which The Coronacases Initiative also shares confirmed cases of warrants more investigation. COVID-19 on the website (https://coronacases.org). Currently, it includes 3D CT images of 10 confirmed COVID-19 cases. V. AI IN FOLLOW-UP STUDIES Also, the COVID-19 CT segmentation dataset With the goal of evaluating the patient’s response and (http://medicalsegmentation.com/covid19/) contains 100 axial investigating their potential problems after clinical treatment, CT slices from 60 patients with manual segmentations, in the the follow-up step plays a significant role in COVID-19 form of JPG images. It is worth noting that the current public treatment. Regarding the long incubation period of COVID-19 datasets still have a very limited number of images for training and its popular infectivity, to design the procedure of and testing of AI algorithms, and the quality of datasets is not AI-empowered follow-up for COVID-19 is challenging. sufficient . As most of the current works focus on the pre-diagnosis of 9 Fig. 2. The follow-up measurement for a COVID-19 patient. self-supervised deep learning and transfer-deep-learning VII. DISCUSSION AND FUTURE WORK methods. Multi-center studies on COVID-19 should also be promoted. AI has been successfully applied to the entire pipeline of the Follow-up is critical in diagnosing COVID-19 and evaluating imaging-based diagnosis of COVID-19. However, there are treatment. Although there are still limited studies, we believe still many works to be conducted in the future. that the methods from other related studies could be borrowed. As mentioned, AI-empowered image acquisition workflows 1) In the prognosis of other pneumonia diseases, machine have proven to make the scanning procedure not only more learning-based methodology could inspire the follow-up study efficient, but also effective in protecting medical staffs from of COVID-19 [81-84]. 2) The follow-up inside and outside of COVID-19 infection. Looking ahead, it is expected that more hospitals could be combined as a long period tracking for the AI-empowered applications will be integrated into the image COVID patients. 3) Multidisciplinary integration, i.e., medical acquisition workflow, to facilitate better scan quality and imaging [85], natural language processing [86], and oncology reduced radiation dosage consumed by patients. For example, and fusion [86], could benefit the overall follow-up procedure more precise AI-based automated ISO-centering and scan of measurement for COVID-19. range determination are required to ensure optimal image quality. Moreover, X-ray exposure parameters can be ONCLUSION VIII. C automatically calculated and optimized with AI inferred body region thickness of the patient, ensuring that just the right The COVID-19 is a disease that has spread all over the world. amount of radiation is used during the scan, which is Intelligent medical imaging has played an important role in particularly important for low-dose imaging. fighting against COVID-19. This paper discusses how AI Medical images usually show negative radiological signs in provides safe, accurate and efficient imaging solutions in the early stage of the disease, and thus the study of this stage is COVID-19 applications. The intelligent imaging platforms, important to assist with the clinical diagnosis uncertainty. clinical diagnosis, and pioneering research are reviewed in Meanwhile, many current AI studies for segmentation and detail, which covers the entire pipeline of AI-empowered diagnosis are based on small samples, which may lead to the imaging applications in COVID-19. Two imaging modalities, overfitting of results. To make the results clinically useful, the i.e., X-ray and CT, are used to demonstrates the effectiveness of quality and number of data need to be further improved. AI-empowered medical imaging for COVID-19. Therefore, more datasets should be built to include the It is worth noting that imaging only provides partial clinically collected X-ray and CT images. information about patients with COVID-19. It is important to Deep learning has become the dominant approach in fighting combine imaging data with clinical manifestations and against COVID-19. However, the imaging data in COVID-19 laboratory examination results to help the screening, detection applications may have incomplete, inexact and inaccurate and diagnosis of COVID-19. In this case, we believe AI will labels, which provides a challenge for training an accurate demonstrate its capability in fusing information from these segmentation and diagnostic network. In this way, weakly multi-source data, for performing accurate and efficient supervised deep learning methods could be leveraged. Further, diagnosis, analysis and follow-up. manually labeling imaging data is expensive and time-consuming, which also encourages the investigation of 10 https://www.gehealthcare.com/products/computed-tomography/revol REFERENCES ution-maxima [1] WHO. (April 5, 2020). Coronavirus disease 2019 (COVID-19) [25] FAST integrated workflow. Available: Situation Report - 76. Available: https://new.siemens.com/global/en/company/stories/research-technol https://www.who.int/docs/default-source/coronaviruse/situation-repor ogies/artificial-intelligence/artificial-intelligence-imaging-techniques. ts/20200405-sitrep-76-covid-19.pdf html [2] WHO. (2020, 30 January, 2020). Statement on the second meeting of [26] L. Casas, N. Navab, and S. Demirci, "Patient 3D body pose estimation the International Health Regulations (2005) Emergency Committee from pressure imaging," International Journal of Computer Assisted regarding the outbreak of novel coronavirus (2019-nCoV). Radiology and Surgery, vol. 14, pp. 517-524, 2019. [3] WHO. (2020). WHO Director-General's opening remarks at the media [27] Z. Cao, T. Simon, S.-E. Wei, and Y. Sheikh, "Realtime multi-person 2d briefing on COVID-19. pose estimation using part affinity fields," in Proceedings of the IEEE [4] T. Ai, Z. Yang, H. Hou, C. Zhan, C. Chen, W. Lv, et al., "Correlation of Conference on Computer Vision and Pattern Recognition, 2017, pp. Chest CT and RT-PCR Testing in Coronavirus Disease 2019 7291-7299. (COVID-19) in China: A Report of 1014 Cases," Radiology, p. 200642, [28] W. Yang, W. Ouyang, X. Wang, J. Ren, H. Li, and X. Wang, "3D human pose estimation in the wild by adversarial learning," in [5] T. Liang, Handbook of COVID-19 prevention and treatment, 2020. Proceedings of the IEEE Conference on Computer Vision and Pattern [6] J. P. Kanne, "Chest CT findings in 2019 novel coronavirus Recognition, 2018, pp. 5255-5264. (2019-nCoV) infections from Wuhan, China: key points for the [29] S. Liu and S. Ostadabbas, "Seeing under the cover: A physics guided radiologist," Radiology, p. 200241, 2020. learning approach for in-bed pose estimation," in International [7] A. Bernheim, X. Mei, M. Huang, Y. Yang, Z. A. Fayad, N. Zhang, et Conference on Medical Image Computing and Computer-Assisted al., "Chest CT findings in coronavirus disease-19 (COVID-19): Intervention, 2019, pp. 236-245. relationship to duration of infection," Radiology, p. 200463, 2020. [30] A. Toshev and C. Szegedy, "Deeppose: Human pose estimation via [8] X. Xie, Z. Zhong, W. Zhao, C. Zheng, F. Wang, and J. J. R. Liu, "Chest deep neural networks," in Proceedings of the IEEE Conference on CT for typical 2019-nCoV pneumonia: relationship to negative Computer Vision and Pattern Recognition, 2014, pp. 1653-1660. RT-PCR testing," Radiology, p. 200343, 2020. [31] K. Sun, B. Xiao, D. Liu, and J. Wang, "Deep high-resolution [9] A. Narin, C. Kaya, and Z. Pamuk, "Automatic detection of representation learning for human pose estimation," in Proceedings of coronavirus disease (COVID-19) using X-ray images and deep the IEEE Conference on Computer Vision and Pattern Recognition, convolutional neural networks," arXiv:2003.10849, 2020. 2019, pp. 5693-5703. [10] I. D. Apostolopoulos and T. Bessiana, "Covid-19: Automatic detection [32] W. Tang, P. Yu, and Y. Wu, "Deeply learned compositional models for from X-Ray images utilizing transfer Learning with convolutional human pose estimation," in Proceedings of the European Conference neural networks," arXiv:2003.11617, 2020. on Computer Vision (ECCV), 2018, pp. 190-206. [11] L. Wang and A. Wong, "COVID-Net: A tailored deep convolutional [33] B. Xiao, H. Wu, and Y. Wei, "Simple baselines for human pose neural network design for detection of COVID-19 cases from vhest estimation and tracking," in Proceedings of the European conference radiography images," arXiv:2003.09871 2020. on computer vision (ECCV), 2018, pp. 466-481. [12] L. A. Bullock Joseph, Pham Katherine Hoffmann, Lam Cynthia, [34] Y. Luo, J. Ren, Z. Wang, W. Sun, J. Pan, J. Liu, et al., "LSTM pose Luengo-Oroz Miguel A., "Mapping the landscape of artificial machines," in Proceedings of the IEEE Conference on Computer intelligence applications against COVID-19," arXiv:2003.11336, Vision and Pattern Recognition, 2018, pp. 5207-5215. [35] X. Nie, J. Feng, Y. Zuo, and S. Yan, "Human pose estimation with [13] J.-H. Lee, D.-i. Kim, and M.-k. Cho, "Computed tomography parsing induced learner," in Proceedings of the IEEE Conference on apparatus and method of controlling X-ray by using the same," ed: Computer Vision and Pattern Recognition, 2018, pp. 2100-2108. Google Patents, 2017. [36] G. Varol, D. Ceylan, B. Russell, J. Yang, E. Yumer, I. Laptev, et al., [14] P. Forthmann and G. Pfleiderer, "Augmented display device for use in "Bodynet: Volumetric inference of 3d human body shapes," in a medical imaging laboratory," ed: Google Patents, 2019. Proceedings of the European Conference on Computer Vision (ECCV), [15] V. T. Jensen, "Method and system of acquiring images with a medical 2018, pp. 20-36. imaging device," ed: Google Patents, 2009. [37] H. Rhodin, M. Salzmann, and P. Fua, "Unsupervised geometry-aware [16] S. Scheib, "Dosimetric end-to-end verification devices, systems, and representation for 3d human pose estimation," in Proceedings of the methods," ed: Google Patents, 2019. European Conference on Computer Vision (ECCV), 2018, pp. [17] United imaging's emergency radiology departments support mobile 750-767. cabin hospitals, facilitate 5G remote diagnosis. Available: [38] G. Pavlakos, L. Zhu, X. Zhou, and K. Daniilidis, "Learning to estimate https://www.prnewswire.com/news-releases/united-imagings-emerge 3D human pose and shape from a single color image," in Proceedings ncy-radiology-departments-support-mobile-cabin-hospitals-facilitate- of the IEEE Conference on Computer Vision and Pattern Recognition, 5g-remote-diagnosis-301010528.html 2018, pp. 459-468. [18] V. K. Singh, K. Ma, B. Tamersoy, Y. Chang, A. Wimmer, T. F. [39] V. Srivastav, T. Issenhuth, A. Kadkhodamohammadi, M. de Mathelin, Odonnell, et al., "DARWIN: Deformable patient avatar representation A. Gangi, and N. J. a. p. a. Padoy, "MVOR: A multi-view RGB-D with deep image network," in Medical Image Computing and operating room dataset for 2D and 3D human pose estimation," Computer Assisted Intervention, 2017, pp. 497-504. arXiv:1808.08180, 2018. [19] V. Singh, Y.-J. Chang, K. Ma, M. Wels, G. Soza, and T. Chen, [40] Y. Wang, X. Lu, J. Liu, X. Li, R. Hu, X. Meng, et al., "Precise "Estimating a patient surface model for optimizing the medical pulmonary scanning and reducing medical radiation exposure by scanning workflow," in International Conference on Medical Image developing a clinically applicable intelligent CT system: Towards Computing and Computer-Assisted Intervention, 2014, pp. 472-479. improving patient care," Preprints with The EBioMedicine, 2020. [20] Siemens CT scanner SOMATOM Force, SOMATOM Drive or [41] R. Li, C. Cai, G. Georgakis, S. Karanam, T. Chen, and Z. Wu, SOMATOM Edge Plus. Available: "Towards robust RGB-D human mesh recovery," arXiv:1911.07383, https://www.siemens-healthineers.com/computed-tomography/techno logies-and-innovations/fast-integrated-workflow [42] R. Booij, R. P. Budde, M. L. Dijkshoorn, and M. van Straten, [21] J. Li, U. K. Udayasankar, T. L. Toth, J. Seamans, W. C. Small, and M. "Accuracy of automated patient positioning in CT using a 3D camera K. Kalra, "Automatic patient centering for MDCT: effect on radiation for body contour detection," European Radiology, vol. 29, pp. dose," American Journal of Roentgenology, vol. 188, pp. 547-552, 2079-2088, 2019. [43] G. Georgakis, R. Li, S. Karanam, T. Chen, J. Kosecka, and Z. Wu, [22] C. J. B. i. Martin and i. journal, "Optimisation in general radiography," "Hierarchical hinematic human mesh recovery," arXiv:2003.04232, Biomedical Imaging and Intervention Journal, vol. 3, 2007. [23] F. Achilles, A. E. Ichim, H. Coskun, F. Tombari, S. Noachtar, and N. [44] M. Loper, N. Mahmood, J. Romero, G. Pons-Moll, and M. Black, Navab, "Patient MoCap: Human pose estimation under blanket "SMPL: A skinned multi-person linear model," ACM Transactions on occlusion for hospital monitoring applications," in Medical Image Graphics, vol. 34, p. 16, 2015. Computing and Computer Assisted Intervention, 2016, pp. 491-499. [45] A. Kanazawa, M. J. Black, D. W. Jacobs, and J. Malik, "End-to-end [24] GE Xtream camera. Available: recovery of human shape and pose," in Proceedings of the IEEE 11 Conference on Computer Vision and Pattern Recognition, 2018, pp. Learning in Medical Image Analysis and Multimodal Learning for 7122-7131. Clinical Decision Support, ed: Springer, 2018, pp. 3-11. [66] F. Isensee, J. Petersen, A. Klein, D. Zimmerer, P. F. Jaeger, S. Kohl, et [46] United imaging sends out more than 100 CT scanners and X-ray machines to aid diagnosis of the coronavirus. Available: al., "nnU-Net: Self-adapting framework for U-Net-based medical https://www.itnonline.com/content/united-imaging-sends-out-more-1 image segmentation," arXiv:1809.10486, 2018. 00-ct-scanners-and-x-ray-machines-aid-diagnosis-coronavirus [67] O. Oktay, J. Schlemper, L. L. Folgoc, M. Lee, M. Heinrich, K. Misawa, [47] (2020, 3rd, April). United imaging aids fight against coronavirus. et al., "Attention U-Net: Learning where to look for the pancreas," arXiv:1804.03999, 2018. Available: https://www.auntminnie.com/index.aspx?sec=log&itemID=128062 [68] O. Ronneberger, P. Fischer, and T. Brox, "U-Net: Convolutional [48] CIMC delivers mobile CT scan cabin to Huangzhou General Hospital networks for biomedical image segmentation," in International to diagnose coronavirus. Available: Conference on Medical Image Computing and Computer-Assisted https://www.hhmglobal.com/industry-updates/press-releases/cimc-del Intervention, 2015, pp. 234-241. [69] C. Jin, W. Cheny, Y. Cao, Z. Xu, X. Zhang, L. Deng, et al., ivers-mobile-ct-scan-cabin-to-huangzhou-general-hospital-to-diagnos e-coronavirus "Development and evaluation of an AI system for COVID-19 [49] Prehospital CT scans possible with mobile stroke unit Available: diagnosis," MedRxiv, 2020. https://www.ems1.com/ems-products/ambulances/articles/prehospital [70] Y. Song, S. Zheng, L. Li, X. Zhang, X. Zhang, Z. Huang, et al., "Deep -ct-scans-possible-with-mobile-stroke-unit-4JKu37U2neG4k68j/ learning enables accurate diagnosis of novel Coronavirus (COVID-19) with CT images.," MedRxiv, 2020. [50] C. Zheng, X. Deng, Q. Fu, Q. Zhou, J. Feng, H. Ma, et al., "Deep learning-based detection for COVID-19 from chest CT using weak [71] H. Y. F. Wong, H. Y. S. Lam, A. H.-T. Fong, S. T. Leung, T. W.-Y. Chin, label," MedRxiv, 2020. C. S. Y. Lo, et al., "Frequency and distribution of chest radiographic [51] Y. Cao, Z. Xu, J. Feng, C. Jin, X. Han, H. Wu, et al., "Longitudinal findings in COVID-19 positive patients," Radiology, p. 201160, 2020. assessment of COVID-19 using a deep learning–based quantitative CT [72] B. Ghoshal and A. Tucker, "Estimating uncertainty and interpretability in deep learning for coronavirus (COVID-19) detection," pipeline: Illustration of two cases," Radiology: Cardiothoracic Imaging, vol. 2, p. e200082, 2020. arXiv:2003.10769, 2020. [52] L. Huang, R. Han, T. Ai, P. Yu, H. Kang, Q. Tao, et al., "Serial [73] J. P. Cohen, P. Morrison, and L. Dao, "COVID-19 image data quantitative chest CT sssessment of COVID-19: Deep-Learning collection," arXiv 2003.11597, 2020. Approach," Radiology: Cardiothoracic Imaging, vol. 2, p. e200075, [74] J. Zhang, Y. Xie, Y. Li, C. Shen, and Y. Xia, "COVID-19 screening on 2020. Chest X-ray images using deep learning based anomaly detection," [53] X. Qi, Z. Jiang, Q. Yu, C. Shao, H. Zhang, H. Yue, et al., "Machine arXiv:2003.12338, 2020. learning-based CT radiomics model for predicting hospital stay in [75] S. Wang, B. Kang, J. Ma, X. Zeng, M. Xiao, J. Guo, et al., "A deep patients with pneumonia associated with SARS-CoV-2 infection: A learning algorithm using CT images to screen for Corona Virus multicenter study," MedRxiv, 2020. Disease (COVID-19)," MedRxiv, 2020. [54] O. Gozes, M. Frid-Adar, H. Greenspan, P. D. Browning, H. Zhang, W. [76] X. Xu, X. Jiang, C. Ma, P. Du, X. Li, S. Lv, et al., "Deep learning Ji, et al., "Rapid AI development cycle for the coronavirus (covid-19) system to screen Coronavirus disease 2019 peumonia," pandemic: Initial results for automated detection & patient monitoring arXiv:2002.09334, 2020. using deep learning ct image analysis," arXiv:2003.05037, 2020. [77] F. Shi, L. Xia, F. Shan, D. Wu, Y. Wei, H. Yuan, et al., "Large-scale [55] L. Li, L. Qin, Z. Xu, Y. Yin, X. Wang, B. Kong, et al., "Artificial screening of COVID-19 from community acquired pneumonia using intelligence distinguishes COVID-19 from community acquired infection size-aware classification," arXiv:2003.09860, 2020. pneumonia on chest CT," Radiology, p. 200905, 2020. [78] Z. Tang, W. Zhao, X. Xie, Z. Zhong, F. Shi, J. Liu, et al., "Severity [56] J. Chen, L. Wu, J. Zhang, L. Zhang, D. Gong, Y. Zhao, et al., "Deep assessment of coronavirus disease 2019 (COVID-19) using learning-based model for detecting 2019 novel coronavirus quantitative features from chest CT images," arXiv:2003.11988, 2020. pneumonia on high-resolution computed tomography: a prospective [79] F. Pan, T. Ye, P. Sun, S. Gui, B. Liang, L. Li, et al., "Time course of study," MedRxiv, 2020. lung changes on chest CT during recovery from 2019 novel [57] S. Jin, B. Wang, H. Xu, C. Luo, L. Wei, W. Zhao, et al., "AI-assisted coronavirus (COVID-19) pneumonia," Radiology, p. 200370, 2020. CT imaging analysis for COVID-19 screening: Building and [80] J. Zhao, Y. Zhang, X. He, and P. Xie, "COVID-CT-Dataset: A CT scan deploying a medical AI system in four weeks," MedRxiv, 2020. dataset about COVID-19," 2020. [58] F. Shan, Y. Gao, J. Wang, W. Shi, N. Shi, M. Han, et al., "Lung [81] Y. Xu, A. Hosny, R. Zeleznik, C. Parmar, T. P. Coroller, I. Franco, et al., Infection quantification of COVID-19 in CT images with deep "Deep learning predicts lung cancer treatment response from serial learning," arXiv:2003.04655, 2020. medical imaging," Clinical Cancer Research, vol. 25, pp. 3266-3275, [59] G. Gaál, B. Maga, and A. Lukács, "Attention U-Net based adversarial 2019. architectures for chest X-ray lung segmentation," arXiv:2003.10304, [82] K. Kourou, T. P. Exarchos, K. P. Exarchos, M. V. Karamouzis, and D. I. 2020. Fotiadis, "Machine learning applications in cancer prognosis and [60] L. Tang, X. Zhang, Y. Wang, and X. Zeng, "Severe COVID-19 prediction," Computational and Structural Biotechnology Journal, vol. Pneumonia: Assessing inflammation burden with Volume-rendered 13, pp. 8-17, 2015. Chest CT," Radiology: Cardiothoracic Imaging, vol. 2, p. e200044, [83] D. W. Kim, S. H. Lee, S. Kwon, W. Nam, I. Cha, and H. J. Kim, "Deep 2020. learning-based survival prediction of oral cancer patients," Scientific [61] C. Shen, N. Yu, S. Cai, J. Zhou, J. Sheng, K. Liu, et al., "Quantitative Reports, vol. 9, p. 6994, 2019. computed tomography analysis for stratifying the severity of [84] J. Hao, Y. Kim, T. Mallavarapu, J. H. Oh, and M. Kang, "Interpretable Coronavirus Disease 2019," Journal of Pharmaceutical Analysis, deep neural network for cancer survival analysis by integrating 2020. genomic and clinical data," BMC Medical Genomics, vol. 12, pp. 1-13, [62] B. C. Lassen, C. Jacobs, J. M. Kuhnigk, B. Van Ginneken, and E. M. 2019. Van Rikxoort, "Robust semi-automatic segmentation of pulmonary [85] X. Wang, Y. Peng, L. Lu, Z. Lu, and R. M. Summers, "TieNet: subsolid nodules in chest computed tomography scans," Physics in Text-image embedding network for common thorax disease Medicine & Biology, vol. 60, pp. 1307-1323. classification and reporting in chest X-rays," in Proceedings of the [63] Ö. Çiçek, A. Abdulkadir, S. S. Lienkamp, T. Brox, and O. IEEE Conference on Computer Vision and Pattern Recognition, 2018, Ronneberger, "3D U-Net: learning dense volumetric segmentation pp. 9049-9058. from sparse annotation," in International Conference on Medical [86] J. Yuan, H. Liao, R. Luo, and J. Luo, "Automatic radiology report Image Computing and Computer-Assisted Intervention, 2016, pp. generation based on multi-view image fusion and medical concept 424-432. enrichment," in International Conference on Medical Image [64] F. Milletari, N. Navab, and S.-A. Ahmadi, "V-net: Fully convolutional Computing and Computer-Assisted Intervention, 2019, pp. 721-729. neural networks for volumetric medical image segmentation," in 2016 Fourth International Conference on 3D Vision (3DV), 2016, pp. 565-571. [65] Z. Zhou, M. M. R. Siddiquee, N. Tajbakhsh, and J. Liang, "UNet++: A nested U-Net architecture for medical image segmentation," in Deep
Journal
Quantitative Biology – arXiv (Cornell University)
Published: Apr 6, 2020