Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

A Multi-Label Classification with an Adversarial-Based Denoising Autoencoder for Medical Image Annotation

A Multi-Label Classification with an Adversarial-Based Denoising Autoencoder for Medical Image... Medical image annotation aims to automatically describe the content of medical images. It helps doctors to understand the content of medical images and make better informed decisions like diagnoses. Existing methods mainly follow the approach for natural images and fail to emphasize the object abnormalities, which is the essence of medical images annotation. In light of this, we propose to transform the medical image annotation to a multi-label classification problem, where object abnormalities are focused directly. However, extant multi-label classification studies rely on arduous feature engineering, or do not solve label correlation issues well in medical images. To solve these problems, we propose a novel deep learning model where a frequent pattern mining component and an adversarial-based denoising autoencoder component are introduced. Extensive experiments are conducted on a real retinal image dataset to evaluate the performance of the proposed model. Results indicate that the proposed model significantly outperforms image captioning baselines and multi-label classification baselines. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png ACM Transactions on Management Information Systems (TMIS) Association for Computing Machinery

A Multi-Label Classification with an Adversarial-Based Denoising Autoencoder for Medical Image Annotation

Download PDF
21 pages

Loading next page...
 
/lp/association-for-computing-machinery/a-multi-label-classification-with-an-adversarial-based-denoising-2JcCzw94OV
Publisher
Association for Computing Machinery
Copyright
Copyright © 2023 Association for Computing Machinery.
ISSN
2158-656X
eISSN
2158-6578
DOI
10.1145/3561653
Publisher site
See Article on Publisher Site

Abstract

Medical image annotation aims to automatically describe the content of medical images. It helps doctors to understand the content of medical images and make better informed decisions like diagnoses. Existing methods mainly follow the approach for natural images and fail to emphasize the object abnormalities, which is the essence of medical images annotation. In light of this, we propose to transform the medical image annotation to a multi-label classification problem, where object abnormalities are focused directly. However, extant multi-label classification studies rely on arduous feature engineering, or do not solve label correlation issues well in medical images. To solve these problems, we propose a novel deep learning model where a frequent pattern mining component and an adversarial-based denoising autoencoder component are introduced. Extensive experiments are conducted on a real retinal image dataset to evaluate the performance of the proposed model. Results indicate that the proposed model significantly outperforms image captioning baselines and multi-label classification baselines.

Journal

ACM Transactions on Management Information Systems (TMIS) – Association for Computing Machinery

Published: Jan 25, 2023

Keywords: Deep learning

References

  • Connecting systems, data, and people: A multidisciplinary research roadmap for chronic disease management
    Bardhan, Indranil; Chen, Hsinchun; Karahanna, Elena
  • Medical image reconstruction with image-adaptive priors learned by use of generative adversarial networks
    Bhadra, Sayantan; Zhou, Weimin; Anastasio, Mark A.
  • Learning multi-label scene classification
    Boutell, Matthew R.; Luo, Jiebo; Shen, Xipeng; Brown, Christopher M.
  • Auto-GAN: Self-supervised collaborative learning for medical image synthesis
    Cao, Bing; Zhang, Han; Wang, Nannan; Gao, Xinbo; Shen, Dinggang
  • Glaucoma diagnosis in the Chinese context: An uncertainty information-centric Bayesian deep learning model
    Chai, Yidong; Bian, Yiyang; Liu, Hongyan; Li, Jiaxing; Xu, Jie
  • Glaucoma diagnosis based on both hidden features and domain knowledge through deep learning models
    Chai, Yidong; Liu, Hongyan; Xu, Jie
  • Multi-label chest X-ray image classification via semantic similarity graph embedding
    Chen, Bingzhi; Zhang, Zheng; Li, Yingjian; Lu, Guangming; Zhang, David
  • Deep hiearchical multi-label classification applied to chest X-ray abnormality taxonomies
    Chen, Haomin; Miao, Shun; Xu, Daguang; Hager, Gregory D.; Harrison, Adam P.
  • TR-GAN: Topology ranking GAN with triplet loss for retinal artery/vein classification
    Chen, Wenting; Yu, Shuang; Wu, Junde; Ma, Kai; Bian, Cheng; Chu, Chunyan; Shen, Linlin; Zheng, Yefeng
  • Robust multi-label transfer feature learning for early diagnosis of Alzheimer’s disease
    Cheng, Bo; Liu, Mingxia; Zhang, Daoqiang; Shen, Dinggang; Initiative, Alzheimer’s Disease Neuroimaging
  • A thorough review on recent deep learning methodologies for image captioning
    Elhagry, Ahmed; Kadaoui, Karima
  • GAN-based synthetic medical image augmentation for increased CNN performance in liver lesion classification
    Frid-Adar, Maayan; Diamant, Idit; Klang, Eyal; Amitai, Michal; Goldberger, Jacob; Greenspan, Hayit
  • Automated identification of diabetic retinopathy using deep learning
    Gargeya, Rishab; Leng, Theodore
  • Discriminative methods for multi-labeled classification
    Godbole, Shantanu; Sarawagi, Sunita
  • Deep convolutional ranking for multilabel image annotation
    Gong, Yunchao; Jia, Yangqing; Leung, Thomas K.; Toshev, Alexander; Ioffe, Sergey
  • Deep Learning
    Goodfellow, Ian; Bengio, Yoshua; Courville, Aaron; Bengio, Yoshua
  • Generative adversarial nets
    Goodfellow, Ian; Pouget-Abadie, Jean; Mirza, Mehdi; Xu, Bing; Warde-Farley, David; Ozair, Sherjil; Courville, Aaron; Bengio, Yoshua
  • Large-scale analysis of free-text data for mental health surveillance with topic modelling
    Gu, Yang; Leroy, Gondy
  • A review on generative adversarial networks: Algorithms, theory, and applications
    Gui, Jie; Sun, Zhenan; Wen, Yonggang; Tao, Dacheng; Ye, Jieping
  • Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs
    Gulshan, Varun; Peng, Lily; Coram, Marc; Stumpe, Martin C.; Wu, Derek; Narayanaswamy, Arunachalam; Venugopalan, Subhashini; Widner, Kasumi; Madams, Tom; Cuadros, Jorge; et al,
  • Performance of a deep-learning algorithm vs manual grading for detecting diabetic retinopathy in India
    Gulshan, Varun; Rajan, Renu P.; Widner, Kasumi; Wu, Derek; Wubbels, Peter; Rhodes, Tyler; Whitehouse, Kira; Coram, Marc; Corrado, Greg; Ramasamy, Kim; et al,
  • Normalized and geometry-aware self-attention network for image captioning
    Guo, Longteng; Liu, Jing; Zhu, Xinxin; Yao, Peng; Lu, Shichen; Lu, Hanqing
  • Automatic extraction of retinal features from colour retinal images for glaucoma diagnosis: A review
    Haleem, Muhammad Salman; Han, Liangxiu; van Hemert, Jano; Li, Baihua
  • Mining frequent patterns without candidate generation: A frequent-pattern tree approach
    Han, Jiawei; Pei, Jian; Yin, Yiwen; Mao, Runying
  • Framing image description as a ranking task: Data, models and evaluation metrics
    Hodosh, Micah; Young, Peter; Hockenmaier, Julia
  • RATCHET: Medical transformer for chest x-ray diagnosis and reporting
    Hou, Benjamin; Kaissis, Georgios; Summers, Ronald M.; Kainz, Bernhard
  • Multi-label learning with visual-semantic embedded knowledge graph for diagnosis of radiology imaging
    Hou, Daibing; Zhao, Zijian; Hu, Sanyuan
  • Deep context-encoding network for retinal image captioning
    Huang, Jia-Hong; Wu, Ting-Wei; Yang, Chao-Han Huck; Worring, Marcel
  • Multi-label learning for crop leaf diseases recognition and severity estimation based on convolutional neural networks
    Ji, Miaomiao; Zhang, Keke; Wu, Qiufeng; Deng, Zhao
  • Calibrated rank-SVM for multi-label image categorization
    Jiang, Aiwen; Wang, Chunheng; Zhu, Yuanping
  • Three-class classification of brain magnetic resonance images using average-pooling convolutional neural network
    Kakarla, Jagadeesh; Isunuri, Bala Venkateswarlu; Doppalapudi, Krishna Sai; Bylapudi, Karthik Satya Raghuram
  • Covid-19 disease diagnosis using smart deep learning techniques
    Kavitha, M.; Jayasankar, T.; Venkatesh, P. Maheswara; Mani, G.; Bharatiraja, C.; Twala, Bhekisipho; et al,
  • Boosted cascaded convnets for multilabel classification of thoracic diseases in chest radiographs
    Kumar, Pulkit; Grewal, Monika; Srivastava, Muktabh Mayank
  • Deep learning
    LeCun, Yann; Bengio, Yoshua; Hinton, Geoffrey
  • Deep adversarial model for musculoskeletal quality evaluation
    Li, Shenglong
  • Attention based CNN-ConvLSTM for pedestrian attribute recognition
    Li, Yang; Xu, Huahu; Bian, Minjie; Xiao, Junsheng
  • The emerging trends of multi-label learning
    Liu, Weiwei; Wang, Haobo; Shen, Xiaobo; Tsang, Ivor
  • Go to YouTube and call me in the morning: Use of social media for chronic conditions
    Liu, Xiao; Zhang, Bin; Susarla, Anjana; Padman, Rema
  • Generative adversarial active learning for unsupervised outlier detection
    Liu, Yezheng; Li, Zhe; Zhou, Chong; Jiang, Yuanchun; Sun, Jianshan; Wang, Meng; He, Xiangnan
  • Dual-level collaborative transformer for image captioning
    Luo, Yunpeng; Ji, Jiayi; Sun, Xiaoshuai; Cao, Liujuan; Wu, Yongjian; Huang, Feiyue; Lin, Chia-Wen; Ji, Rongrong
  • Image super-resolution using progressive generative adversarial networks for medical image analysis
    Mahapatra, Dwarikanath; Bozorgtabar, Behzad; Garnavi, Rahil
  • Learning and transferring mid-level image representations using convolutional neural networks
    Oquab, Maxime; Bottou, Leon; Laptev, Ivan; Sivic, Josef
  • Automatic Myanmar image captioning using CNN and LSTM-based language model
    Pa, San; Aung, Pa; Pa, Win Pa; Nwe, Tin Lay
  • A data analytics approach to building a clinical decision support system for diabetic retinopathy: Developing and deploying a model ensemble
    Piri, Saeed; Delen, Dursun; Liu, Tieming; Zolbanin, Hamed M.
  • Multi-label classification of surgical tools with convolutional neural networks
    Prellberg, Jonas; Kramer, Oliver
  • Denoising of 3D magnetic resonance images using a residual encoder–decoder Wasserstein generative adversarial network
    Ran, Maosong; Hu, Jinrong; Chen, Yang; Chen, Hu; Sun, Huaiqiang; Zhou, Jiliu; Zhang, Yi
  • Multi-label classification using ensembles of pruned sets
    Read, Jesse; Pfahringer, Bernhard; Holmes, Geoff
  • Classifier chains for multi-label classification
    Read, Jesse; Pfahringer, Bernhard; Holmes, Geoff; Frank, Eibe
  • Linking exploits from the dark web to known vulnerabilities for proactive cyber threat intelligence: An attention-based deep structured semantic model
    Samtani, Sagar; Chai, Yidong; Chen, Hsinchun
  • Learning to read chest X-rays: Recurrent neural cascade model for automated image annotation
    Shin, Hoo Chang; Roberts, Kirk; Lu, Le; Demner-Fushman, Dina; Yao, Jianhua; Summers, Ronald M.
  • MM-GAN: 3D MRI data augmentation for medical image segmentation via generative adversarial networks
    Sun, Yi; Yuan, Peisen; Sun, Yuming
  • Image caption generator
    Sunny, Liya Ann; Joseph, Sara Susan; Geogy, Sonu Sara; Sreelakshmi, K. S.; Abraham, Abin T.
  • Applying artificial intelligence to disease staging: Deep learning for improved staging of diabetic retinopathy
    Takahashi, Hidenori; Tampo, Hironobu; Arai, Yusuke; Inoue, Yuji; Kawashima, Hidetoshi
  • A review of methods for imbalanced multi-label classification
    Tarekegn, Adane; Giacobini, Mario; Michalak, Krzysztof
  • Development and validation of a deep learning system for diabetic retinopathy and related eye diseases using retinal images from multiethnic populations with diabetes
    Ting, Daniel Shu Wei; Cheung, Carol Yim-Lui; Lim, Gilbert; Tan, Gavin Siew Wei; Quang, Nguyen D.; Gan, Alfred; Hamzah, Haslina; Garcia-Franco, Renata; Yeo, Ian Yew San; Lee, Shu Yen; et al,
  • Adversarial learning of label dependency: A novel framework for multi-class classification
    Tsai, Che-Ping; Lee, Hung-Yi
  • Random k-labelsets for multilabel classification
    Tsoumakas, Grigorios; Katakis, Ioannis; Vlahavas, Ioannis
  • CNN-RNN: A unified framework for multi-label image classification
    Wang, Jiang; Yang, Yi; Mao, Junhua; Huang, Zhiheng; Huang, Chang; Xu, Wei
  • CNN + CNN: Convolutional decoders for image captioning
    Wang, Qingzhong; Chan, Antoni B.
  • DSSAE: Deep stacked sparse autoencoder analytical model for COVID-19 diagnosis by fractional Fourier entropy
    Wang, Shui-Hua; Zhang, Xin; Zhang, Yu-Dong
  • Conditional infilling GANs for data augmentation in mammogram classification
    Wu, Eric; Wu, Kevin; Cox, David; Lotter, William
  • Understanding medication nonadherence from social media: A sentiment-enriched deep learning approach
    Xie, Jiaheng; Liu, Xiao; Zeng, Daniel Dajun; Fang, Xiao
  • Concept detection based on multi-label classification and image captioning approach-DAMO at ImageCLEF 2019
    Xu, Jing; Liu, Wei; Liu, Chao; Wang, Yu; Chi, Ying; Xie, Xuansong; Hua, Xiansheng
  • SeGAN: Adversarial network with multi-scale l1 loss for medical image segmentation
    Xue, Yuan; Xu, Tao; Zhang, Han; Long, L. Rodney; Huang, Xiaolei
  • Deconfounded image captioning: A causal retrospect
    Yang, Xu; Zhang, Hanwang; Cai, Jianfei
  • Image captioning with semantic attention
    You, Quanzeng; Jin, Hailin; Wang, Zhaowen; Chen, Fang; Luo, Jiebo
  • Wearable sensor-based chronic condition severity assessment: An adversarial attention-based deep multisource multitask learning approach
    Yu, Shuo; Chai, Yidong; Chen, Hsinchun; Sherman, Scott J.; Brown, Randall A.
  • Deep learning for ultrasound image caption generation based on object detection
    Zeng, Xianhua; Wen, Li; Liu, Banggui; Qi, Xiaojun
  • MDNet: A semantically and visually interpretable medical image diagnosis network
    Zhang, Zizhao; Xie, Yuanpu; Xing, Fuyong; McGough, Mason; Yang, Lin
  • Multi-label convolutional neural network based pedestrian attribute classification
    Zhu, Jianqing; Liao, Shengcai; Lei, Zhen; Li, Stan Z.
  • AIDCOV: An interpretable artificial intelligence model for detection of COVID-19 from chest radiography images
    Zokaeinikoo, Maryam; Kazemian, Pooyan; Mitra, Prasenjit; Kumara, Soundar