Transfer Learning using Denoising Auto-Encoders for Cellular-Level Annotation of Tumor in Pathology Slides
- Los Alamos National Lab. (LANL), Los Alamos, NM (United States); New Mexico Consortium, Los Alamos, NM (United States)
Adversarial examples can produce altered classifications using only seemingly innocuous, imperceptible perturbations to the original image. The imperceptibility of adversarial perturbations suggests that the corresponding classifiers use decision criteria different than those of a human. In a medical setting, inexplicable decision criteria confound a pathologist’s willingness to trust machine-generated annotations. Here, we analyze denoising tumor detection models to see if they are robust to imperceptible adversarial perturbations. Moreover, to be more fully trusted by pathologists, we require tumor detectors that generate interpretable annotations which segment pathology slides into tumorous and normal regions at the cellular level. We therefore compare transfer learning based on two different autoencoder architectures, one derived from a deep denoising bottleneck autoencoder and one from an over-complete sparse autoencoder. Both autoencoders were first trained in an unsupervised manner on a set of pathology slides drawn from the Camelyon16 dataset. The latent representations produced by each autoencoder were then passed to separate neural networks that were trained in a supervised manner on binary tumor-normal masks generated by pathologists at cellular resolution. Both tumor detectors supported better than 90% AUC PR as measured by the area under the precision/recall curve on a held-out pathology slide. To assess the underlying decision criteria used by both tumor detectors, we constructed imperceptible adversarial examples which reduced the AUC PR of both models to less than 70%. Random noise of the same amplitude had almost no effect on the AUC PR of either model. Additionally, each tumor detector was resistant to adversarial “transfer” attacks targeting the other. The adversarial perturbations showed strong characteristic differences: the deep denoising models perturbations were a very diffuse, seemingly unrecognizable pattern while the sparse coding models perturbations showed traces of tissue cells.
- Research Organization:
- Los Alamos National Lab. (LANL), Los Alamos, NM (United States); New Mexico Consortium, Los Alamos, NM (United States)
- Sponsoring Organization:
- USDOE National Nuclear Security Administration (NNSA); USDOE Laboratory Directed Research and Development (LDRD) Program
- DOE Contract Number:
- 89233218CNA000001
- OSTI ID:
- 1768438
- Report Number(s):
- LA-UR--21-21957
- Country of Publication:
- United States
- Language:
- English
Similar Records
Sparse coding of pathology slides compared to transfer learning with deep neural networks
Deep learning integrates histopathology and proteogenomics at a pan-cancer level
MO-DE-207B-08: Radiomic CT Features Complement Semantic Annotations to Predict EGFR Mutations in Lung Adenocarcinomas
Journal Article
·
Fri Nov 30 19:00:00 EST 2018
· BMC Bioinformatics
·
OSTI ID:1626772
Deep learning integrates histopathology and proteogenomics at a pan-cancer level
Journal Article
·
Sun Aug 13 20:00:00 EDT 2023
· Cell Reports Medicine
·
OSTI ID:2008417
MO-DE-207B-08: Radiomic CT Features Complement Semantic Annotations to Predict EGFR Mutations in Lung Adenocarcinomas
Journal Article
·
Wed Jun 15 00:00:00 EDT 2016
· Medical Physics
·
OSTI ID:22649569