DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Discriminative analysis of schizophrenia patients using graph convolutional networks: A combined multimodal MRI and connectomics analysis

Abstract

Introduction Recent studies in human brain connectomics with multimodal magnetic resonance imaging (MRI) data have widely reported abnormalities in brain structure, function and connectivity associated with schizophrenia (SZ). However, most previous discriminative studies of SZ patients were based on MRI features of brain regions, ignoring the complex relationships within brain networks. Methods We applied a graph convolutional network (GCN) to discriminating SZ patients using the features of brain region and connectivity derived from a combined multimodal MRI and connectomics analysis. Structural magnetic resonance imaging (sMRI) and resting-state functional magnetic resonance imaging (rs-fMRI) data were acquired from 140 SZ patients and 205 normal controls. Eighteen types of brain graphs were constructed for each subject using 3 types of node features, 3 types of edge features, and 2 brain atlases. We investigated the performance of 18 brain graphs and used the TopK pooling layers to highlight salient brain regions (nodes in the graph). Results The GCN model, which used functional connectivity as edge features and multimodal features (sMRI + fMRI) of brain regions as node features, obtained the highest average accuracy of 95.8%, and outperformed other existing classification studies in SZ patients. In the explainability analysis, we reported that the top 10more » salient brain regions, predominantly distributed in the prefrontal and occipital cortices, were mainly involved in the systems of emotion and visual processing. Discussion Our findings demonstrated that GCN with a combined multimodal MRI and connectomics analysis can effectively improve the classification of SZ at an individual level, indicating a promising direction for the diagnosis of SZ patients. The code is available at https://github.com/CXY-scut/GCN-SZ.git .« less

Authors:
; ; ; ; ; ; ; ; ; ; ; ;
Publication Date:
Sponsoring Org.:
USDOE Office of Electricity (OE), Advanced Grid Research & Development. Power Systems Engineering Research
OSTI Identifier:
1963970
Grant/Contract Number:  
2018B030335001; 2020B0101130020; 2020B0404010002; 2019A1515110427; 201903010032; 202103000032; 202206060005; 202206080005; 202206010077; 202206010034; 2020KSYS001
Resource Type:
Published Article
Journal Name:
Frontiers in Neuroscience (Online)
Additional Journal Information:
Journal Name: Frontiers in Neuroscience (Online) Journal Volume: 17; Journal ID: ISSN 1662-453X
Publisher:
Frontiers Media SA
Country of Publication:
Switzerland
Language:
English

Citation Formats

Chen, Xiaoyi, Ke, Pengfei, Huang, Yuanyuan, Zhou, Jing, Li, Hehua, Peng, Runlin, Huang, Jiayuan, Liang, Liqin, Ma, Guolin, Li, Xiaobo, Ning, Yuping, Wu, Fengchun, and Wu, Kai. Discriminative analysis of schizophrenia patients using graph convolutional networks: A combined multimodal MRI and connectomics analysis. Switzerland: N. p., 2023. Web. doi:10.3389/fnins.2023.1140801.
Chen, Xiaoyi, Ke, Pengfei, Huang, Yuanyuan, Zhou, Jing, Li, Hehua, Peng, Runlin, Huang, Jiayuan, Liang, Liqin, Ma, Guolin, Li, Xiaobo, Ning, Yuping, Wu, Fengchun, & Wu, Kai. Discriminative analysis of schizophrenia patients using graph convolutional networks: A combined multimodal MRI and connectomics analysis. Switzerland. https://doi.org/10.3389/fnins.2023.1140801
Chen, Xiaoyi, Ke, Pengfei, Huang, Yuanyuan, Zhou, Jing, Li, Hehua, Peng, Runlin, Huang, Jiayuan, Liang, Liqin, Ma, Guolin, Li, Xiaobo, Ning, Yuping, Wu, Fengchun, and Wu, Kai. Thu . "Discriminative analysis of schizophrenia patients using graph convolutional networks: A combined multimodal MRI and connectomics analysis". Switzerland. https://doi.org/10.3389/fnins.2023.1140801.
@article{osti_1963970,
title = {Discriminative analysis of schizophrenia patients using graph convolutional networks: A combined multimodal MRI and connectomics analysis},
author = {Chen, Xiaoyi and Ke, Pengfei and Huang, Yuanyuan and Zhou, Jing and Li, Hehua and Peng, Runlin and Huang, Jiayuan and Liang, Liqin and Ma, Guolin and Li, Xiaobo and Ning, Yuping and Wu, Fengchun and Wu, Kai},
abstractNote = {Introduction Recent studies in human brain connectomics with multimodal magnetic resonance imaging (MRI) data have widely reported abnormalities in brain structure, function and connectivity associated with schizophrenia (SZ). However, most previous discriminative studies of SZ patients were based on MRI features of brain regions, ignoring the complex relationships within brain networks. Methods We applied a graph convolutional network (GCN) to discriminating SZ patients using the features of brain region and connectivity derived from a combined multimodal MRI and connectomics analysis. Structural magnetic resonance imaging (sMRI) and resting-state functional magnetic resonance imaging (rs-fMRI) data were acquired from 140 SZ patients and 205 normal controls. Eighteen types of brain graphs were constructed for each subject using 3 types of node features, 3 types of edge features, and 2 brain atlases. We investigated the performance of 18 brain graphs and used the TopK pooling layers to highlight salient brain regions (nodes in the graph). Results The GCN model, which used functional connectivity as edge features and multimodal features (sMRI + fMRI) of brain regions as node features, obtained the highest average accuracy of 95.8%, and outperformed other existing classification studies in SZ patients. In the explainability analysis, we reported that the top 10 salient brain regions, predominantly distributed in the prefrontal and occipital cortices, were mainly involved in the systems of emotion and visual processing. Discussion Our findings demonstrated that GCN with a combined multimodal MRI and connectomics analysis can effectively improve the classification of SZ at an individual level, indicating a promising direction for the diagnosis of SZ patients. The code is available at https://github.com/CXY-scut/GCN-SZ.git .},
doi = {10.3389/fnins.2023.1140801},
journal = {Frontiers in Neuroscience (Online)},
number = ,
volume = 17,
place = {Switzerland},
year = {Thu Mar 30 00:00:00 EDT 2023},
month = {Thu Mar 30 00:00:00 EDT 2023}
}

Works referenced in this record:

Systematic misestimation of machine learning performance in neuroimaging studies of depression
journal, May 2021


BrainGNN: Interpretable Brain Graph Neural Network for fMRI Analysis
journal, December 2021


Medial prefrontal cortex in neurological diseases
journal, September 2019


Effects of randomness in the development of machine learning models in neuroimaging studies of schizophrenia
journal, February 2023


A neuroimaging biomarker for striatal dysfunction in schizophrenia
journal, March 2020


Classification of First-Episode Schizophrenia, Chronic Schizophrenia and Healthy Control Based on Brain Network of Mismatch Negativity by Graph Neural Network
journal, January 2021

  • Chang, Qi; Li, Cancheng; Tian, Qing
  • IEEE Transactions on Neural Systems and Rehabilitation Engineering, Vol. 29
  • DOI: 10.1109/TNSRE.2021.3105669

node2vec: Scalable Feature Learning for Networks
conference, January 2016

  • Grover, Aditya; Leskovec, Jure
  • Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining - KDD '16
  • DOI: 10.1145/2939672.2939754

A Multi-Domain Connectome Convolutional Neural Network for Identifying Schizophrenia From EEG Connectivity Patterns
journal, May 2020

  • Phang, Chun-Ren; Noman, Fuad; Hussain, Hadri
  • IEEE Journal of Biomedical and Health Informatics, Vol. 24, Issue 5
  • DOI: 10.1109/jbhi.2019.2941222

Single‐subject morphological brain networks: connectivity mapping, topological characterization and test–retest reliability
journal, March 2016

  • Wang, Hao; Jin, Xiaoqing; Zhang, Ye
  • Brain and Behavior, Vol. 6, Issue 4
  • DOI: 10.1002/brb3.448

Hi-GCN: A hierarchical graph convolution network for graph embedding learning of brain network and brain disorders prediction
journal, December 2020


Towards Sparse Hierarchical Graph Classifiers
preprint, January 2018


EEG Source Network for the Diagnosis of Schizophrenia and the Identification of Subtypes Based on Symptom Severity—A Machine Learning Approach
journal, December 2020

  • Kim, Jeong-Youn; Lee, Hyun Seo; Lee, Seung-Hwan
  • Journal of Clinical Medicine, Vol. 9, Issue 12
  • DOI: 10.3390/jcm9123934

Multimodal Graph Coarsening for Interpretable, MRI-Based Brain Graph Neural Network
conference, October 2021

  • Sebenius, Isaac; Campbell, Alexander; Morgan, Sarah E.
  • 2021 IEEE 31st International Workshop on Machine Learning for Signal Processing (MLSP)
  • DOI: 10.1109/mlsp52302.2021.9690626

Diagnosing schizophrenia with network analysis and a machine learning method
journal, February 2020

  • Jo, Young Tak; Joo, Sung Woo; Shon, Seung‐Hyun
  • International Journal of Methods in Psychiatric Research, Vol. 29, Issue 1
  • DOI: 10.1002/mpr.1818

Single subject prediction of brain disorders in neuroimaging: Promises and pitfalls
journal, January 2017


Beyond the disconnectivity hypothesis of schizophrenia
journal, August 2019

  • Rolls, Edmund T.; Cheng, Wei; Gilson, Matthieu
  • Cerebral Cortex, Vol. 30, Issue 3
  • DOI: 10.1093/cercor/bhz161

Classification of schizophrenia patients using a graph convolutional network: A combined functional MRI and connectomics analysis
journal, February 2023


Automated Anatomical Labeling of Activations in SPM Using a Macroscopic Anatomical Parcellation of the MNI MRI Single-Subject Brain
journal, January 2002

  • Tzourio-Mazoyer, N.; Landeau, B.; Papathanassiou, D.
  • NeuroImage, Vol. 15, Issue 1
  • DOI: 10.1006/nimg.2001.0978

Puzzling over schizophrenia: Schizophrenia, social environment and the brain
journal, February 2012

  • Tost, Heike; Meyer-Lindenberg, Andreas
  • Nature Medicine, Vol. 18, Issue 2
  • DOI: 10.1038/nm.2671

Brain Networks in Schizophrenia
journal, February 2014


Semi-Supervised Classification with Graph Convolutional Networks
preprint, January 2016


3D-CNN based discrimination of schizophrenia using resting-state fMRI
journal, July 2019


Overview of Machine Learning: Part 2
journal, November 2020

  • Le, William Trung; Maleki, Farhad; Romero, Francisco Perdigón
  • Neuroimaging Clinics of North America, Vol. 30, Issue 4
  • DOI: 10.1016/j.nic.2020.06.003

Measuring individual morphological relationship of cortical regions
journal, November 2014


Self-Attention Graph Pooling
preprint, January 2019


Graph U-Nets
journal, January 2021


EEG functional connectivity and deep learning for automatic diagnosis of brain disorders: Alzheimer’s disease and schizophrenia
journal, April 2022

  • Alves, Caroline L.; Pineda, Aruane M.; Roster, Kirstin
  • Journal of Physics: Complexity, Vol. 3, Issue 2
  • DOI: 10.1088/2632-072X/ac5f8d

The Human Brainnetome Atlas: A New Brain Atlas Based on Connectional Architecture
journal, May 2016


Pitfalls of Graph Neural Network Evaluation
preprint, January 2018


Effects of Brain Atlases and Machine Learning Methods on the Discrimination of Schizophrenia Patients: A Multimodal MRI Study
journal, July 2021


Explainability Techniques for Graph Convolutional Networks
preprint, January 2019


Regional homogeneity approach to fMRI data analysis
journal, May 2004


DPABI: Data Processing & Analysis for (Resting-State) Brain Imaging
journal, April 2016


A Mutual Multi-Scale Triplet Graph Convolutional Network for Classification of Brain Disorders Using Functional or Structural Connectivity
journal, April 2021

  • Yao, Dongren; Sui, Jing; Wang, Mingliang
  • IEEE Transactions on Medical Imaging, Vol. 40, Issue 4
  • DOI: 10.1109/TMI.2021.3051604

Graph Convolutional Networks Reveal Network-Level Functional Dysconnectivity in Schizophrenia
journal, May 2022

  • Lei, Du; Qin, Kun; Pinaya, Walter H. L.
  • Schizophrenia Bulletin, Vol. 48, Issue 4
  • DOI: 10.1093/schbul/sbac047

GRETNA: a graph theoretical network analysis toolbox for imaging connectomics
journal, June 2015


Mild cognitive impairment and fMRI studies of brain functional connectivity: the state of the art
journal, August 2015

  • Farràs-Permanyer, Laia; Guàrdia-Olmos, Joan; Peró-Cebollero, Maribel
  • Frontiers in Psychology, Vol. 6
  • DOI: 10.3389/fpsyg.2015.01095

A Survey of Deep Learning: Platforms, Applications and Emerging Research Trends
journal, January 2018


Diagnosis of schizophrenia with functional connectome data: a graph-based convolutional neural network approach
journal, January 2022


Representation Learning on Graphs with Jumping Knowledge Networks
preprint, January 2018


Multimodal Magnetic Resonance Imaging Reveals Aberrant Brain Age Trajectory During Youth in Schizophrenia Patients
journal, March 2022


TE-HI-GCN: An Ensemble of Transfer Hierarchical Graph Convolutional Networks for Disorder Diagnosis
journal, November 2021


Size of burden of schizophrenia and psychotic disorders
journal, August 2005


Evolving functional network properties and synchronizability during human epileptic seizures
journal, September 2008

  • Schindler, Kaspar A.; Bialonski, Stephan; Horstmann, Marie-Therese
  • Chaos: An Interdisciplinary Journal of Nonlinear Science, Vol. 18, Issue 3
  • DOI: 10.1063/1.2966112

On random graphs. I.
journal, July 2022


Abnormal Degree Centrality of Bilateral Putamen and Left Superior Frontal Gyrus in Schizophrenia with Auditory Hallucinations
journal, December 2015


Altered baseline brain activity in children with ADHD revealed by resting-state functional MRI
journal, March 2007


Neuroimaging in Schizophrenia
journal, February 2020

  • Keshavan, Matcheri S.; Collin, Guusje; Guimond, Synthia
  • Neuroimaging Clinics of North America, Vol. 30, Issue 1
  • DOI: 10.1016/j.nic.2019.09.007