DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Deep reinforcement learning of cell movement in the early stage of C.elegans embryogenesis

Journal Article · · Bioinformatics
 [1]; ORCiD logo [2];  [1]; ORCiD logo [3];  [1];  [3]
  1. Univ. of Tennessee, Knoxville, TN (United States). Dept. of Electrical Engineering and Computer Science
  2. Univ. of Tennessee, Knoxville, TN (United States). Dept. of Electrical Engineering and Computer Science; Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States). Environmental Science Division
  3. Sloan-Kettering Inst., New York, NY (United States). Developmental Biology Program

Motivation: Cell movement in the early phase of Caenorhabditis elegans development is regulated by a highly complex process in which a set of rules and connections are formulated at distinct scales. Previous efforts have demonstrated that agent-based, multi-scale modeling systems can integrate physical and biological rules and provide new avenues to study developmental systems. However, the application of these systems to model cell movement is still challenging and requires a comprehensive understanding of regulatory networks at the right scales. Recent developments in deep learning and reinforcement learning provide an unprecedented opportunity to explore cell movement using 3D time-lapse microscopy images. Results: We present a deep reinforcement learning approach within an agent-based modeling system to characterize cell movement in the embryonic development of C.elegans. Our modeling system captures the complexity of cell movement patterns in the embryo and overcomes the local optimization problem encountered by traditional rule-based, agent-based modeling that uses greedy algorithms. Here, we tested our model with two real developmental processes: the anterior movement of the Cpaaa cell via intercalation and the rearrangement of the superficial left-right asymmetry. In the first case, the model results suggested that Cpaaa’s intercalation is an active directional cell movement caused by the continuous effects from a longer distance (farther than the length of two adjacent cells), as opposed to a passive movement caused by neighbor cell movements. In the second case, a leader-follower mechanism well explained the collective cell movement pattern in the asymmetry rearrangement. These results showed that our approach to introduce deep reinforcement learning into agent-based modeling can test regulatory mechanisms by exploring cell migration paths in a reverse engineering perspective. Lastly, this model opens new doors to explore the large datasets generated by live imaging. Availability and implementation: Source code is available at https://github.com/zwang84/drl4cellmovement.

Research Organization:
Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)
Sponsoring Organization:
USDOE; National Institutes of Health (NIH)
Grant/Contract Number:
AC05-00OR22725; R01GM097576; P30CA008748
OSTI ID:
1463974
Journal Information:
Bioinformatics, Vol. 34, Issue 18; ISSN 1367-4803
Publisher:
Oxford University PressCopyright Statement
Country of Publication:
United States
Language:
English
Citation Metrics:
Cited by: 13 works
Citation information provided by
Web of Science

References (33)

Virtual exploration of early stage atherosclerosis journal August 2016
Multidimensional regulation of gene expression in the C. elegans embryo journal April 2012
Assessing Normal Embryogenesis inCaenorhabditis elegansUsing a 4D Microscope: Variability of Development and Regional Specification journal April 1997
Human-level control through deep reinforcement learning journal February 2015
A cell-based simulation software for multi-cellular systems journal August 2010
Mechanisms of cell positioning during C. elegans gastrulation journal January 2003
Four-dimensional realistic modeling of pancreatic organogenesis journal December 2008
Systematic quantification of developmental phenotypes at single-cell resolution during embryogenesis journal July 2013
Mechanisms, mechanics and function of epithelial–mesenchymal transitions in early development journal November 2003
An Observation-Driven Agent-Based Modeling and Analysis Framework for C. elegans Embryogenesis journal November 2016
WDDD: Worm Developmental Dynamics Database journal November 2012
Visualization of 3-Dimensional Vectors in a Dynamic Embryonic System—WormGUIDES journal January 2017
Spatio-temporal reference model of Caenorhabditis elegans embryogenesis with cell contact maps journal September 2009
Chiral Forces Organize Left-Right Patterning in C. elegans by Uncoupling Midline and Anteroposterior Axis journal September 2010
Forces in Tissue Morphogenesis and Patterning journal May 2013
Multi-scale computational modeling of developmental biology journal May 2012
Automated cell lineage tracing in Caenorhabditis elegans journal February 2006
A semi-local neighborhood-based framework for probabilistic cell lineage tracing journal January 2014
Mounting Caenorhabditis elegans Embryos for Live Imaging of Embryogenesis journal August 2011
Quantitative semi-automated analysis of morphogenesis with single-cell resolution in complex embryos journal October 2012
The Regulatory Landscape of Lineage Differentiation in a Metazoan Embryo journal September 2015
The embryonic cell lineage of the nematode Caenorhabditis elegans journal November 1983
Multiagent cooperation and competition with deep reinforcement learning journal April 2017
De Novo Inference of Systems-Level Mechanistic Models of Development from Live-Imaging-Based Phenotype Analysis journal January 2014
A Comprehensive Survey of Multiagent Reinforcement Learning journal March 2008
Cell Movement Is Guided by the Rigidity of the Substrate journal July 2000
Multiagent cooperation and competition with deep reinforcement learning text January 2017
Mechanisms of cell positioning during C. elegans gastrulation text January 2003
Virtual exploration of early stage atherosclerosis journal January 2017
Assessing Normal Embryogenesis inCaenorhabditis elegansUsing a 4D Microscope: Variability of Development and Regional Specification journal April 1997
De Novo Inference of Systems-Level Mechanistic Models of Development from Live-Imaging-Based Phenotype Analysis journal January 2014
Chiral Forces Organize Left-Right Patterning in C. elegans by Uncoupling Midline and Anteroposterior Axis journal September 2010
WDDD: Worm Developmental Dynamics Database journal November 2012

Cited By (1)

Using deep reinforcement learning to speed up collective cell migration journal November 2019