DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Diffraction-geometry refinement in the DIALS framework

Abstract

Rapid data collection and modern computing resources provide the opportunity to revisit the task of optimizing the model of diffraction geometry prior to integration. A comprehensive description is given of new software that builds upon established methods by performing a single global refinement procedure, utilizing a smoothly varying model of the crystal lattice where appropriate. This global refinement technique extends to multiple data sets, providing useful constraints to handle the problem of correlated parameters, particularly for small wedges of data. Examples of advanced uses of the software are given and the design is explained in detail, with particular emphasis on the flexibility and extensibility it entails.

Authors:
 [1];  [2];  [2];  [3];  [4];  [4];  [2]
  1. Science and Technology Facilities Council (STFC), Didcot (United Kingdom). Rutherford Appleton Lab. (RAL) and Collaborative Computational Project Number 4 (CCP4)
  2. Science and Technology Facilities Council (STFC), Harwell Campus, Oxford (United Kingdom). Diamond Light Source, Ltd.
  3. Science and Technology Facilities Council (STFC), Harwell Campus, Oxford (United Kingdom). Diamond Light Source, Ltd.; MRC Lab. of Molecular Biology, Cambridge (United Kingdom)
  4. Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)
Publication Date:
Research Org.:
Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States)
Sponsoring Org.:
National Institutes of Health (NIH)
OSTI Identifier:
1379263
Grant/Contract Number:  
AC02-05CH11231
Resource Type:
Accepted Manuscript
Journal Name:
Acta Crystallographica. Section D. Structural Biology
Additional Journal Information:
Journal Volume: 72; Journal Issue: 4; Journal ID: ISSN 2059-7983
Publisher:
IUCr
Country of Publication:
United States
Language:
English
Subject:
59 BASIC BIOLOGICAL SCIENCES; global refinement; DIALS framework; centroid refinement

Citation Formats

Waterman, David G., Winter, Graeme, Gildea, Richard J., Parkhurst, James M., Brewster, Aaron S., Sauter, Nicholas K., and Evans, Gwyndaf. Diffraction-geometry refinement in the DIALS framework. United States: N. p., 2016. Web. doi:10.1107/S2059798316002187.
Waterman, David G., Winter, Graeme, Gildea, Richard J., Parkhurst, James M., Brewster, Aaron S., Sauter, Nicholas K., & Evans, Gwyndaf. Diffraction-geometry refinement in the DIALS framework. United States. https://doi.org/10.1107/S2059798316002187
Waterman, David G., Winter, Graeme, Gildea, Richard J., Parkhurst, James M., Brewster, Aaron S., Sauter, Nicholas K., and Evans, Gwyndaf. Wed . "Diffraction-geometry refinement in the DIALS framework". United States. https://doi.org/10.1107/S2059798316002187. https://www.osti.gov/servlets/purl/1379263.
@article{osti_1379263,
title = {Diffraction-geometry refinement in the DIALS framework},
author = {Waterman, David G. and Winter, Graeme and Gildea, Richard J. and Parkhurst, James M. and Brewster, Aaron S. and Sauter, Nicholas K. and Evans, Gwyndaf},
abstractNote = {Rapid data collection and modern computing resources provide the opportunity to revisit the task of optimizing the model of diffraction geometry prior to integration. A comprehensive description is given of new software that builds upon established methods by performing a single global refinement procedure, utilizing a smoothly varying model of the crystal lattice where appropriate. This global refinement technique extends to multiple data sets, providing useful constraints to handle the problem of correlated parameters, particularly for small wedges of data. Examples of advanced uses of the software are given and the design is explained in detail, with particular emphasis on the flexibility and extensibility it entails.},
doi = {10.1107/S2059798316002187},
journal = {Acta Crystallographica. Section D. Structural Biology},
number = 4,
volume = 72,
place = {United States},
year = {Wed Mar 30 00:00:00 EDT 2016},
month = {Wed Mar 30 00:00:00 EDT 2016}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record

Citation Metrics:
Cited by: 134 works
Citation information provided by
Web of Science

Figures / Tables:

Figure 1 Figure 1: The diffraction geometry of the simple central impact model used by DIALS. Vectors are expressed in either a reciprocal-space or real-space laboratory frame. The rotation axis $\hat{e}$ intersects the origin of laboratory space within the crystal at Oc and defines a right-handed rotation. The direct-beam wavevector s0 passesmore » through Oc and defines the origin of reciprocal space Ors at its tip. A reciprocal-lattice point rotated by an angle φ to touch the surface of the Ewald sphere is shown by rφ. The diffracted beam wavevector s1 extends from Oc to the tip of rφ. Further projection of this vector leads to an intersection on a detector plane at the position marked (X, Y). The detector plane is described by three vectors: d0, which defines the origin of the detector coordinate system Od at one corner of the plane, and a pair of mutually orthogonal unit vectors $\hat{d}_x$ and $\hat{d}_y$ defining a Cartesian plane. The detector normal vector $\hat{d}_n$ = $\hat{d}_x$ x $\hat{d}_y$ completes the detector coordinate system basis. The position (X, Y) is recorded if it is inside the pair of limits (xlim, ylim).« less

Save / Share:

Works referenced in this record:

New methods for indexing multi-lattice diffraction data
journal, September 2014

  • Gildea, Richard J.; Waterman, David G.; Parkhurst, James M.
  • Acta Crystallographica Section D Biological Crystallography, Vol. 70, Issue 10
  • DOI: 10.1107/S1399004714017039

On the limited memory BFGS method for large scale optimization
journal, August 1989

  • Liu, Dong C.; Nocedal, Jorge
  • Mathematical Programming, Vol. 45, Issue 1-3
  • DOI: 10.1007/BF01589116

The anatomy of a comprehensive constrained, restrained refinement program for the modern computing environment – Olex2 dissected
journal, January 2015

  • Bourhis, Luc J.; Dolomanov, Oleg V.; Gildea, Richard J.
  • Acta Crystallographica Section A Foundations and Advances, Vol. 71, Issue 1
  • DOI: 10.1107/S2053273314022207

Processing and post-refinement of oscillation camera data
journal, December 1979

  • Rossmann, M. G.; Leslie, A. G. W.; Abdel-Meguid, S. S.
  • Journal of Applied Crystallography, Vol. 12, Issue 6
  • DOI: 10.1107/S0021889879013273

xia2 : an expert system for macromolecular crystallography data reduction
journal, December 2009


Corrgrams: Exploratory Displays for Correlation Matrices
journal, November 2002


On the geometry of a modern imaging diffractometer
journal, May 1999

  • Paciorek, W. A.; Meyer, M.; Chapuis, G.
  • Acta Crystallographica Section A Foundations of Crystallography, Vol. 55, Issue 3
  • DOI: 10.1107/S0108767398015037

An Algorithm for Automatic Indexing of Oscillation Images using Fourier Analysis
journal, December 1997

  • Steller, I.; Bolotovsky, R.; Rossmann, M. G.
  • Journal of Applied Crystallography, Vol. 30, Issue 6
  • DOI: 10.1107/S0021889897008777

Automated data collection for macromolecular crystallography
journal, September 2011


The PILATUS 1M detector
journal, February 2006

  • Broennimann, Ch.; Eikenberry, E. F.; Henrich, B.
  • Journal of Synchrotron Radiation, Vol. 13, Issue 2
  • DOI: 10.1107/S0909049505038665

Propagation of errors for matrix inversion
journal, September 2000

  • Lefebvre, M.; Keeler, R. K.; Sobie, R.
  • Nuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment, Vol. 451, Issue 2
  • DOI: 10.1016/S0168-9002(00)00323-5

Small sample corrections for LTS and MCD
journal, April 2002


Estimating fluctuating selection in age-structured populations: Estimating fluctuating selection
journal, June 2012


dxtbx : the diffraction experiment toolbox
journal, July 2014

  • Parkhurst, James M.; Brewster, Aaron S.; Fuentes-Montero, Luis
  • Journal of Applied Crystallography, Vol. 47, Issue 4
  • DOI: 10.1107/S1600576714011996

The oscillation method for crystals with very large unit cells
journal, November 1979

  • Winkler, F. K.; Schutt, C. E.; Harrison, S. C.
  • Acta Crystallographica Section A, Vol. 35, Issue 6
  • DOI: 10.1107/S0567739479002035

Crystal orientation and X-ray pattern prediction routines for area-detector diffractometer systems in macromolecular crystallography
journal, August 1987


How good are my data and what is the resolution?
journal, June 2013

  • Evans, Philip R.; Murshudov, Garib N.
  • Acta Crystallographica Section D Biological Crystallography, Vol. 69, Issue 7
  • DOI: 10.1107/S0907444913000061

Other refinement methods
book, October 2006


Improved statistics for determining the Patterson symmetry from unmerged diffraction intensities
journal, March 2006

  • Sauter, Nicholas K.; Grosse-Kunstleve, Ralf W.; Adams, Paul D.
  • Journal of Applied Crystallography, Vol. 39, Issue 2
  • DOI: 10.1107/S0021889805042299

The Computational Crystallography Toolbox : crystallographic algorithms in a reusable software framework
journal, January 2002

  • Grosse-Kunstleve, Ralf W.; Sauter, Nicholas K.; Moriarty, Nigel W.
  • Journal of Applied Crystallography, Vol. 35, Issue 1
  • DOI: 10.1107/S0021889801017824

Robust Regression: Asymptotics, Conjectures and Monte Carlo
journal, September 1973


DENZO and SCALEPACK
book, April 2012


Classification and use of image data
book, October 2006


Automated diffraction image analysis and spot searching for high-throughput crystal screening
journal, January 2006

  • Zhang, Zepu; Sauter, Nicholas K.; van den Bedem, Henry
  • Journal of Applied Crystallography, Vol. 39, Issue 1
  • DOI: 10.1107/S0021889805040677

Integration, scaling, space-group assignment and post-refinement
journal, January 2010

  • Kabsch, Wolfgang
  • Acta Crystallographica Section D Biological Crystallography, Vol. 66, Issue 2, p. 133-144
  • DOI: 10.1107/S0907444909047374

Influence Function and Efficiency of the Minimum Covariance Determinant Scatter Matrix Estimator
journal, November 1999

  • Croux, Christophe; Haesbroeck, Gentiane
  • Journal of Multivariate Analysis, Vol. 71, Issue 2
  • DOI: 10.1006/jmva.1999.1839

XDS
journal, January 2010

  • Kabsch, Wolfgang
  • Acta Crystallographica Section D Biological Crystallography, Vol. 66, Issue 2
  • DOI: 10.1107/S0907444909047337

A Fast Algorithm for the Minimum Covariance Determinant Estimator
journal, August 1999


[20] Processing of X-ray diffraction data collected in oscillation mode
book, January 1997


Angle calculations for 3- and 4-circle X-ray and neutron diffractometers
journal, April 1967


Eigenvalue filtering in the refinement of crystal and orientation parameters for oscillation photography
journal, August 1984


The integration of macromolecular diffraction data
journal, December 2005

  • Leslie, Andrew G. W.
  • Acta Crystallographica Section D Biological Crystallography, Vol. 62, Issue 1
  • DOI: 10.1107/S0907444905039107

Thaumatin / Diamond Light Source I04 User Training
dataset, January 2014


Small Sample Corrections for LTS and MCD
book, January 2003


Propagation of Errors for Matrix Inversion
text, January 1999


Works referencing / citing this record:

Crystal structure of peptide‐bound neprilysin reveals key binding interactions
journal, September 2019

  • Moss, Stephen; Subramanian, Vasanta; Acharya, K. Ravi
  • FEBS Letters, Vol. 594, Issue 2
  • DOI: 10.1002/1873-3468.13602

C7orf59/LAMTOR4 phosphorylation and structural flexibility modulate Ragulator assembly
journal, July 2019

  • Rasheed, Nadia; Lima, Tatiani B.; Mercaldi, Gustavo F.
  • FEBS Open Bio, Vol. 9, Issue 9
  • DOI: 10.1002/2211-5463.12700

Crystal structure of botulinum neurotoxin subtype A3 cell binding domain in complex with GD1a co‐receptor ganglioside
journal, January 2020


Two Aluminophosphate Molecular Sieves Built from Pairs of Enantiomeric Structural Building Units
journal, March 2018

  • Seo, Seungwan; Yang, Taimin; Shin, Jiho
  • Angewandte Chemie International Edition, Vol. 57, Issue 14
  • DOI: 10.1002/anie.201800791

Exploration of Strategies for Mechanism‐Based Inhibitor Design for Family GH99 endo ‐α‐1,2‐Mannanases
journal, April 2018

  • Fernandes, Pearl Z.; Petricevic, Marija; Sobala, Lukasz
  • Chemistry – A European Journal, Vol. 24, Issue 29
  • DOI: 10.1002/chem.201800435

Cotranslational Folding of a Pentarepeat β-Helix Protein
journal, December 2018

  • Notari, Luigi; Martínez-Carranza, Markel; Farías-Rico, José Arcadio
  • Journal of Molecular Biology, Vol. 430, Issue 24
  • DOI: 10.1016/j.jmb.2018.10.016

Structure of photosystem II and substrate binding at room temperature
journal, November 2016

  • Young, Iris D.; Ibrahim, Mohamed; Chatterjee, Ruchira
  • Nature, Vol. 540, Issue 7633
  • DOI: 10.1038/nature20161

Complex pectin metabolism by gut bacteria reveals novel catalytic functions
journal, March 2017

  • Ndeh, Didier; Rogowski, Artur; Cartmell, Alan
  • Nature, Vol. 544, Issue 7648
  • DOI: 10.1038/nature21725

Structure of PINK1 in complex with its substrate ubiquitin
journal, October 2017

  • Schubert, Alexander F.; Gladkova, Christina; Pardon, Els
  • Nature, Vol. 552, Issue 7683
  • DOI: 10.1038/nature24645

Mechanism and regulation of the Lys6-selective deubiquitinase USP30
journal, September 2017

  • Gersch, Malte; Gladkova, Christina; Schubert, Alexander F.
  • Nature Structural & Molecular Biology, Vol. 24, Issue 11
  • DOI: 10.1038/nsmb.3475

Structural basis for amino acid transport by the CAT family of SLC7 transporters
journal, February 2018

  • Jungnickel, Katharina E. J.; Parker, Joanne L.; Newstead, Simon
  • Nature Communications, Vol. 9, Issue 1
  • DOI: 10.1038/s41467-018-03066-6

A metal–organic framework for efficient water-based ultra-low-temperature-driven cooling
journal, July 2019


The ALFA-tag is a highly versatile tool for nanobody-based bioscience applications
journal, September 2019

  • Götzke, Hansjörg; Kilisch, Markus; Martínez-Carranza, Markel
  • Nature Communications, Vol. 10, Issue 1
  • DOI: 10.1038/s41467-019-12301-7

Structural basis for maintenance of bacterial outer membrane lipid asymmetry
journal, October 2017

  • Abellón-Ruiz, Javier; Kaptan, Shreyas S.; Baslé, Arnaud
  • Nature Microbiology, Vol. 2, Issue 12
  • DOI: 10.1038/s41564-017-0046-x

Mechanism of parkin activation by PINK1
journal, June 2018


Structures of the intermediates of Kok’s photosynthetic water oxidation clock
journal, November 2018


The crystal structure of the chitinase ChiA74 of Bacillus thuringiensis has a multidomain assembly
journal, February 2019

  • Juárez-Hernández, Estefania O.; Casados-Vázquez, Luz E.; Brieba, Luis G.
  • Scientific Reports, Vol. 9, Issue 1
  • DOI: 10.1038/s41598-019-39464-z

Synthesis and application of a highly branched, mechanism-based 2-deoxy-2-fluoro-oligosaccharide inhibitor of endo -xyloglucanases
journal, January 2018

  • Jain, Namrata; Attia, Mohamed A.; Offen, Wendy A.
  • Organic & Biomolecular Chemistry, Vol. 16, Issue 45
  • DOI: 10.1039/c8ob02250j

Structural basis for the C-domain-selective angiotensin-converting enzyme inhibition by bradykinin-potentiating peptide b (BPPb)
journal, May 2019

  • Sturrock, Edward D.; Lubbe, Lizelle; Cozier, Gyles E.
  • Biochemical Journal, Vol. 476, Issue 10
  • DOI: 10.1042/bcj20190290

Crystal structures of angiotensin-converting enzyme from Anopheles gambiae in its native form and with a bound inhibitor
journal, November 2019

  • Cashman, John S.; Cozier, Gyles E.; Harrison, Charlotte
  • Biochemical Journal, Vol. 476, Issue 22
  • DOI: 10.1042/bcj20190635

A cysteine protease–like domain enhances the cytotoxic effects of the Photorhabdus asymbiotica toxin PaTox
journal, November 2018

  • Bogdanovic, Xenia; Schneider, Silvia; Levanova, Nadezhda
  • Journal of Biological Chemistry, Vol. 294, Issue 3
  • DOI: 10.1074/jbc.ra118.005043

Structural basis for isoform-specific kinesin-1 recognition of Y-acidic cargo adaptors
journal, May 2018

  • Pernigo, Stefano; Chegkazi, Magda; Yip, Yan Y.
  • eLife
  • DOI: 10.1101/322057

A rationally designed and highly versatile epitope tag for nanobody-based purification, detection and manipulation of proteins
journal, June 2019

  • Götzke, Hansjörg; Kilisch, Markus; Martínez-Carranza, Markel
  • Nature Communications
  • DOI: 10.1101/640771

On the quality of the continuous rotation electron diffraction data for accurate atomic structure determination of inorganic compounds
journal, July 2018

  • Wang, Yunchen; Yang, Taimin; Xu, Hongyi
  • Journal of Applied Crystallography, Vol. 51, Issue 4
  • DOI: 10.1107/s1600576718007604

Calibration of rotation axes for multi-axis goniometers in macromolecular crystallography
journal, September 2018

  • White, K. Ian; Bugris, Valeria; McCarthy, Andrew A.
  • Journal of Applied Crystallography, Vol. 51, Issue 5
  • DOI: 10.1107/s1600576718010956

ClickX : a visualization-based program for preprocessing of serial crystallography data
journal, May 2019

  • Li, Xuanxuan; Li, Chufeng; Liu, Haiguang
  • Journal of Applied Crystallography, Vol. 52, Issue 3
  • DOI: 10.1107/s1600576719005363

Intermolecular correlations are necessary to explain diffuse scattering from protein crystals
journal, February 2018


Crystal structure of the type IV secretion system component CagX from Helicobacter pylori
journal, February 2017

  • Zhang, Jin; Fan, Fei; Zhao, Yanhe
  • Acta Crystallographica Section F Structural Biology Communications, Vol. 73, Issue 3
  • DOI: 10.1107/s2053230x17001376

Crystal structure of the Agrobacterium tumefaciens type VI effector–immunity complex
journal, November 2018

  • Fukuhara, Satoshi; Nakane, Takanori; Yamashita, Keitaro
  • Acta Crystallographica Section F Structural Biology Communications, Vol. 74, Issue 12
  • DOI: 10.1107/s2053230x18016369

Fixed target combined with spectral mapping: approaching 100% hit rates for serial crystallography
journal, July 2016

  • Oghbaey, Saeed; Sarracini, Antoine; Ginn, Helen M.
  • Acta Crystallographica Section D Structural Biology, Vol. 72, Issue 8, p. 944-955
  • DOI: 10.1107/s2059798316010834

Gentle, fast and effective crystal soaking by acoustic dispensing
journal, March 2017

  • Collins, Patrick M.; Ng, Jia Tsing; Talon, Romain
  • Acta Crystallographica Section D Structural Biology, Vol. 73, Issue 3
  • DOI: 10.1107/s205979831700331x

Where is crystallography going?
journal, February 2018

  • Grimes, Jonathan M.; Hall, David R.; Ashton, Alun W.
  • Acta Crystallographica Section D Structural Biology, Vol. 74, Issue 2
  • DOI: 10.1107/s2059798317016709

Electron diffraction data processing with DIALS
journal, May 2018

  • Clabbers, Max T. B.; Gruene, Tim; Parkhurst, James M.
  • Acta Crystallographica Section D Structural Biology, Vol. 74, Issue 6
  • DOI: 10.1107/s2059798318007726

Coping with strong translational noncrystallographic symmetry and extreme anisotropy in molecular replacement with Phaser : human Rab27a
journal, February 2019

  • Jamshidiha, Mostafa; Pérez-Dorado, Inmaculada; Murray, James W.
  • Acta Crystallographica Section D Structural Biology, Vol. 75, Issue 3
  • DOI: 10.1107/s2059798318017825

How best to use photons
journal, March 2019

  • Winter, Graeme; Gildea, Richard J.; Paterson, Neil G.
  • Acta Crystallographica Section D Structural Biology, Vol. 75, Issue 3
  • DOI: 10.1107/s2059798319003528

ATP-specificity of succinyl-CoA synthetase from Blastocystis hominis
journal, June 2019

  • Huang, Ji; Nguyen, Vinh H.; Hamblin, Karleigh A.
  • Acta Crystallographica Section D Structural Biology, Vol. 75, Issue 7
  • DOI: 10.1107/s2059798319007976

The molecular structure of the glycoside hydrolase domain of Cwp19 from Clostridium difficile
journal, November 2017

  • Bradshaw, William J.; Kirby, Jonathan M.; Roberts, April K.
  • The FEBS Journal, Vol. 284, Issue 24
  • DOI: 10.1111/febs.14310

Crystal structures of sampatrilat and sampatrilat‐Asp in complex with human ACE – a molecular basis for domain selectivity
journal, December 2017

  • Cozier, Gyles E.; Schwager, Sylva L.; Sharma, Rajni K.
  • The FEBS Journal, Vol. 285, Issue 8
  • DOI: 10.1111/febs.14421

Structure of the DASH/Dam1 complex shows its role at the yeast kinetochore-microtubule interface
journal, May 2018


In vitro and in vivo characterization of three Cellvibrio japonicus glycoside hydrolase family 5 members reveals potent xyloglucan backbone-cleaving functions
journal, February 2018

  • Attia, Mohamed A.; Nelson, Cassandra E.; Offen, Wendy A.
  • Biotechnology for Biofuels, Vol. 11, Issue 1
  • DOI: 10.1186/s13068-018-1039-6

The molecular structure of Schistosoma mansoni PNP isoform 2 provides insights into the nucleoside selectivity of PNPs
journal, September 2018

  • Torini, Juliana Roberta; Romanello, Larissa; Batista, Fernanda Aparecida Heleno
  • PLOS ONE, Vol. 13, Issue 9
  • DOI: 10.1371/journal.pone.0203532

Structural basis for isoform-specific kinesin-1 recognition of Y-acidic cargo adaptors
journal, October 2018


Two Aluminophosphate Molecular Sieves Built from Pairs of Enantiomeric Structural Building Units
journal, March 2018


In vitro and in vivo characterization of three Cellvibrio japonicus glycoside hydrolase family 5 members reveals potent xyloglucan backbone-cleaving functions
text, January 2018

  • Attia, Mohamed A.; Nelson, Cassandra E.; Offen, Wendy A.
  • Maryland Shared Open Access Repository
  • DOI: 10.13016/m27p8tf9v

Cotranslational folding of a pentarepeat β-helix protein
journal, October 2018

  • Notari, Luigi; Martínez-Carranza, Markel; Farias-Rico, Jose Arcadio
  • Journal of Molecular Biology
  • DOI: 10.1101/255810

Sample manipulation and data assembly for robust microcrystal synchrotron crystallography
journal, July 2018

  • Liu, Qun; Guo, Gongrui; Fuchs, Martin R.
  • Acta Crystallographica Section A Foundations and Advances, Vol. 74, Issue a1
  • DOI: 10.1107/s0108767318096046

The molecular structure of Schistosoma mansoni PNP isoform 2 provides insights into the nucleotide selectivity of PNPs
journal, April 2018

  • Torini, Juliana Roberta; Romanelo, Larissa; Batista, Fernanda Aparecida Heleno
  • PLOS ONE
  • DOI: 10.1101/300533

ATP-specificity of succinyl-CoA synthetase from Blastocystis hominis
text, January 2019


Intermolecular correlations are necessary to explain diffuse scattering from protein crystals
text, January 2017


Figures/Tables have been extracted from DOE-funded journal article accepted manuscripts.