Diffraction-geometry refinement in the DIALS framework
Abstract
Rapid data collection and modern computing resources provide the opportunity to revisit the task of optimizing the model of diffraction geometry prior to integration. A comprehensive description is given of new software that builds upon established methods by performing a single global refinement procedure, utilizing a smoothly varying model of the crystal lattice where appropriate. This global refinement technique extends to multiple data sets, providing useful constraints to handle the problem of correlated parameters, particularly for small wedges of data. Examples of advanced uses of the software are given and the design is explained in detail, with particular emphasis on the flexibility and extensibility it entails.
- Authors:
-
- Science and Technology Facilities Council (STFC), Didcot (United Kingdom). Rutherford Appleton Lab. (RAL) and Collaborative Computational Project Number 4 (CCP4)
- Science and Technology Facilities Council (STFC), Harwell Campus, Oxford (United Kingdom). Diamond Light Source, Ltd.
- Science and Technology Facilities Council (STFC), Harwell Campus, Oxford (United Kingdom). Diamond Light Source, Ltd.; MRC Lab. of Molecular Biology, Cambridge (United Kingdom)
- Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)
- Publication Date:
- Research Org.:
- Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States)
- Sponsoring Org.:
- National Institutes of Health (NIH)
- OSTI Identifier:
- 1379263
- Grant/Contract Number:
- AC02-05CH11231
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Acta Crystallographica. Section D. Structural Biology
- Additional Journal Information:
- Journal Volume: 72; Journal Issue: 4; Journal ID: ISSN 2059-7983
- Publisher:
- IUCr
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 59 BASIC BIOLOGICAL SCIENCES; global refinement; DIALS framework; centroid refinement
Citation Formats
Waterman, David G., Winter, Graeme, Gildea, Richard J., Parkhurst, James M., Brewster, Aaron S., Sauter, Nicholas K., and Evans, Gwyndaf. Diffraction-geometry refinement in the DIALS framework. United States: N. p., 2016.
Web. doi:10.1107/S2059798316002187.
Waterman, David G., Winter, Graeme, Gildea, Richard J., Parkhurst, James M., Brewster, Aaron S., Sauter, Nicholas K., & Evans, Gwyndaf. Diffraction-geometry refinement in the DIALS framework. United States. https://doi.org/10.1107/S2059798316002187
Waterman, David G., Winter, Graeme, Gildea, Richard J., Parkhurst, James M., Brewster, Aaron S., Sauter, Nicholas K., and Evans, Gwyndaf. Wed .
"Diffraction-geometry refinement in the DIALS framework". United States. https://doi.org/10.1107/S2059798316002187. https://www.osti.gov/servlets/purl/1379263.
@article{osti_1379263,
title = {Diffraction-geometry refinement in the DIALS framework},
author = {Waterman, David G. and Winter, Graeme and Gildea, Richard J. and Parkhurst, James M. and Brewster, Aaron S. and Sauter, Nicholas K. and Evans, Gwyndaf},
abstractNote = {Rapid data collection and modern computing resources provide the opportunity to revisit the task of optimizing the model of diffraction geometry prior to integration. A comprehensive description is given of new software that builds upon established methods by performing a single global refinement procedure, utilizing a smoothly varying model of the crystal lattice where appropriate. This global refinement technique extends to multiple data sets, providing useful constraints to handle the problem of correlated parameters, particularly for small wedges of data. Examples of advanced uses of the software are given and the design is explained in detail, with particular emphasis on the flexibility and extensibility it entails.},
doi = {10.1107/S2059798316002187},
journal = {Acta Crystallographica. Section D. Structural Biology},
number = 4,
volume = 72,
place = {United States},
year = {Wed Mar 30 00:00:00 EDT 2016},
month = {Wed Mar 30 00:00:00 EDT 2016}
}
Web of Science
Figures / Tables:
Works referenced in this record:
New methods for indexing multi-lattice diffraction data
journal, September 2014
- Gildea, Richard J.; Waterman, David G.; Parkhurst, James M.
- Acta Crystallographica Section D Biological Crystallography, Vol. 70, Issue 10
On the limited memory BFGS method for large scale optimization
journal, August 1989
- Liu, Dong C.; Nocedal, Jorge
- Mathematical Programming, Vol. 45, Issue 1-3
The anatomy of a comprehensive constrained, restrained refinement program for the modern computing environment – Olex2 dissected
journal, January 2015
- Bourhis, Luc J.; Dolomanov, Oleg V.; Gildea, Richard J.
- Acta Crystallographica Section A Foundations and Advances, Vol. 71, Issue 1
Processing and post-refinement of oscillation camera data
journal, December 1979
- Rossmann, M. G.; Leslie, A. G. W.; Abdel-Meguid, S. S.
- Journal of Applied Crystallography, Vol. 12, Issue 6
xia2 : an expert system for macromolecular crystallography data reduction
journal, December 2009
- Winter, G.
- Journal of Applied Crystallography, Vol. 43, Issue 1
Corrgrams: Exploratory Displays for Correlation Matrices
journal, November 2002
- Friendly, Michael
- The American Statistician, Vol. 56, Issue 4
On the geometry of a modern imaging diffractometer
journal, May 1999
- Paciorek, W. A.; Meyer, M.; Chapuis, G.
- Acta Crystallographica Section A Foundations of Crystallography, Vol. 55, Issue 3
An Algorithm for Automatic Indexing of Oscillation Images using Fourier Analysis
journal, December 1997
- Steller, I.; Bolotovsky, R.; Rossmann, M. G.
- Journal of Applied Crystallography, Vol. 30, Issue 6
Automated data collection for macromolecular crystallography
journal, September 2011
- Winter, Graeme; McAuley, Katherine E.
- Methods, Vol. 55, Issue 1
The PILATUS 1M detector
journal, February 2006
- Broennimann, Ch.; Eikenberry, E. F.; Henrich, B.
- Journal of Synchrotron Radiation, Vol. 13, Issue 2
Propagation of errors for matrix inversion
journal, September 2000
- Lefebvre, M.; Keeler, R. K.; Sobie, R.
- Nuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment, Vol. 451, Issue 2
Small sample corrections for LTS and MCD
journal, April 2002
- Pison, G.; Aelst, S. Van; Willems, G.
- Metrika, Vol. 55, Issue 1-2
[19] Diffraction-data processing for electronic detectors: Theory and practice
book, January 1997
- Pflugrath, James W.
- Methods in Enzymology
Estimating fluctuating selection in age-structured populations: Estimating fluctuating selection
journal, June 2012
- Engen, S.; Saether, B. -E.; Kvalnes, T.
- Journal of Evolutionary Biology, Vol. 25, Issue 8
dxtbx : the diffraction experiment toolbox
journal, July 2014
- Parkhurst, James M.; Brewster, Aaron S.; Fuentes-Montero, Luis
- Journal of Applied Crystallography, Vol. 47, Issue 4
The oscillation method for crystals with very large unit cells
journal, November 1979
- Winkler, F. K.; Schutt, C. E.; Harrison, S. C.
- Acta Crystallographica Section A, Vol. 35, Issue 6
Crystal orientation and X-ray pattern prediction routines for area-detector diffractometer systems in macromolecular crystallography
journal, August 1987
- Messerschmidt, A.; Pflugrath, J. W.
- Journal of Applied Crystallography, Vol. 20, Issue 4
How good are my data and what is the resolution?
journal, June 2013
- Evans, Philip R.; Murshudov, Garib N.
- Acta Crystallographica Section D Biological Crystallography, Vol. 69, Issue 7
Other refinement methods
book, October 2006
- Prince, E.; Collins, D. M.
- International Tables for Crystallography
Improved statistics for determining the Patterson symmetry from unmerged diffraction intensities
journal, March 2006
- Sauter, Nicholas K.; Grosse-Kunstleve, Ralf W.; Adams, Paul D.
- Journal of Applied Crystallography, Vol. 39, Issue 2
The Computational Crystallography Toolbox : crystallographic algorithms in a reusable software framework
journal, January 2002
- Grosse-Kunstleve, Ralf W.; Sauter, Nicholas K.; Moriarty, Nigel W.
- Journal of Applied Crystallography, Vol. 35, Issue 1
Robust Regression: Asymptotics, Conjectures and Monte Carlo
journal, September 1973
- Huber, Peter J.
- The Annals of Statistics, Vol. 1, Issue 5
DENZO and SCALEPACK
book, April 2012
- Otwinowski, Z.; Minor, W.; Borek, D.
- International Tables for Crystallography
Classification and use of image data
book, October 2006
- Bernstein, H. J.
- International Tables for Crystallography
Automated diffraction image analysis and spot searching for high-throughput crystal screening
journal, January 2006
- Zhang, Zepu; Sauter, Nicholas K.; van den Bedem, Henry
- Journal of Applied Crystallography, Vol. 39, Issue 1
Integration, scaling, space-group assignment and post-refinement
journal, January 2010
- Kabsch, Wolfgang
- Acta Crystallographica Section D Biological Crystallography, Vol. 66, Issue 2, p. 133-144
Influence Function and Efficiency of the Minimum Covariance Determinant Scatter Matrix Estimator
journal, November 1999
- Croux, Christophe; Haesbroeck, Gentiane
- Journal of Multivariate Analysis, Vol. 71, Issue 2
XDS
journal, January 2010
- Kabsch, Wolfgang
- Acta Crystallographica Section D Biological Crystallography, Vol. 66, Issue 2
A Fast Algorithm for the Minimum Covariance Determinant Estimator
journal, August 1999
- Rousseeuw, Peter J.; Driessen, Katrien Van
- Technometrics, Vol. 41, Issue 3
[20] Processing of X-ray diffraction data collected in oscillation mode
book, January 1997
- Otwinowski, Zbyszek; Minor, Wladek
- Macromolecular Crystallography Part A, 307-326
Angle calculations for 3- and 4-circle X-ray and neutron diffractometers
journal, April 1967
- Busing, W. R.; Levy, H. A.
- Acta Crystallographica, Vol. 22, Issue 4
Eigenvalue filtering in the refinement of crystal and orientation parameters for oscillation photography
journal, August 1984
- Reeke Jnr, G. N.
- Journal of Applied Crystallography, Vol. 17, Issue 4
The integration of macromolecular diffraction data
journal, December 2005
- Leslie, Andrew G. W.
- Acta Crystallographica Section D Biological Crystallography, Vol. 62, Issue 1
Thaumatin / Diamond Light Source I04 User Training
dataset, January 2014
- Winter, Graeme; Hall, David
- Zenodo
Small Sample Corrections for LTS and MCD
book, January 2003
- Pison, G.; Van Aelst, S.; Willems, G.
- Developments in Robust Statistics
Propagation of Errors for Matrix Inversion
text, January 1999
- Lefebvre, M.; Keeler, R. K.; Sobie, R.
- arXiv
Works referencing / citing this record:
Crystal structure of peptide‐bound neprilysin reveals key binding interactions
journal, September 2019
- Moss, Stephen; Subramanian, Vasanta; Acharya, K. Ravi
- FEBS Letters, Vol. 594, Issue 2
C7orf59/LAMTOR4 phosphorylation and structural flexibility modulate Ragulator assembly
journal, July 2019
- Rasheed, Nadia; Lima, Tatiani B.; Mercaldi, Gustavo F.
- FEBS Open Bio, Vol. 9, Issue 9
Crystal structure of botulinum neurotoxin subtype A3 cell binding domain in complex with GD1a co‐receptor ganglioside
journal, January 2020
- Gregory, Kyle S.; Liu, Sai Man; Acharya, K. Ravi
- FEBS Open Bio, Vol. 10, Issue 3
Two Aluminophosphate Molecular Sieves Built from Pairs of Enantiomeric Structural Building Units
journal, March 2018
- Seo, Seungwan; Yang, Taimin; Shin, Jiho
- Angewandte Chemie International Edition, Vol. 57, Issue 14
Exploration of Strategies for Mechanism‐Based Inhibitor Design for Family GH99 endo ‐α‐1,2‐Mannanases
journal, April 2018
- Fernandes, Pearl Z.; Petricevic, Marija; Sobala, Lukasz
- Chemistry – A European Journal, Vol. 24, Issue 29
Cotranslational Folding of a Pentarepeat β-Helix Protein
journal, December 2018
- Notari, Luigi; Martínez-Carranza, Markel; Farías-Rico, José Arcadio
- Journal of Molecular Biology, Vol. 430, Issue 24
Structure of photosystem II and substrate binding at room temperature
journal, November 2016
- Young, Iris D.; Ibrahim, Mohamed; Chatterjee, Ruchira
- Nature, Vol. 540, Issue 7633
Complex pectin metabolism by gut bacteria reveals novel catalytic functions
journal, March 2017
- Ndeh, Didier; Rogowski, Artur; Cartmell, Alan
- Nature, Vol. 544, Issue 7648
Structure of PINK1 in complex with its substrate ubiquitin
journal, October 2017
- Schubert, Alexander F.; Gladkova, Christina; Pardon, Els
- Nature, Vol. 552, Issue 7683
Mechanism and regulation of the Lys6-selective deubiquitinase USP30
journal, September 2017
- Gersch, Malte; Gladkova, Christina; Schubert, Alexander F.
- Nature Structural & Molecular Biology, Vol. 24, Issue 11
Structural basis for amino acid transport by the CAT family of SLC7 transporters
journal, February 2018
- Jungnickel, Katharina E. J.; Parker, Joanne L.; Newstead, Simon
- Nature Communications, Vol. 9, Issue 1
A metal–organic framework for efficient water-based ultra-low-temperature-driven cooling
journal, July 2019
- Lenzen, Dirk; Zhao, Jingjing; Ernst, Sebastian-Johannes
- Nature Communications, Vol. 10, Issue 1
The ALFA-tag is a highly versatile tool for nanobody-based bioscience applications
journal, September 2019
- Götzke, Hansjörg; Kilisch, Markus; Martínez-Carranza, Markel
- Nature Communications, Vol. 10, Issue 1
Structural basis for maintenance of bacterial outer membrane lipid asymmetry
journal, October 2017
- Abellón-Ruiz, Javier; Kaptan, Shreyas S.; Baslé, Arnaud
- Nature Microbiology, Vol. 2, Issue 12
Mechanism of parkin activation by PINK1
journal, June 2018
- Gladkova, Christina; Maslen, Sarah L.; Skehel, J. Mark
- Nature, Vol. 559, Issue 7714
Structures of the intermediates of Kok’s photosynthetic water oxidation clock
journal, November 2018
- Kern, Jan; Chatterjee, Ruchira; Young, Iris D.
- Nature, Vol. 563, Issue 7731
The crystal structure of the chitinase ChiA74 of Bacillus thuringiensis has a multidomain assembly
journal, February 2019
- Juárez-Hernández, Estefania O.; Casados-Vázquez, Luz E.; Brieba, Luis G.
- Scientific Reports, Vol. 9, Issue 1
Synthesis and application of a highly branched, mechanism-based 2-deoxy-2-fluoro-oligosaccharide inhibitor of endo -xyloglucanases
journal, January 2018
- Jain, Namrata; Attia, Mohamed A.; Offen, Wendy A.
- Organic & Biomolecular Chemistry, Vol. 16, Issue 45
Structural basis for the C-domain-selective angiotensin-converting enzyme inhibition by bradykinin-potentiating peptide b (BPPb)
journal, May 2019
- Sturrock, Edward D.; Lubbe, Lizelle; Cozier, Gyles E.
- Biochemical Journal, Vol. 476, Issue 10
Crystal structures of angiotensin-converting enzyme from Anopheles gambiae in its native form and with a bound inhibitor
journal, November 2019
- Cashman, John S.; Cozier, Gyles E.; Harrison, Charlotte
- Biochemical Journal, Vol. 476, Issue 22
A cysteine protease–like domain enhances the cytotoxic effects of the Photorhabdus asymbiotica toxin PaTox
journal, November 2018
- Bogdanovic, Xenia; Schneider, Silvia; Levanova, Nadezhda
- Journal of Biological Chemistry, Vol. 294, Issue 3
Structural basis for isoform-specific kinesin-1 recognition of Y-acidic cargo adaptors
journal, May 2018
- Pernigo, Stefano; Chegkazi, Magda; Yip, Yan Y.
- eLife
A rationally designed and highly versatile epitope tag for nanobody-based purification, detection and manipulation of proteins
journal, June 2019
- Götzke, Hansjörg; Kilisch, Markus; Martínez-Carranza, Markel
- Nature Communications
On the quality of the continuous rotation electron diffraction data for accurate atomic structure determination of inorganic compounds
journal, July 2018
- Wang, Yunchen; Yang, Taimin; Xu, Hongyi
- Journal of Applied Crystallography, Vol. 51, Issue 4
Calibration of rotation axes for multi-axis goniometers in macromolecular crystallography
journal, September 2018
- White, K. Ian; Bugris, Valeria; McCarthy, Andrew A.
- Journal of Applied Crystallography, Vol. 51, Issue 5
ClickX : a visualization-based program for preprocessing of serial crystallography data
journal, May 2019
- Li, Xuanxuan; Li, Chufeng; Liu, Haiguang
- Journal of Applied Crystallography, Vol. 52, Issue 3
Intermolecular correlations are necessary to explain diffuse scattering from protein crystals
journal, February 2018
- Peck, Ariana; Poitevin, Frédéric; Lane, Thomas J.
- IUCrJ, Vol. 5, Issue 2
Crystal structure of the type IV secretion system component CagX from Helicobacter pylori
journal, February 2017
- Zhang, Jin; Fan, Fei; Zhao, Yanhe
- Acta Crystallographica Section F Structural Biology Communications, Vol. 73, Issue 3
Crystal structure of the Agrobacterium tumefaciens type VI effector–immunity complex
journal, November 2018
- Fukuhara, Satoshi; Nakane, Takanori; Yamashita, Keitaro
- Acta Crystallographica Section F Structural Biology Communications, Vol. 74, Issue 12
The 1.1 Å resolution structure of a periplasmic phosphate-binding protein from Stenotrophomonas maltophilia : a crystallization contaminant identified by molecular replacement using the entire Protein Data Bank
journal, July 2016
- Keegan, Ronan; Waterman, David G.; Hopper, David J.
- Acta Crystallographica Section D Structural Biology, Vol. 72, Issue 8
Fixed target combined with spectral mapping: approaching 100% hit rates for serial crystallography
journal, July 2016
- Oghbaey, Saeed; Sarracini, Antoine; Ginn, Helen M.
- Acta Crystallographica Section D Structural Biology, Vol. 72, Issue 8, p. 944-955
Gentle, fast and effective crystal soaking by acoustic dispensing
journal, March 2017
- Collins, Patrick M.; Ng, Jia Tsing; Talon, Romain
- Acta Crystallographica Section D Structural Biology, Vol. 73, Issue 3
Where is crystallography going?
journal, February 2018
- Grimes, Jonathan M.; Hall, David R.; Ashton, Alun W.
- Acta Crystallographica Section D Structural Biology, Vol. 74, Issue 2
Electron diffraction data processing with DIALS
journal, May 2018
- Clabbers, Max T. B.; Gruene, Tim; Parkhurst, James M.
- Acta Crystallographica Section D Structural Biology, Vol. 74, Issue 6
Coping with strong translational noncrystallographic symmetry and extreme anisotropy in molecular replacement with Phaser : human Rab27a
journal, February 2019
- Jamshidiha, Mostafa; Pérez-Dorado, Inmaculada; Murray, James W.
- Acta Crystallographica Section D Structural Biology, Vol. 75, Issue 3
How best to use photons
journal, March 2019
- Winter, Graeme; Gildea, Richard J.; Paterson, Neil G.
- Acta Crystallographica Section D Structural Biology, Vol. 75, Issue 3
ATP-specificity of succinyl-CoA synthetase from Blastocystis hominis
journal, June 2019
- Huang, Ji; Nguyen, Vinh H.; Hamblin, Karleigh A.
- Acta Crystallographica Section D Structural Biology, Vol. 75, Issue 7
The molecular structure of the glycoside hydrolase domain of Cwp19 from Clostridium difficile
journal, November 2017
- Bradshaw, William J.; Kirby, Jonathan M.; Roberts, April K.
- The FEBS Journal, Vol. 284, Issue 24
Crystal structures of sampatrilat and sampatrilat‐Asp in complex with human ACE – a molecular basis for domain selectivity
journal, December 2017
- Cozier, Gyles E.; Schwager, Sylva L.; Sharma, Rajni K.
- The FEBS Journal, Vol. 285, Issue 8
Structural/mechanistic insights into the efficacy of nonclassical β-lactamase inhibitors against extensively drug resistant Stenotrophomonas maltophilia clinical isolates: β-lactamase inhibitors versus S. maltophilia
journal, September 2017
- Calvopiña, Karina; Hinchliffe, Philip; Brem, Jürgen
- Molecular Microbiology, Vol. 106, Issue 3
Structure of the DASH/Dam1 complex shows its role at the yeast kinetochore-microtubule interface
journal, May 2018
- Jenni, Simon; Harrison, Stephen C.
- Science, Vol. 360, Issue 6388
In vitro and in vivo characterization of three Cellvibrio japonicus glycoside hydrolase family 5 members reveals potent xyloglucan backbone-cleaving functions
journal, February 2018
- Attia, Mohamed A.; Nelson, Cassandra E.; Offen, Wendy A.
- Biotechnology for Biofuels, Vol. 11, Issue 1
The molecular structure of Schistosoma mansoni PNP isoform 2 provides insights into the nucleoside selectivity of PNPs
journal, September 2018
- Torini, Juliana Roberta; Romanello, Larissa; Batista, Fernanda Aparecida Heleno
- PLOS ONE, Vol. 13, Issue 9
A novel decarboxylating amidohydrolase involved in avoiding metabolic dead ends during cyanuric acid catabolism in Pseudomonas sp. strain ADP
journal, November 2018
- Esquirol, Lygie; Peat, Thomas S.; Wilding, Matthew
- PLOS ONE, Vol. 13, Issue 11
Structural basis for isoform-specific kinesin-1 recognition of Y-acidic cargo adaptors
journal, October 2018
- Pernigo, Stefano; Chegkazi, Magda S.; Yip, Yan Y.
- eLife, Vol. 7
Two Aluminophosphate Molecular Sieves Built from Pairs of Enantiomeric Structural Building Units
journal, March 2018
- Seo, Seungwan; Yang, Taimin; Shin, Jiho
- Angewandte Chemie, Vol. 130, Issue 14
In vitro and in vivo characterization of three Cellvibrio japonicus glycoside hydrolase family 5 members reveals potent xyloglucan backbone-cleaving functions
text, January 2018
- Attia, Mohamed A.; Nelson, Cassandra E.; Offen, Wendy A.
- Maryland Shared Open Access Repository
Cotranslational folding of a pentarepeat β-helix protein
journal, October 2018
- Notari, Luigi; Martínez-Carranza, Markel; Farias-Rico, Jose Arcadio
- Journal of Molecular Biology
Sample manipulation and data assembly for robust microcrystal synchrotron crystallography
journal, July 2018
- Liu, Qun; Guo, Gongrui; Fuchs, Martin R.
- Acta Crystallographica Section A Foundations and Advances, Vol. 74, Issue a1
In vitro and in vivo characterization of three Cellvibrio japonicus glycoside hydrolase family 5 members reveals potent xyloglucan backbone-cleaving functions
text, January 2018
- Attia, Mohamed A.; Nelson, Cassandra E.; Offen, Wendy A.
- BioMed Central
The molecular structure of Schistosoma mansoni PNP isoform 2 provides insights into the nucleotide selectivity of PNPs
journal, April 2018
- Torini, Juliana Roberta; Romanelo, Larissa; Batista, Fernanda Aparecida Heleno
- PLOS ONE
ATP-specificity of succinyl-CoA synthetase from Blastocystis hominis
text, January 2019
- Huang, Ji; Nguyen, Vinh H.; Hamblin, Karleigh A.
- International Union of Crystallography (IUCr)
Intermolecular correlations are necessary to explain diffuse scattering from protein crystals
text, January 2017
- Peck, Ariana; Poitevin, Frédéric; Lane, Thomas J.
- arXiv
Figures / Tables found in this record: