Search Menu
DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information
Search Scholarly Publications

Title: Best practices for high data-rate macromolecular crystallography (HDRMX)

Abstract

In macromolecular crystallography, higher flux, smaller beams, and faster detectors open the door to experiments with very large numbers of very small samples that can reveal polymorphs and dynamics but require re-engineering of approaches to the clustering of images both at synchrotrons and XFELs (X-ray free electron lasers). The need for the management of orders of magnitude more images and limitations of file systems favor a transition from simple one-file-per-image systems such as CBF to image container systems such as HDF5. This further increases the load on computers and networks and requires a re-examination of the presentation of metadata. In this paper, we discuss three important components of this problem—improved approaches to the clustering of images to better support experiments on polymorphs and dynamics, recent and upcoming changes in metadata for Eiger images, and software to rapidly validate images in the revised Eiger format.

Authors:
ORCiD logo [1]; ORCiD logo [2];  [1];  [1];  [3];  [4]; ORCiD logo [1]; ORCiD logo [5];  [3];  [5]
+ Show Author Affiliations
  1. Brookhaven National Lab. (BNL), Upton, NY (United States)
  2. Ronin Inst. for Independent Scholarship, Kirkland, WA (United States)
  3. Stony Brook Univ., NY (United States)
  4. Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)
  5. Mount Sinai High School, Mt Sinai, NY (United States)
Publication Date:
Research Org.:
Brookhaven National Lab. (BNL), Upton, NY (United States)
Sponsoring Org.:
USDOE Office of Science (SC), Basic Energy Sciences (BES); USDOE Office of Science (SC), Biological and Environmental Research (BER); National Institutes of Health (NIH)
OSTI Identifier:
1607978
Alternate Identifier(s):
OSTI ID: 1581838
Report Number(s):
BNL-213788-2020-JAAM
Journal ID: ISSN 2329-7778
Grant/Contract Number:  
SC0012704; AC02-98CH10886; P41RR012408; P41GM103473; P41GM111244; R01GM117126; P30GM133893; R21GM129570
Resource Type:
Accepted Manuscript
Journal Name:
Structural Dynamics
Additional Journal Information:
Journal Volume: 7; Journal Issue: 1; Journal ID: ISSN 2329-7778
Publisher:
American Crystallographic Association/AIP
Country of Publication:
United States
Language:
English
Subject:
36 MATERIALS SCIENCE

Citation Formats

Bernstein, Herbert J., Andrews, Lawrence C., Diaz, Jorge A., Jakoncic, Jean, Nguyen, Thu, Sauter, Nicholas K., Soares, Alexei S., Wei, Justin Y., Wlodek, Maciej R., and Xerri, Mario A. Best practices for high data-rate macromolecular crystallography (HDRMX). United States: N. p., 2020. Web. doi:10.1063/1.5128498.
Copy to clipboard
Bernstein, Herbert J., Andrews, Lawrence C., Diaz, Jorge A., Jakoncic, Jean, Nguyen, Thu, Sauter, Nicholas K., Soares, Alexei S., Wei, Justin Y., Wlodek, Maciej R., & Xerri, Mario A. Best practices for high data-rate macromolecular crystallography (HDRMX). United States. https://doi.org/10.1063/1.5128498
Copy to clipboard
Bernstein, Herbert J., Andrews, Lawrence C., Diaz, Jorge A., Jakoncic, Jean, Nguyen, Thu, Sauter, Nicholas K., Soares, Alexei S., Wei, Justin Y., Wlodek, Maciej R., and Xerri, Mario A. Thu . "Best practices for high data-rate macromolecular crystallography (HDRMX)". United States. https://doi.org/10.1063/1.5128498. https://www.osti.gov/servlets/purl/1607978.
Copy to clipboard
@article{osti_1607978,
title = {Best practices for high data-rate macromolecular crystallography (HDRMX)},
author = {Bernstein, Herbert J. and Andrews, Lawrence C. and Diaz, Jorge A. and Jakoncic, Jean and Nguyen, Thu and Sauter, Nicholas K. and Soares, Alexei S. and Wei, Justin Y. and Wlodek, Maciej R. and Xerri, Mario A.},
abstractNote = {In macromolecular crystallography, higher flux, smaller beams, and faster detectors open the door to experiments with very large numbers of very small samples that can reveal polymorphs and dynamics but require re-engineering of approaches to the clustering of images both at synchrotrons and XFELs (X-ray free electron lasers). The need for the management of orders of magnitude more images and limitations of file systems favor a transition from simple one-file-per-image systems such as CBF to image container systems such as HDF5. This further increases the load on computers and networks and requires a re-examination of the presentation of metadata. In this paper, we discuss three important components of this problem—improved approaches to the clustering of images to better support experiments on polymorphs and dynamics, recent and upcoming changes in metadata for Eiger images, and software to rapidly validate images in the revised Eiger format.},
doi = {10.1063/1.5128498},
journal = {Structural Dynamics},
number = 1,
volume = 7,
place = {United States},
year = {2020},
month = {1}
}
Copy to clipboard
Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record
https://doi.org/10.1063/1.5128498
Copyright Statement
Other availability
Search WorldCat Search WorldCat to find libraries that may hold this journal
Citation Metrics:
Cited by: 1 work
Citation information provided by
Web of Science
Save / Share:
Export Metadata
Save to My Library
You must Sign In or Create an Account in order to save documents to your library.

Works referenced in this record:

Lattices and reduced cells as points in 6-space and selection of Bravais lattice type by projections
journal, November 1988

  • Andrews, L. C.; Bernstein, H. J.
  • Acta Crystallographica Section A Foundations of Crystallography, Vol. 44, Issue 6
  • DOI: 10.1107/S0108767388006427

The geometry of Niggli reduction: BGAOL –embedding Niggli reduction and analysis of boundaries
journal, January 2014

  • Andrews, Lawrence C.; Bernstein, Herbert J.
  • Journal of Applied Crystallography, Vol. 47, Issue 1
  • DOI: 10.1107/S1600576713031002

A perturbation stable cell comparison technique
journal, March 1980

  • Andrews, L. C.; Bernstein, H. J.; Pelletier, G. A.
  • Acta Crystallographica Section A, Vol. 36, Issue 2
  • DOI: 10.1107/S0567739480000496

Selling reduction versus Niggli reduction for crystallographic lattices
journal, January 2019

  • Andrews, Lawrence C.; Bernstein, Herbert J.; Sauter, Nicholas K.
  • Acta Crystallographica Section A Foundations and Advances, Vol. 75, Issue 1
  • DOI: 10.1107/S2053273318015413

A space for lattice representation and clustering
journal, April 2019

  • Andrews, Lawrence C.; Bernstein, Herbert J.; Sauter, Nicholas K.
  • Acta Crystallographica Section A Foundations and Advances, Vol. 75, Issue 3
  • DOI: 10.1107/S2053273319002729

Automated data collection and real-time data analysis suite for serial synchrotron crystallography
journal, January 2019

  • Basu, Shibom; Kaminski, Jakub W.; Panepucci, Ezequiel
  • Journal of Synchrotron Radiation, Vol. 26, Issue 1
  • DOI: 10.1107/S1600577518016570

The Protein Data Bank
journal, January 2000

The protein data bank: A computer-based archival file for macromolecular structures
journal, May 1977

  • Bernstein, Frances C.; Koetzle, Thomas F.; Williams, Graheme J. B.
  • Journal of Molecular Biology, Vol. 112, Issue 3
  • DOI: 10.1016/S0022-2836(77)80200-3

Accelerating k -nearest-neighbor searches
journal, August 2016

  • Bernstein, Herbert J.; Andrews, Lawrence C.
  • Journal of Applied Crystallography, Vol. 49, Issue 5
  • DOI: 10.1107/S1600576716011353

Dissecting random and systematic differences between noisy composite data sets
journal, March 2017

Scaling and assessment of data quality
journal, December 2005

  • Evans, Philip
  • Acta Crystallographica Section D Biological Crystallography, Vol. 62, Issue 1, p. 72-82
  • DOI: 10.1107/S0907444905036693

Clustering procedures for the optimal selection of data sets from multiple crystals in macromolecular crystallography
journal, July 2013

  • Foadi, James; Aller, Pierre; Alguel, Yilmaz
  • Acta Crystallographica Section D Biological Crystallography, Vol. 69, Issue 8
  • DOI: 10.1107/S0907444913012274

Determination of Patterson group symmetry from sparse multi-crystal data sets in the presence of an indexing ambiguity
journal, April 2018

  • Gildea, Richard J.; Winter, Graeme
  • Acta Crystallographica Section D Structural Biology, Vol. 74, Issue 5
  • DOI: 10.1107/S2059798318002978

An alternate description of two crystal structures of phospholipase A 2 from Bungarus caeruleus
journal, March 2007

  • Le Trong, Isolde; Stenkamp, Ronald E.
  • Acta Crystallographica Section D Biological Crystallography, Vol. 63, Issue 4
  • DOI: 10.1107/S0907444907007354

Getting the Most Out of Your Crystals: Data Collection at the New High-Flux, Microfocus MX Beamlines at NSLS-II
journal, January 2019

Detection and correction of underassigned rotational symmetry prior to structure deposition
journal, April 2010

  • Poon, Billy K.; Grosse-Kunstleve, Ralf W.; Zwart, Peter H.
  • Acta Crystallographica Section D Biological Crystallography, Vol. 66, Issue 5
  • DOI: 10.1107/S0907444910001502

Exploring structural homology of proteins
journal, July 1976

Robust indexing for automatic data collection
journal, May 2004

  • Sauter, Nicholas K.; Grosse-Kunstleve, Ralf W.; Adams, Paul D.
  • Journal of Applied Crystallography, Vol. 37, Issue 3
  • DOI: 10.1107/S0021889804005874

Improved statistics for determining the Patterson symmetry from unmerged diffraction intensities
journal, March 2006

  • Sauter, Nicholas K.; Grosse-Kunstleve, Ralf W.; Adams, Paul D.
  • Journal of Applied Crystallography, Vol. 39, Issue 2
  • DOI: 10.1107/S0021889805042299

CrystFEL : a software suite for snapshot serial crystallography
journal, March 2012

  • White, Thomas A.; Kirian, Richard A.; Martin, Andrew V.
  • Journal of Applied Crystallography, Vol. 45, Issue 2
  • DOI: 10.1107/S0021889812002312

KAMO : towards automated data processing for microcrystals
journal, April 2018

  • Yamashita, Keitaro; Hirata, Kunio; Yamamoto, Masaki
  • Acta Crystallographica Section D Structural Biology, Vol. 74, Issue 5
  • DOI: 10.1107/S2059798318004576

FATCAT: a web server for flexible structure comparison and structure similarity searching
journal, July 2004

  • Ye, Y.; Godzik, A.
  • Nucleic Acids Research, Vol. 32, Issue Web Server
  • DOI: 10.1093/nar/gkh430

Data Exploration Toolkit for serial diffraction experiments
journal, January 2015

  • Zeldin, Oliver B.; Brewster, Aaron S.; Hattne, Johan
  • Acta Crystallographica Section D Biological Crystallography, Vol. 71, Issue 2
  • DOI: 10.1107/S1399004714025875

The protein data bank: A computer-based archival file for macromolecular structures
journal, January 1978

  • Bernstein, Frances C.; Koetzle, Thomas F.; Williams, Graheme J. B.
  • Archives of Biochemistry and Biophysics, Vol. 185, Issue 2
  • DOI: 10.1016/0003-9861(78)90204-7

The Protein Data Bank
journal, May 2002

  • Berman, Helen M.; Battistuz, Tammy; Bhat, T. N.
  • Acta Crystallographica Section D Biological Crystallography, Vol. 58, Issue 6
  • DOI: 10.1107/s0907444902003451
    Sort by:
    [ × clear filter / sort ]

    Similar Records in DOE PAGES and OSTI.GOV collections: