DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: BioXTAS RAW 2 : new developments for a free open-source program for small-angle scattering data reduction and analysis

Abstract

BioXTAS RAW is a free open-source program for reduction, analysis and modelling of biological small-angle scattering data. Here, the new developments in RAW version 2 are described. These include improved data reduction using pyFAI ; updated automated Guinier fitting and D max finding algorithms; automated series ( e.g. size-exclusion chromatography coupled small-angle X-ray scattering or SEC-SAXS) buffer- and sample-region finding algorithms; linear and integral baseline correction for series; deconvolution of series data using regularized alternating least squares ( REGALS ); creation of electron-density reconstructions using electron density via solution scattering ( DENSS ); a comparison window showing residuals, ratios and statistical comparisons between profiles; and generation of PDF reports with summary plots and tables for all analysis. Furthermore, there is now a RAW API, which can be used without the graphical user interface (GUI), providing full access to all of the functionality found in the GUI. In addition to these new capabilities, RAW has undergone significant technical updates, such as adding Python 3 compatibility, and has entirely new documentation available both online and in the program.

Authors:
ORCiD logo
Publication Date:
Sponsoring Org.:
USDOE
OSTI Identifier:
2282829
Grant/Contract Number:  
AC02-06CH11357
Resource Type:
Published Article
Journal Name:
Journal of Applied Crystallography (Online)
Additional Journal Information:
Journal Name: Journal of Applied Crystallography (Online) Journal Volume: 57 Journal Issue: 1; Journal ID: ISSN 1600-5767
Publisher:
International Union of Crystallography (IUCr)
Country of Publication:
Denmark
Language:
English

Citation Formats

Hopkins, Jesse B. BioXTAS RAW 2 : new developments for a free open-source program for small-angle scattering data reduction and analysis. Denmark: N. p., 2024. Web. doi:10.1107/S1600576723011019.
Hopkins, Jesse B. BioXTAS RAW 2 : new developments for a free open-source program for small-angle scattering data reduction and analysis. Denmark. https://doi.org/10.1107/S1600576723011019
Hopkins, Jesse B. Thu . "BioXTAS RAW 2 : new developments for a free open-source program for small-angle scattering data reduction and analysis". Denmark. https://doi.org/10.1107/S1600576723011019.
@article{osti_2282829,
title = {BioXTAS RAW 2 : new developments for a free open-source program for small-angle scattering data reduction and analysis},
author = {Hopkins, Jesse B.},
abstractNote = {BioXTAS RAW is a free open-source program for reduction, analysis and modelling of biological small-angle scattering data. Here, the new developments in RAW version 2 are described. These include improved data reduction using pyFAI ; updated automated Guinier fitting and D max finding algorithms; automated series ( e.g. size-exclusion chromatography coupled small-angle X-ray scattering or SEC-SAXS) buffer- and sample-region finding algorithms; linear and integral baseline correction for series; deconvolution of series data using regularized alternating least squares ( REGALS ); creation of electron-density reconstructions using electron density via solution scattering ( DENSS ); a comparison window showing residuals, ratios and statistical comparisons between profiles; and generation of PDF reports with summary plots and tables for all analysis. Furthermore, there is now a RAW API, which can be used without the graphical user interface (GUI), providing full access to all of the functionality found in the GUI. In addition to these new capabilities, RAW has undergone significant technical updates, such as adding Python 3 compatibility, and has entirely new documentation available both online and in the program.},
doi = {10.1107/S1600576723011019},
journal = {Journal of Applied Crystallography (Online)},
number = 1,
volume = 57,
place = {Denmark},
year = {Thu Feb 01 00:00:00 EST 2024},
month = {Thu Feb 01 00:00:00 EST 2024}
}

Works referenced in this record:

SEC-SAXS: Experimental set-up and software developments build up a powerful tool
book, January 2022

  • Pérez, Javier; Thureau, Aurélien; Vachette, Patrice
  • Small Angle Scattering Part A: Methods for Structural Investigation
  • DOI: 10.1016/bs.mie.2022.08.024

Uniqueness of ab initio shape determination in small-angle scattering
journal, April 2003

  • Volkov, Vladimir V.; Svergun, Dmitri I.
  • Journal of Applied Crystallography, Vol. 36, Issue 3, p. 860-864
  • DOI: 10.1107/S0021889803000268

Ab initio electron density determination directly from solution scattering data
journal, January 2018


CHROMIXS: automatic and interactive analysis of chromatography-coupled small-angle X-ray scattering data
journal, December 2017


Global Rigid Body Modeling of Macromolecular Complexes against Small-Angle Scattering Data
journal, August 2005


DAMMIF, a program for rapid ab-initio shape determination in small-angle scattering
journal, January 2009

  • Franke, Daniel; Svergun, Dmitri I.
  • Journal of Applied Crystallography, Vol. 42, Issue 2, p. 342-346
  • DOI: 10.1107/S0021889809000338

Innovative scattering analysis shows that hydrophobic disordered proteins are expanded in water
journal, October 2017

  • Riback, Joshua A.; Bowman, Micayla A.; Zmyslowski, Adam M.
  • Science, Vol. 358, Issue 6360
  • DOI: 10.1126/science.aan5774

CRYSOL – a Program to Evaluate X-ray Solution Scattering of Biological Macromolecules from Atomic Coordinates
journal, December 1995

  • Svergun, D.; Barberato, C.; Koch, M. H. J.
  • Journal of Applied Crystallography, Vol. 28, Issue 6
  • DOI: 10.1107/S0021889895007047

Accuracy of molecular mass determination of proteins in solution by small-angle X-ray scattering
journal, February 2007

  • Mylonas, Efstratios; Svergun, Dmitri I.
  • Journal of Applied Crystallography, Vol. 40, Issue s1
  • DOI: 10.1107/S002188980700252X

Determination of the regularization parameter in indirect-transform methods using perceptual criteria
journal, August 1992


REGALS : a general method to deconvolve X-ray scattering data from evolving mixtures
journal, February 2021


BioXTAS RAW : improvements to a free open-source program for small-angle X-ray scattering data reduction and analysis
journal, September 2017

  • Hopkins, Jesse Bennett; Gillilan, Richard E.; Skou, Soren
  • Journal of Applied Crystallography, Vol. 50, Issue 5
  • DOI: 10.1107/S1600576717011438

WAXSiS: a web server for the calculation of SAXS/WAXS curves based on explicit-solvent molecular dynamics
journal, April 2015

  • Knight, Christopher J.; Hub, Jochen S.
  • Nucleic Acids Research, Vol. 43, Issue W1
  • DOI: 10.1093/nar/gkv309

ATSAS 2.8 : a comprehensive data analysis suite for small-angle scattering from macromolecular solutions
journal, June 2017

  • Franke, D.; Petoukhov, M. V.; Konarev, P. V.
  • Journal of Applied Crystallography, Vol. 50, Issue 4
  • DOI: 10.1107/S1600576717007786

Improved radiation dose efficiency in solution SAXS using a sheath flow sample environment
journal, November 2016

  • Kirby, Nigel; Cowieson, Nathan; Hawley, Adrian M.
  • Acta Crystallographica Section D Structural Biology, Vol. 72, Issue 12
  • DOI: 10.1107/S2059798316017174

PRIMUS: a Windows PC-based system for small-angle scattering data analysis
journal, September 2003

  • Konarev, Petr V.; Volkov, Vladimir V.; Sokolova, Anna V.
  • Journal of Applied Crystallography, Vol. 36, Issue 5, p. 1277-1282
  • DOI: 10.1107/S0021889803012779

NADPH oxidase activator p67phox behaves in solution as a multidomain protein with semi-flexible linkers
journal, January 2010

  • Durand, Dominique; Vivès, Corinne; Cannella, Dominique
  • Journal of Structural Biology, Vol. 169, Issue 1
  • DOI: 10.1016/j.jsb.2009.08.009

Small-angle scattering studies of biological macromolecules in solution
journal, September 2003


SASBDB: Towards an automatically curated and validated repository for biological scattering data
journal, October 2019

  • Kikhney, Alexey G.; Borges, Clemente R.; Molodenskiy, Dmitry S.
  • Protein Science, Vol. 29, Issue 1
  • DOI: 10.1002/pro.3731

ATSAS 2.1 – towards automated and web-supported small-angle scattering data analysis
journal, April 2007

  • Petoukhov, Maxim V.; Konarev, Peter V.; Kikhney, Alexey G.
  • Journal of Applied Crystallography, Vol. 40, Issue s1
  • DOI: 10.1107/S0021889807002853

Bayesian estimation of hyperparameters for indirect Fourier transformation in small-angle scattering
journal, December 2000


Consensus Bayesian assessment of protein molecular mass from solution X-ray scattering data
journal, May 2018


A multi-step nucleation process determines the kinetics of prion-like domain phase separation
journal, July 2021


DADIMODO : a program for refining the structure of multidomain proteins and complexes against small-angle scattering data and NMR-derived restraints
journal, October 2011

  • Evrard, Guillaume; Mareuil, Fabien; Bontems, Francois
  • Journal of Applied Crystallography, Vol. 44, Issue 6
  • DOI: 10.1107/S0021889811035758

Domain Movements upon Activation of Phenylalanine Hydroxylase Characterized by Crystallography and Chromatography-Coupled Small-Angle X-ray Scattering
journal, May 2016

  • Meisburger, Steve P.; Taylor, Alexander B.; Khan, Crystal A.
  • Journal of the American Chemical Society, Vol. 138, Issue 20
  • DOI: 10.1021/jacs.6b01563

SASSIE: A program to study intrinsically disordered biological molecules and macromolecular ensembles using experimental scattering restraints
journal, February 2012

  • Curtis, Joseph E.; Raghunandan, Sindhu; Nanda, Hirsh
  • Computer Physics Communications, Vol. 183, Issue 2
  • DOI: 10.1016/j.cpc.2011.09.010

Memprot : a program to model the detergent corona around a membrane protein based on SEC–SAXS data
journal, January 2015

  • Pérez, Javier; Koutsioubas, Alexandros
  • Acta Crystallographica Section D Biological Crystallography, Vol. 71, Issue 1
  • DOI: 10.1107/S1399004714016678

FoXS, FoXSDock and MultiFoXS: Single-state and multi-state structural modeling of proteins and their complexes based on SAXS profiles
journal, May 2016

  • Schneidman-Duhovny, Dina; Hammel, Michal; Tainer, John A.
  • Nucleic Acids Research, Vol. 44, Issue W1
  • DOI: 10.1093/nar/gkw389

US-SOMO HPLC-SAXS module: dealing with capillary fouling and extraction of pure component patterns from poorly resolved SEC-SAXS data
journal, September 2016

  • Brookes, Emre; Vachette, Patrice; Rocco, Mattia
  • Journal of Applied Crystallography, Vol. 49, Issue 5
  • DOI: 10.1107/S1600576716011201

Small-angle scattering for structural biology-Expanding the frontier while avoiding the pitfalls
journal, January 2010

  • Jacques, David A.; Trewhella, Jill
  • Protein Science, Vol. 19, Issue 4
  • DOI: 10.1002/pro.351

BioXTAS RAW , a software program for high-throughput automated small-angle X-ray scattering data reduction and preliminary analysis
journal, August 2009

  • Nielsen, S. S.; Toft, K. Noergaard; Snakenborg, D.
  • Journal of Applied Crystallography, Vol. 42, Issue 5
  • DOI: 10.1107/S0021889809023863

Fibrinogen species as resolved by HPLC-SAXS data processing within the UltraScan Solution Modeler ( US-SOMO ) enhanced SAS module
journal, November 2013

  • Brookes, Emre; Pérez, Javier; Cardinali, Barbara
  • Journal of Applied Crystallography, Vol. 46, Issue 6
  • DOI: 10.1107/S0021889813027751

Machine Learning Methods for X-Ray Scattering Data Analysis from Biomacromolecular Solutions
journal, June 2018


Structural Analyses of Intrinsically Disordered Proteins by Small-Angle X-Ray Scattering
book, July 2020


Hybrid Applications of Solution Scattering to Aid Structural Biology
book, January 2017


The fast azimuthal integration Python library: pyFAI
journal, March 2015

  • Ashiotis, Giannis; Deschildre, Aurore; Nawaz, Zubair
  • Journal of Applied Crystallography, Vol. 48, Issue 2
  • DOI: 10.1107/S1600576715004306

SciPy 1.0: fundamental algorithms for scientific computing in Python
journal, February 2020


Methods, development and applications of small-angle X-ray scattering to characterize biological macromolecules in solution
journal, January 2020


New tools for calibrating diffraction setups
journal, February 2020


Evolving SAXS versatility: solution X-ray scattering for macromolecular architecture, functional landscapes, and integrative structural biology
journal, October 2019


High-Throughput SAXS for the Characterization of Biomolecules in Solution: A Practical Approach
book, October 2013


Valence and patterning of aromatic residues determine the phase behavior of prion-like domains
journal, February 2020


Synchrotron-based small-angle X-ray scattering of proteins in solution
journal, June 2014

  • Skou, Soren; Gillilan, Richard E.; Ando, Nozomi
  • Nature Protocols, Vol. 9, Issue 7
  • DOI: 10.1038/nprot.2014.116

New developments in the ATSAS program package for small-angle scattering data analysis
journal, March 2012

  • Petoukhov, Maxim V.; Franke, Daniel; Shkumatov, Alexander V.
  • Journal of Applied Crystallography, Vol. 45, Issue 2
  • DOI: 10.1107/S0021889812007662

Advanced sample environments and sample requirements for biological SAXS
book, January 2022

  • Graewert, Melissa A.; Svergun, Dmitri I.
  • Small Angle Scattering Part A: Methods for Structural Investigation
  • DOI: 10.1016/bs.mie.2022.08.009

Resolution of ab initio shapes determined from small-angle scattering
journal, October 2016


SAXS experiments on absolute scale with Kratky systems using water as a secondary standard
journal, April 2000

  • Orthaber, Doris; Bergmann, Alexander; Glatter, Otto
  • Journal of Applied Crystallography, Vol. 33, Issue 2
  • DOI: 10.1107/S0021889899015216

Ambiguity assessment of small-angle scattering curves from monodisperse systems
journal, April 2015

  • Petoukhov, Maxim V.; Svergun, Dmitri I.
  • Acta Crystallographica Section D Biological Crystallography, Vol. 71, Issue 5
  • DOI: 10.1107/S1399004715002576

Automated matching of high- and low-resolution structural models
journal, February 2001


From dilute to concentrated solutions of intrinsically disordered proteins: Sample preparation and data collection
book, January 2022

  • Lenton, Samuel; Tully, Mark D.; Skepö, Marie
  • Small Angle Scattering Part A: Methods for Structural Investigation
  • DOI: 10.1016/bs.mie.2022.08.036

Determination of the molecular weight of proteins in solution from a single small-angle X-ray scattering measurement on a relative scale
journal, December 2009

  • Fischer, H.; de Oliveira Neto, M.; Napolitano, H. B.
  • Journal of Applied Crystallography, Vol. 43, Issue 1
  • DOI: 10.1107/S0021889809043076

Array programming with NumPy
journal, September 2020

  • Harris, Charles R.; Millman, K. Jarrod; van der Walt, Stéfan J.
  • Nature, Vol. 585, Issue 7825
  • DOI: 10.1038/s41586-020-2649-2

Beamline B21: high-throughput small-angle X-ray scattering at Diamond Light Source
journal, August 2020

  • Cowieson, Nathan P.; Edwards-Gayle, Charlotte J. C.; Inoue, Katsuaki
  • Journal of Synchrotron Radiation, Vol. 27, Issue 5
  • DOI: 10.1107/S1600577520009960

A practical guide to small angle X-ray scattering (SAXS) of flexible and intrinsically disordered proteins
journal, August 2015


Size exclusion chromatography coupled small angle X-ray scattering with tandem multiangle light scattering at the SIBYLS beamline
book, January 2022

  • Rosenberg, Daniel J.; Hura, Greg L.; Hammel, Michal
  • Small Angle Scattering Part A: Methods for Structural Investigation
  • DOI: 10.1016/bs.mie.2022.08.031

Structure and flexibility within proteins as identified through small angle X-ray scattering
journal, January 2009

  • Pelikan, M.; Hura, G.; Hammel, M.
  • General Physiology and Biophysics, Vol. 28, Issue 2
  • DOI: 10.4149/gpb_2009_02_174

Matplotlib: A 2D Graphics Environment
journal, January 2007


Small-angle X-ray scattering experiments of monodisperse intrinsically disordered protein samples close to the solubility limit
book, January 2021

  • Martin, Erik W.; Hopkins, Jesse B.; Mittag, Tanja
  • Liquid-Liquid Phase Coexistence and Membraneless Organelles
  • DOI: 10.1016/bs.mie.2020.07.002

Correlation Map, a goodness-of-fit test for one-dimensional X-ray scattering spectra
journal, April 2015

  • Franke, Daniel; Jeffries, Cy M.; Svergun, Dmitri I.
  • Nature Methods, Vol. 12, Issue 5
  • DOI: 10.1038/nmeth.3358

SAXSMoW 2.0: Online calculator of the molecular weight of proteins in dilute solution from experimental SAXS data measured on a relative scale
journal, December 2018

  • Piiadov, Vassili; Ares de Araújo, Evandro; Oliveira Neto, Mario
  • Protein Science, Vol. 28, Issue 2
  • DOI: 10.1002/pro.3528

Accurate assessment of mass, models and resolution by small-angle scattering
journal, April 2013


Robotic sample changers for macromolecular X-ray crystallography and biological small-angle X-ray scattering at the National Synchrotron Light Source II
journal, August 2021

  • Lazo, Edwin O.; Antonelli, Stephen; Aishima, Jun
  • Journal of Synchrotron Radiation, Vol. 28, Issue 5
  • DOI: 10.1107/S1600577521007578

ATSAS 3.0 : expanded functionality and new tools for small-angle scattering data analysis
journal, February 2021

  • Manalastas-Cantos, Karen; Konarev, Petr V.; Hajizadeh, Nelly R.
  • Journal of Applied Crystallography, Vol. 54, Issue 1
  • DOI: 10.1107/S1600576720013412

FabIO: easy access to two-dimensional X-ray detector images in Python
journal, February 2013

  • Knudsen, Erik B.; Sørensen, Henning O.; Wright, Jonathan P.
  • Journal of Applied Crystallography, Vol. 46, Issue 2
  • DOI: 10.1107/S0021889813000150

X-ray Scattering Studies of Protein Structural Dynamics
journal, May 2017


FIT2D : a multi-purpose data reduction, analysis and visualization program
journal, March 2016


Two-dimensional detector software: From real detector to idealised image or two-theta scan
journal, January 1996

  • Hammersley, A. P.; Svensson, S. O.; Hanfland, M.
  • High Pressure Research, Vol. 14, Issue 4-6, p. 235-248
  • DOI: 10.1080/08957959608201408

BioSAXS on the SWING beamline at Synchrotron SOLEIL
journal, November 2021

  • Thureau, Aurélien; Roblin, Pierre; Pérez, Javier
  • Journal of Applied Crystallography, Vol. 54, Issue 6
  • DOI: 10.1107/S1600576721008736