BioXTAS RAW 2 : new developments for a free open-source program for small-angle scattering data reduction and analysis
Abstract
BioXTAS RAW is a free open-source program for reduction, analysis and modelling of biological small-angle scattering data. Here, the new developments in RAW version 2 are described. These include improved data reduction using pyFAI ; updated automated Guinier fitting and D max finding algorithms; automated series ( e.g. size-exclusion chromatography coupled small-angle X-ray scattering or SEC-SAXS) buffer- and sample-region finding algorithms; linear and integral baseline correction for series; deconvolution of series data using regularized alternating least squares ( REGALS ); creation of electron-density reconstructions using electron density via solution scattering ( DENSS ); a comparison window showing residuals, ratios and statistical comparisons between profiles; and generation of PDF reports with summary plots and tables for all analysis. Furthermore, there is now a RAW API, which can be used without the graphical user interface (GUI), providing full access to all of the functionality found in the GUI. In addition to these new capabilities, RAW has undergone significant technical updates, such as adding Python 3 compatibility, and has entirely new documentation available both online and in the program.
- Authors:
- Publication Date:
- Sponsoring Org.:
- USDOE
- OSTI Identifier:
- 2282829
- Grant/Contract Number:
- AC02-06CH11357
- Resource Type:
- Published Article
- Journal Name:
- Journal of Applied Crystallography (Online)
- Additional Journal Information:
- Journal Name: Journal of Applied Crystallography (Online) Journal Volume: 57 Journal Issue: 1; Journal ID: ISSN 1600-5767
- Publisher:
- International Union of Crystallography (IUCr)
- Country of Publication:
- Denmark
- Language:
- English
Citation Formats
Hopkins, Jesse B. BioXTAS RAW 2 : new developments for a free open-source program for small-angle scattering data reduction and analysis. Denmark: N. p., 2024.
Web. doi:10.1107/S1600576723011019.
Hopkins, Jesse B. BioXTAS RAW 2 : new developments for a free open-source program for small-angle scattering data reduction and analysis. Denmark. https://doi.org/10.1107/S1600576723011019
Hopkins, Jesse B. Thu .
"BioXTAS RAW 2 : new developments for a free open-source program for small-angle scattering data reduction and analysis". Denmark. https://doi.org/10.1107/S1600576723011019.
@article{osti_2282829,
title = {BioXTAS RAW 2 : new developments for a free open-source program for small-angle scattering data reduction and analysis},
author = {Hopkins, Jesse B.},
abstractNote = {BioXTAS RAW is a free open-source program for reduction, analysis and modelling of biological small-angle scattering data. Here, the new developments in RAW version 2 are described. These include improved data reduction using pyFAI ; updated automated Guinier fitting and D max finding algorithms; automated series ( e.g. size-exclusion chromatography coupled small-angle X-ray scattering or SEC-SAXS) buffer- and sample-region finding algorithms; linear and integral baseline correction for series; deconvolution of series data using regularized alternating least squares ( REGALS ); creation of electron-density reconstructions using electron density via solution scattering ( DENSS ); a comparison window showing residuals, ratios and statistical comparisons between profiles; and generation of PDF reports with summary plots and tables for all analysis. Furthermore, there is now a RAW API, which can be used without the graphical user interface (GUI), providing full access to all of the functionality found in the GUI. In addition to these new capabilities, RAW has undergone significant technical updates, such as adding Python 3 compatibility, and has entirely new documentation available both online and in the program.},
doi = {10.1107/S1600576723011019},
journal = {Journal of Applied Crystallography (Online)},
number = 1,
volume = 57,
place = {Denmark},
year = {Thu Feb 01 00:00:00 EST 2024},
month = {Thu Feb 01 00:00:00 EST 2024}
}
https://doi.org/10.1107/S1600576723011019
Works referenced in this record:
SEC-SAXS: Experimental set-up and software developments build up a powerful tool
book, January 2022
- Pérez, Javier; Thureau, Aurélien; Vachette, Patrice
- Small Angle Scattering Part A: Methods for Structural Investigation
Uniqueness of ab initio shape determination in small-angle scattering
journal, April 2003
- Volkov, Vladimir V.; Svergun, Dmitri I.
- Journal of Applied Crystallography, Vol. 36, Issue 3, p. 860-864
Ab initio electron density determination directly from solution scattering data
journal, January 2018
- Grant, Thomas D.
- Nature Methods, Vol. 15, Issue 3
CHROMIXS: automatic and interactive analysis of chromatography-coupled small-angle X-ray scattering data
journal, December 2017
- Panjkovich, Alejandro; Svergun, Dmitri I.
- Bioinformatics, Vol. 34, Issue 11
Global Rigid Body Modeling of Macromolecular Complexes against Small-Angle Scattering Data
journal, August 2005
- Petoukhov, Maxim V.; Svergun, Dmitri I.
- Biophysical Journal, Vol. 89, Issue 2
DAMMIF, a program for rapid ab-initio shape determination in small-angle scattering
journal, January 2009
- Franke, Daniel; Svergun, Dmitri I.
- Journal of Applied Crystallography, Vol. 42, Issue 2, p. 342-346
Innovative scattering analysis shows that hydrophobic disordered proteins are expanded in water
journal, October 2017
- Riback, Joshua A.; Bowman, Micayla A.; Zmyslowski, Adam M.
- Science, Vol. 358, Issue 6360
CRYSOL – a Program to Evaluate X-ray Solution Scattering of Biological Macromolecules from Atomic Coordinates
journal, December 1995
- Svergun, D.; Barberato, C.; Koch, M. H. J.
- Journal of Applied Crystallography, Vol. 28, Issue 6
Accuracy of molecular mass determination of proteins in solution by small-angle X-ray scattering
journal, February 2007
- Mylonas, Efstratios; Svergun, Dmitri I.
- Journal of Applied Crystallography, Vol. 40, Issue s1
Determination of the regularization parameter in indirect-transform methods using perceptual criteria
journal, August 1992
- Svergun, D. I.
- Journal of Applied Crystallography, Vol. 25, Issue 4, p. 495-503
REGALS : a general method to deconvolve X-ray scattering data from evolving mixtures
journal, February 2021
- Meisburger, Steve P.; Xu, Da; Ando, Nozomi
- IUCrJ, Vol. 8, Issue 2
BioXTAS RAW : improvements to a free open-source program for small-angle X-ray scattering data reduction and analysis
journal, September 2017
- Hopkins, Jesse Bennett; Gillilan, Richard E.; Skou, Soren
- Journal of Applied Crystallography, Vol. 50, Issue 5
WAXSiS: a web server for the calculation of SAXS/WAXS curves based on explicit-solvent molecular dynamics
journal, April 2015
- Knight, Christopher J.; Hub, Jochen S.
- Nucleic Acids Research, Vol. 43, Issue W1
ATSAS 2.8 : a comprehensive data analysis suite for small-angle scattering from macromolecular solutions
journal, June 2017
- Franke, D.; Petoukhov, M. V.; Konarev, P. V.
- Journal of Applied Crystallography, Vol. 50, Issue 4
Improved radiation dose efficiency in solution SAXS using a sheath flow sample environment
journal, November 2016
- Kirby, Nigel; Cowieson, Nathan; Hawley, Adrian M.
- Acta Crystallographica Section D Structural Biology, Vol. 72, Issue 12
PRIMUS: a Windows PC-based system for small-angle scattering data analysis
journal, September 2003
- Konarev, Petr V.; Volkov, Vladimir V.; Sokolova, Anna V.
- Journal of Applied Crystallography, Vol. 36, Issue 5, p. 1277-1282
NADPH oxidase activator p67phox behaves in solution as a multidomain protein with semi-flexible linkers
journal, January 2010
- Durand, Dominique; Vivès, Corinne; Cannella, Dominique
- Journal of Structural Biology, Vol. 169, Issue 1
Small-angle scattering studies of biological macromolecules in solution
journal, September 2003
- Svergun, Dmitri I.; Koch, Michel H. J.
- Reports on Progress in Physics, Vol. 66, Issue 10
A customizable software for fast reduction and analysis of large X-ray scattering data sets: applications of the new DPDAK package to small-angle X-ray scattering and grazing-incidence small-angle X-ray scattering
journal, September 2014
- Benecke, Gunthard; Wagermaier, Wolfgang; Li, Chenghao
- Journal of Applied Crystallography, Vol. 47, Issue 5
SASBDB: Towards an automatically curated and validated repository for biological scattering data
journal, October 2019
- Kikhney, Alexey G.; Borges, Clemente R.; Molodenskiy, Dmitry S.
- Protein Science, Vol. 29, Issue 1
ATSAS 2.1 – towards automated and web-supported small-angle scattering data analysis
journal, April 2007
- Petoukhov, Maxim V.; Konarev, Peter V.; Kikhney, Alexey G.
- Journal of Applied Crystallography, Vol. 40, Issue s1
Bayesian estimation of hyperparameters for indirect Fourier transformation in small-angle scattering
journal, December 2000
- Hansen, Steen
- Journal of Applied Crystallography, Vol. 33, Issue 6
Consensus Bayesian assessment of protein molecular mass from solution X-ray scattering data
journal, May 2018
- Hajizadeh, Nelly R.; Franke, Daniel; Jeffries, Cy M.
- Scientific Reports, Vol. 8, Issue 1
A multi-step nucleation process determines the kinetics of prion-like domain phase separation
journal, July 2021
- Martin, Erik W.; Harmon, Tyler S.; Hopkins, Jesse B.
- Nature Communications, Vol. 12, Issue 1
DADIMODO : a program for refining the structure of multidomain proteins and complexes against small-angle scattering data and NMR-derived restraints
journal, October 2011
- Evrard, Guillaume; Mareuil, Fabien; Bontems, Francois
- Journal of Applied Crystallography, Vol. 44, Issue 6
Domain Movements upon Activation of Phenylalanine Hydroxylase Characterized by Crystallography and Chromatography-Coupled Small-Angle X-ray Scattering
journal, May 2016
- Meisburger, Steve P.; Taylor, Alexander B.; Khan, Crystal A.
- Journal of the American Chemical Society, Vol. 138, Issue 20
SASSIE: A program to study intrinsically disordered biological molecules and macromolecular ensembles using experimental scattering restraints
journal, February 2012
- Curtis, Joseph E.; Raghunandan, Sindhu; Nanda, Hirsh
- Computer Physics Communications, Vol. 183, Issue 2
Memprot : a program to model the detergent corona around a membrane protein based on SEC–SAXS data
journal, January 2015
- Pérez, Javier; Koutsioubas, Alexandros
- Acta Crystallographica Section D Biological Crystallography, Vol. 71, Issue 1
BioSAXS at European Synchrotron Radiation Facility – Extremely Brilliant Source: BM29 with an upgraded source, detector, robot, sample environment, data collection and analysis software
journal, January 2023
- Tully, Mark D.; Kieffer, Jerome; Brennich, Martha E.
- Journal of Synchrotron Radiation, Vol. 30, Issue 1
FoXS, FoXSDock and MultiFoXS: Single-state and multi-state structural modeling of proteins and their complexes based on SAXS profiles
journal, May 2016
- Schneidman-Duhovny, Dina; Hammel, Michal; Tainer, John A.
- Nucleic Acids Research, Vol. 44, Issue W1
US-SOMO HPLC-SAXS module: dealing with capillary fouling and extraction of pure component patterns from poorly resolved SEC-SAXS data
journal, September 2016
- Brookes, Emre; Vachette, Patrice; Rocco, Mattia
- Journal of Applied Crystallography, Vol. 49, Issue 5
Small-angle scattering for structural biology-Expanding the frontier while avoiding the pitfalls
journal, January 2010
- Jacques, David A.; Trewhella, Jill
- Protein Science, Vol. 19, Issue 4
BioXTAS RAW , a software program for high-throughput automated small-angle X-ray scattering data reduction and preliminary analysis
journal, August 2009
- Nielsen, S. S.; Toft, K. Noergaard; Snakenborg, D.
- Journal of Applied Crystallography, Vol. 42, Issue 5
Fibrinogen species as resolved by HPLC-SAXS data processing within the UltraScan Solution Modeler ( US-SOMO ) enhanced SAS module
journal, November 2013
- Brookes, Emre; Pérez, Javier; Cardinali, Barbara
- Journal of Applied Crystallography, Vol. 46, Issue 6
Machine Learning Methods for X-Ray Scattering Data Analysis from Biomacromolecular Solutions
journal, June 2018
- Franke, Daniel; Jeffries, Cy M.; Svergun, Dmitri I.
- Biophysical Journal, Vol. 114, Issue 11
Structural Analyses of Intrinsically Disordered Proteins by Small-Angle X-Ray Scattering
book, July 2020
- Sagar, Amin; Svergun, Dmitri; Bernadó, Pau
- Intrinsically Disordered Proteins
Hybrid Applications of Solution Scattering to Aid Structural Biology
book, January 2017
- Grishaev, Alexander V.
- Biological Small Angle Scattering: Techniques, Strategies and Tips
The fast azimuthal integration Python library: pyFAI
journal, March 2015
- Ashiotis, Giannis; Deschildre, Aurore; Nawaz, Zubair
- Journal of Applied Crystallography, Vol. 48, Issue 2
SciPy 1.0: fundamental algorithms for scientific computing in Python
journal, February 2020
- Virtanen, Pauli; Gommers, Ralf; Oliphant, Travis E.
- Nature Methods
Methods, development and applications of small-angle X-ray scattering to characterize biological macromolecules in solution
journal, January 2020
- Da Vela, Stefano; Svergun, Dmitri I.
- Current Research in Structural Biology, Vol. 2
Recent advances in small-angle scattering and its expanding impact in structural biology
journal, January 2022
- Trewhella, Jill
- Structure, Vol. 30, Issue 1
New tools for calibrating diffraction setups
journal, February 2020
- Kieffer, J.; Valls, V.; Blanc, N.
- Journal of Synchrotron Radiation, Vol. 27, Issue 2
Evolving SAXS versatility: solution X-ray scattering for macromolecular architecture, functional landscapes, and integrative structural biology
journal, October 2019
- Brosey, Chris A.; Tainer, John A.
- Current Opinion in Structural Biology, Vol. 58
High-Throughput SAXS for the Characterization of Biomolecules in Solution: A Practical Approach
book, October 2013
- Dyer, Kevin N.; Hammel, Michal; Rambo, Robert P.
- Structural Genomics
Valence and patterning of aromatic residues determine the phase behavior of prion-like domains
journal, February 2020
- Martin, Erik W.; Holehouse, Alex S.; Peran, Ivan
- Science, Vol. 367, Issue 6478
Synchrotron-based small-angle X-ray scattering of proteins in solution
journal, June 2014
- Skou, Soren; Gillilan, Richard E.; Ando, Nozomi
- Nature Protocols, Vol. 9, Issue 7
Restoring Low Resolution Structure of Biological Macromolecules from Solution Scattering Using Simulated Annealing
journal, June 1999
- Svergun, D. I.
- Biophysical Journal, Vol. 76, Issue 6, p. 2879-2886
New developments in the ATSAS program package for small-angle scattering data analysis
journal, March 2012
- Petoukhov, Maxim V.; Franke, Daniel; Shkumatov, Alexander V.
- Journal of Applied Crystallography, Vol. 45, Issue 2
Advanced sample environments and sample requirements for biological SAXS
book, January 2022
- Graewert, Melissa A.; Svergun, Dmitri I.
- Small Angle Scattering Part A: Methods for Structural Investigation
Resolution of ab initio shapes determined from small-angle scattering
journal, October 2016
- Tuukkanen, Anne T.; Kleywegt, Gerard J.; Svergun, Dmitri I.
- IUCrJ, Vol. 3, Issue 6
SAXS experiments on absolute scale with Kratky systems using water as a secondary standard
journal, April 2000
- Orthaber, Doris; Bergmann, Alexander; Glatter, Otto
- Journal of Applied Crystallography, Vol. 33, Issue 2
Ambiguity assessment of small-angle scattering curves from monodisperse systems
journal, April 2015
- Petoukhov, Maxim V.; Svergun, Dmitri I.
- Acta Crystallographica Section D Biological Crystallography, Vol. 71, Issue 5
Automated matching of high- and low-resolution structural models
journal, February 2001
- Kozin, M. B.; Svergun, D. I.
- Journal of Applied Crystallography, Vol. 34, Issue 1, p. 33-41
From dilute to concentrated solutions of intrinsically disordered proteins: Sample preparation and data collection
book, January 2022
- Lenton, Samuel; Tully, Mark D.; Skepö, Marie
- Small Angle Scattering Part A: Methods for Structural Investigation
Determination of the molecular weight of proteins in solution from a single small-angle X-ray scattering measurement on a relative scale
journal, December 2009
- Fischer, H.; de Oliveira Neto, M.; Napolitano, H. B.
- Journal of Applied Crystallography, Vol. 43, Issue 1
Array programming with NumPy
journal, September 2020
- Harris, Charles R.; Millman, K. Jarrod; van der Walt, Stéfan J.
- Nature, Vol. 585, Issue 7825
Beamline B21: high-throughput small-angle X-ray scattering at Diamond Light Source
journal, August 2020
- Cowieson, Nathan P.; Edwards-Gayle, Charlotte J. C.; Inoue, Katsuaki
- Journal of Synchrotron Radiation, Vol. 27, Issue 5
A practical guide to small angle X-ray scattering (SAXS) of flexible and intrinsically disordered proteins
journal, August 2015
- Kikhney, Alexey G.; Svergun, Dmitri I.
- FEBS Letters, Vol. 589, Issue 19PartA
Size exclusion chromatography coupled small angle X-ray scattering with tandem multiangle light scattering at the SIBYLS beamline
book, January 2022
- Rosenberg, Daniel J.; Hura, Greg L.; Hammel, Michal
- Small Angle Scattering Part A: Methods for Structural Investigation
Structure and flexibility within proteins as identified through small angle X-ray scattering
journal, January 2009
- Pelikan, M.; Hura, G.; Hammel, M.
- General Physiology and Biophysics, Vol. 28, Issue 2
Matplotlib: A 2D Graphics Environment
journal, January 2007
- Hunter, John D.
- Computing in Science & Engineering, Vol. 9, Issue 3
Small-angle X-ray scattering experiments of monodisperse intrinsically disordered protein samples close to the solubility limit
book, January 2021
- Martin, Erik W.; Hopkins, Jesse B.; Mittag, Tanja
- Liquid-Liquid Phase Coexistence and Membraneless Organelles
Correlation Map, a goodness-of-fit test for one-dimensional X-ray scattering spectra
journal, April 2015
- Franke, Daniel; Jeffries, Cy M.; Svergun, Dmitri I.
- Nature Methods, Vol. 12, Issue 5
SAXSMoW 2.0: Online calculator of the molecular weight of proteins in dilute solution from experimental SAXS data measured on a relative scale
journal, December 2018
- Piiadov, Vassili; Ares de Araújo, Evandro; Oliveira Neto, Mario
- Protein Science, Vol. 28, Issue 2
Accurate assessment of mass, models and resolution by small-angle scattering
journal, April 2013
- Rambo, Robert P.; Tainer, John A.
- Nature, Vol. 496, Issue 7446
Robotic sample changers for macromolecular X-ray crystallography and biological small-angle X-ray scattering at the National Synchrotron Light Source II
journal, August 2021
- Lazo, Edwin O.; Antonelli, Stephen; Aishima, Jun
- Journal of Synchrotron Radiation, Vol. 28, Issue 5
ATSAS 3.0 : expanded functionality and new tools for small-angle scattering data analysis
journal, February 2021
- Manalastas-Cantos, Karen; Konarev, Petr V.; Hajizadeh, Nelly R.
- Journal of Applied Crystallography, Vol. 54, Issue 1
FabIO: easy access to two-dimensional X-ray detector images in Python
journal, February 2013
- Knudsen, Erik B.; Sørensen, Henning O.; Wright, Jonathan P.
- Journal of Applied Crystallography, Vol. 46, Issue 2
X-ray Scattering Studies of Protein Structural Dynamics
journal, May 2017
- Meisburger, Steve P.; Thomas, William C.; Watkins, Maxwell B.
- Chemical Reviews, Vol. 117, Issue 12
FIT2D : a multi-purpose data reduction, analysis and visualization program
journal, March 2016
- Hammersley, A. P.
- Journal of Applied Crystallography, Vol. 49, Issue 2
Two-dimensional detector software: From real detector to idealised image or two-theta scan
journal, January 1996
- Hammersley, A. P.; Svensson, S. O.; Hanfland, M.
- High Pressure Research, Vol. 14, Issue 4-6, p. 235-248
BioSAXS on the SWING beamline at Synchrotron SOLEIL
journal, November 2021
- Thureau, Aurélien; Roblin, Pierre; Pérez, Javier
- Journal of Applied Crystallography, Vol. 54, Issue 6