OSiRIS: a distributed Ceph deployment using software defined networking for multi-institutional research

McKee, Shawn; Kissel, Ezra; Meekhof, Benjeman; Swany, Martin; Miller, Charles; Gregorowicz, Michael

doi:10.1088/1742-6596/898/6/062045

OSiRIS: a distributed Ceph deployment using software defined networking for multi-institutional research

Journal Article · Sun Oct 01 04:00:00 EDT 2017 · Journal of Physics. Conference Series

DOI:https://doi.org/10.1088/1742-6596/898/6/062045· OSTI ID:1638944

McKee, Shawn ^[1]; Kissel, Ezra ^[2]; Meekhof, Benjeman ^[3]; Swany, Martin ^[2]; Miller, Charles ^[4]; Gregorowicz, Michael ^[5]

Univ. of Michigan, Ann Arbor, MI (United States); University of Michigan, Ann Arbor MI
Indiana Univ., Bloomington, IN (United States)
Univ. of Michigan, Ann Arbor, MI (United States)
Michigan State Univ., East Lansing, MI (United States)
Wayne State Univ., Detroit, MI (United States)

We report on the first year of the OSiRIS project (NSF Award #1541335, UM, IU, MSU and WSU) which is targeting the creation of a distributed Ceph storage infrastructure coupled together with software-defined networking to provide high-performance access for wellconnected locations on any participating campus. The projects goal is to provide a single scalable, distributed storage infrastructure that allows researchers at each campus to read, write, manage and share data directly from their own computing locations. The NSF CC*DNI DIBBS program which funded OSiRIS is seeking solutions to the challenges of multi-institutional collaborations involving large amounts of data and we are exploring the creative use of Ceph and networking to address those challenges. While OSiRIS will eventually be serving a broad range of science domains, its first adopter will be the LHC ATLAS detector project via the ATLAS Great Lakes Tier-2 (AGLT2) jointly located at the University of Michigan and Michigan State University. Part of our presentation will cover how ATLAS is using the OSiRIS infrastructure and our experiences integrating our first user community. The presentation will also review the motivations for and goals of the project, the technical details of the OSiRIS infrastructure, the challenges in providing such an infrastructure, and the technical choices made to address those challenges. We will conclude with our plans for the remaining 4 years of the project and our vision for what we hope to deliver by the projects end.