TY - GEN
T1 - High-Performance Ptychographic Reconstruction with Federated Facilities
AU - Bicer, Tekin
AU - Yu, Xiaodong
AU - Ching, Daniel J.
AU - Chard, Ryan
AU - Cherukara, Mathew J.
AU - Nicolae, Bogdan
AU - Kettimuthu, Rajkumar
AU - Foster, Ian T.
N1 - Publisher Copyright:
© 2022, Springer Nature Switzerland AG.
PY - 2022
Y1 - 2022
N2 - Beamlines at synchrotron light source facilities are powerful scientific instruments used to image samples and observe phenomena at high spatial and temporal resolutions. Typically, these facilities are equipped only with modest compute resources for the analysis of generated experimental datasets. However, high data rate experiments can easily generate data in volumes that take days (or even weeks) to process on those local resources. To address this challenge, we present a system that unifies leadership computing and experimental facilities by enabling the automated establishment of data analysis pipelines that extend from edge data acquisition systems at synchrotron beamlines to remote computing facilities; under the covers, our system uses Globus Auth authentication to minimize user interaction, funcX to run user-defined functions on supercomputers, and Globus Flows to define and execute workflows. We describe the application of this system to ptychography, an ultra-high-resolution coherent diffraction imaging technique that can produce 100s of gigabytes to terabytes in a single experiment. When deployed on the DGX A100 ThetaGPU cluster at the Argonne Leadership Computing Facility and a microscopy beamline at the Advanced Photon Source, our system performs analysis as an experiment progresses to provide timely feedback.
AB - Beamlines at synchrotron light source facilities are powerful scientific instruments used to image samples and observe phenomena at high spatial and temporal resolutions. Typically, these facilities are equipped only with modest compute resources for the analysis of generated experimental datasets. However, high data rate experiments can easily generate data in volumes that take days (or even weeks) to process on those local resources. To address this challenge, we present a system that unifies leadership computing and experimental facilities by enabling the automated establishment of data analysis pipelines that extend from edge data acquisition systems at synchrotron beamlines to remote computing facilities; under the covers, our system uses Globus Auth authentication to minimize user interaction, funcX to run user-defined functions on supercomputers, and Globus Flows to define and execute workflows. We describe the application of this system to ptychography, an ultra-high-resolution coherent diffraction imaging technique that can produce 100s of gigabytes to terabytes in a single experiment. When deployed on the DGX A100 ThetaGPU cluster at the Argonne Leadership Computing Facility and a microscopy beamline at the Advanced Photon Source, our system performs analysis as an experiment progresses to provide timely feedback.
KW - Federation
KW - High-performance computing
KW - Ptychography
KW - Scientific computing
KW - Synchrotron light source
UR - http://www.scopus.com/inward/record.url?scp=85127075962&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85127075962&partnerID=8YFLogxK
U2 - 10.1007/978-3-030-96498-6_10
DO - 10.1007/978-3-030-96498-6_10
M3 - Conference contribution
AN - SCOPUS:85127075962
SN - 9783030964979
T3 - Communications in Computer and Information Science
SP - 173
EP - 189
BT - Driving Scientific and Engineering Discoveries Through the Integration of Experiment, Big Data, and Modeling and Simulation - 21st Smoky Mountains Computational Sciences and Engineering, SMC 2021, Revised Selected Papers
A2 - Nichols, [given-name]Jeffrey
A2 - Maccabe, [given-name]Arthur ‘Barney’
A2 - Nutaro, James
A2 - Pophale, Swaroop
A2 - Devineni, Pravallika
A2 - Ahearn, Theresa
A2 - Verastegui, Becky
T2 - 21st Smoky Mountains Computational Sciences and Engineering Conference, SMC 2021
Y2 - 18 October 2021 through 20 October 2021
ER -