Services

CloudStor makes Synchroton data transfers easy for researchers

Fields marked with an * are required

Subscribe to our newsletter

CloudStor user story: sharing large imaging datasets

CSIRO Scientific Software Engineer Darren Thompson works across a number of areas in the Synchrotron sciences, developing software for high-speed X-ray imaging and computed tomography (CT) reconstruction on Synchrotron datasets using high performance computing (HPC) systems.

Datasets from Synchrotron experiments can be in the order of 10’s to 100’s of gigabits. Thompson says he has found the AARNet CloudStor file sender service very useful on numerous occasions for shifting these large datasets to people located interstate or overseas who do not have access to CSIRO’s internal systems. He also uses CloudStor to send data to colleagues in different sections of CSIRO when there is no common storage.

Thompson’s software work supports scientists using the Australian Synchrotron from a number of research fields, including medical and life sciences, earth and environmental sciences, advanced materials and engineering, and accelerator sciences. Synchrotron X-rays are used for measuring hard-to-detect quantities or properties, observing physically hidden features, or stimulating atomic and molecular processes that require a lot of energy, and other applications.

He is also a researcher, working in the field of CT mammography using Synchrotron datasets for his own investigations, exploring 3D X-ray CT combined with phase-contrast imaging techniques with the aim of improving the accuracy of breast cancer diagnostic imaging.

“Generally, over the course of their beam-time a Synchrotron user will acquire many such input datasets resulting in several terabytes of input data alone. If they process the data with the onsite MASSIVE HPC system this will increase even more. Interestingly – CT reconstruction produces output datasets even bigger than the input,” he says.

After the experiments are complete this data often needs to be moved offsite.

“AARNet’s CloudStor file sender is proving to be a reliable way to bulk move this experiment data to people who haven’t be able get their data via other methods.”

CloudStor has been built for the research community and is a quick, easy and free way to transfer large files. Researchers and other users at AARNet-connected universities can access CloudStor using Australian Access Federation credentials.

MORE INFORMATION

Find out more about the benefits of AARNet’s CloudStor file sender and storage service, including 100GB free storage for researchers and group quotas for projects.


Related Stories

Services

Sep 30, 2019

Research and education network leaders in Internet Hall of Fame class of 2019

AARNet congratulates national research and education network colleagues from around the world inducted into the prestigious Internet Hall of Fame! The 2019 Internet Hall of Fame inductees were announced at a special ceremony held in Costa Rica on 27 September 2019, recognising the...

Services

Aug 29, 2019

Data analysis in CloudStor: SWAN is ready for researchers

In the sciences, humanities and the arts...

Services

Jul 19, 2019

AARNet and ownCloud partner to develop next-gen architecture for shared data

The new architecture, called “Infinite Scale”, will dramatically reduce database requirements and enable geo-replication in the near future. It also allows the introduction of a scalable workflow engine. AARNet (Australia's Academic and Research Network), is co-developing ownCloud Infinite Scale and...