dCacheFS
Python file-system interface for dCache storages.
RS-DAT
Earth Observation (EO) data has become too large to be downloaded and analyzed on local desktop infrastructures, and even on many local cluster solutions. Although most of the data is freely available, a range of difficulties still hamper achievable benefit, not only for scientists, but also for citizens, industry and society.
In the eScience center we are building expertise in EO research, aiming to position ourselves as a hub of excellence for RS data handling, computing and analytics, while SURF is building the infrastructure and services to allow for innovative research that will result from big Geodata. This project aims to develop and set up an environment for exploration and analysis of Remote Sensing (RS) data.
The environment will provide scientists with tools to access RS data and analyze it, enabling them to use the massive storage and infrastructure offered by SURF. We identified eScience projects that address modern EO questions where access to large RS data is crucial, as is efficient data handling. These projects will serve as use cases that will provide us with insight into the common needs of the EO community and will act as drivers enabling us to create generic tools to address these needs, with specific focus on data access, retrieval and storage, analysis at scale, and ML supported analysis and exploitation.
Each generic tool will be delivered with a dedicated tutorial, a demo, and with a deployment recipe on SURF facilities, to promote and ease the environment's adaptation by the scientific community.
Estimating Motion of Objects on Earth from Space
Chasing shadows to investigate glacier change worldwide
Using remote sensing to develop damage indicators across all Antarctic ice shelves
Understanding phenological variability
Python file-system interface for dCache storages.
A Dask cluster and a Jupyter server on a SLURM system
STAC2dCache is a Python tool to create and manipulate STAC catalogs on a dCache storage system.