Sign in
Ctrl K

PADRE - The PetaFLOP AARTFAAC Data-Reduction Engine

Improving the AARTFAAC processing pipeline

AARTFAAC is an all-sky radio telescope and transient-detection facility. It piggybacks on raw data from a limited number of antennas of the LOFAR telescope. Last year, the AARTFAAC 2.0 program started, which couples a planned telescope upgrade with better transient-detection capabilities and new science cases.

This proposal, the PetaFLOP AARTFAAC Data-Reduction Engine (PADRE), aims to improve the AARTFAAC processing pipeline to achieve the following goals.

First, transients will be detected in real time with low latency, so that the raw samples of all LOFAR antennas (which are available for only seven seconds) can be saved in time for further analysis, while other instruments, observing at other wavelengths, are alerted to initiate follow-up observations immediately.

Second, the pipeline will scale to support more antennas and more bandwidth, through algorithmic optimizations and the use of new GPU technologies, which yields better images and greatly enhances the transient discovery rate.

Third, the pipeline will facilitate other, new use cases (space-wheather monitoring, ionospheric research, cosmic dawn) by providing intermediate data products like calibrated images. The pipeline that PADRE will develop is thus at the heart of a versatile, powerful instrument.

This project is in cooperation with SURF, Axel Berg is the call director, Raymond Oonk is the SURF Advisor, and Duncan Kampert is the SURF engineer.

Part of PADRE will be continued from March 1, 2024 until September 1, 2025 as "PySE: a fast source extractor for astronomy, written in Python and flexible enough to integrate into a pipeline", which is a Software Sustainability Project by The Netherlands eScience Center.

Participating organisations

ASTRON
Netherlands eScience Center
SURF
Natural Sciences & Engineering
Natural Sciences & Engineering
University of Amsterdam

Impact

Output

Team

JR
John Romein
Principal investigator
Netherlands Institute for Radio Astronomy
AR
Antonia Rowlinson
Co-Applicant
University of Amsterdam
RW
Ralph Wijers
Co-Applicant
University of Amsterdam
SW
Stefan Wijnholds
Hanno Spreeuw
Hanno Spreeuw
Lead RSE
Netherlands eScience Center
AB
Axel Berg
Programme Director
SURF
Ben van Werkhoven
Ben van Werkhoven
eScience Research Engineer
Netherlands eScience Center
DK
Duncan Kampert
Research engineer
SURF
RO
Raymond Oonk
Advisor
SURF
Rena Bakhshi
Rena Bakhshi
Programme Manager
Netherlands eScience Center

Related projects

RECRUIT

Reducing Energy Consumption in Radio-astronomical and Ultrasound Imaging Tools

Updated 1 week ago
In progress

CORTEX

Self-learning machines hunt for explosions in the universe and speed up innovations in industry and...

Updated 18 months ago
In progress

DarkGenerators

Interpretable large scale deep generative models for Dark Matter searches

Updated 18 months ago
Finished

Scaling up pangenomics for plant breeding

Delivering a pangenome approach that drastically improves the analytical power on plant data

Updated 2 weeks ago
Finished

EOSCpilot LOFAR

Unlocking the LOFAR Long Term Archive

Updated 15 months ago
Finished

DIRAC

Distributed radio astronomical computing

Updated 14 months ago
Finished

AA-ALERT

Access and acceleration of the Apertif Legacy exploration of the radio transient sky

Updated 18 months ago
Finished

Compressing the sky into a large collection of statistical models

Optimized data handling for observations in astronomy

Updated 14 months ago
Finished

Beyond the Data Explosion (eAstronomy)

An eScience infrastructure for huge interferometric datasets

Updated 14 months ago
Finished

Related software

TraP: The LOFAR Transients Pipeline

TR

The LOFAR Transients Pipeline (or "TraP") is a Python and SQL based system for detecting and responding to transient and variable sources in a stream of astronomical images.

Updated 14 months ago
8 6