DarkGenerators

Interpretable large scale deep generative models for Dark Matter searches

Dark matter (DM) is five times more abundant in the Universe than visible matter. Yet, its nature remains unknown and constitutes one of the most exciting and complex research questions today. New astrophysical/experimental big volume and high quality data must be matched with tools that are fit for the complex analysis of these data. Recent developments in deep learning and differentiable programming are likely to play a key role in this regard. Differential programming allows the efficient optimisation of a very large number of parameters of a program, e.g. to choose optimal internal or (astro-)physical parameters of a physical simulation. Deep generative models are Machine Learning programs that can generate data and can be used to simulate physical events. Exploring the optimal use, connection and synergy of these two new possibilities is the main goal of this proposal. We concentrate on two exemplary important datasets for DM research: data from the Large Hadron Collider (LHC), and images of strongly lensed galaxies. We will study how to improve the realism of deep generative models, and connect them with the help of differentiable probabilistic programming techniques to build fast, accurate and flexible new analysis pipelines. We explore the use of these pipelines for anomaly detection (to search for new physics), image and parameter reconstruction. A central outcome of our work will be an accessible and extensible public analysis tool that will spread the best of these new techniques to the large community of DM research and beyond.

Participating organisations

Natural Sciences & Engineering
Natural Sciences & Engineering
Netherlands eScience Center
SURF
University of Amsterdam

Impact

Output

Team

CW
Christoph Weniger
Principal investigator
University of Amsterdam
Meiert Grootes
Meiert Grootes
Senior eScience Research Engineer
Netherlands eScience Center
FN
eScience Research Engineer
Netherlands eScience Center
AB
Axel Berg
Programme Director
SURF
Sonja Georgievska
Sonja Georgievska
eScience Research Engineer
Netherlands eScience Center
Rena Bakhshi
Rena Bakhshi
Programme Manager
Netherlands eScience Center

Related projects

CORTEX

Self-learning machines hunt for explosions in the universe and speed up innovations in industry and...

Updated 22 months ago
In progress

PADRE - The PetaFLOP AARTFAAC Data-Reduction Engine

Improving the AARTFAAC processing pipeline

Updated 6 months ago
Finished

Scaling up pangenomics for plant breeding

Delivering a pangenome approach that drastically improves the analytical power on plant data

Updated 4 months ago
Finished

EOSCpilot LOFAR

Unlocking the LOFAR Long Term Archive

Updated 19 months ago
Finished

Automated Parallel Calculation of Collaborative Statistical Models

Large scale statistical data analysis in particle physics

Updated 22 months ago
Finished

iDark

The intelligent Dark Matter survey

Updated 19 months ago
Finished

Real-time detection of neutrinos from the distant Universe

Observing processes that are inaccessible to optical telescopes

Updated 18 months ago
Finished

Giving Pandas a ROOT to Chew on

Modern big data front and backends in the hunt for Dark Matter

Updated 18 months ago
Finished

Related software

swyft

SW

swyft is the official implementation of Truncated Marginal Neural Ratio Estimation, a hyper-efficient, simulation-based inference technique for complex data and expensive simulators.

Updated 15 months ago
5