Xenon

If you are using remote machines to do your computations, and don’t feel like learning and implementing many different APIs, Xenon is the tool for you.

13
mentions
11
contributors
Get started
1950 commitsLast commit ≈ 6 months ago34 stars17 forks

Cite this software

What Xenon can do for you

  • Provides an easy-to-use interface for distributed computing developers
  • Enables the use of different file transfer protocols and scheduling systems on remote machines
  • No need to learn and implement many different APIs
  • Successfully used in many eScience tools and projects

Many applications use remote storage and compute resources. To do so, they need to include code to interact with the scheduling systems and file transfer protocols used on those remote machines.

Unfortunately, many different scheduler systems and file transfer protocols exist, often with completely different programming interfaces. This makes it difficult for applications to switch to a different system or support multiple remote systems simultaneously.

Xenon solves this problem by providing a single programming interface to many different types of remote resources. As a result, changing from one scheduler to another, or from one file transfer protocol to another, becomes a matter of changing just a few lines of code. This is obviously much cheaper in time and money than developing, debugging, and maintaining new code that implements the same logic you had before, but for a different scheduler or a different file transfer protocol.

Participating organisations

Netherlands eScience Center
Vrije Universiteit Amsterdam
Natural Sciences & Engineering
Natural Sciences & Engineering

Mentions

Portable HPC workflows with Snakemake, Conda, and Xenon

Author(s): Jurriaan H. Spaaks
Published in 2018

Contributors

Arnold Kuzniar
Arnold Kuzniar
AvdP
Atze van der Ploeg
Ben van Werkhoven
Ben van Werkhoven
Joris Borgdorff
Joris Borgdorff
Jurriaan H. Spaaks
Jurriaan H. Spaaks
Niels  Drost
Niels Drost
PdB
Piter T. de Boer
Netherlands eScience Center

Related projects

PROCESS

Providing computing solutions for exascale challenges

Updated 24 months ago
Finished

A methodology and ecosystem for many-core programming

Boosting the performance of current and future programs

Updated 20 months ago
Finished

Emotion Recognition in Dementia

Advancing technology for multimodal analysis of emotion expression in everyday life

Updated 24 months ago
Finished

Googling the cancer genome

Identification and prioritization of cancer-causing structural variations in whole genomes

Updated 2 weeks ago
Finished

Visualizing Uncertainty and Perspectives

Strengthening the methodology of digital humanities

Updated 20 months ago
Finished

Enabling Dynamic Services

Realizing the full potential of the Dutch e-Infrastructure

Updated 20 months ago
Finished

ABC-MUSE

The generalization and optimization of the multi-purpose software environment

Updated 24 months ago
Finished

Mapping the Via Appia in 3D

Developing a 4D geographic information system for archaeological purposes

Updated 20 months ago
Finished

AMUSE

The evolution of embedded star clusters

Updated 20 months ago
Finished

Chemical Informatics for Metabolite Identification and Biochemical Network Reconstruction

Chemical informatics for metabolite identification and biochemical network reconstruction

Updated 20 months ago
Finished

eSALSA

Predicting local sea level changes

Updated 20 months ago
Finished

Related software

PyXenon

PY

Python wrapper for the Xenon programming interface to various compute and storage resources.

Updated 29 months ago
3

sv-callers

SV

Highly portable parallel workflow to detect structural variants in cancer genomes.

Updated 14 months ago
32 4

sv-gen

SV

Highly portable parallel workflow to generate artificial genomes with structural variants.

Updated 29 months ago
5

Xenon command line interface

XE

A command line interface for the Xenon library that allows you to use remote machines to do your computations.

Updated 14 months ago
9 2

Xenon gRPC server

XE

Run applications remotely via a gRPC interface.

Updated 14 months ago
4 3