Explainable embeddings
Experiments with regard to explanation of embedded spaces and multi modal models.
Deep Insight And Neural Network Analysis, DIANNA is the only Explainable AI, XAI library for scientists supporting Open Neural Network Exchange, ONNX - the de facto standard models format.
Modern scientific challenges are often tackled with (Deep) Neural Networks (DNN). Despite their high predictive accuracy, DNNs lack inherent explainability. Many scientists do not harvest DNNs power because of lack of trust and understanding of their working. Meanwhile, the eXplainable AI (XAI) research offers some post-hoc (after training) interpretability methods that provide insight into the DNN reasoning by quantifying the relevance of individual features (image pixels, words in text, etc.) concerning the prediction. These relevance heatmaps indicate how the network has reached its decision directly in the input modality (images, text, speech etc.) of the scientific data. Representing visually the captured knowledge by the AI system can become a source of scientific insights. There are many Open Source Software (OSS) implementations of these methods, alas, supporting a single DNN format, while standards like Open Neural Network eXchange (ONNX) exist. The libraries are known mostly by the AI experts. For the adoption by the wide scientific community, understanding of the XAI methods, and well-documented and standardized OSS are needed. The DIANNA library supports the best XAI methods in the context of scientific usage providing their OSS implementation based on the ONNX standard and demonstrations on benchmark datasets. DIANNA supports images, text, time-series, tabular data and some embeddings support. DIANNA also comes with scientific use-casse tutorials about the use of XAI in different scientific domains: astronomy, climate, social sciences (law) and soon in geo-sciences.
DIANNA is easy to implement into my codes. It provides various methods for heat maps. DIANNA is pretty flexible as it does not require specific kinds of models or data.
What I like about DIANNA is the logo ;-), that it has a very easy interface, it is model agnostic and supports various methods and auto-tuning of parameters.
Fast, easy to use, comprehensive, nice visualizations.
What is happening in your machine-learned embedded spaces?
A high-level python package integrating expert knowledge and artificial intelligence to boost (sub) seasonal forecasting
Explainable AI tool for scientists
XAI4GEO
An alternative approach for intelligent systems to understand human speech
More efficient lighting and solar energy conversion devices
Experiments with regard to explanation of embedded spaces and multi modal models.