Skip to main content

Introduction

Let's discover the Radicalbit AI Monitoring Platform in less than 5 minutes.

Welcome!​

This platform provides a comprehensive solution for monitoring and observing your Artificial Intelligence (AI) models in production.

Why Monitor AI Models?​

While models often perform well during development and validation, their effectiveness can degrade over time in production due to various factors like data shifts or concept drift. The Radicalbit AI Monitor platform helps you proactively identify and address potential performance issues.

Key Functionalities​

The platform provides comprehensive monitoring capabilities to ensure optimal performance of your AI models in production. It analyzes both your reference dataset (used for pre-production validation) and the current datasets in use, allowing you to put under control:

  • Data Quality: evaluate the quality of your data, as high-quality data is crucial for maintaining optimal model performance. The platform analyzes both numerical and categorical features in your dataset to provide insights into
    • data distribution
    • missing values
    • target variable distribution (for supervised learning).
  • Model Quality Monitoring: the platform provides a comprehensive suite of metrics specifically designed at the moment for binary classification models. These metrics include:
    • Accuracy, Precision, Recall, and F1: These metrics provide different perspectives on how well your model is classifying positive and negative cases.
    • False/True Negative/Positive Rates and Confusion Matrix: These offer a detailed breakdown of your model's classification performance, including the number of correctly and incorrectly classified instances.
    • AUC-ROC and PR AUC: These are performance curves that help visualize your model's ability to discriminate between positive and negative classes.
  • Model Drift Detection: analyze model drift, which occurs when the underlying data distribution changes over time and can affect model accuracy.

Current Scope and Future Plans​

This initial version focuses on binary classification models. Support for additional model types is planned for future releases.