Announcing AI Arena Beta Launch

We are excited to announce the launch of The Arena [Beta] in the Cranium platform! It gives users a centralized view of their AI models, allowing them to assess vulnerabilities, analyze attack scenarios, and strengthen their security posture. Through automated and manual penetration testing, the Arena simulates real-world adversarial techniques to uncover potential weaknesses before they can be exploited. Each AI model discovered across your AI Bills of Materials (BOMs) is cataloged and analyzed, providing detailed insights into its risk profile. The Arena further breaks down a model’s security assessment, helping users understand key threats, evaluate attack categories, and track known weaknesses.

AI Arena Beta Phase

Please note that The Arena is a beta feature and is only available to organizations participating in beta testing. If you are interested in participating in The Arena Beta Phase, please contact our Customer Success team.

Known Issues

Below is a list of known issues to keep in mind during testing.

Testable Models

Only certain model types will be included in the beta phase. This includes HuggingFace text-generating language models and manually tested models.
Testable models are identified in Bills of Materials. Only the specified model types will be identified as testable models; all other model types will be ignored.
Cranium conducts either automated or manual penetration tests on a model. Therefore, if a Bill of Materials contains a model for which Cranium has already conducted manual penetration tests, it will be identified and pulled into the Arena.

Getting Started

Upon your first visit to the AI Arena page in the Cranium app, the 'My AI Models' list will be empty.
Cranium identifies AI Models from a Bill of Materials and ties it to the AI Arena. While in the beta phase, you must generate a new Bill of Materials for this identification to occur. At this time, the process of identifying testable models is directly tied to the process of generating a new Bill of Materials.
Using the 'Rescan BOM' function in the 3-dot action menu on the Bill of Materials List will not trigger the AI Model identification.

Models & AI Systems

Only newly generated Bills of Materials are tied to the AI Arena. Therefore, only AI Systems containing newly generated Bills of Materials will be tied to the AI Arena.
The Arena identifies the AI Systems which contain each AI model to allow users to trace vulnerabilities at both the model and system levels. To enable this level of visibility, you must ensure the new Bills of Materials generated to populate your AI Arena are attached to the appropriate AI Systems.

Bug Fixes & Other Improvements

Stabilized the process for Vulnerability Report generation. The improvements decrease the time to generate a report and prioritize Models and Technologies vulnerabilities.
Resolved an error in triggering CodeSensor for GitLab VCS.
Resolved an issue handling empty libraries in Vulnerability Assessment scans.

Did this answer your question?