Overruled Verdict Auditor

Version updated for https://github.com/MohibShaikh/overruled-action to version v0.1.2.

  • This action is used across all versions by ? repositories.

Action Type

This is a Composite action.

Go to the GitHub Marketplace to find the latest changes.

Action Summary

This GitHub Action automates the auditing process of AI SOC agents using the overruled tool, which checks if an agent is overruled on ground-truth cases. It fails the workflow if the subject agent gets overruled and provides a JUnit XML report for further analysis. The action allows users to specify the investigation URL, token, number of runs, output format, and output file path.

What’s Changed

Marketplace listing name must be unique across actions, users and organizations, and the account OverRuled already holds overruled. The listing is now “Overruled Verdict Auditor”.

The uses: path is unchanged. The README pins @v0 so consumers do not need a bump on every patch.