Version updated for https://github.com/lmdixon23/evalcanary to version v0.1.1. This action is used across all versions by ? repositories. Action Type This is a Composite action. Go to the GitHub Marketplace to find the latest changes. Action Summary EvalCanary automates the process of evaluating and comparing two different evaluators for a fixed set of cases. It helps detect drift in evaluation results when an evaluator is updated, ensuring that changes to verifiers or scorers do not introduce unexpected behavior. The action provides detailed reports on how individual cases change between versions and offers insights into subgroup effects and uncertainty estimates.