Below you will find pages that utilize the taxonomy term “Bihanikeshav”
April 12, 2026
promptry eval
Version updated for https://github.com/bihanikeshav/promptry to version v0.5.0.
This action is used across all versions by 0 repositories. Action Type This is a Composite action.
Go to the GitHub Marketplace to find the latest changes.
Action Summary Summary:
The promptry GitHub Action automates regression testing and evaluation of large language model (LLM) pipelines by tracking prompt versions, running evaluation suites, and detecting regressions or quality drifts. It helps developers identify changes in prompt performance, analyze root causes, and compare models against historical baselines, ensuring consistent and high-quality outputs. Key features include prompt versioning, statistical model comparison, cost tracking, and support for a web dashboard.