Below you will find pages that utilize the taxonomy term “SynapseKit”
April 14, 2026
EvalCI by SynapseKit
Version updated for https://github.com/SynapseKit/evalci to version v1.
This action is used across all versions by ? repositories. Action Type This is a Composite action.
Go to the GitHub Marketplace to find the latest changes.
Action Summary EvalCI is a GitHub Action designed to automate the evaluation of pull requests using Language Model (LLM) quality gates. It discovers and executes test cases tagged with @eval_case, assesses their performance against user-defined criteria (e.g., minimum score thresholds), posts a formatted results table as a PR comment, and blocks merging if quality metrics fall below the specified thresholds. The action simplifies LLM testing workflows by integrating directly with GitHub Actions, requiring no external infrastructure, and supporting multiple LLM providers.