LLM in GitHub Actions
Version updated for https://github.com/muhac/llm-actions to version v1.0.3.
- This action is used across all versions by ? repositories.
Action Type
This is a Composite action.
Go to the GitHub Marketplace to find the latest changes.
Action Summary
This GitHub Action enables running inference using Hugging Face models on a temporary vLLM server within a CI/CD pipeline. It automates the process of deploying and executing large language models (LLMs) directly in GitHub Actions, solving challenges related to testing and using AI models in constrained environments. Key capabilities include support for various LLMs, customization of model versions, and compatibility with both public and private models for streamlined integration into workflows.
Release notes
What’s Changed
- Upgrade vLLM to v0.17.0
New Contributors
- @Copilot made their first contribution in https://github.com/muhac/llm-actions/pull/1
Full Changelog: https://github.com/muhac/llm-actions/compare/v1.0.2...v1.0.3