STACKITGit/cli
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Merge pull request #11398 from cli/babakks/update-eval-script-docs

Browse source 
Delete obsolete comment about `gh-models` not respecting API rate-limit
This commit is contained in:
Andy Feller 2025-07-28 07:47:57 -04:00 • committed by GitHub
commit 7d70980d83
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 0 additions and 4 deletions
Download patch file Download diff file Expand all files Collapse all files

4
.github/workflows/scripts/spam-detection/eval.sh vendored
View file

@ -14,8 +14,4 @@ SPAM_DIR="$(dirname "$(realpath "$0")")"
_system_prompt="$($SPAM_DIR/generate-sys-prompt.sh)"
_final_prompt="$(_value="$_system_prompt" yq eval '.messages[0].content = strenv(_value)' $SPAM_DIR/eval-prompts.yml)"
# The following `gh models eval` command will fail after 20 requests due to rate limits.
# We are going to open up an issue in `github/gh-models` to address this.
#
# TODO: break up `eval-prompts.yml` file into smaller batches to avoid hitting the rate limit.
gh models eval <(echo "$_final_prompt")