Commit graph

42 commits

Author SHA1 Message Date
Andy Feller
e8842f861f Add missing test to trigger acceptance tests 2024-10-17 16:03:37 -04:00
Andy Feller
b4be8cbf9d Add acceptance tests for gh variable 2024-10-17 16:03:37 -04:00
Andy Feller
e335113706 Minor polish / consistency 2024-10-17 16:02:39 -04:00
Andy Feller
e91052dd9b Fix typo in custom command doc 2024-10-17 10:59:54 -04:00
Andy Feller
7c534e6010 Refactor env2upper, env2lower; add docs
This commit refactors 2 new custom commands to work more like the native env command, allowing for multiple environment variables to be set.

Additionally, the documentation on acceptance tests have been expanded to list out custom commands.
2024-10-17 10:49:17 -04:00
Andy Feller
5bbe69b1d1 Update secret note about potential failure
Environments are only supported for GitHub Actions with certain plans; `gh-acceptance-testing` at this time does not have this support.
2024-10-17 10:11:50 -04:00
Andy Feller
b1792403be Add testscripts for gh secret, helper cmds
These are initial testscripts for confidence around core `gh secret` subcommands around 1) repository, 2) repository environment, 3) organization secrets.

Each testscript exercises the 3 core subcommands of `gh secret`: 1) setting, 2) listing, and 3) deleting each type of secret.

Note should be made that repository environments do not exist for free accounts such as `gh-acceptance-testing`.
2024-10-17 10:09:08 -04:00
Andy Feller
a6974cc8d6
Merge pull request #9757 from cli/wm/testscript-issues
Add Acceptance tests for `issue` command
2024-10-15 14:47:33 -04:00
William Martin
e37cf8b694
Fix issue creation with metadata regex
Co-authored-by: Andy Feller <andyfeller@github.com>
2024-10-15 19:11:49 +01:00
Tyler McGoffin
c1939e9c15
Merge pull request #9754 from cli/wm/acceptance-test-defer-fails
Ensure Acceptance defer failures are debuggable
2024-10-14 14:58:26 -07:00
William Martin
6970eb36f1 Acceptance test issue command 2024-10-14 20:53:43 +02:00
William Martin
5ad4a385bb Support GH_ACCEPTANCE_SCRIPT 2024-10-14 20:44:07 +02:00
William Martin
3b1f06a88f Ensure Acceptance defer failures are debuggable 2024-10-14 20:27:34 +02:00
William Martin
2a0be61d5e Ensure pr create with metadata has assignment 2024-10-14 14:50:59 +02:00
William Martin
5e02326792
Document sharedCmds func in acceptance tests
Co-authored-by: Andy Feller <andyfeller@github.com>
2024-10-14 14:36:34 +02:00
William Martin
f7b279db11 Correct testscript description in Acceptance readme 2024-10-14 14:35:35 +02:00
William Martin
b095d6bd58
Add link to testscript pkg documentation
Co-authored-by: Andy Feller <andyfeller@github.com>
2024-10-14 14:33:49 +02:00
William Martin
f3589b2573
Add VSCode extension links to Acceptance README
Co-authored-by: Andy Feller <andyfeller@github.com>
2024-10-14 14:33:17 +02:00
William Martin
c2c88b293e Fix GH_HOST / GH_ACCEPTANCE_HOST misuse 2024-10-14 14:32:05 +02:00
William Martin
1f94cf9dac Acceptance test PR list 2024-10-14 14:31:24 +02:00
William Martin
bfa5b6afa5 Support skipping Acceptance test cleanup 2024-10-14 13:59:55 +02:00
William Martin
4d986aaed4 Acceptance test PR creation with metadata 2024-10-14 13:54:31 +02:00
William Martin
fbc72fd2be Suggest using legacy PAT for acceptance tests 2024-10-14 13:01:13 +02:00
William Martin
503659f11c Add host recommendation to Acceptance test docs 2024-10-14 12:56:27 +02:00
William Martin
0d7ec44895 Validate required env vars not-empty for Acceptance tests 2024-10-11 18:08:42 +02:00
William Martin
846a39d7be Add go to test instructions in Acceptance README 2024-10-11 17:57:08 +02:00
William Martin
fd66555510 Error if acceptance tests are targeting github or cli orgs 2024-10-11 17:51:17 +02:00
William Martin
f9b24990d6 Add codecoverage to Acceptance README 2024-10-11 16:31:23 +02:00
William Martin
9d569b3c11 Isolate acceptance env vars 2024-10-11 16:31:23 +02:00
William Martin
dc7c66c142 Add Writing Tests section to Acceptance README 2024-10-11 16:31:22 +02:00
William Martin
64f5b3c206 Add Debug and Authoring sections to Acceptance README 2024-10-11 16:31:22 +02:00
William Martin
ee5709a4b6 Acceptance test PR comment 2024-10-11 16:31:22 +02:00
William Martin
99a9b35410 Acceptance test PR merge and rebase 2024-10-11 16:31:22 +02:00
William Martin
320c5aba4a Note syntax highlighting support for txtar files 2024-10-11 16:31:22 +02:00
William Martin
502daff2a1 Refactor acceptance test environment handling 2024-10-11 16:31:22 +02:00
William Martin
5745eb1c1c Add initial acceptance test README 2024-10-11 16:31:22 +02:00
William Martin
eb9eeb10e1 Use txtar extension for testscripts 2024-10-11 16:31:22 +02:00
William Martin
99f7e048f9 Support targeting other hosts in acceptance tests 2024-10-11 16:31:22 +02:00
William Martin
464a69ae87 Use stdout2env in PR acceptance tests 2024-10-11 16:31:21 +02:00
William Martin
37171628c6 Acceptance test PR checkout 2024-10-11 16:31:21 +02:00
William Martin
5ed237c65a Add pr view test script 2024-10-11 16:31:21 +02:00
William Martin
d7465bdf3c Initial testscript introduction 2024-10-11 16:31:16 +02:00