Andy Feller
acf62dacf2
Address @williammartin PR feedback
2024-10-21 11:53:05 -04:00
Andy Feller
f4f161c096
Refactor gh secret testscript
...
This is a bit of a refactor based on the work done in `gh workflow` as a better approach to verify secrets created are what we expect.
Changes made:
1. Removed `env2lower` as it wasn't being used in testscripts
2. Added `replace` custom command to deal with testing organization workflow secrets
3. Refactored secret testscripts to create and run workflow that tests the value of the secret provided
4. Minor reordering of test `acceptance` test functions as appending to the end is confusing and adds conflicts
5. Removed stdout TTY assertions
2024-10-18 15:56:03 -04:00
Andy Feller
1571a113c2
Merge branch 'trunk' into andyfeller/testscripts-secret
2024-10-18 09:46:25 -04:00
Andy Feller
e335113706
Minor polish / consistency
2024-10-17 16:02:39 -04:00
Andy Feller
e91052dd9b
Fix typo in custom command doc
2024-10-17 10:59:54 -04:00
Andy Feller
7c534e6010
Refactor env2upper, env2lower; add docs
...
This commit refactors 2 new custom commands to work more like the native env command, allowing for multiple environment variables to be set.
Additionally, the documentation on acceptance tests have been expanded to list out custom commands.
2024-10-17 10:49:17 -04:00
Andy Feller
5bbe69b1d1
Update secret note about potential failure
...
Environments are only supported for GitHub Actions with certain plans; `gh-acceptance-testing` at this time does not have this support.
2024-10-17 10:11:50 -04:00
Andy Feller
b1792403be
Add testscripts for gh secret, helper cmds
...
These are initial testscripts for confidence around core `gh secret` subcommands around 1) repository, 2) repository environment, 3) organization secrets.
Each testscript exercises the 3 core subcommands of `gh secret`: 1) setting, 2) listing, and 3) deleting each type of secret.
Note should be made that repository environments do not exist for free accounts such as `gh-acceptance-testing`.
2024-10-17 10:09:08 -04:00
William Martin
24fc2db395
Remove stdout assertion from release
2024-10-17 16:06:14 +02:00
bagtoad
473faea573
Rename test files
2024-10-17 16:06:14 +02:00
bagtoad
a009933a16
Add acceptance tests for release commands
2024-10-17 16:06:10 +02:00
bagtoad
06c20f3a8b
Implement basic API acceptance test
2024-10-17 15:39:29 +02:00
William Martin
f21ac8f68e
Merge pull request #9766 from cli/kw/github-cli-585-add-acceptance-tests-for-actions-commands
...
Add acceptance tests for `workflow`, `run`, and `cache` commands
2024-10-17 15:36:54 +02:00
William Martin
dc3e805078
Remove unnecesary mkdir from download Acceptance test
2024-10-17 15:13:43 +02:00
William Martin
07ea43ae5a
Remove empty stdout checks
2024-10-17 15:13:38 +02:00
William Martin
0f62ec20e2
Adjust sleeps to echos in Acceptance workflows
2024-10-17 15:06:45 +02:00
William Martin
93081c9e65
Use regex assert for enable disable workflow Acceptance test
2024-10-17 14:25:02 +02:00
William Martin
8f567e2791
Watch for run to end for cancel Acceptance test
2024-10-17 14:13:50 +02:00
bagtoad
4ce8236142
sleep 10s before checking for workflow run
2024-10-15 15:09:47 -06:00
bagtoad
8d626312a4
Update run-rerun.txtar
2024-10-15 14:59:21 -06:00
bagtoad
924d81a34b
Create cache-list-delete.txtar
2024-10-15 14:59:19 -06:00
bagtoad
682b75fb4e
Create run-view.txtar
2024-10-15 14:19:52 -06:00
bagtoad
745863b365
Create run-rerun.txtar
2024-10-15 14:19:49 -06:00
bagtoad
3d3e061d06
Create run-download.txtar
2024-10-15 14:19:47 -06:00
bagtoad
3f080e0948
Create run-delete.txtar
2024-10-15 14:19:44 -06:00
Andy Feller
a6974cc8d6
Merge pull request #9757 from cli/wm/testscript-issues
...
Add Acceptance tests for `issue` command
2024-10-15 14:47:33 -04:00
William Martin
e37cf8b694
Fix issue creation with metadata regex
...
Co-authored-by: Andy Feller <andyfeller@github.com>
2024-10-15 19:11:49 +01:00
bagtoad
446ffede12
Create run-cancel.txtar
2024-10-15 11:37:14 -06:00
bagtoad
3737f10246
Create workflow-run.txtar
2024-10-15 11:37:11 -06:00
bagtoad
0b1d6923e1
Create workflow-view.txtar
2024-10-15 11:37:06 -06:00
bagtoad
5f919bc5b0
implement workflow enable/disable acceptance test
2024-10-15 11:01:21 -06:00
bagtoad
c3ffdc90c8
implement base workflow list acceptance test
2024-10-15 11:01:09 -06:00
Tyler McGoffin
c1939e9c15
Merge pull request #9754 from cli/wm/acceptance-test-defer-fails
...
Ensure Acceptance defer failures are debuggable
2024-10-14 14:58:26 -07:00
William Martin
6970eb36f1
Acceptance test issue command
2024-10-14 20:53:43 +02:00
William Martin
5ad4a385bb
Support GH_ACCEPTANCE_SCRIPT
2024-10-14 20:44:07 +02:00
William Martin
3b1f06a88f
Ensure Acceptance defer failures are debuggable
2024-10-14 20:27:34 +02:00
William Martin
2a0be61d5e
Ensure pr create with metadata has assignment
2024-10-14 14:50:59 +02:00
William Martin
5e02326792
Document sharedCmds func in acceptance tests
...
Co-authored-by: Andy Feller <andyfeller@github.com>
2024-10-14 14:36:34 +02:00
William Martin
f7b279db11
Correct testscript description in Acceptance readme
2024-10-14 14:35:35 +02:00
William Martin
b095d6bd58
Add link to testscript pkg documentation
...
Co-authored-by: Andy Feller <andyfeller@github.com>
2024-10-14 14:33:49 +02:00
William Martin
f3589b2573
Add VSCode extension links to Acceptance README
...
Co-authored-by: Andy Feller <andyfeller@github.com>
2024-10-14 14:33:17 +02:00
William Martin
c2c88b293e
Fix GH_HOST / GH_ACCEPTANCE_HOST misuse
2024-10-14 14:32:05 +02:00
William Martin
1f94cf9dac
Acceptance test PR list
2024-10-14 14:31:24 +02:00
William Martin
bfa5b6afa5
Support skipping Acceptance test cleanup
2024-10-14 13:59:55 +02:00
William Martin
4d986aaed4
Acceptance test PR creation with metadata
2024-10-14 13:54:31 +02:00
William Martin
fbc72fd2be
Suggest using legacy PAT for acceptance tests
2024-10-14 13:01:13 +02:00
William Martin
503659f11c
Add host recommendation to Acceptance test docs
2024-10-14 12:56:27 +02:00
William Martin
0d7ec44895
Validate required env vars not-empty for Acceptance tests
2024-10-11 18:08:42 +02:00
William Martin
846a39d7be
Add go to test instructions in Acceptance README
2024-10-11 17:57:08 +02:00
William Martin
fd66555510
Error if acceptance tests are targeting github or cli orgs
2024-10-11 17:51:17 +02:00
