Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore(sdk): running the sdk spec tests action before the build #3850

Closed
wants to merge 87 commits into from

Conversation

tsuf239
Copy link
Collaborator

@tsuf239 tsuf239 commented Aug 17, 2023

Running the sdk spec tests action after pushing to main

Checklist

  • Title matches Winglang's style guide
  • Description explains motivation and solution
  • Tests added (always)
  • Docs updated (only required for features)
  • Added pr/e2e-full label if this feature requires end-to-end testing

By submitting this pull request, I confirm that my contribution is made under the terms of the Wing Cloud Contribution License.

@tsuf239 tsuf239 requested a review from a team as a code owner August 17, 2023 10:23
.github/workflows/tf-aws-test.yml Outdated Show resolved Hide resolved
Copy link
Contributor

@MarkMcCulloh MarkMcCulloh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's possible that these tests need to instead run inside of hangar so that it can install the dev version of wing, but triggered separately from the existing e2e tests. This would be similar to the benchmark tests.

.github/workflows/tf-aws-test.yml Outdated Show resolved Hide resolved
.github/workflows/tf-aws-test.yml Show resolved Hide resolved
@monadabot
Copy link
Contributor

Results for sim SDK spec tests:
Array

@monadabot
Copy link
Contributor

Results for sim SDK spec tests:
Array

@monadabot
Copy link
Contributor

Results for sim SDK spec tests:
Array

@monadabot
Copy link
Contributor

Results for sim SDK spec tests:
{
"total_attempts": "1",
"text": "fail ┌ public_url.main.wsim » root/env0/test:publicUrl\n │ TypeError: fetch failed\n │ at Object.fetch (node:internal/deps/undici/undici:11457:11)\n │ at async Util.fetch (/tmp/wing-bundles-0m9kgP/index.js:5425:21)\n │ at async $Closure1.handle (/tmp/wing-bundles-0m9kgP/index.js:109:19)\n │ at async exports.handler (/tmp/wing-bundles-0m9kgP/index.js:6015:10)\n │ at async Object.withTrace (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/@winglang/sdk/lib/testing/simulator.js:256:34)\n │ at async TestRunnerClient.runTest (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/@winglang/sdk/lib/target-sim/test-runner.inflight.js:31:13)\n │ at async testSimulator (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/winglang/dist/commands/test.js:214:22)\n │ at async testOne (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/winglang/dist/commands/test.js:125:20)\n │ at async testFile (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/winglang/dist/commands/test.js:55:39)\n │ at async Promise.all (index 0)\n │ at async Object.test (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/winglang/dist/commands/test.js:66:5)\n └ at async Command. (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/winglang/dist/cli.js:46:30)\npass ─ put.main.wsim » root/env0/test:put\n \nResults:\n ✓ bucket/put.main.w\n × bucket/public_url.main.w\n \nErrors:\nAt bucket/public_url.main.w\nTypeError: fetch failed\n at Object.fetch (node:internal/deps/undici/undici:11457:11)\n at async Util.fetch (/tmp/wing-bundles-0m9kgP/index.js:5425:21)\n at async $Closure1.handle (/tmp/wing-bundles-0m9kgP/index.js:109:19)\n at async exports.handler (/tmp/wing-bundles-0m9kgP/index.js:6015:10)\n at async Object.withTrace (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/@winglang/sdk/lib/testing/simulator.js:256:34)\n at async TestRunnerClient.runTest (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/@winglang/sdk/lib/target-sim/test-runner.inflight.js:31:13)\n at async testSimulator (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/winglang/dist/commands/test.js:214:22)\n at async testOne (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/winglang/dist/commands/test.js:125:20)\n at async testFile (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/winglang/dist/commands/test.js:55:39)\n at async Promise.all (index 0)\n at async Object.test (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/winglang/dist/commands/test.js:66:5)\n at async Command. (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/winglang/dist/cli.js:46:30)\n \nTests 1 failed | 1 passed (2)\nTest Files 1 failed | 1 passed (2)\nDuration 0m2.44s",
"exit_code": "0"
}

@monadabot
Copy link
Contributor

Results for sim SDK spec tests:
fail ┌ public_url.main.wsim » root/env0/test:publicUrl
│ TypeError: fetch failed
│ at Object.fetch (node:internal/deps/undici/undici:11457:11)
│ at async Util.fetch (/tmp/wing-bundles-P7txsA/index.js:5425:21)
│ at async $Closure1.handle (/tmp/wing-bundles-P7txsA/index.js:109:19)
│ at async exports.handler (/tmp/wing-bundles-P7txsA/index.js:6015:10)
│ at async Object.withTrace (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/@winglang/sdk/lib/testing/simulator.js:256:34)
│ at async TestRunnerClient.runTest (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/@winglang/sdk/lib/target-sim/test-runner.inflight.js:31:13)
│ at async testSimulator (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/winglang/dist/commands/test.js:214:22)
│ at async testOne (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/winglang/dist/commands/test.js:125:20)
│ at async testFile (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/winglang/dist/commands/test.js:55:39)
│ at async Promise.all (index 0)
│ at async Object.test (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/winglang/dist/commands/test.js:66:5)
└ at async Command. (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/winglang/dist/cli.js:46:30)
pass ─ put.main.wsim » root/env0/test:put

Results:
✓ bucket/put.main.w
× bucket/public_url.main.w

Errors:
At bucket/public_url.main.w
TypeError: fetch failed
at Object.fetch (node:internal/deps/undici/undici:11457:11)
at async Util.fetch (/tmp/wing-bundles-P7txsA/index.js:5425:21)
at async $Closure1.handle (/tmp/wing-bundles-P7txsA/index.js:109:19)
at async exports.handler (/tmp/wing-bundles-P7txsA/index.js:6015:10)
at async Object.withTrace (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/@winglang/sdk/lib/testing/simulator.js:256:34)
at async TestRunnerClient.runTest (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/@winglang/sdk/lib/target-sim/test-runner.inflight.js:31:13)
at async testSimulator (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/winglang/dist/commands/test.js:214:22)
at async testOne (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/winglang/dist/commands/test.js:125:20)
at async testFile (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/winglang/dist/commands/test.js:55:39)
at async Promise.all (index 0)
at async Object.test (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/winglang/dist/commands/test.js:66:5)
at async Command. (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/winglang/dist/cli.js:46:30)

Tests 1 failed | 1 passed (2)
Test Files 1 failed | 1 passed (2)
Duration 0m2.51s

@monadabot
Copy link
Contributor

Results for sim SDK spec tests:

@monadabot
Copy link
Contributor

Results for sim SDK spec tests:
Object

@monadabot
Copy link
Contributor

Results for sim SDK spec tests:
{
"total_attempts": "3",
"exit_error": "Final attempt failed. Child_process exited with error code 1",
"exit_code": "1"
}

@monadabot
Copy link
Contributor

Results for sim SDK spec tests:
{}

@monadabot
Copy link
Contributor

Results for sim SDK spec tests:
{}

@monadabot
Copy link
Contributor

Results for sim SDK spec tests:
{
"text": "fail ┌ public_url.main.wsim » root/env0/test:publicUrl"
}

@monadabot
Copy link
Contributor

Results for sim SDK spec tests:
{
"text": "fail ┌ public_url.main.wsim » root/env0/test:publicUrl\n │ TypeError: fetch failed\n │ at Object.fetch (node:internal/deps/undici/undici:11457:11)\n │ at async Util.fetch (/tmp/wing-bundles-mrBVLV/index.js:5425:21)\n │ at async $Closure1.handle (/tmp/wing-bundles-mrBVLV/index.js:109:19)\n │ at async exports.handler (/tmp/wing-bundles-mrBVLV/index.js:6015:10)\n │ at async Object.withTrace (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/@winglang/sdk/lib/testing/simulator.js:256:34)\n │ at async TestRunnerClient.runTest (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/@winglang/sdk/lib/target-sim/test-runner.inflight.js:31:13)\n │ at async testSimulator (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/winglang/dist/commands/test.js:214:22)\n │ at async testOne (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/winglang/dist/commands/test.js:125:20)\n │ at async testFile (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/winglang/dist/commands/test.js:55:39)\n │ at async Promise.all (index 0)\n │ at async Object.test (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/winglang/dist/commands/test.js:66:5)\n └ at async Command. (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/winglang/dist/cli.js:46:30)\npass ─ put.main.wsim » root/env0/test:put\n \nResults:\n ✓ bucket/put.main.w\n × bucket/public_url.main.w\n \nErrors:\nAt bucket/public_url.main.w\nTypeError: fetch failed\n at Object.fetch (node:internal/deps/undici/undici:11457:11)\n at async Util.fetch (/tmp/wing-bundles-mrBVLV/index.js:5425:21)\n at async $Closure1.handle (/tmp/wing-bundles-mrBVLV/index.js:109:19)\n at async exports.handler (/tmp/wing-bundles-mrBVLV/index.js:6015:10)\n at async Object.withTrace (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/@winglang/sdk/lib/testing/simulator.js:256:34)\n at async TestRunnerClient.runTest (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/@winglang/sdk/lib/target-sim/test-runner.inflight.js:31:13)\n at async testSimulator (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/winglang/dist/commands/test.js:214:22)\n at async testOne (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/winglang/dist/commands/test.js:125:20)\n at async testFile (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/winglang/dist/commands/test.js:55:39)\n at async Promise.all (index 0)\n at async Object.test (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/winglang/dist/commands/test.js:66:5)\n at async Command. (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/winglang/dist/cli.js:46:30)\n \nTests 1 failed | 1 passed (2)\nTest Files 1 failed | 1 passed (2)\nDuration 0m2.48s"
}

@monadabot
Copy link
Contributor

Results for sim SDK spec tests:
pass ─ pop.main.wsim » root/env0/test:pop
fail ┌ public_url.main.wsim » root/env0/test:publicUrl
│ TypeError: fetch failed
│ at Object.fetch (node:internal/deps/undici/undici:11457:11)
│ at async Util.fetch (/tmp/wing-bundles-6Ooiic/index.js:5425:21)
│ at async $Closure1.handle (/tmp/wing-bundles-6Ooiic/index.js:109:19)
│ at async exports.handler (/tmp/wing-bundles-6Ooiic/index.js:6015:10)
│ at async Object.withTrace (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/@winglang/sdk/lib/testing/simulator.js:256:34)
│ at async TestRunnerClient.runTest (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/@winglang/sdk/lib/target-sim/test-runner.inflight.js:31:13)
│ at async testSimulator (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/winglang/dist/commands/test.js:214:22)
│ at async testOne (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/winglang/dist/commands/test.js:125:20)
│ at async testFile (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/winglang/dist/commands/test.js:55:39)
│ at async Promise.all (index 0)
│ at async Object.test (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/winglang/dist/commands/test.js:66:5)
└ at async Command. (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/winglang/dist/cli.js:46:30)
pass ─ put.main.wsim » root/env0/test:put

Results:
✓ queue/pop.main.w
✓ bucket/put.main.w
× bucket/public_url.main.w

Errors:
At bucket/public_url.main.w
TypeError: fetch failed
at Object.fetch (node:internal/deps/undici/undici:11457:11)
at async Util.fetch (/tmp/wing-bundles-6Ooiic/index.js:5425:21)
at async $Closure1.handle (/tmp/wing-bundles-6Ooiic/index.js:109:19)
at async exports.handler (/tmp/wing-bundles-6Ooiic/index.js:6015:10)
at async Object.withTrace (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/@winglang/sdk/lib/testing/simulator.js:256:34)
at async TestRunnerClient.runTest (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/@winglang/sdk/lib/target-sim/test-runner.inflight.js:31:13)
at async testSimulator (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/winglang/dist/commands/test.js:214:22)
at async testOne (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/winglang/dist/commands/test.js:125:20)
at async testFile (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/winglang/dist/commands/test.js:55:39)
at async Promise.all (index 0)
at async Object.test (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/winglang/dist/commands/test.js:66:5)
at async Command. (/opt/hostedtoolcache/node/18.16.0/x64/lib/node_modules/winglang/dist/cli.js:46:30)

Tests 1 failed | 2 passed (3)
Test Files 1 failed | 2 passed (3)
Duration 0m3.21s

@tsuf239
Copy link
Collaborator Author

tsuf239 commented Sep 21, 2023

closing, opened #4245 instead :)

@tsuf239 tsuf239 closed this Sep 21, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants