Skip to content

chore(ci): Run E2E tests in a per-test matrix#2398

Merged
phipag merged 10 commits intomainfrom
phipag/e2e-test-matrix
Mar 3, 2026
Merged

chore(ci): Run E2E tests in a per-test matrix#2398
phipag merged 10 commits intomainfrom
phipag/e2e-test-matrix

Conversation

@phipag
Copy link
Contributor

@phipag phipag commented Mar 3, 2026

Summary

This PR runs the E2E tests in a GitHub concurrent matrix to speed up test execution and avoid credential timeouts. After recently added E2E tests we exceeded the one hour validity of the temporary credentials.

The tests will be discovered automatically by a small bash script parsing the E2E test pom.xml to find the globs of the test classes. This is done to avoid forgetting to add a test class to GH actions when authoring new tests. The pom.xml is the source of truth of the test discovery now.

image

Changes

Issue number: #2397


By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

Disclaimer: We value your time and bandwidth. As such, any pull requests created on non-triaged issues might not be successful.

@phipag phipag self-assigned this Mar 3, 2026
@phipag phipag changed the title Setup initial test matrix for test classes. chore(ci): Setup initial test matrix for test classes. Mar 3, 2026
@phipag phipag linked an issue Mar 3, 2026 that may be closed by this pull request
2 tasks
@phipag
Copy link
Contributor Author

phipag commented Mar 3, 2026

Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR restructures the E2E GitHub Actions workflow to run end-to-end tests in a per-test-class matrix, reducing overall runtime and minimizing AWS temporary credential expiration during long-running E2E runs.

Changes:

  • Adds a discover-tests job that derives E2E and GraalVM E2E test class lists and exposes them as job outputs.
  • Updates e2e and e2e-graal jobs to run one test class per matrix entry via -Dit.test=..., increasing concurrency.
  • Moves the full project build into a dedicated step before AWS credential configuration in each matrix job.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

phipag and others added 2 commits March 3, 2026 15:16
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
@phipag
Copy link
Contributor Author

phipag commented Mar 3, 2026

Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 1 out of 1 changed files in this pull request and generated 4 comments.


💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

phipag and others added 3 commits March 3, 2026 15:35
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
@sonarqubecloud
Copy link

sonarqubecloud bot commented Mar 3, 2026

@phipag
Copy link
Contributor Author

phipag commented Mar 3, 2026

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

Status: Coming soon

Development

Successfully merging this pull request may close these issues.

Maintenance: E2E tests credentials time out after 1h

3 participants