Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test(critical): Add API Level matrix #3810

Merged
merged 33 commits into from
Oct 28, 2024
Merged
Changes from all commits
Commits
Show all changes
33 commits
Select commit Hold shift + click to select a range
a7b38d4
Add New UI Tests App for critical tests
krystofwoldrich Oct 17, 2024
855903a
Format code
getsentry-bot Oct 17, 2024
835d432
Return proguard rules file
krystofwoldrich Oct 17, 2024
339a8d7
Add CI build and test jobs
krystofwoldrich Oct 18, 2024
4dc470d
Merge remote-tracking branch 'origin/kw/test/add-critical-ui-tests' i…
krystofwoldrich Oct 18, 2024
26ff65e
Fix maestro install and emulator boot
krystofwoldrich Oct 18, 2024
d675e3f
Fix apk install
krystofwoldrich Oct 18, 2024
8049612
fix apk name when testing
krystofwoldrich Oct 18, 2024
304f261
use maestro action
krystofwoldrich Oct 18, 2024
069f17d
fix the action name
krystofwoldrich Oct 18, 2024
7fc41c1
fix path
krystofwoldrich Oct 18, 2024
eab8424
Fix java and server tests
krystofwoldrich Oct 18, 2024
bba38d6
ref and fix server build
krystofwoldrich Oct 18, 2024
32c0ab6
fix maybe
krystofwoldrich Oct 18, 2024
9cbfacf
Update Makefile
stefanosiano Oct 21, 2024
88c7396
Update sentry-android-integration-tests/sentry-uitest-android-critica…
krystofwoldrich Oct 21, 2024
76a5eff
test(critical): Add API Level matrix
krystofwoldrich Oct 21, 2024
88f290b
fix maestro version
krystofwoldrich Oct 21, 2024
57cc5d8
Merge branch 'kw/test/add-critical-ui-tests' into kw/test/extend-crit…
krystofwoldrich Oct 21, 2024
229409c
Fix atd only runs on api level 30
krystofwoldrich Oct 21, 2024
85326e8
update 31 and newer runners
krystofwoldrich Oct 21, 2024
c332e7d
tmp: list available images
krystofwoldrich Oct 21, 2024
1e560ea
tmp: fix path
krystofwoldrich Oct 21, 2024
d4b00cb
change default arch for 31 and higher
krystofwoldrich Oct 21, 2024
0cf0a0c
tmp: remove images list
krystofwoldrich Oct 21, 2024
a99c02f
remove api level 29, the test would succeed but the runner timeout on…
krystofwoldrich Oct 22, 2024
5dda9c3
Merge branch 'main' into kw/test/extend-critical-tests-matrix
krystofwoldrich Oct 22, 2024
837a64f
test(critical): Add Mock Relay to verify crash envelope
krystofwoldrich Oct 22, 2024
d03418e
Format code
getsentry-bot Oct 22, 2024
a18acf3
Revert "Format code"
krystofwoldrich Oct 22, 2024
aa01a76
Revert "test(critical): Add Mock Relay to verify crash envelope"
krystofwoldrich Oct 22, 2024
84a09ab
Merge remote-tracking branch 'origin/main' into kw/test/extend-critic…
krystofwoldrich Oct 24, 2024
cc887cd
Merge branch 'main' into kw/test/extend-critical-tests-matrix
krystofwoldrich Oct 28, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
32 changes: 27 additions & 5 deletions .github/workflows/integration-tests-ui-critical.yml
Original file line number Diff line number Diff line change
Expand Up @@ -19,7 +19,7 @@ env:

jobs:
build:
name: Build sentry-uitest-android-critical
name: Build
runs-on: ubuntu-latest
steps:
- name: Checkout code
Expand Down Expand Up @@ -47,9 +47,30 @@ jobs:
retention-days: 1

run-maestro-tests:
name: Run Maestro Tests
name: Run Tests for API Level ${{ matrix.api-level }}
needs: build
runs-on: ubuntu-latest
strategy:
# we want that the matrix keeps running, default is to cancel them if it fails.
fail-fast: false
matrix:
include:
- api-level: 30 # Android 11
target: aosp_atd
channel: canary # Necessary for ATDs
arch: x86_64
- api-level: 31 # Android 12
target: aosp_atd
channel: canary # Necessary for ATDs
arch: x86_64
- api-level: 33 # Android 13
target: aosp_atd
channel: canary # Necessary for ATDs
arch: x86_64
- api-level: 34 # Android 14
target: aosp_atd
channel: canary # Necessary for ATDs
arch: x86_64
steps:
- name: Checkout code
uses: actions/checkout@v4
Expand Down Expand Up @@ -78,12 +99,13 @@ jobs:
- name: Run tests
uses: reactivecircus/android-emulator-runner@62dbb605bba737720e10b196cb4220d374026a6d # pin@v2.33.0
with:
api-level: 30
api-level: ${{ matrix.api-level }}
force-avd-creation: false
disable-animations: true
disable-spellchecker: true
target: 'aosp_atd'
channel: canary # Necessary for ATDs
target: ${{ matrix.target }}
channel: ${{ matrix.channel }}
arch: ${{ matrix.arch }}
emulator-options: >
-no-window
-no-snapshot-save
Expand Down
Loading