Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test(e2e): Feedback Widget Maestro tests #4604

Draft
wants to merge 3 commits into
base: main
Choose a base branch
from
Draft

Conversation

antonis
Copy link
Collaborator

@antonis antonis commented Feb 26, 2025

📢 Type of change

  • Bugfix
  • New feature
  • Enhancement
  • Refactoring

📜 Description

💡 Motivation and Context

💚 How did you test it?

📝 Checklist

  • I added tests to verify changes
  • No new PII added or SDK only sends newly added PII if sendDefaultPII is enabled
  • I updated the docs if needed.
  • I updated the wizard if needed.
  • All tests passing
  • No breaking changes

🔮 Next steps

#skip-changelog

Copy link
Contributor

Android (legacy) Performance metrics 🚀

  Plain With Sentry Diff
Startup time 304.77 ms 337.51 ms 32.74 ms
Size 17.75 MiB 20.12 MiB 2.37 MiB

Baseline results on branch: main

Startup times

Revision Plain With Sentry Diff
c6f01ea 486.20 ms 486.98 ms 0.77 ms
d16beca 448.87 ms 447.20 ms -1.67 ms
12427f4 393.69 ms 414.84 ms 21.14 ms
a0b0298 427.50 ms 428.10 ms 0.60 ms
43e66e0 373.32 ms 366.57 ms -6.75 ms
6707be9 445.04 ms 464.24 ms 19.20 ms
6a667d6 485.15 ms 541.62 ms 56.47 ms
b6f8ea2 472.49 ms 469.60 ms -2.89 ms
0ebca77 414.93 ms 444.49 ms 29.56 ms
db44eaf 437.65 ms 436.06 ms -1.59 ms

App size

Revision Plain With Sentry Diff
c6f01ea 17.74 MiB 20.10 MiB 2.36 MiB
d16beca 17.74 MiB 20.10 MiB 2.36 MiB
12427f4 17.73 MiB 19.85 MiB 2.12 MiB
a0b0298 17.75 MiB 20.12 MiB 2.37 MiB
43e66e0 17.74 MiB 20.09 MiB 2.35 MiB
6707be9 17.75 MiB 20.11 MiB 2.37 MiB
6a667d6 17.75 MiB 20.11 MiB 2.36 MiB
b6f8ea2 17.75 MiB 20.11 MiB 2.36 MiB
0ebca77 17.73 MiB 19.95 MiB 2.21 MiB
db44eaf 17.74 MiB 20.08 MiB 2.35 MiB

Copy link
Contributor

iOS (legacy) Performance metrics 🚀

  Plain With Sentry Diff
Startup time 1224.80 ms 1229.92 ms 5.12 ms
Size 2.63 MiB 3.75 MiB 1.12 MiB

Baseline results on branch: main

Startup times

Revision Plain With Sentry Diff
57448c5+dirty 1228.73 ms 1235.90 ms 7.16 ms
6c56eb1+dirty 1224.29 ms 1232.00 ms 7.71 ms
30189be+dirty 1205.04 ms 1226.73 ms 21.69 ms
4cc5c27+dirty 1211.45 ms 1214.60 ms 3.16 ms
d43a46b+dirty 1219.24 ms 1219.65 ms 0.41 ms
8900e1a+dirty 1210.27 ms 1218.66 ms 8.39 ms
2dc8f22+dirty 1224.88 ms 1212.40 ms -12.47 ms
62a750b+dirty 1216.60 ms 1229.14 ms 12.54 ms
acadc0f+dirty 1264.38 ms 1290.06 ms 25.68 ms
9a3ca65+dirty 1247.06 ms 1274.58 ms 27.52 ms

App size

Revision Plain With Sentry Diff
57448c5+dirty 2.36 MiB 3.10 MiB 752.34 KiB
6c56eb1+dirty 2.36 MiB 3.11 MiB 759.87 KiB
30189be+dirty 2.63 MiB 3.70 MiB 1.06 MiB
4cc5c27+dirty 2.36 MiB 3.04 MiB 698.52 KiB
d43a46b+dirty 2.36 MiB 3.08 MiB 734.25 KiB
8900e1a+dirty 2.36 MiB 2.83 MiB 479.25 KiB
2dc8f22+dirty 2.63 MiB 3.69 MiB 1.05 MiB
62a750b+dirty 2.36 MiB 2.92 MiB 570.00 KiB
acadc0f+dirty 2.36 MiB 2.83 MiB 480.37 KiB
9a3ca65+dirty 2.36 MiB 2.82 MiB 462.89 KiB

Copy link
Contributor

Android (new) Performance metrics 🚀

  Plain With Sentry Diff
Startup time 382.37 ms 393.08 ms 10.71 ms
Size 7.15 MiB 8.39 MiB 1.23 MiB

Baseline results on branch: main

Startup times

Revision Plain With Sentry Diff
a0df630+dirty 360.73 ms 406.64 ms 45.91 ms
30189be+dirty 362.02 ms 386.80 ms 24.78 ms
83f6f6c+dirty 442.82 ms 487.48 ms 44.66 ms
8e80789+dirty 464.48 ms 551.10 ms 86.63 ms
7143e6f+dirty 338.60 ms 374.92 ms 36.32 ms
7e87527+dirty 406.35 ms 465.24 ms 58.90 ms
70caa60+dirty 308.83 ms 393.06 ms 84.23 ms
e540498+dirty 408.56 ms 480.00 ms 71.44 ms
b6f8ea2+dirty 397.51 ms 457.40 ms 59.88 ms
8bda0cc+dirty 383.08 ms 417.40 ms 34.32 ms

App size

Revision Plain With Sentry Diff
a0df630+dirty 7.15 MiB 8.38 MiB 1.23 MiB
30189be+dirty 7.15 MiB 8.38 MiB 1.23 MiB
83f6f6c+dirty 7.15 MiB 8.37 MiB 1.22 MiB
8e80789+dirty 7.15 MiB 8.37 MiB 1.22 MiB
7143e6f+dirty 7.15 MiB 8.38 MiB 1.23 MiB
7e87527+dirty 7.15 MiB 8.38 MiB 1.23 MiB
70caa60+dirty 7.15 MiB 8.03 MiB 901.79 KiB
e540498+dirty 7.15 MiB 8.38 MiB 1.23 MiB
b6f8ea2+dirty 7.15 MiB 8.38 MiB 1.23 MiB
8bda0cc+dirty 7.15 MiB 8.38 MiB 1.23 MiB

Copy link
Contributor

iOS (new) Performance metrics 🚀

  Plain With Sentry Diff
Startup time 1220.02 ms 1217.43 ms -2.59 ms
Size 3.19 MiB 4.32 MiB 1.13 MiB

Baseline results on branch: main

Startup times

Revision Plain With Sentry Diff
57448c5+dirty 1244.65 ms 1249.20 ms 4.55 ms
6c56eb1+dirty 1240.96 ms 1243.41 ms 2.45 ms
30189be+dirty 1228.73 ms 1219.06 ms -9.67 ms
4cc5c27+dirty 1220.43 ms 1215.13 ms -5.30 ms
d43a46b+dirty 1223.31 ms 1230.92 ms 7.61 ms
8900e1a+dirty 1268.36 ms 1273.04 ms 4.68 ms
2dc8f22+dirty 1215.43 ms 1206.68 ms -8.75 ms
62a750b+dirty 1228.12 ms 1230.53 ms 2.41 ms
acadc0f+dirty 1271.12 ms 1272.28 ms 1.16 ms
9a3ca65+dirty 1276.40 ms 1279.14 ms 2.74 ms

App size

Revision Plain With Sentry Diff
57448c5+dirty 2.92 MiB 3.66 MiB 756.65 KiB
6c56eb1+dirty 2.92 MiB 3.67 MiB 772.48 KiB
30189be+dirty 3.19 MiB 4.26 MiB 1.08 MiB
4cc5c27+dirty 2.92 MiB 3.61 MiB 705.47 KiB
d43a46b+dirty 2.92 MiB 3.64 MiB 740.29 KiB
8900e1a+dirty 2.92 MiB 3.39 MiB 485.96 KiB
2dc8f22+dirty 3.19 MiB 4.25 MiB 1.06 MiB
62a750b+dirty 2.92 MiB 3.48 MiB 575.59 KiB
acadc0f+dirty 2.92 MiB 3.39 MiB 487.34 KiB
9a3ca65+dirty 2.92 MiB 3.37 MiB 464.32 KiB

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant