Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve performance for gcp uploads #383

Merged
merged 6 commits into from
Oct 16, 2022
Merged

Conversation

andrcuns
Copy link
Owner

@andrcuns andrcuns commented Oct 15, 2022

Implement batch uploads using gsutil to improve report upload performance and fix unstable upload results

Allure report

allure-report-publisher generated test report!

rspec: ✅ test report for 08b0a24c

+----------------------------------------------------------------+
|                       behaviors summary                        |
+-----------+--------+--------+---------+-------+-------+--------+
|           | passed | failed | skipped | flaky | total | result |
+-----------+--------+--------+---------+-------+-------+--------+
| commands  | 57     | 0      | 0       | 0     | 57    ||
| uploaders | 51     | 0      | 0       | 0     | 51    ||
| helpers   | 123    | 0      | 0       | 0     | 123   ||
| providers | 48     | 0      | 0       | 0     | 48    ||
| generator | 9      | 0      | 0       | 0     | 9     ||
| cli       | 3      | 0      | 0       | 0     | 3     ||
+-----------+--------+--------+---------+-------+-------+--------+
| Total     | 291    | 0      | 0       | 0     | 291   ||
+-----------+--------+--------+---------+-------+-------+--------+

@andrcuns andrcuns added the enhancement New enhancement label Oct 15, 2022
@codeclimate
Copy link

codeclimate bot commented Oct 15, 2022

Code Climate has analyzed commit b77fde0 and detected 0 issues on this pull request.

The test coverage on the diff in this pull request is 96.2% (50% is the threshold).

This pull request will bring the total coverage in the repository to 98.3% (0.0% change).

View more on Code Climate.

@andrcuns andrcuns force-pushed the improvement-gcs-performance branch 2 times, most recently from d5516ae to 9183996 Compare October 16, 2022 00:35
@andrcuns andrcuns force-pushed the improvement-gcs-performance branch 6 times, most recently from c8b410c to da9e888 Compare October 16, 2022 12:38
Improve execute shell command helper

Add explicit platforms to gemfile.lock

Add gsutil wrapper helper class

Correctly set up temp credentials for gsutil command
@andrcuns andrcuns force-pushed the improvement-gcs-performance branch from 08b0a24 to 9987f23 Compare October 16, 2022 14:20
@andrcuns andrcuns merged commit cac6388 into main Oct 16, 2022
@andrcuns andrcuns deleted the improvement-gcs-performance branch October 16, 2022 23:04
andrcuns added a commit that referenced this pull request Nov 7, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New enhancement
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant