Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[PH] Performance Harness improvements #1195

Merged
merged 15 commits into from
May 22, 2023
Merged

Conversation

oschwaldp-oci
Copy link
Contributor

@oschwaldp-oci oschwaldp-oci commented May 18, 2023

  1. Allow setting tps floor (--min-tps-to-test) for search range in performance_test
  2. Provide success/failure indication for Performance Test Basic report
  3. Make integration test names unique to allow easier running of individual tests in ctest
  4. Additional refactoring for clarity and some small additions to reporting for ease of information access

…ce_test_basic.

This allows knowledge of objective and subjective test scenario success outcomes at the basic test level.

Add reporting of summary of search scenarios for quick reference.

Add test duration calculation to report for quick reference.
Move report creation out of log_reader into the more appropriate performance test basic. Now only parse and analyze logs in log_reader and leave report creation to the test itself.

Add Search Scenarios Summary of results to the performance test report to give a quick overview of the scenarios and success/failure for each.

Consolidate json report creation and exporting into a single location in JsonReportHandler.

Added test duration calculation to report for easy reference.
@heifner heifner added the OCI Work exclusive to OCI team label May 18, 2023
@heifner heifner added this to the Leap v5.0.0-rc1 milestone May 18, 2023
@oschwaldp-oci oschwaldp-oci requested a review from ScottBailey May 18, 2023 12:54
@oschwaldp-oci oschwaldp-oci merged commit ef9c176 into main May 22, 2023
@oschwaldp-oci oschwaldp-oci deleted the ph-perf-test-improvements branch May 22, 2023 21:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
OCI Work exclusive to OCI team
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants