Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Retry failed integration tests #298

Merged
merged 1 commit into from
Jun 12, 2024
Merged

Retry failed integration tests #298

merged 1 commit into from
Jun 12, 2024

Conversation

hectorcast-db
Copy link
Contributor

Changes

Retry failed integration tests

Tests

Increase the retry count to 20, and replaced all tests by this test:

@Test
  void randomlyFail(WorkspaceClient w) {
    int randomNum = (int) (Math.random() * (5));
    assert randomNum == 2;
  }

Then run:

mvn verify

Results:

[INFO] Results:
[INFO] 
[WARNING] Flakes: 
[WARNING] com.databricks.sdk.integration.TestIT.randomlyFail(WorkspaceClient)
[ERROR]   Run 1: TestIT.randomlyFail:15
[ERROR]   Run 2:TestIT.randomlyFail:15
[ERROR]   Run 3: TestIT.randomlyFail:15
[ERROR]   Run 4: TestIT.randomlyFail:15
[ERROR]   Run 5: TestIT.randomlyFail:15
[ERROR]   Run 6: TestIT.randomlyFail:15
[INFO]   Run 7: PASS
[INFO] 
[INFO] 
[WARNING] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Flakes: 1
[INFO] 
[INFO] 
[INFO] --- failsafe:3.2.5:verify (default) @ databricks-sdk-java ---
[INFO] 
[INFO] --- jacoco:0.8.10:report (report) @ databricks-sdk-java ---
[INFO] Loading execution data file /Users/hector.castejon/databricks-sdk-java/databricks-sdk-java/target/jacoco.exec
[INFO] Analyzed bundle 'databricks-sdk-java' with 86 classes
[INFO] 
[INFO] --- jacoco:0.8.10:check (check) @ databricks-sdk-java ---
[INFO] Loading execution data file /Users/hector.castejon/databricks-sdk-java/databricks-sdk-java/target/jacoco.exec
[INFO] Analyzed bundle 'databricks-sdk-java' with 86 classes
[INFO] All coverage checks have been met.
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary for Databricks SDK for Java 0.26.0:
[INFO] 
[INFO] Databricks SDK for Java ............................ SUCCESS [  0.422 s]
[INFO] databricks-sdk-java ................................ SUCCESS [  7.317 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  7.809 s
[INFO] Finished at: 2024-06-11T15:49:49+02:00
[INFO] ------------------------------------------------------------------------

@hectorcast-db hectorcast-db added this pull request to the merge queue Jun 12, 2024
Merged via the queue into main with commit ffb7fb6 Jun 12, 2024
9 checks passed
@hectorcast-db hectorcast-db deleted the retry-failed-tests branch June 12, 2024 06:55
hectorcast-db added a commit that referenced this pull request Jun 25, 2024
### Improvements

 * Support partners in headers for SDK ([#291](#291)).
 * Add `serverless_compute_id` field to the config ([#299](#299)).

### Internal Changes

 * Ignore DataPlane Services during generation ([#296](#296)).
 * Update OpenAPI spec ([#297](#297)).
 * Retry failed integration tests ([#298](#298)).

### API Changes:

 * Changed `list()` method for `accountClient.storageCredentials()` service to return `com.databricks.sdk.service.catalog.ListAccountStorageCredentialsResponse` class.
 * Changed `isolationMode` field for `com.databricks.sdk.service.catalog.CatalogInfo` to `com.databricks.sdk.service.catalog.CatalogIsolationMode` class.
 * Added `isolationMode` field for `com.databricks.sdk.service.catalog.ExternalLocationInfo`.
 * Added `maxResults` and `pageToken` fields for `com.databricks.sdk.service.catalog.ListCatalogsRequest`.
 * Added `nextPageToken` field for `com.databricks.sdk.service.catalog.ListCatalogsResponse`.
 * Added `tableServingUrl` field for `com.databricks.sdk.service.catalog.OnlineTable`.
 * Added `isolationMode` field for `com.databricks.sdk.service.catalog.StorageCredentialInfo`.
 * Changed `isolationMode` field for `com.databricks.sdk.service.catalog.UpdateCatalog` to `com.databricks.sdk.service.catalog.CatalogIsolationMode` class.
 * Added `isolationMode` field for `com.databricks.sdk.service.catalog.UpdateExternalLocation`.
 * Added `isolationMode` field for `com.databricks.sdk.service.catalog.UpdateStorageCredential`.
 * Added `com.databricks.sdk.service.catalog.CatalogIsolationMode` and `com.databricks.sdk.service.catalog.ListAccountStorageCredentialsResponse` class.es
 * Added `createSchedule()`, `createSubscription()`, `deleteSchedule()`, `deleteSubscription()`, `getSchedule()`, `getSubscription()`, `list()`, `listSchedules()`, `listSubscriptions()` and `updateSchedule()` methods for `workspaceClient.lakeview()` service.
 * Added `com.databricks.sdk.service.dashboards.CreateScheduleRequest`, `com.databricks.sdk.service.dashboards.CreateSubscriptionRequest`, `com.databricks.sdk.service.dashboards.CronSchedule`, `com.databricks.sdk.service.dashboards.DashboardView`, `com.databricks.sdk.service.dashboards.DeleteScheduleRequest`, `com.databricks.sdk.service.dashboards.DeleteSubscriptionRequest`, `com.databricks.sdk.service.dashboards.GetScheduleRequest`, `com.databricks.sdk.service.dashboards.GetSubscriptionRequest`, `com.databricks.sdk.service.dashboards.ListDashboardsRequest`, `com.databricks.sdk.service.dashboards.ListDashboardsResponse`,`com.databricks.sdk.service.dashboards.ListSchedulesRequest`, `com.databricks.sdk.service.dashboards.ListSchedulesResponse`, `com.databricks.sdk.service.dashboards.ListSubscriptionsRequest`, `com.databricks.sdk.service.dashboards.ListSubscriptionsResponse`, `com.databricks.sdk.service.dashboards.Schedule`, `com.databricks.sdk.service.dashboards.SchedulePauseStatus`, `com.databricks.sdk.service.dashboards.Subscriber`, `com.databricks.sdk.service.dashboards.Subscription`, `com.databricks.sdk.service.dashboards.SubscriptionSubscriberDestination`, `com.databricks.sdk.service.dashboards.SubscriptionSubscriberUser`and `com.databricks.sdk.service.dashboards.UpdateScheduleRequest` classes.
 * Added `terminationCategory` field for `com.databricks.sdk.service.jobs.ForEachTaskErrorMessageStats`.
 * Added `onStreamingBacklogExceeded` field for `com.databricks.sdk.service.jobs.JobEmailNotifications`.
 * Added `environmentKey` field for `com.databricks.sdk.service.jobs.RunTask`.
 * Removed `conditionTask`, `dbtTask`, `notebookTask`, `pipelineTask`, `pythonWheelTask`, `runJobTask`, `sparkJarTask`, `sparkPythonTask`, `sparkSubmitTask` and `sqlTask` fields for `com.databricks.sdk.service.jobs.SubmitRun`.
 * Added `environments` field for `com.databricks.sdk.service.jobs.SubmitRun`.
 * Added `dbtTask` field for `com.databricks.sdk.service.jobs.SubmitTask`.
 * Added `environmentKey` field for `com.databricks.sdk.service.jobs.SubmitTask`.
 * Added `onStreamingBacklogExceeded` field for `com.databricks.sdk.service.jobs.TaskEmailNotifications`.
 * Added `periodic` field for `com.databricks.sdk.service.jobs.TriggerSettings`.
 * Added `onStreamingBacklogExceeded` field for `com.databricks.sdk.service.jobs.WebhookNotifications`.
 * Added `com.databricks.sdk.service.jobs.PeriodicTriggerConfiguration` and `com.databricks.sdk.service.jobs.PeriodicTriggerConfigurationTimeUnit` classes.
 * Added `batchGet()` method for `workspaceClient.consumerListings()` service.
 * Added `batchGet()` method for `workspaceClient.consumerProviders()` service.
 * Added `providerSummary` field for `com.databricks.sdk.service.marketplace.Listing`.
 * Added `com.databricks.sdk.service.marketplace.BatchGetListingsRequest`, `com.databricks.sdk.service.marketplace.BatchGetListingsResponse`, `com.databricks.sdk.service.marketplace.BatchGetProvidersRequest`, `com.databricks.sdk.service.marketplace.BatchGetProvidersResponse`, `com.databricks.sdk.service.marketplace.ProviderIconFile`, `com.databricks.sdk.service.marketplace.ProviderIconType`, `com.databricks.sdk.service.marketplace.ProviderListingSummaryInfo` and `com.databricks.sdk.service.oauth2.DataPlaneInfo` classes.
 * Removed `createDeployment()` method for `workspaceClient.apps()` service.
 * Added `deploy()` and `start()` methods for `workspaceClient.apps()` service.
 * Added `workspaceClient.servingEndpointsDataPlane()` service.
 * Added `servicePrincipalId` field for `com.databricks.sdk.service.serving.App`.
 * Added `servicePrincipalName` field for `com.databricks.sdk.service.serving.App`.
 * Added `mode` field for `com.databricks.sdk.service.serving.AppDeployment`.
 * Added `mode` field for `com.databricks.sdk.service.serving.CreateAppDeploymentRequest`.
 * Added `dataPlaneInfo` field for `com.databricks.sdk.service.serving.ServingEndpointDetailed`.
 * Added `com.databricks.sdk.service.serving.AppDeploymentMode` class.
 * Added `com.databricks.sdk.service.serving.ModelDataPlaneInfo` class.
 * Added `com.databricks.sdk.service.serving.StartAppRequest` class.
 * Added `queryNextPage()` method for `workspaceClient.vectorSearchIndexes()` service.
 * Added `queryType` field for `com.databricks.sdk.service.vectorsearch.QueryVectorIndexRequest`.
 * Added `nextPageToken` field for `com.databricks.sdk.service.vectorsearch.QueryVectorIndexResponse`.
 * Added `com.databricks.sdk.service.vectorsearch.QueryVectorIndexNextPageRequest` class.

OpenAPI SHA: 7437dabb9dadee402c1fc060df4c1ce8cc5369f0, Date: 2024-06-24
@hectorcast-db hectorcast-db mentioned this pull request Jun 25, 2024
github-merge-queue bot pushed a commit that referenced this pull request Jun 25, 2024
### Improvements
 
* Support partners in headers for SDK
([#291](#291)).
* Add `serverless_compute_id` field to the config
([#299](#299)).


### Internal Changes
 
* Ignore DataPlane Services during generation
([#296](#296)).
* Update OpenAPI spec
([#297](#297)).
* Retry failed integration tests
([#298](#298)).


### API Changes:

* Changed `list()` method for `accountClient.storageCredentials()`
service to return
`com.databricks.sdk.service.catalog.ListAccountStorageCredentialsResponse`
class.
* Changed `isolationMode` field for
`com.databricks.sdk.service.catalog.CatalogInfo` to
`com.databricks.sdk.service.catalog.CatalogIsolationMode` class.
* Added `isolationMode` field for
`com.databricks.sdk.service.catalog.ExternalLocationInfo`.
* Added `maxResults` and `pageToken` fields for
`com.databricks.sdk.service.catalog.ListCatalogsRequest`.
* Added `nextPageToken` field for
`com.databricks.sdk.service.catalog.ListCatalogsResponse`.
* Added `tableServingUrl` field for
`com.databricks.sdk.service.catalog.OnlineTable`.
* Added `isolationMode` field for
`com.databricks.sdk.service.catalog.StorageCredentialInfo`.
* Changed `isolationMode` field for
`com.databricks.sdk.service.catalog.UpdateCatalog` to
`com.databricks.sdk.service.catalog.CatalogIsolationMode` class.
* Added `isolationMode` field for
`com.databricks.sdk.service.catalog.UpdateExternalLocation`.
* Added `isolationMode` field for
`com.databricks.sdk.service.catalog.UpdateStorageCredential`.
* Added `com.databricks.sdk.service.catalog.CatalogIsolationMode` and
`com.databricks.sdk.service.catalog.ListAccountStorageCredentialsResponse`
class.es
* Added `createSchedule()`, `createSubscription()`, `deleteSchedule()`,
`deleteSubscription()`, `getSchedule()`, `getSubscription()`, `list()`,
`listSchedules()`, `listSubscriptions()` and `updateSchedule()` methods
for `workspaceClient.lakeview()` service.
* Added `com.databricks.sdk.service.dashboards.CreateScheduleRequest`,
`com.databricks.sdk.service.dashboards.CreateSubscriptionRequest`,
`com.databricks.sdk.service.dashboards.CronSchedule`,
`com.databricks.sdk.service.dashboards.DashboardView`,
`com.databricks.sdk.service.dashboards.DeleteScheduleRequest`,
`com.databricks.sdk.service.dashboards.DeleteSubscriptionRequest`,
`com.databricks.sdk.service.dashboards.GetScheduleRequest`,
`com.databricks.sdk.service.dashboards.GetSubscriptionRequest`,
`com.databricks.sdk.service.dashboards.ListDashboardsRequest`,
`com.databricks.sdk.service.dashboards.ListDashboardsResponse`,`com.databricks.sdk.service.dashboards.ListSchedulesRequest`,
`com.databricks.sdk.service.dashboards.ListSchedulesResponse`,
`com.databricks.sdk.service.dashboards.ListSubscriptionsRequest`,
`com.databricks.sdk.service.dashboards.ListSubscriptionsResponse`,
`com.databricks.sdk.service.dashboards.Schedule`,
`com.databricks.sdk.service.dashboards.SchedulePauseStatus`,
`com.databricks.sdk.service.dashboards.Subscriber`,
`com.databricks.sdk.service.dashboards.Subscription`,
`com.databricks.sdk.service.dashboards.SubscriptionSubscriberDestination`,
`com.databricks.sdk.service.dashboards.SubscriptionSubscriberUser`and
`com.databricks.sdk.service.dashboards.UpdateScheduleRequest` classes.
* Added `terminationCategory` field for
`com.databricks.sdk.service.jobs.ForEachTaskErrorMessageStats`.
* Added `onStreamingBacklogExceeded` field for
`com.databricks.sdk.service.jobs.JobEmailNotifications`.
* Added `environmentKey` field for
`com.databricks.sdk.service.jobs.RunTask`.
* Removed `conditionTask`, `dbtTask`, `notebookTask`, `pipelineTask`,
`pythonWheelTask`, `runJobTask`, `sparkJarTask`, `sparkPythonTask`,
`sparkSubmitTask` and `sqlTask` fields for
`com.databricks.sdk.service.jobs.SubmitRun`.
* Added `environments` field for
`com.databricks.sdk.service.jobs.SubmitRun`.
* Added `dbtTask` field for
`com.databricks.sdk.service.jobs.SubmitTask`.
* Added `environmentKey` field for
`com.databricks.sdk.service.jobs.SubmitTask`.
* Added `onStreamingBacklogExceeded` field for
`com.databricks.sdk.service.jobs.TaskEmailNotifications`.
* Added `periodic` field for
`com.databricks.sdk.service.jobs.TriggerSettings`.
* Added `onStreamingBacklogExceeded` field for
`com.databricks.sdk.service.jobs.WebhookNotifications`.
* Added `com.databricks.sdk.service.jobs.PeriodicTriggerConfiguration`
and
`com.databricks.sdk.service.jobs.PeriodicTriggerConfigurationTimeUnit`
classes.
* Added `batchGet()` method for `workspaceClient.consumerListings()`
service.
* Added `batchGet()` method for `workspaceClient.consumerProviders()`
service.
* Added `providerSummary` field for
`com.databricks.sdk.service.marketplace.Listing`.
* Added
`com.databricks.sdk.service.marketplace.BatchGetListingsRequest`,
`com.databricks.sdk.service.marketplace.BatchGetListingsResponse`,
`com.databricks.sdk.service.marketplace.BatchGetProvidersRequest`,
`com.databricks.sdk.service.marketplace.BatchGetProvidersResponse`,
`com.databricks.sdk.service.marketplace.ProviderIconFile`,
`com.databricks.sdk.service.marketplace.ProviderIconType`,
`com.databricks.sdk.service.marketplace.ProviderListingSummaryInfo` and
`com.databricks.sdk.service.oauth2.DataPlaneInfo` classes.
* Removed `createDeployment()` method for `workspaceClient.apps()`
service.
* Added `deploy()` and `start()` methods for `workspaceClient.apps()`
service.
 * Added `workspaceClient.servingEndpointsDataPlane()` service.
* Added `servicePrincipalId` field for
`com.databricks.sdk.service.serving.App`.
* Added `servicePrincipalName` field for
`com.databricks.sdk.service.serving.App`.
* Added `mode` field for
`com.databricks.sdk.service.serving.AppDeployment`.
* Added `mode` field for
`com.databricks.sdk.service.serving.CreateAppDeploymentRequest`.
* Added `dataPlaneInfo` field for
`com.databricks.sdk.service.serving.ServingEndpointDetailed`.
 * Added `com.databricks.sdk.service.serving.AppDeploymentMode` class.
 * Added `com.databricks.sdk.service.serving.ModelDataPlaneInfo` class.
 * Added `com.databricks.sdk.service.serving.StartAppRequest` class.
* Added `queryNextPage()` method for
`workspaceClient.vectorSearchIndexes()` service.
* Added `queryType` field for
`com.databricks.sdk.service.vectorsearch.QueryVectorIndexRequest`.
* Added `nextPageToken` field for
`com.databricks.sdk.service.vectorsearch.QueryVectorIndexResponse`.
* Added
`com.databricks.sdk.service.vectorsearch.QueryVectorIndexNextPageRequest`
class.

OpenAPI SHA: 7437dabb9dadee402c1fc060df4c1ce8cc5369f0, Date: 2024-06-24
github-merge-queue bot pushed a commit that referenced this pull request Jul 9, 2024
## Changes
Improve Changelog by grouping changes

## Tests
Recreated latest release Changelog:
```
Release v0.27.0

### Other Changes

 * Add `serverless_compute_id` field to the config ([#299](#299)).
 * Ignore DataPlane Services during generation ([#296](#296)).
 * Release v0.27.0 ([#301](#301)).
 * Retry failed integration tests ([#298](#298)).
 * Support partners in SDK ([#291](#291)).
 * Test parsing of error messages with `int` error codes ([#303](#303)).
 * Update OpenAPI spec ([#297](#297)).


### API Changes:

 * Added `workspaceClient.servingEndpointsDataPlane()` service.
 * Added `deploy()` and `start()` methods for `workspaceClient.apps()` service.
 * Added `batchGet()` method for `workspaceClient.consumerListings()` service.
 * Added `batchGet()` method for `workspaceClient.consumerProviders()` service.
 * Added `createSchedule()`, `createSubscription()`, `deleteSchedule()`, `deleteSubscription()`, `getSchedule()`, `getSubscription()`, `list()`, `listSchedules()`, `listSubscriptions()` and `updateSchedule()` methods for `workspaceClient.lakeview()` service.
 * Added `queryNextPage()` method for `workspaceClient.vectorSearchIndexes()` service.
 * Added `com.databricks.sdk.service.serving.AppDeploymentMode`, `com.databricks.sdk.service.serving.ModelDataPlaneInfo` and `com.databricks.sdk.service.serving.StartAppRequest` classes.
 * Added `com.databricks.sdk.service.catalog.CatalogIsolationMode` and `com.databricks.sdk.service.catalog.ListAccountStorageCredentialsResponse` classes.
 * Added `com.databricks.sdk.service.dashboards.CreateScheduleRequest`, `com.databricks.sdk.service.dashboards.CreateSubscriptionRequest`, `com.databricks.sdk.service.dashboards.CronSchedule`, `com.databricks.sdk.service.dashboards.DashboardView`, `com.databricks.sdk.service.dashboards.DeleteScheduleRequest`, `Object`, `com.databricks.sdk.service.dashboards.DeleteSubscriptionRequest`, `Object`, `com.databricks.sdk.service.dashboards.GetScheduleRequest`, `com.databricks.sdk.service.dashboards.GetSubscriptionRequest`, `com.databricks.sdk.service.dashboards.ListDashboardsRequest`, `com.databricks.sdk.service.dashboards.ListDashboardsResponse`, `com.databricks.sdk.service.dashboards.ListSchedulesRequest`, `com.databricks.sdk.service.dashboards.ListSchedulesResponse`, `com.databricks.sdk.service.dashboards.ListSubscriptionsRequest`, `com.databricks.sdk.service.dashboards.ListSubscriptionsResponse`, `com.databricks.sdk.service.dashboards.Schedule`, `com.databricks.sdk.service.dashboards.SchedulePauseStatus`, `com.databricks.sdk.service.dashboards.Subscriber`, `com.databricks.sdk.service.dashboards.Subscription`, `com.databricks.sdk.service.dashboards.SubscriptionSubscriberDestination`, `com.databricks.sdk.service.dashboards.SubscriptionSubscriberUser` and `com.databricks.sdk.service.dashboards.UpdateScheduleRequest` classes.
 * Added `com.databricks.sdk.service.jobs.PeriodicTriggerConfiguration` and `com.databricks.sdk.service.jobs.PeriodicTriggerConfigurationTimeUnit` classes.
 * Added `com.databricks.sdk.service.marketplace.BatchGetListingsRequest`, `com.databricks.sdk.service.marketplace.BatchGetListingsResponse`, `com.databricks.sdk.service.marketplace.BatchGetProvidersRequest`, `com.databricks.sdk.service.marketplace.BatchGetProvidersResponse`, `com.databricks.sdk.service.marketplace.ProviderIconFile`, `com.databricks.sdk.service.marketplace.ProviderIconType` and `com.databricks.sdk.service.marketplace.ProviderListingSummaryInfo` classes.
 * Added `com.databricks.sdk.service.oauth2.DataPlaneInfo` class.
 * Added `com.databricks.sdk.service.vectorsearch.QueryVectorIndexNextPageRequest` class.
 * Added `isolationMode` field for `com.databricks.sdk.service.catalog.ExternalLocationInfo`.
 * Added `maxResults` and `pageToken` fields for `com.databricks.sdk.service.catalog.ListCatalogsRequest`.
 * Added `nextPageToken` field for `com.databricks.sdk.service.catalog.ListCatalogsResponse`.
 * Added `tableServingUrl` field for `com.databricks.sdk.service.catalog.OnlineTable`.
```
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants