Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore: remove flaky websocket test #158

Merged
merged 1 commit into from
Sep 3, 2024

Conversation

corymhall
Copy link
Contributor

Unfortunately the websocket test is too flaky and has been failing
frequently (#157, #155). Removing the piece that validates the dynamodb
record exists in the table since that is the part that is too flaky.

fixes #157

Unfortunately the websocket test is too flaky and has been failing
frequently (#157, #155). Removing the piece that validates the dynamodb
record exists in the table since that is the part that is too flaky.

fixes #157
@@ -156,55 +148,22 @@ func retryFunc(t *testing.T, fn func() bool) error {
}
}

// isConnected validates that the $connect lambda was triggered successfully by
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm wondering whether we should leave the example in if it's too flaky.
It's not the best experience if somebody tries it out and can't get it working (even if the problem is not on the Pulumi end)

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah you are probably right. I also think websockets is a weird example to pick, we should probably switch the example to just be a normal HTTP api.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good question! I think of examples and tests as serving two distinct purposes. If the test bits (verification) are flaky, but the users can still cd example/foo && pulumi up then it still might have value as an example and worth leaving in.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@corymhall corymhall merged commit 0cad908 into main Sep 3, 2024
8 checks passed
@corymhall corymhall deleted the corymhall/fix-flaky-websocket-test branch September 3, 2024 18:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Workflow failure: main
3 participants