Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix flaky behavior with "list namespaces/projects -o json" integration tests #6355

Conversation

rm3l
Copy link
Member

@rm3l rm3l commented Nov 28, 2022

What type of PR is this:
/kind bug
/area testing

What does this PR do / why we need it:
I noticed repeating issues with this test on a few PRs.

For some reason, odo list namespaces/projects would contain the current test namespace, but the subsequent odo list namespaces/projects -o json would no longer contain this namespace.
After taking a look at Gomega doc, this PR changes the test so that it only relies on what is actually needed for the test and uses expectations on the JSON output only.

Which issue(s) this PR fixes:

PR acceptance criteria:

  • Unit test

  • Integration test

  • Documentation

How to test changes / Special notes to the reviewer:

@rm3l rm3l added this to the v3.4.0 🚀 milestone Nov 28, 2022
@netlify
Copy link

netlify bot commented Nov 28, 2022

Deploy Preview for odo-docusaurus-preview canceled.

Name Link
🔨 Latest commit d501fa0
🔍 Latest deploy log https://app.netlify.com/sites/odo-docusaurus-preview/deploys/63860420f2cc2700088103ed

@openshift-ci openshift-ci bot added kind/bug Categorizes issue or PR as related to a bug. area/testing Issues or PRs related to testing, Quality Assurance or Quality Engineering labels Nov 28, 2022
@openshift-ci openshift-ci bot requested review from feloy and valaparthvi November 28, 2022 16:16
@rm3l rm3l changed the title Fix flaky behavior with "list namespaces/projects" integration tests Fix flaky behavior with "list namespaces/projects -o json" integration tests Nov 28, 2022
@odo-robot
Copy link

odo-robot bot commented Nov 28, 2022

NoCluster Tests on commit c114643 finished successfully.
View logs: TXT HTML

@odo-robot
Copy link

odo-robot bot commented Nov 28, 2022

Unit Tests on commit c114643 finished successfully.
View logs: TXT HTML

@odo-robot
Copy link

odo-robot bot commented Nov 28, 2022

Validate Tests on commit c114643 finished successfully.
View logs: TXT HTML

@odo-robot
Copy link

odo-robot bot commented Nov 28, 2022

Windows Tests (OCP) on commit c114643 finished successfully.
View logs: TXT HTML

@odo-robot
Copy link

odo-robot bot commented Nov 28, 2022

OpenShift Tests on commit c114643 finished successfully.
View logs: TXT HTML

@odo-robot
Copy link

odo-robot bot commented Nov 28, 2022

Kubernetes Tests on commit c114643 finished successfully.
View logs: TXT HTML

For some reason, "odo list namespaces/projects" would contain
the current test namespace, but the subsequent
"odo list namespaces/projects -o json" would no longer
contain this namespace.
@rm3l rm3l force-pushed the fix_list_namespaces_integration_tests branch from ffeeb25 to d501fa0 Compare November 29, 2022 13:07
@sonarqubecloud
Copy link

Kudos, SonarCloud Quality Gate passed!    Quality Gate passed

Bug A 0 Bugs
Vulnerability A 0 Vulnerabilities
Security Hotspot A 0 Security Hotspots
Code Smell A 0 Code Smells

No Coverage information No Coverage information
0.0% 0.0% Duplication

@feloy
Copy link
Contributor

feloy commented Nov 29, 2022

/lgtm
/approve

/override ci/prow/v4.11-integration-e2e

@openshift-ci openshift-ci bot added the lgtm Indicates that a PR is ready to be merged. Required by Prow. label Nov 29, 2022
@openshift-ci
Copy link

openshift-ci bot commented Nov 29, 2022

@feloy: Overrode contexts on behalf of feloy: ci/prow/v4.11-integration-e2e

In response to this:

/lgtm
/approve

/override ci/prow/v4.11-integration-e2e

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@openshift-ci
Copy link

openshift-ci bot commented Nov 29, 2022

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: feloy

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci openshift-ci bot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. Required by Prow. label Nov 29, 2022
@feloy
Copy link
Contributor

feloy commented Nov 29, 2022

Thanks for this PR.
This function signature for Eventually is interesting

@openshift-merge-robot openshift-merge-robot merged commit 70c5bd5 into redhat-developer:main Nov 29, 2022
@rm3l rm3l deleted the fix_list_namespaces_integration_tests branch November 29, 2022 20:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. Required by Prow. area/testing Issues or PRs related to testing, Quality Assurance or Quality Engineering kind/bug Categorizes issue or PR as related to a bug. lgtm Indicates that a PR is ready to be merged. Required by Prow.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants