Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix TestPipelineLevelFinally_OneDAGTaskFailed test to avoid false negative error #3722

Merged
merged 1 commit into from
Jan 27, 2021

Conversation

barthy1
Copy link
Member

@barthy1 barthy1 commented Jan 27, 2021

Changes

For TestPipelineLevelFinally_OneDAGTaskFailed_InvalidTaskResult_Failure test list of skipped tasks is checked. In case if order of actual skipped tasks is different than expected, test may fail despite equality between actual and expected skipped tasks.

    pipelinefinally_test.go:288: Expected four skipped tasks, dag task with condition failure dagtask3, dag task with when expression,two final tasks with missing result reference finaltaskconsumingdagtask1 and finaltaskconsumingdagtask4 in SkippedTasks. Diff: (-want, +got):   []v1beta1.SkippedTask{
          	{Name: "dagtask3"},
          	{Name: "dagtask4", WhenExpressions: {{Input: "foo", Operator: "notin", Values: {"foo"}}}},
          	{
        - 		Name:            "finaltaskconsumingdagtask4",
        + 		Name:            "finaltaskconsumingdagtask1",
          		WhenExpressions: nil,
          	},
          	{
        - 		Name:            "finaltaskconsumingdagtask1",
        + 		Name:            "finaltaskconsumingdagtask4",
          		WhenExpressions: nil,
          	},
          }
...
--- FAIL: TestPipelineLevelFinally_OneDAGTaskFailed_InvalidTaskResult_Failure (29.51s)

Sort of actual skipped tasks based on their names will fix this problem.

/kind failing-test

Submitter Checklist

These are the criteria that every PR should meet, please check them off as you
review them:

  • Includes tests (if functionality changed/added)
  • Includes docs (if user facing)
  • Commit messages follow commit message best practices
  • Release notes block has been filled in or deleted (only if no user facing changes)

See the contribution guide for more details.

Double check this list of stuff that's easy to miss:

Reviewer Notes

If API changes are included, additive changes must be approved by at least two OWNERS and backwards incompatible changes must be approved by more than 50% of the OWNERS, and they must first be added in a backwards compatible way.

Release Notes

NONE

…ative error

For TestPipelineLevelFinally_OneDAGTaskFailed_InvalidTaskResult_Failure
list of skipped tasks is checked. In case if order of actual skipped
tasks is different then expected, test fails despite equality between actual and expected skipped tasks.

Sort of actual skipped tasks order based on their names will fix this problem.

Signed-off-by: Yulia Gaponenko <yulia.gaponenko1@de.ibm.com>
@tekton-robot tekton-robot added release-note-none Denotes a PR that doesnt merit a release note. kind/failing-test Categorizes issue or PR as related to a consistently or frequently failing test. labels Jan 27, 2021
@tekton-robot tekton-robot added the size/XS Denotes a PR that changes 0-9 lines, ignoring generated files. label Jan 27, 2021
@tekton-robot tekton-robot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Jan 27, 2021
@barthy1
Copy link
Member Author

barthy1 commented Jan 27, 2021

/test check-pr-has-kind-label

Copy link
Member

@vdemeester vdemeester left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm

@tekton-robot tekton-robot added the lgtm Indicates that a PR is ready to be merged. label Jan 27, 2021
@tekton-robot
Copy link
Collaborator

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: sbwsg, vdemeester

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@tekton-robot tekton-robot merged commit d4a3aa2 into tektoncd:master Jan 27, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. kind/failing-test Categorizes issue or PR as related to a consistently or frequently failing test. lgtm Indicates that a PR is ready to be merged. release-note-none Denotes a PR that doesnt merit a release note. size/XS Denotes a PR that changes 0-9 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants