Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Failing test: Security Solution Cypress.x-pack/plugins/security_solution/public/management/cypress/e2e/response_actions/response_console_actions·cy·ts - Response console User journey for Processes operations: list, kill and suspend process "before all" hook for ""processes" - should obtain a list of processes" "before all" hook for ""processes" - should obtain a list of processes" #169465

Closed
kibanamachine opened this issue Oct 20, 2023 · 3 comments
Assignees
Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:Defend Workflows “EDR Workflows” sub-team of Security Solution

Comments

@kibanamachine
Copy link
Contributor

kibanamachine commented Oct 20, 2023

A test failed on a tracked branch

CypressError: `cy.task('createEndpointHost')` failed with the following error:

> Timed out waiting for host [test-host-6187] to show up in Fleet

https://on.cypress.io/api/task

Because this error occurred during a `before all` hook we are skipping the remaining tests in the current suite: `User journey for Processes ...`

Although you have test retries enabled, we do not retry tests when `before all` or `after all` hooks fail
    at <unknown> (http://localhost:5633/__cypress/runner/cypress_runner.js:135296:70)
    at tryCatcher (http://localhost:5633/__cypress/runner/cypress_runner.js:1807:23)
    at Promise._settlePromiseFromHandler (http://localhost:5633/__cypress/runner/cypress_runner.js:1519:31)
    at Promise._settlePromise (http://localhost:5633/__cypress/runner/cypress_runner.js:1576:18)
    at Promise._settlePromise0 (http://localhost:5633/__cypress/runner/cypress_runner.js:1621:10)
    at Promise._settlePromises (http://localhost:5633/__cypress/runner/cypress_runner.js:1697:18)
    at _drainQueueStep (http://localhost:5633/__cypress/runner/cypress_runner.js:2407:12)
    at _drainQueue (http://localhost:5633/__cypress/runner/cypress_runner.js:2400:9)
    at Async._drainQueues (http://localhost:5633/__cypress/runner/cypress_runner.js:2416:5)
    at Async.drainQueues (http://localhost:5633/__cypress/runner/cypress_runner.js:2286:14)
From Your Spec Code:
    at createEndpointHost (webpack:///./tasks/create_endpoint_host.ts:15:12)
    at Context.eval (webpack:///./e2e/response_actions/response_console_actions.cy.ts:111:38)

From Node.js Internals:
  Error: Timed out waiting for host [test-host-6187] to show up in Fleet
      at waitForHostToEnroll (/opt/local-ssd/buildkite/builds/kb-n2-4-virt-1080a7f1029b19c6/elastic/kibana-on-merge/kibana/x-pack/plugins/security_solution/scripts/endpoint/common/fleet_services.ts:168:11)
      at async enrollHostWithFleet (/opt/local-ssd/buildkite/builds/kb-n2-4-virt-1080a7f1029b19c6/elastic/kibana-on-merge/kibana/x-pack/plugins/security_solution/scripts/endpoint/common/endpoint_host_services.ts:338:17)
      at async createAndEnrollEndpointHost (/opt/local-ssd/buildkite/builds/kb-n2-4-virt-1080a7f1029b19c6/elastic/kibana-on-merge/kibana/x-pack/plugins/security_solution/scripts/endpoint/common/endpoint_host_services.ts:117:23)

First failure: CI Build - main

@kibanamachine kibanamachine added the failed-test A test failure on a tracked branch, potentially flaky-test label Oct 20, 2023
@botelastic botelastic bot added the needs-team Issues missing a team label label Oct 20, 2023
@kibanamachine kibanamachine added the Team:Defend Workflows “EDR Workflows” sub-team of Security Solution label Oct 20, 2023
@elasticmachine
Copy link
Contributor

Pinging @elastic/security-defend-workflows (Team:Defend Workflows)

@botelastic botelastic bot removed the needs-team Issues missing a team label label Oct 20, 2023
szwarckonrad added a commit that referenced this issue Oct 25, 2023
…169092)

Restart vagrant vm on error during `beforeAll` task `createEndpointHost`

Defend Workflows Cypress suite ran 300 times through flaky test runner:
1. 100x
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3699
2. 50x
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3707
3. 50x
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3708
4. 50x
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3709
5. 50x
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3710


Flaky test runner runs with `createEndpointHost` task failure with
successful recovery:
1.
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3710#018b62fd-9ae9-4988-b1e0-ab0f04d8efdc
2.
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3710#018b62fd-9ae6-4340-992b-1474ee0f114b
3.
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3708#018b62fd-578e-4817-ae1c-8c58e8774eec
4.
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3708#018b62fd-5787-4245-85a6-cb446e42bc73
5.
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3707#018b62fc-fc17-407e-88de-d0b43b6b1d44
(failed due to unrelated issue)
6.
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3699#018b61d9-d2c3-430c-b3e3-72b9fbb22d24
7.
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3699#018b61d9-d2c6-4315-b828-b3218a70f209
8.
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3699#018b61d9-d2c7-4ff7-9a70-7354f90179e0
9.
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3699#018b61d9-d2d7-418f-b043-049e5effb26f
10.
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3699#018b61d9-d2da-47cc-b4ea-a4d4de3ba0a0

New errors not spotted before that got to do with env set up:

1. `vagrant up` failed:
1.1
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3708#018b62fd-5787-4245-85a6-cb446e42bc73
1.2
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3699#018b61d9-d2d0-4a52-87d9-34caa8927465

2. `CypressError: `cy.task('indexFleetEndpointPolicy')` timed out after
waiting `60000ms`.:
2.1
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3707#018b62fc-fc04-40d4-b155-46f094681edb
2.2
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3699#018b61d9-d2c9-4ebb-9174-eb9d79d04d02
2.3
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3699#018b61d9-d2dc-438f-94b0-9f94ae95701c
    

Closes:
#168284
#169343
#169468
#169469
#169467
#169465
#169466
#169157
#168719
#168427
#168359
#168340
#169689

---------

Co-authored-by: Patryk Kopyciński <contact@patrykkopycinski.com>
@kibanamachine kibanamachine reopened this Oct 26, 2023
@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@joeypoon
Copy link
Member

joeypoon commented Jan 16, 2024

Test file has been removed and split up. Relevant test now lives in: https://github.com/elastic/kibana/blob/main/x-pack/plugins/security_solution/public/management/cypress/e2e/response_actions/response_console/process_operations.cy.ts. Closing as newly split test has been passing.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:Defend Workflows “EDR Workflows” sub-team of Security Solution
Projects
None yet
Development

No branches or pull requests

4 participants