Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Defend Workflow] Add Cypress tests to the Kibana release quality gate #187243

Closed
MadameSheema opened this issue Jul 1, 2024 · 2 comments · Fixed by #199742
Closed

[Defend Workflow] Add Cypress tests to the Kibana release quality gate #187243

MadameSheema opened this issue Jul 1, 2024 · 2 comments · Fixed by #199742
Assignees
Labels
OLM Sprint Team:Defend Workflows “EDR Workflows” sub-team of Security Solution

Comments

@MadameSheema
Copy link
Member

Add the @serverlessQA to all the tests you want to have executed in the second quality gate as part the Kibana serverless release.

Please make sure that the tests you are adding are stable in MKI environments (remember that any failure at this stage will block a release to production). The tests should be covering critical paths, behaviours that if are broken or not working properly an SDH or blocker issue might be reported by our customers.

@MadameSheema MadameSheema added the Team:Defend Workflows “EDR Workflows” sub-team of Security Solution label Jul 1, 2024
@elasticmachine
Copy link
Contributor

Pinging @elastic/security-defend-workflows (Team:Defend Workflows)

@szwarckonrad
Copy link
Contributor

szwarckonrad commented Nov 12, 2024

Tests currently enabled in the MKI environment without agent enrollment (agentless) and stable over the past seven days (buildkite builds). All Osquery Cypress tests involve agent enrollment by default and are therefore not included here.

Cypress DW:

Test File Agentless Stable
components/agent_policy_settings_essentials.cy.ts
artifacts/blocklist.cy.ts
policy_details_endpoint_essentials.cy.ts
api/agent_policy_settings_complete.cy.ts
policy/policy_list.cy.ts
components/agent_policy_settings_complete.cy.ts
endpoint_alerts.cy.ts
execute.cy.ts
automated_response_actions.cy.ts
response_console/isolate.cy.ts
endpoint_list/endpoints.cy.ts
file_operations.cy.ts

API DW:

Test File Agentless Stable
security_solution_api_integration/test_suites/edr_workflows/resolver
security_solution_api_integration/test_suites/edr_workflows/response_actions

szwarckonrad added a commit that referenced this issue Nov 13, 2024
…99742)

This PR enables tests in the release pipeline that are 1) agentless (do
not involve agent enrollment) and 2) have been stable over the past
week. These tests are already running in the periodic pipeline, with
addition of `@serverlessQA` tag they will be promoted to be executed in
the release pipeline.

Test eligibility breakdown -
#187243 (comment)

CC @MadameSheema
CAWilson94 pushed a commit to CAWilson94/kibana that referenced this issue Nov 18, 2024
…astic#199742)

This PR enables tests in the release pipeline that are 1) agentless (do
not involve agent enrollment) and 2) have been stable over the past
week. These tests are already running in the periodic pipeline, with
addition of `@serverlessQA` tag they will be promoted to be executed in
the release pipeline.

Test eligibility breakdown -
elastic#187243 (comment)

CC @MadameSheema
CAWilson94 pushed a commit to CAWilson94/kibana that referenced this issue Nov 18, 2024
…astic#199742)

This PR enables tests in the release pipeline that are 1) agentless (do
not involve agent enrollment) and 2) have been stable over the past
week. These tests are already running in the periodic pipeline, with
addition of `@serverlessQA` tag they will be promoted to be executed in
the release pipeline.

Test eligibility breakdown -
elastic#187243 (comment)

CC @MadameSheema
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
OLM Sprint Team:Defend Workflows “EDR Workflows” sub-team of Security Solution
Projects
None yet
Development

Successfully merging a pull request may close this issue.

4 participants