Failing test: X-Pack Endpoint Functional Tests.x-pack/test/security_solution_endpoint/apps/endpoint/responder·ts - endpoint Response Actions Responder from timeline should show Responder from alert in a timeline

[kibanamachine]

A test failed on a tracked branch

StaleElementReferenceError: stale element reference: element is not attached to the page document
  (Session info: headless chrome=102.0.5005.115)
    at Object.throwDecodedError (node_modules/selenium-webdriver/lib/error.js:522:15)
    at parseHttpResponse (node_modules/selenium-webdriver/lib/http.js:589:13)
    at Executor.execute (node_modules/selenium-webdriver/lib/http.js:514:28)
    at runMicrotasks (<anonymous>)
    at processTicksAndRejections (node:internal/process/task_queues:96:5)
    at Task.exec (test/functional/services/remote/prevent_parallel_calls.ts:28:20) {
  remoteStacktrace: '#0 0x556988442f33 <unknown>\n' +
    '#1 0x55698818d118 <unknown>\n' +
    '#2 0x55698818ff97 <unknown>\n' +
    '#3 0x55698818fe3b <unknown>\n' +
    '#4 0x5569881900fc <unknown>\n' +
    '#5 0x5569881be65e <unknown>\n' +
    '#6 0x5569881e0f72 <unknown>\n' +
    '#7 0x5569881b7e73 <unknown>\n' +
    '#8 0x5569881e107e <unknown>\n' +
    '#9 0x5569881f42e4 <unknown>\n' +
    '#10 0x5569881e0e63 <unknown>\n' +
    '#11 0x5569881b682a <unknown>\n' +
    '#12 0x5569881b7985 <unknown>\n' +
    '#13 0x5569884874cd <unknown>\n' +
    '#14 0x55698848b5ec <unknown>\n' +
    '#15 0x55698847171e <unknown>\n' +
    '#16 0x55698848c238 <unknown>\n' +
    '#17 0x556988466870 <unknown>\n' +
    '#18 0x5569884a8608 <unknown>\n' +
    '#19 0x5569884a8788 <unknown>\n' +
    '#20 0x5569884c2f1d <unknown>\n' +
    '#21 0x7f1a6fe41609 <unknown>\n'
}

First failure: CI Build - main

[elasticmachine]

Pinging @elastic/security-solution (Team: SecuritySolution)

[kevinlog]

@paul-tavares can you take a look?

[paul-tavares]

Hey @spalger ,

Wondering if you might have some insight here. The failure seems to be happening in a Global beforeEach() that points back to this file test/functional/services/remote/prevent_parallel_calls.ts. Any idea what might have caused this one?

This same error also just got reported today on a different test - here (build failure here).

I checked out code for these tests and we don't have global beforeEach hooks defined - all of ours are scoped to describe() blocks.

[kibanamachine]

New failure: CI Build - main

[spalger]

The output is a bit verbose, but the failure line lists the test which was executing when the error was caught endpoint When on the Endpoint Policy Details Page and the save button is clicked should have updated policy data in overall Agent Policy.

The error message StaleElementReferenceError: stale element reference: element is not attached to the page document is caused when a reference to an element is captured, then used in some way, but between the capturing and the use the element was re-rendered or deleted for some reason. This code can look like this:

const button = await testSubjects.find('someButton')
await button.click();

This does two actions, and if the element with someButton test subject is re-rendered between those two actions then the second action will fail. Instead, you should use:

await testSubjects.click('someButton')

This handle the error by re-fetching the element using the same selection if the click fails.

[paul-tavares]

Ohhh... This is good info. on the differences between those two approached. I know for sure in some cases I am using the approach that you mention might lead to this StaleElementReferrenceError. I will look for ways around it.

Thank you @spalger 🙏

[paul-tavares]

PR merged. Lets see what happens. :)

[kibanamachine]

New failure: CI Build - main

[spalger]

Failed within 4 hours of merging the PR 😬 That's not great

https://buildkite.com/organizations/elastic/pipelines/kibana-on-merge/builds/20467/jobs/0182f9d6-f81a-4340-b2fb-52857e2b1120/artifacts/0182fa09-88eb-410c-a877-5bc2ad4427f3

[spalger]

So, I took a look at the testSubjects.clickWhenNotDisabled() method, which is a wrapper around find.clickByCssSelectorWhenNotDisabled(), which explicitly says that it shouldn't protect against stale element execptions... which is a very weird decisions that I don't understand

kibana/test/functional/services/common/find.ts

Lines 288 to 301 in 71b9ed4

	public async clickByCssSelectorWhenNotDisabled(
	selector: string,
	{ timeout } = { timeout: this.defaultFindTimeout }
	): Promise<void> {
	this.log.debug(`Find.clickByCssSelectorWhenNotDisabled('${selector}') with timeout=${timeout}`);
	// Don't wrap this code in a retry, or stale element checks may get caught here and the element
	// will never be re-grabbed. Let errors bubble, but continue checking for disabled property until
	// it's gone.
	const element = await this.byCssSelector(selector, timeout);
	await element.moveMouseTo();
	await this.driver.wait(until.elementIsEnabled(element._webElement), timeout);
	await element.click();
	}

Unfortunately testSubjects.clickWhenNotDisabled() is used in 90 places across 40 files, which means changing the meaning of that method is pretty risky.

[spalger]

Opened #139964 to fix this

[spalger]

Fixed by #139964

[kevinlog]

Thank you for looking at this @spalger !

cc @paul-tavares

[paul-tavares]

Thanks @spalger . Appreciate you taking a look.

[kibanamachine]

New failure: CI Build - main

[kibanamachine]

New failure: CI Build - main

[kibanamachine]

New failure: CI Build - main

[kibanamachine]

Skipped

main: 404c359

[elasticmachine]

Pinging @elastic/security-defend-workflows (Team:Defend Workflows)

[kibanamachine]

New failure: CI Build - main

[kibanamachine]

New failure: CI Build - main

[kibanamachine]

New failure: CI Build - main

[kibanamachine]

New failure: CI Build - main

[kibanamachine]

New failure: CI Build - main

[kibanamachine]

New failure: CI Build - main

[kibanamachine]

New failure: CI Build - main

[kibanamachine]

New failure: CI Build - main

[kibanamachine]

New failure: CI Build - main

[kibanamachine]

New failure: CI Build - main

[kibanamachine]

New failure: CI Build - main