[Obs AI Assistant] ai assistant system connector #179980

klacabane · 2024-04-03T19:12:33Z

Summary

Creates a system connector that can call the observability ai assistant to execute actions on behalf of user. The connector is tagged as tech preview.

The connector can be triggered when an alert fires. Connector can be configured with an initial message to the assistant which generates an answer and triggers potential actions on the assistant side. The current experimental scenario is to ask the assistant to generate a report of the alert that fired (by initially providing some context in the first message), recalling any information/potential resolutions of previous occurrences stored in the knowledge base and also including other active alerts that may be related. One last step that can be asked to the assistant is to trigger an action, currently only sending the report (or any other message) to a preconfigured slack webhook is supported.

Testing

Note: when asked to send a message to another connector (in our case slack), we'll try to include a link to the generated conversation. It is only possible to generate this link if server.publicBaseUrl is correctly set in kibana settings.

Create a slack webhook connector
- Get slack webhook. I can share one and invite you to the workspace, or if you want to create one:
  - create personal workspace at https://slack.com/signin#workspaces
  - create an app for that workspace at https://api.slack.com/apps
  - under Features > OAuth & Permissions > Scopes > Bot Token Scopes, add incoming-webhook permission
  - install the app
  - webhook url is available under Features > Incoming Webhooks
Create a rule that can be triggered with available documents and attach observability AI assistant connector. (I use Error Count Threshold and generate errors via node scripts/synthtrace many_errors.ts --live)
- configure the connector with one genai connector and a message with instructions. Example:

High error count alert has triggered. Execute the following steps:
  - create a graph of the error count for the service impacted by the alert for the last 24h
  - to help troubleshoot recall past occurrences of this alarm, also any other active alerts. Generate a report with all the found informations and send it to slack connector as a single message. Also include the link to this conversation in the report

Track alert status and verify connector was executed. You should get a slack notification sent by the assistant, and a new conversation will be stored

TODO

unit/integration tests - see [Cases] Case action #168369 for reference implementation
documentation

apmmachine · 2024-04-03T19:12:51Z

🤖 GitHub comments

Expand to view the GitHub comments

Just comment with:

/oblt-deploy : Deploy a Kibana instance using the Observability test environments.
/oblt-deploy-serverless : Deploy a serverless Kibana instance using the Observability test environments.
run elasticsearch-ci/docs : Re-trigger the docs validation. (use unformatted text in the comment!)

klacabane · 2024-04-04T21:21:16Z

/ci

…fix'

klacabane · 2024-04-08T12:57:57Z

/ci

klacabane · 2024-04-08T13:45:48Z

/ci

klacabane · 2024-04-08T16:41:04Z

/ci

klacabane · 2024-04-08T17:46:34Z

/ci

...gins/observability_solution/observability_ai_assistant/server/functions/execute_connector.ts

cnasikas · 2024-04-15T08:40:14Z

@elastic/response-ops we exposed connectors schema (email connector example) as part of this PR to teach assistant how to call them. This increases the bundle size, are we fine bumping the limit ?

++ to what @dgieselaar said 🙂.

elasticmachine · 2024-04-15T09:15:56Z

Pinging @elastic/obs-ux-management-team (Team:obs-ux-management)

benakansara

Obs-ux-management changes LGTM

dgieselaar

LGTM! There are some open comments but those can be addressed in a follow-up. Thanks for doing this, really exciting feature!

dgieselaar · 2024-04-15T16:11:27Z

x-pack/plugins/observability_solution/observability_ai_assistant/server/rule_connector/index.ts

+  const extractAlertData = (hit: AlertHit) => {
+    return {
+      id: hit._id,
+      reason: get(hit, 'kibana.alert.reason') || null,


any reason why we would not send over the full alert data here? Maybe good to talk to @sorenlouv about this as well - we can also do it in a followup.

I wanted to limit the noise and amount of token sent but that's probably too early for that. Updated in cfe8800

kibana-ci · 2024-04-15T19:19:24Z

💚 Build Succeeded

Buildkite Build
Commit: cfe8800

Metrics [docs]

Module Count

Fewer modules leads to a faster build time

id	before	after	diff
`observabilityAIAssistant`	89	94	+5

Public APIs missing comments

Total count of every public API that lacks a comment. Target amount is 0. Run node scripts/build_api_docs --plugin [yourplugin] --stats comments for more detailed information.

id	before	after	diff
`stackConnectors`	4	10	+6

Async chunks

Total size of all lazy-loaded chunks that will be downloaded as the user navigates the app

id	before	after	diff
`observabilityAIAssistant`	16.9KB	18.6KB	+1.7KB

Page load bundle

Size of the bundles that are downloaded on every page load. Target size is below 100kb

id	before	after	diff
`observabilityAIAssistant`	46.0KB	47.0KB	+1.1KB

Unknown metric groups

API count

id	before	after	diff
`stackConnectors`	4	10	+6

async chunk count

id	before	after	diff
`observabilityAIAssistant`	2	3	+1

ESLint disabled line counts

id	before	after	diff
`observabilityAIAssistant`	5	7	+2

Total ESLint disabled count

id	before	after	diff
`observabilityAIAssistant`	8	10	+2

History

💔 Build #203753 failed 671a021
💔 Build #203717 failed bff956f
💚 Build #203596 succeeded 146fdf7
💔 Build #203595 failed f72d35a
💔 Build #203556 failed 5012440

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

cc @klacabane

…app (#180949) ## Summary Resolves #180910 This change simply moves the rule_connector introduced in #179980 to the `observability_ai_assistant_app` plugin. There are not functional changes. Also added some unit tests ### Testing See testing section in #179980 --------- Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>

…app (elastic#180949) ## Summary Resolves elastic#180910 This change simply moves the rule_connector introduced in elastic#179980 to the `observability_ai_assistant_app` plugin. There are not functional changes. Also added some unit tests ### Testing See testing section in elastic#179980 --------- Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com> (cherry picked from commit e8fe9db)

register system connector

3c3a698

klacabane added 7 commits April 3, 2024 22:38

add connector parameter

43624f6

ruleregistry dependency

41eacba

execute_connector function

5ff4e45

update start contract

a597a72

connector assistant logic with handcrafted resources

e3df4f5

dynamic connector selection

4a4972a

Merge branch 'main' into 135-aiassistant-system-connector

a9b6ead

kibanamachine and others added 7 commits April 4, 2024 21:30

[CI] Auto-commit changed files from 'node scripts/lint_ts_projects --…

a769451

…fix'

useGenAIConnector hook

52ec844

add icon and experimental flag

a03c494

connector adapter

ba79f69

select connector on render

158d6f7

make user optional in assistant client

cdc2178

Merge branch 'main' into 135-aiassistant-system-connector

d03e25c

optional user

09a8f48

klacabane added 5 commits April 8, 2024 17:06

Merge branch 'main' into 135-aiassistant-system-connector

3dc864a

add licensing context

70f5e1d

connector id constant

497ca6a

params error handling

b2efe50

fix tests

18d382b

klacabane added 2 commits April 8, 2024 19:46

fix tests

d4b2e7f

Merge branch 'main' into 135-aiassistant-system-connector

cb25853

add email and slack parameters

5f80d83

klacabane added 2 commits April 14, 2024 23:43

execute when alert recovers

80d8094

remove debug log

ff23142

dgieselaar reviewed Apr 15, 2024

View reviewed changes

...gins/observability_solution/observability_ai_assistant/server/functions/execute_connector.ts Outdated Show resolved Hide resolved

Remove export from common

677f3ff

Fix type issues

5012440

klacabane requested a review from a team as a code owner April 15, 2024 09:15

botelastic bot added the Team:obs-ux-management Observability Management User Experience Team label Apr 15, 2024

klacabane added 2 commits April 15, 2024 12:29

return connector execution result

f72d35a

Merge branch 'main' into 135-aiassistant-system-connector

146fdf7

benakansara approved these changes Apr 15, 2024

View reviewed changes

dgieselaar approved these changes Apr 15, 2024

View reviewed changes

klacabane added 3 commits April 15, 2024 16:26

Merge branch 'main' into 135-aiassistant-system-connector

bff956f

include alerts summary in instruction

d0f35b9

Merge branch 'main' into 135-aiassistant-system-connector

671a021

dgieselaar reviewed Apr 15, 2024

View reviewed changes

klacabane added 3 commits April 15, 2024 19:04

use client instead of getClient

d2d016d

update snapshot

b7094a6

provide full alerts as context

cfe8800

klacabane merged commit 66587d8 into elastic:main Apr 15, 2024
35 checks passed

kibanamachine added v8.14.0 backport:skip This commit does not require backporting labels Apr 15, 2024

This was referenced Apr 16, 2024

[Obs AI Assistant] Move rule connector to observability_ai_assistant_app #180910

Closed

[Obs AI Assistant] move rule connector to observability_ai_assistant_app #180949

Merged

dgieselaar mentioned this pull request Apr 24, 2024

[obs ai assistant] aiassistant connector #176704

Closed

klacabane mentioned this pull request Apr 24, 2024

[Obs AI Assistant] Connector documentation #181282

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Obs AI Assistant] ai assistant system connector #179980

[Obs AI Assistant] ai assistant system connector #179980

klacabane commented Apr 3, 2024 •

edited

Loading

apmmachine commented Apr 3, 2024

klacabane commented Apr 4, 2024

klacabane commented Apr 8, 2024

klacabane commented Apr 8, 2024

klacabane commented Apr 8, 2024

klacabane commented Apr 8, 2024

cnasikas commented Apr 15, 2024

elasticmachine commented Apr 15, 2024

benakansara left a comment

dgieselaar left a comment

dgieselaar Apr 15, 2024

klacabane Apr 15, 2024

kibana-ci commented Apr 15, 2024

API count

async chunk count

ESLint disabled line counts

Total ESLint disabled count

[Obs AI Assistant] ai assistant system connector #179980

[Obs AI Assistant] ai assistant system connector #179980

Conversation

klacabane commented Apr 3, 2024 • edited Loading

Summary

Testing

apmmachine commented Apr 3, 2024

🤖 GitHub comments

klacabane commented Apr 4, 2024

klacabane commented Apr 8, 2024

klacabane commented Apr 8, 2024

klacabane commented Apr 8, 2024

klacabane commented Apr 8, 2024

cnasikas commented Apr 15, 2024

elasticmachine commented Apr 15, 2024

benakansara left a comment

Choose a reason for hiding this comment

dgieselaar left a comment

Choose a reason for hiding this comment

dgieselaar Apr 15, 2024

Choose a reason for hiding this comment

klacabane Apr 15, 2024

Choose a reason for hiding this comment

kibana-ci commented Apr 15, 2024

💚 Build Succeeded

Metrics [docs]

Module Count

Public APIs missing comments

Async chunks

Page load bundle

API count

async chunk count

ESLint disabled line counts

Total ESLint disabled count

History

klacabane commented Apr 3, 2024 •

edited

Loading