Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add inference.stream_inference and inference.update #3399

Merged
merged 8 commits into from
Jan 15, 2025
Merged

Conversation

lcawl
Copy link
Contributor

@lcawl lcawl commented Jan 1, 2025

Copy link
Contributor

github-actions bot commented Jan 1, 2025

Following you can find the validation results for the APIs you have changed.

API Status Request Response
inference.stream_inference Missing test Missing test

You can validate these APIs yourself by using the make validate target.

@lcawl lcawl marked this pull request as ready for review January 1, 2025 04:09
@lcawl lcawl requested a review from a team as a code owner January 1, 2025 04:09
Copy link
Contributor

github-actions bot commented Jan 2, 2025

Following you can find the validation results for the APIs you have changed.

API Status Request Response
inference.stream_inference Missing test Missing test

You can validate these APIs yourself by using the make validate target.

@lcawl lcawl changed the title Add inference.stream_inference Add inference.stream_inference and inference.update Jan 2, 2025
Copy link
Contributor

github-actions bot commented Jan 2, 2025

Following you can find the validation results for the APIs you have changed.

API Status Request Response
inference.stream_inference Missing test Missing test
inference.update Missing test Missing test

You can validate these APIs yourself by using the make validate target.

@l-trotta l-trotta self-assigned this Jan 7, 2025
*/

export class Response {
body: {}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we need to discuss how to handle the response, because the server sends text while we always expect json

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think the same is true of the cat APIs, since I started playing with in #3419

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

the cat APIs all have options to turn the output into json (query parameter ?format=json), while this one cannot be converted

Copy link
Contributor

github-actions bot commented Jan 7, 2025

Following you can find the validation results for the APIs you have changed.

API Status Request Response
inference.stream_inference Missing test Missing test
inference.update Missing test Missing test

You can validate these APIs yourself by using the make validate target.

1 similar comment
Copy link
Contributor

github-actions bot commented Jan 7, 2025

Following you can find the validation results for the APIs you have changed.

API Status Request Response
inference.stream_inference Missing test Missing test
inference.update Missing test Missing test

You can validate these APIs yourself by using the make validate target.

@l-trotta
Copy link
Contributor

l-trotta commented Jan 9, 2025

waiting to merge #3313 so that we can use the new StreamResult type (alias for ArrayBuffer that we'll use for streaming responses)

Copy link
Contributor

Following you can find the validation results for the APIs you have changed.

API Status Request Response
inference.stream_inference Missing test Missing test
inference.update Missing test Missing test

You can validate these APIs yourself by using the make validate target.

Copy link
Contributor

Following you can find the validation results for the APIs you have changed.

API Status Request Response
inference.stream_inference Missing test Missing test
inference.update Missing test Missing test

You can validate these APIs yourself by using the make validate target.

Copy link
Contributor

Following you can find the validation results for the APIs you have changed.

API Status Request Response
inference.stream_inference Missing test Missing test
inference.update Missing test Missing test

You can validate these APIs yourself by using the make validate target.

Copy link
Contributor

Following you can find the validation results for the APIs you have changed.

API Status Request Response
inference.stream_inference Missing test Missing test
inference.update Missing test Missing test

You can validate these APIs yourself by using the make validate target.

1 similar comment
Copy link
Contributor

Following you can find the validation results for the APIs you have changed.

API Status Request Response
inference.stream_inference Missing test Missing test
inference.update Missing test Missing test

You can validate these APIs yourself by using the make validate target.

Copy link
Contributor

Following you can find the validation results for the APIs you have changed.

API Status Request Response
inference.stream_inference Missing test Missing test
inference.update Missing test Missing test

You can validate these APIs yourself by using the make validate target.

Copy link
Contributor

Following you can find the validation results for the APIs you have changed.

API Status Request Response
inference.stream_inference Missing test Missing test
inference.update Missing test Missing test

You can validate these APIs yourself by using the make validate target.

@l-trotta
Copy link
Contributor

@lcawl added the new type, ready to be merged! could you just check the doc overlay? I may have messed something up while rebasing ^^"

Copy link
Contributor

Following you can find the validation results for the APIs you have changed.

API Status Request Response
inference.stream_inference Missing test Missing test
inference.update Missing test Missing test

You can validate these APIs yourself by using the make validate target.

Copy link
Contributor

Following you can find the validation results for the APIs you have changed.

API Status Request Response
inference.stream_inference Missing test Missing test
inference.update Missing test Missing test

You can validate these APIs yourself by using the make validate target.

@lcawl
Copy link
Contributor Author

lcawl commented Jan 14, 2025

@lcawl added the new type, ready to be merged! could you just check the doc overlay? I may have messed something up while rebasing ^^"

The output LGTM, thanks!

@l-trotta l-trotta merged commit cf1f2c9 into main Jan 15, 2025
10 checks passed
@l-trotta l-trotta deleted the inference-specs branch January 15, 2025 08:55
Copy link
Contributor

The backport to 8.x failed:

The process '/usr/bin/git' failed with exit code 1

To backport manually, run these commands in your terminal:

# Fetch latest updates from GitHub
git fetch
# Create a new working tree
git worktree add .worktrees/backport-8.x 8.x
# Navigate to the new working tree
cd .worktrees/backport-8.x
# Create a new branch
git switch --create backport-3399-to-8.x
# Cherry-pick the merged commit of this pull request and resolve the conflicts
git cherry-pick -x --mainline 1 cf1f2c9aef10b395681418361ca455610bcf8531
# Push it to GitHub
git push --set-upstream origin backport-3399-to-8.x
# Go back to the original working tree
cd ../..
# Delete the working tree
git worktree remove .worktrees/backport-8.x

Then, create a pull request where the base branch is 8.x and the compare/head branch is backport-3399-to-8.x.

Copy link
Contributor

The backport to 8.17 failed:

The process '/usr/bin/git' failed with exit code 1

To backport manually, run these commands in your terminal:

# Fetch latest updates from GitHub
git fetch
# Create a new working tree
git worktree add .worktrees/backport-8.17 8.17
# Navigate to the new working tree
cd .worktrees/backport-8.17
# Create a new branch
git switch --create backport-3399-to-8.17
# Cherry-pick the merged commit of this pull request and resolve the conflicts
git cherry-pick -x --mainline 1 cf1f2c9aef10b395681418361ca455610bcf8531
# Push it to GitHub
git push --set-upstream origin backport-3399-to-8.17
# Go back to the original working tree
cd ../..
# Delete the working tree
git worktree remove .worktrees/backport-8.17

Then, create a pull request where the base branch is 8.17 and the compare/head branch is backport-3399-to-8.17.

l-trotta added a commit that referenced this pull request Jan 15, 2025
* Add inference.stream_inference

* Add inference.update

* Add array of strings to stream inference input

* update inference response with streamresult type

* fix overlay

* fix wrong rebase

* fix overlay wrong indent

---------

Co-authored-by: Laura Trotta <laura.trotta@elastic.co>
l-trotta added a commit that referenced this pull request Jan 15, 2025
* Add inference.stream_inference

* Add inference.update

* Add array of strings to stream inference input

* update inference response with streamresult type

* fix overlay

* fix wrong rebase

* fix overlay wrong indent

---------

Co-authored-by: Laura Trotta <laura.trotta@elastic.co>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants