Skip to content

Commit

Permalink
Fix(aws): Use abort signal when available with SDK requests (langchai…
Browse files Browse the repository at this point in the history
…n-ai#6540)

Co-authored-by: Peter Lisy <plisy@amazon.com>
  • Loading branch information
2 people authored and CarterMorris committed Nov 10, 2024
1 parent a41600d commit 54fbebd
Showing 1 changed file with 6 additions and 2 deletions.
8 changes: 6 additions & 2 deletions libs/langchain-aws/src/chat_models.ts
Original file line number Diff line number Diff line change
Expand Up @@ -817,7 +817,9 @@ export class ChatBedrockConverse
system: converseSystem,
...params,
});
const response = await this.client.send(command);
const response = await this.client.send(command, {
abortSignal: options.signal,
});
const { output, ...responseMetadata } = response;
if (!output?.message) {
throw new Error("No message found in Bedrock response.");
Expand Down Expand Up @@ -855,7 +857,9 @@ export class ChatBedrockConverse
system: converseSystem,
...params,
});
const response = await this.client.send(command);
const response = await this.client.send(command, {
abortSignal: options.signal,
});
if (response.stream) {
for await (const chunk of response.stream) {
if (chunk.contentBlockStart) {
Expand Down

0 comments on commit 54fbebd

Please sign in to comment.