Tool with API call not returning results but sync tool calls work.

[daynewright]

When I attempt to use a tool that creates an api call, I am not getting the results passed back to the useChat hook in the messages but I can log that the tool runs and receives the data. It seems like it is returning too soon or I am missing an implementation detail.

Error in chat API:  [AI_MessageConversionError: ToolInvocation must have a result: {"state":"call","toolCallId":"VG6RxiD","toolName":"fetchPatientBasicInfo","args":{"patientId":"ID"}}]

I have an API call happening in the tool and it works, but the result is never resolved and is missing. It is like the execute is ignoring the async? All the other tools I have that just restructure the data work fine.

import type { NextRequest } from 'next/server';
import { createGoogleGenerativeAI } from '@ai-sdk/google';
import { convertToCoreMessages, streamText } from 'ai';

import { system } from '../utils/prompt';
import { createTableTool, patientDataTool, patientBasicInfoTool, titleTool } from '../utils/tools';

const google = createGoogleGenerativeAI({
  apiKey: process.env.GOOGLE_GENERATIVE_AI_API_KEY,
});

export const config = {
  runtime: 'edge',
};

export default async function POST(req: NextRequest) {
  try {
    const { messages } = await req.json();

    const result = await streamText({
      model: google('gemini-1.5-pro'),
      system: system,
      messages: convertToCoreMessages(messages),
      tools: {
        title: titleTool,
        fetchPatientData: patientDataTool,
        fetchPatientBasicInfo: patientBasicInfoTool,
        createTable: createTableTool,
      },
    });

    return result.toDataStreamResponse();
  } catch (error) {
    console.error('Error in chat API:', error);
    return new Response(error, { status: 500 });
  }
}

export const patientBasicInfoTool = {
  name: 'fetchPatientBasicInfo',
  description: 'Fetch basic information for a patient using their ID',
  parameters: z.object({
    patientId: z.string().describe('The ID of the patient to fetch basic information for'),
  }),
  execute: async ({ patientId }: z.infer<typeof patientBasicInfoTool.parameters>) => {
    try {
      // Use the internal API endpoint for fetching patient basic info
      const response = await axios.get(`http://localhost:3000/api/patient/${patientId}`);

      const patientData = response.data;

      // Function to get initials
      const getInitials = (name: { given: string[]; family: string }) => {
        const givenInitials = name.given.map(n => n[0]).join('');
        const familyInitial = name.family[0];
        return `${givenInitials}${familyInitial}`.toUpperCase();
      };

      // Extract and format the basic information
      const formattedData = {
        id: patientData.id,
        name: `${patientData.name[0].prefix[0]} ${patientData.name[0].given.join(' ')} ${patientData.name[0].family}`,
        initials: getInitials(patientData.name[0]),
        status: 'Existing Patient',
        sex: patientData.gender.charAt(0).toUpperCase() + patientData.gender.slice(1),
      };

      console.log('formattedData --->', formattedData);

      return {
        ...formattedData,
        message: 'Here is the basic information for the patient',
      };
    } catch (error) {
      console.error('Error fetching patient basic information:', error);
      return { message: 'Failed to fetch patient basic information. Are you sure the patient ID is correct?' };
    }
  },
};

When I log the formattedData I see it but it never makes it to the messages. 🤔

    "@ai-sdk/google": "^0.0.52",
    "ai": "^3.4.17",

[fourr4]

Any update?

[filippozanfini]

Same here! Any update on this?

[naufalpram]

Any update on this? the same thing happened to me, it seems like the fetch request just stops when called inside the execute property. so my workaround was fetching the data on the client using useChat with the onToolCall event listener and then adding the result to the stream with addToolResult property.

[naufalpram]

nvm solved mine lol

[Sanjay-Ganapathi]

How did you solve it ? for async functions