Unable to get any response from Retriever

[hemanthaar]

After struggling a lot to run the chainlit app, I am facing a new issue. The agents are not able to retrieve any information even though the documents are successfully indexed.

I am getting only this response multiple times no matter what the question is.

Can you suggest any solution or workaround. Thanks.

[karthik-codex]

What is your LLM config looks like? Are you using the api_base of LiteLLM?

[hemanthaar]

Yes. Here is my config detail.

llm_config_autogen = {
"seed": 42, # change the seed for different trials
"temperature": 0,
"config_list": [{"model": "litellm",
"base_url": "http://127.0.0.1:4000/",
'api_key': 'ollama'},
],
"timeout": 60000,
}

[tdemel]

I am having the same issue. The error message can be located in the autogen code and I thought it may have to do with the versioning of autogen as I can otherwise connect to my Ollama models without issues and a new Autogen version was released on 13 August. However, even with the previous Autogen version I am receiving the same error. I haven't tried with a much older version. It would be great if someone knows a solution to this.

[hemanthaar]

@tdemel You are right. It didn't occur to me that pyautogen version could be issue. You can install autogen version 0.2.32 and it works but the response comes in the terminal instead of chainlit app. Let me know if you find any solution for this.

[zluckymn]

0.2.32
i got the correct message by impelementing the following steps:

CONFIG_FILEPATH = './settings.yaml'

def run_local_search(
config_filepath: str | None,
data_dir: str | None,
root_dir: str | None,
community_level: int,
response_type: str,
streaming: bool,
query: str,
):

if LOCAL_SEARCH:
result = run_local_search(CONFIG_FILEPATH,INPUT_DIR, ROOT_DIR, COMMUNITY ,RESPONSE_TYPE,True, question)
else:
result = run_global_search(CONFIG_FILEPATH,INPUT_DIR, ROOT_DIR, COMMUNITY ,RESPONSE_TYPE,True, question)

[michael-hoon]

still having the same issue here, has anyone managed to solve this?