bug: Instructions are not sent when using the Claude 3.5 model

[luketech85]

• I have searched the existing issues

Current behavior

Instructions are not sent when using the Claude 3.5 model. They work with other models (tested Open AI).

Minimum reproduction step

Select Claude 3.5 model.
Enter instructions e.g. "You will play the role of Hal, a highly knowledgeable AI assistant with a humorous and often sarcastic personality. Engage in conversation with the user, providing informative and helpful responses while injecting wit, irony, and playful jabs. Your responses should be a mix of genuine information and sarcastic remarks that poke fun at the situation, the user’s questions, or even yourself. Maintain a lighthearted and friendly tone throughout the conversation, ensuring that your sarcasm is not hurtful or offensive."
Send a chat "What's your name"
Model will respond: "My name is Claude."
Switch to GPT4o model and ask the same question.
Model will correctly identify it's name.

Expected behavior

Model should respond based on the instructions provided.

Screenshots / Logs

2024-09-01T12:56:19.546Z [SPECS]::Version: 0.5.32024-09-01T12:56:19.546Z [SPECS]::CPUs: [{"model":"Intel(R) Core(TM) i3-8100 CPU @ 3.60GHz","speed":3600,"times":{"user":319642578,"nice":0,"sys":78278203,"idle":1196330375,"irq":18647265}},{"model":"Intel(R) Core(TM) i3-8100 CPU @ 3.60GHz","speed":3600,"times":{"user":446380343,"nice":0,"sys":63399218,"idle":1084471375,"irq":984531}},{"model":"Intel(R) Core(TM) i3-8100 CPU @ 3.60GHz","speed":3600,"times":{"user":421282921,"nice":0,"sys":56779203,"idle":1116188812,"irq":931203}},{"model":"Intel(R) Core(TM) i3-8100 CPU @ 3.60GHz","speed":3600,"times":{"user":379067468,"nice":0,"sys":53951906,"idle":1161231562,"irq":725218}}]
2024-09-01T12:56:19.547Z [SPECS]::Machine: x86_64
2024-09-01T12:56:19.547Z [SPECS]::Endianness: LE
2024-09-01T12:56:19.548Z [SPECS]::OS Version: Windows 10 Home
2024-09-01T12:56:19.548Z [SPECS]::OS Release: 10.0.19045
2024-09-01T12:56:19.547Z [SPECS]::Parallelism: 4
2024-09-01T12:56:19.548Z [APP]::{"notify":true,"run_mode":"cpu","nvidia_driver":{"exist":false,"version":""},"cuda":{"exist":false,"version":""},"gpus":[],"gpu_highest_vram":"","gpus_in_use":[""],"is_initial":false,"vulkan":false}
2024-09-01T12:56:19.547Z [SPECS]::Free Mem: 17538760704
2024-09-01T12:56:19.548Z [SPECS]::OS Platform: win32
2024-09-01T12:56:19.548Z [SPECS]::Total Mem: 34278678528
2024-09-01T12:58:01.662Z [CORTEX]::Debug: Request to kill cortex
2024-09-01T12:58:13.092Z [SPECS]::Version: 0.5.3
2024-09-01T12:58:13.093Z [SPECS]::Endianness: LE
2024-09-01T12:58:13.092Z [SPECS]::Machine: x86_64
2024-09-01T12:58:13.092Z [SPECS]::CPUs: [{"model":"Intel(R) Core(TM) i3-8100 CPU @ 3.60GHz","speed":3600,"times":{"user":319745640,"nice":0,"sys":78310218,"idle":1196489531,"irq":18651765}},{"model":"Intel(R) Core(TM) i3-8100 CPU @ 3.60GHz","speed":3600,"times":{"user":446492500,"nice":0,"sys":63426046,"idle":1084626625,"irq":985046}},{"model":"Intel(R) Core(TM) i3-8100 CPU @ 3.60GHz","speed":3600,"times":{"user":421399625,"nice":0,"sys":56802734,"idle":1116342812,"irq":931500}},{"model":"Intel(R) Core(TM) i3-8100 CPU @ 3.60GHz","speed":3600,"times":{"user":379193781,"nice":0,"sys":53974171,"idle":1161377218,"irq":725515}}]
2024-09-01T12:58:13.093Z [SPECS]::Parallelism: 4
2024-09-01T12:58:13.093Z [SPECS]::Free Mem: 17837563904
2024-09-01T12:58:13.093Z [SPECS]::Total Mem: 34278678528
2024-09-01T12:58:13.093Z [SPECS]::OS Version: Windows 10 Home
2024-09-01T12:58:13.093Z [SPECS]::OS Platform: win32
2024-09-01T12:58:13.094Z [SPECS]::OS Release: 10.0.19045
2024-09-01T12:58:13.094Z [APP]::{"notify":true,"run_mode":"cpu","nvidia_driver":{"exist":false,"version":""},"cuda":{"exist":false,"version":""},"gpus":[],"gpu_highest_vram":"","gpus_in_use":[""],"is_initial":false,"vulkan":false}
2024-09-01T13:16:13.601Z [CORTEX]::Debug: Request to kill cortex
2024-09-01T13:16:13.650Z [CORTEX]::Debug: cortex process is terminated
2024-09-01T13:16:17.900Z [SPECS]::Version: 0.5.3
2024-09-01T13:16:17.901Z [SPECS]::CPUs: [{"model":"Intel(R) Core(TM) i3-8100 CPU @ 3.60GHz","speed":3600,"times":{"user":320054218,"nice":0,"sys":78402125,"idle":1197174015,"irq":18666046}},{"model":"Intel(R) Core(TM) i3-8100 CPU @ 3.60GHz","speed":3600,"times":{"user":446885265,"nice":0,"sys":63504078,"idle":1085240796,"irq":986078}},{"model":"Intel(R) Core(TM) i3-8100 CPU @ 3.60GHz","speed":3600,"times":{"user":421792984,"nice":0,"sys":56874125,"idle":1116963031,"irq":932171}},{"model":"Intel(R) Core(TM) i3-8100 CPU @ 3.60GHz","speed":3600,"times":{"user":379580781,"nice":0,"sys":54046437,"idle":1162002921,"irq":726343}}]
2024-09-01T13:16:17.901Z [SPECS]::Machine: x86_64
2024-09-01T13:16:17.901Z [SPECS]::Endianness: LE
2024-09-01T13:16:17.901Z [SPECS]::Parallelism: 4
2024-09-01T13:16:17.901Z [SPECS]::Free Mem: 18733211648
2024-09-01T13:16:17.901Z [SPECS]::Total Mem: 34278678528
2024-09-01T13:16:17.902Z [SPECS]::OS Version: Windows 10 Home
2024-09-01T13:16:17.902Z [SPECS]::OS Release: 10.0.19045
2024-09-01T13:16:17.902Z [SPECS]::OS Platform: win32
2024-09-01T13:16:17.902Z [APP]::{"notify":true,"run_mode":"cpu","nvidia_driver":{"exist":false,"version":""},"cuda":{"exist":false,"version":""},"gpus":[],"gpu_highest_vram":"","gpus_in_use":[""],"is_initial":false,"vulkan":false}

Jan version

0.5.3

In which operating systems have you tested?

• macOS
• Windows
• Linux

Environment details

No response

[Van-QA]

The issue is reproducible:

• Open AI with instruction: ✅
  
• Claude not include the instruction in the request: ❌
  

R‌elated to #3528

[imtuyethan]

LGTM (0.5.4-650)