Feat/modelhub (#1)

[HSPK]

• feat: translations (feat: translations langgenius/dify#3176)

• fix: prompt editor variable picker (fix: prompt editor variable picker langgenius/dify#3177)

• Fix: features of agent-chat (Fix: features of agent-chat langgenius/dify#3178)

• version to 0.6.0-fix1 (version to 0.6.0-fix1 langgenius/dify#3179)

• fix keyword index error when storage source is S3 (fix keyword index error when storage source is S3 langgenius/dify#3182)

• Update README.md to include workflows (Update README.md to include workflows langgenius/dify#3180)

• Compatible with unique index conflicts (Compatible with unique index conflicts langgenius/dify#3183)

• fix: sometimes chosed old selected knowledge may overwirte the new knowledge (fix: sometimes chosed old selected knowledge may overwirte the new knowledge langgenius/dify#3199)

• Fix: remove unavailable return_preamble parameter in cohere (Fix: remove unavailable return_preamble parameter in cohere langgenius/dify#3201)

• Fix/code transform result (Fix/code transform result langgenius/dify#3203)

• fix(code_executor): surrogates not allowed error in jinja2 template (fix(code_executor): surrogates not allowed error in jinja2 template langgenius/dify#3191)

• fix: node connect self (fix: node connect self langgenius/dify#3194)

• Update README.md (Update README.md langgenius/dify#3206)

• fix economy index search in workflow (fix economy index search in workflow langgenius/dify#3205)

• fix: index number in api/README (fix: index number in api/README langgenius/dify#3214)

• Update README.md (Update README.md langgenius/dify#3212)

• fix detached instance error in keyword index create thread and fix question classifier node out of index error ( fix detached instance error in keyword index create thread and fix question classifier node out of index error langgenius/dify#3219)

• fix: incomplete response (fix: incomplete response langgenius/dify#3215)

• fix: latest image tag not push in GitHub action (fix: latest image tag not push in GitHub action langgenius/dify#3213)

• fix: vision config doesn't enabled in llm (fix: vision config doesn't enabled in llm langgenius/dify#3225)

• fixed the issue of missing cleanup function in the AudioBtn component (fixed the issue of missing cleanup function in the AudioBtn component langgenius/dify#3133)

• fix: image text when retrieve chat histories (fix: image text when retrieve chat histories langgenius/dify#3220)

• feat: moonshot function call (feat: moonshot function call langgenius/dify#3227)

• feat: support setting database used in Milvus (feat: support setting database used in Milvus langgenius/dify#3003)

• fix milvus database name parameter missed ( fix milvus database name parameter missed langgenius/dify#3229)

• fix: file not uploaded caused api error (fix: file not uploaded caused api error langgenius/dify#3228)

• update link (update link langgenius/dify#3226)

• fix: skip Celery warning by setting broker_connection_retry_on_startup config (fix: skip Celery warning by setting broker_connection_retry_on_startup config langgenius/dify#3188)

• fix: workflow run edge status (fix: workflow run edge status langgenius/dify#3236)

• fix: empty conversation list of explore chatbot (fix: empty conversation list of explore chatbot langgenius/dify#3235)

• Fix: picture of workflow (Fix: picture of workflow langgenius/dify#3241)

• feat: prompt-editor support undo (feat: prompt-editor support undo langgenius/dify#3242)

• fix: number type in app would render as select type in webapp (fix: number type in app would render as select type in webapp langgenius/dify#3244)

• fix: token is not logging of question classifier node (fix: token is not logging of question classifier node langgenius/dify#3249)

• chore: remove langchain in tools (chore: remove langchain in tools langgenius/dify#3247)

• make sure validation flow works for all model providers in bedrock (make sure validation flow works for all model providers in bedrock langgenius/dify#3250)

• feat: remove unregistered-llm-in-debug (feat: remove unregistered-llm-in-debug langgenius/dify#3251)

• version to 0.6.1 (version to 0.6.1 langgenius/dify#3253)

• fix: agent chat multiple model debug (fix: agent chat multiple model debug langgenius/dify#3258)

• feat: gpt-4-turbo (feat: gpt-4-turbo langgenius/dify#3263)

• fix: image was sent to an unsupported LLM when sending second message (fix: image was sent to an unsupported LLM when sending second message langgenius/dify#3268)

• feat: vision parameter support of OpenAI Compatible API (feat: vision parameter support of OpenAI Compatible API langgenius/dify#3272)

• fix: var assigner input node can not find caused error (fix: var assigner input node can not find caused error langgenius/dify#3274)

• fix: variable-assigner node connect (fix: variable-assigner node connect langgenius/dify#3288)

• Feat/Agent-Image-Processing (Feat/Agent-Image-Processing langgenius/dify#3293)

• chore: address security alerts on braces escape and KaTeX (chore: address security alerts on braces escape and KaTeX langgenius/dify#3301)

• chore(deps): bump katex from 0.16.8 to 0.16.10 in /web (chore(deps): bump katex from 0.16.8 to 0.16.10 in /web langgenius/dify#3307)

• Update README.md (Update README.md langgenius/dify#3281)

• Remove langchain dataset retrival agent logic (Remove langchain dataset retrival agent logic langgenius/dify#3311)

• add german translations (add german translations langgenius/dify#3322)

• feat: add missing workflow i18n keys (feat: add missing workflow i18n keys langgenius/dify#3309)

• feat:add 'name' field return (feat:add 'name' field return langgenius/dify#3152)

• improvement: speed up dependency installation in docker image rebuilds by mounting cache layer (improvement: speed up dependency installation in docker image rebuilds by mounting cache layer langgenius/dify#3218)

• feat: support gpt-4-turbo-2024-04-09 model (feat: support gpt-4-turbo-2024-04-09 model langgenius/dify#3300)

• feat: Add Cohere Command R / R+ model support (feat: Add Cohere Command R / R+ model support langgenius/dify#3333)

• fix dataset retrival in dataset mode (fix dataset retrival in dataset mode langgenius/dify#3334)

• chore:bump pypdfium2 from 4.16.0 to 4.17.0 (chore:bump pypdfium2 from 4.16.0 to 4.17.0 langgenius/dify#3310)

• feat(llm/models): add gemini-1.5-pro (feat(llm/models): add gemini-1.5-pro langgenius/dify#2925)

• feat: make input size bigger in start (feat: make input size bigger in start langgenius/dify#3340)

• Doc/update readme (Doc/update readme langgenius/dify#3344)

• fix: leave progress page still call indexing-status api (fix: leave progress page still call indexing-status api langgenius/dify#3345)

• feat: update aws bedrock (feat: update aws bedrock langgenius/dify#3326)

• fix/moonshot-function-call (fix/moonshot-function-call langgenius/dify#3339)

• fix issue: user’s keywords do not affect when add segment (fix issue: user’s keywords do not affect when add segment langgenius/dify#3349)

• add segment with keyword issue (fix: add segment with keyword issue langgenius/dify#3351)

• Fix issue : don't delete DatasetProcessRule, DatasetQuery and AppDatasetJoin when delete dataset with no document (Fix issue : don't delete DatasetProcessRule, DatasetQuery and AppDatasetJoin when delete dataset with no document langgenius/dify#3354)

• fix: remove middle editor may cause render placement error (fix: remove middle editor may cause render placement error langgenius/dify#3356)

• Added a note on the front-end docker build: use taobao source to accelerate the installation of front-end dependency packages to achieve the purpose of quickly building containers (Added a note on the front-end docker build: use taobao source to accelerate the installation of front-end dependency packages to achieve the purpose of quickly building containers langgenius/dify#3358)

• fix: var name too long would break ui in var assigner and end nodes (fix: var name too long would break ui in var assigner and end nodes langgenius/dify#3361)

• Refactor/react agent (Refactor/react agent langgenius/dify#3355)

• Fix/Bing Search url endpoint cannot be customized (Fix/Bing Search url endpoint cannot be customized langgenius/dify#3366)

• fix: image token calc of OpenAI Compatible API (fix: image token calc of OpenAI Compatible API langgenius/dify#3368)

• Update README.md (Update README.md langgenius/dify#3371)

• update workflow intro mp4 codec (update workflow intro mp4 codec langgenius/dify#3372)

• fix: cohere tool call does not support single tool (fix: cohere tool call does not support single tool langgenius/dify#3373)

• version to 0.6.2 (version to 0.6.2 langgenius/dify#3375)

• fix: variable pool mapping variable mixed up (fix: variable pool mapping variable mixed up langgenius/dify#3378)

• version to 0.6.2-fix1 (version to 0.6.2-fix1 langgenius/dify#3380)

• fix: yarn install extract package err when using GitHub Cache in amd6… (fix: yarn install extract package err when using GitHub Cache in amd6… langgenius/dify#3383)

• feat: Add support for embed file with AWS Bedrock Titan Model (feat: Add support for embed file with AWS Bedrock Titan Model langgenius/dify#3377)

• fix: remove - in dataset retriever tool name (fix: remove - in dataset retriever tool name langgenius/dify#3381)

• feat:api Add support for extracting EPUB files in ExtractProcessor (feat:api Add support for extracting EPUB files in ExtractProcessor langgenius/dify#3254)

• feat: show citation info in run history (feat: show citation info in run history langgenius/dify#3399)

• Feat: Invitation link automatically completes domain name (Feat: Invitation link automatically completes domain name langgenius/dify#3393)

• Integrated SearXNG search as built-in tool (Integrated SearXNG search as built-in tool langgenius/dify#3363)

• fix: [azure_openai] Error: 'NoneType' object has no attribute 'content' (fix: [azure_openai] Error: 'NoneType' object has no attribute 'content' langgenius/dify#3389)

• Update providers preview (Update providers preview langgenius/dify#3403)

• add xls file suport (add xls file suport langgenius/dify#3321)

• Update README.md (Update README.md langgenius/dify#3405)

• Fix/workflow tool incorrect parameter configurations (Fix/workflow tool incorrect parameter configurations langgenius/dify#3402)

• chore: replace all set interval (chore: replace all set interval langgenius/dify#3411)

• feat: Deprecate datetime.utcnow() in favor of datetime.now(timezone.utc).replace(tzinfo=None) for better timezone handling (Proposal to Replace datetime.datetime.utcnow() Due to Potential Deprecation and Improve Timezone Handling langgenius/dify#3408) (feat: Deprecate datetime.utcnow() in favor of datetime.now(timezone.utc).replace(tzinfo=None) for better timezone handling (#3408) langgenius/dify#3416)

• chore: remove Langchain tools import (chore: remove Langchain tools import langgenius/dify#3407)

• feat: gemini pro function call (feat: gemini pro function call langgenius/dify#3406)

• fix: shared text-generation stream (fix: shared text-generation stream langgenius/dify#3419)

• fix/dataset-retriever-tool-parameter-redundancy (fix/dataset-retriever-tool-parameter-redundancy langgenius/dify#3418)

• Feat/api tool custom timeout (Feat/api tool custom timeout langgenius/dify#3420)

• fix: test env key missing or wrong (fix: test env key missing or wrong langgenius/dify#3430)

• Doc/update readme (Doc/update readme langgenius/dify#3433)

• Update README_CN.md (Update README_CN.md langgenius/dify#3434)

• Update README_CN.md (Update README_CN.md langgenius/dify#3435)

• feat: add workflow editor shortcuts ( Implement Keyboard Shortcuts for the Workflow Editor langgenius/dify#3382) (feat: add workflow editor shortcuts (#3382) langgenius/dify#3390)

• FEAT: cohere rerank 3 model added (FEAT: cohere rerank 3 model added langgenius/dify#3431)

• chore: remove the COPY instruction in .devcontainer/Dockerfile (chore: remove the COPY instruction in .devcontainer/Dockerfile langgenius/dify#3409)

• fix typo: Changlog -> Changelog (fix typo: Changlog -> Changelog langgenius/dify#3442)

• fix: node shortcuts active in input fields (fix: node shortcuts active in input fields langgenius/dify#3438)

• Add nvidia codegemma 7b (Add nvidia codegemma 7b langgenius/dify#3437)

• Update yaml and py file in Tavily Tool (Update yaml and py file in Tavily Tool langgenius/dify#3450)

• feat: Added the mirror of Aliyun's Linux apk installation package and updated the deprecated taobao npm mirror address to npmmirror (feat: Added the mirror of Aliyun's Linux apk installation package and updated the deprecated taobao npm mirror address to npmmirror langgenius/dify#3459)

• Revert "Update yaml and py file in Tavily Tool" (Revert "Update yaml and py file in Tavily Tool" langgenius/dify#3464)

• feat: jina reader (feat: jina reader langgenius/dify#3468)

• feat: support configurate openai compatible stream tool call (feat: support configurate openai compatible stream tool call langgenius/dify#3467)

• feat: optimize the efficiency of generating chatbot conversation name (feat: optimize the efficiency of generating chatbot conversation name langgenius/dify#3472)

• feat: remove langchain from output parsers (feat: remove langchain from output parsers langgenius/dify#3473)

• chore: separate Python dependencies for development (chore: separate Python dependencies for development langgenius/dify#3198)

• chore: add sandbox permission tooltip (chore: add sandbox permission tooltip langgenius/dify#3477)

• fix: prompt template issue (fix: prompt template issue langgenius/dify#3449)

• feat: support relyt vector database (feat: support relyt vector database  langgenius/dify#3367)

• Update README.md (Update README.md langgenius/dify#3478)

• nvidia-label-update (nvidia-label-update langgenius/dify#3482)

• fix: in conversation log click op button would cause close drawer (fix: in conversation log click op button would cause close drawer langgenius/dify#3483)

• fix: workflow auto layout nodes offset & delete node shortcuts (fix: workflow auto layout nodes offset & delete node shortcuts langgenius/dify#3484)

• fix: workflow edge curvature (fix: workflow edge curvature langgenius/dify#3488)

• fix: stringify object while exporting batch result to csv (fix: stringify object while exporting batch result to csv langgenius/dify#3481)

• question classifier prompt optimization (question classifier prompt optimization langgenius/dify#3479)

• feat: refactor tongyi models (feat: refactor tongyi models langgenius/dify#3496)

• fix: bump twilio to 9.0.4 skipping yanked versions (fix: bump twilio to 9.0.4 skipping yanked versions langgenius/dify#3500)

• test: install ffmpeg for pytests (test: install ffmpeg for pytests langgenius/dify#3499)

• feat: support var auto rename in prompt editor (feat: support var auto rename in prompt editor langgenius/dify#3510)

• fix: add message caused problem after simple chat convert to workflow (fix: add message caused problem after simple chat convert to workflow langgenius/dify#3511)

• fix: the object field is empty string in some openAI api compatible model (fix: the object field is empty string in some openAI api compatible model langgenius/dify#3506)

• Add suuport for AWS Bedrock Cohere embedding (Add suuport for AWS Bedrock Cohere embedding langgenius/dify#3444)

• fix: add completion mode object check (fix: add completion mode object check langgenius/dify#3515)

• get config default for sandbox (get config default for sandbox langgenius/dify#3508)

• chore: improve reference variable picker user experience (chore: improve reference variable picker user experience langgenius/dify#3517)

• fix: array[string] context in llm node invalid (fix: array[string] context in llm node invalid langgenius/dify#3518)

• version to 0.6.3 (version to 0.6.3 langgenius/dify#3519)

• fix the return with wrong datatype of segment (fix the return with wrong datatype of segment langgenius/dify#3525)

• fix: the hover style of the card-item operation button container (fix: the hover style of the card-item operation button container langgenius/dify#3520)

• chore: lint .env file templates (chore: lint .env file templates langgenius/dify#3507)

• add support for swagger object type (add support for swagger object type langgenius/dify#3426)

• /fix register

• /add modelhub

• localhost

• /fix req bugs

• modelhub add rerank

---

Description

Please include a summary of the change and which issue is fixed. Please also include relevant motivation and context. List any dependencies that are required for this change.

Fixes # (issue)

Type of Change

Please delete options that are not relevant.

• Bug fix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds functionality)
• Breaking change (fix or feature that would cause existing functionality to not work as expected)
• This change requires a documentation update, included: Dify Document
• Improvement, including but not limited to code refactoring, performance optimization, and UI/UX improvement
• Dependency upgrade

How Has This Been Tested?

Please describe the tests that you ran to verify your changes. Provide instructions so we can reproduce. Please also list any relevant details for your test configuration

• TODO

Suggested Checklist:

• I have performed a self-review of my own code
• I have commented my code, particularly in hard-to-understand areas
• My changes generate no new warnings
• I ran dev/reformat(backend) and cd web && npx lint-staged(frontend) to appease the lint gods
• optional I have made corresponding changes to the documentation
• optional I have added tests that prove my fix is effective or that my feature works
• optional New and existing unit tests pass locally with my changes