v0.11.0

[laipz8200]

🌟 What's New in v0.11.0? 🌟

Welcome to version v0.11.0, where we're elevating your workflow and model capabilities with new features and improvements designed to empower your technical operations.

⚡ Workflow Improvement

• ✨ Shining Spotlight: Iteration Node Parallel Mode - Elevate your productivity with the Iteration Node now supporting parallel processing, complete with enhanced error handling. This ensures smoother and more efficient workflows, crafted by @Nov1c444 in feat: Iteration node support parallel mode #9493.
• Support for Forms in Conversations: Streamline your dialogue capabilities with integrated form support, thanks to @crazywoola in Feat/support form in conversation #9980.
• Configurable Workflow File Upload Limit: Now you can cap workflow file uploads to better control system resources, a thoughtful addition by @laipz8200 in feat(workflow): add configurable workflow file upload limit #10176.
• PPTX Data Extraction with Unstructured API: Streamline your PPTX data parsing with the latest unstructured API support from @laipz8200 in feat(document_extractor): integrate unstructured API for PPTX extraction #10180.
• Prompt Generators with LLM Indicators: Easily craft prompts with added contextual insights from LLM indicators, thanks to @Kota-Yamaguchi in Feat : add LLM model indicator in prompt generator #10187.

📚 Knowledgebase Features

• Knowledge API Update: The original Dataset Hit Testing API is updated to Retrieve Chunks from a Knowledge Base. Users can access Dify's Knowledge as an independent service through this API, thanks to @JohnJyong in Feat/update knowledge api url #10102.
• Optimized Full-Text and YAML Support: Retrieve top-k results in Elasticsearch and utilize YAML in document nodes, thanks to enhancements by @JohnJyong and @hwzhuhao.

🔍 Providers and Models

• xAI Model Provider: Broaden your options with the new xAI provider, equipped by @hjlarry in feat: add xAI model provider #10272.
• Claude 3.5 Haiku by Anthropic: Expand your toolkit with Anthropic's latest model, "claude-3-5-haiku-20241022," offering new creative AI opportunities, added by @mazyu36 in feat(model_runtime): add new model 'claude-3-5-haiku-20241022' #10285.
• Ernie-4.0-turbo-128k LLM: Embrace the power of Wenxin's latest LLM offering, courtesy of @yaohongfenglove in add llm: ernie-4.0-turbo-128k of wenxin #10135.
• VESSL AI OpenAI API Compatibility: Integrate effortlessly with VESSL AI models, thanks to @larcane97 in Add VESSL AI OpenAI API-compatible model provider and LLM model #9474.
• GPUStack Model Provider: Meet your compute-intensive needs with the GPUStack provider, introduced by @gitlawr in feat: add gpustack model provider #10158.
• Claude 3.5 Haiku for Bedrock: Unleash creative AI with Amazon Bedrock's integration of "claude-3-5-haiku-20241022," contributed by @mazyu36 in feat: support Claude 3.5 Haiku on Amazon Bedrock #10265.

🗄️ VDB Integrations

• Couchbase VDB Integration: Unlock the power of Couchbase as a vector database, a seamless addition by @roadgoat19 in feat: couchbase integration #6165.
• OceanBase as a Vector Store Option: Explore OceanBase for advanced vector management, brought to you by @powerfooI in Added OceanBase as an option for the vector store in Dify #10010.
• Lindorm as a Vector Store Option: Discover Lindorm for enhanced vector storage capabilities, from @AlwaysBluer in Add Lindorm as a VDB choice #10202.

🔧 Fixes & Enhancements

• Async Preloading for Fast Launches: Speed up your server starts with async preloading, a game-changer from @bowenliang123 in improve: significantly speed up the server launching time by async preloading tool providers #9146.
• Robust Rerank & Retrieval Validation: Fine-tune your searches with enhanced validation integrity, cleverly optimized by @zxhlyh and @JohnJyong.
• Content-Type Header Flexibility: Say goodbye to case sensitivity issues, thanks to a vital fix by @fujita-h in Fix content-type header case sensitivity #9961.
• Secure Input & Index Handling: Ensure input reliability and indexing with these vital fixes from @JohnJyong and @laipz8200.
• Reliable Conversation Variables: Keep your data flows consistent and accurate with improvements by @hjlarry in fix: conversation variable may not change in the answer node #10034.

📄 Documents

• Added: README_PT.md in Brazilian Portuguese: Expand your documentation reach with a Brazilian Portuguese version, thanks to @lc-rezende in Added: README_PT.md in Brazilian Portuguese #10026.

This release makes our platform more robust and versatile, catering to your needs for a more efficient and feature-rich environment. Upgrade now to explore the possibilities! 🚀

---

Upgrade Guide

Docker compose deployments

1. Back up your customized docker-compose YAML file (optional)

   cd docker
   cp docker-compose.yaml docker-compose.yaml.$(date +%s).bak

2. Get the latest code from the main branch

   git checkout main
   git pull origin main

3. Stop the service，Command, please execute in the docker directory

   docker compose down

4. Back up data

   tar -cvf volumes-$(date +%s).tgz volumes

5. Upgrade services

   docker compose up -d

Source Code deployments

1. Stop API server, Worker and Web frontend Server.

2. Get the latest code from the release branch:

   git checkout 0.11.0

3. Update Python dependencies:

   cd api
   poetry install

4. Then, let's run the migration script:

   poetry run flask db upgrade

5. Finally, run API server, Worker and Web frontend Server again.

---

What's Changed

• fix: button rendering when using streaming by @crazywoola in fix: button rendering when using streaming #9957
• add top_k for es full text search by @JohnJyong in add top_k for es full text search #9963
• fix: Fix page logout issue due to refresh-token by @WTW0313 in fix: Fix page logout issue due to refresh-token #9970
• chore: Enable tencent cos test to run by @yaoice in chore: Enable tencent cos test to run #9971
• fix: allow external knowledge api use simple host by @hjlarry in fix: allow external knowledge api use simple host #9966
• Feat/support form in conversation by @crazywoola in Feat/support form in conversation #9980
• feat: couchbase integration by @roadgoat19 in feat: couchbase integration #6165
• fix: gemini model use some tools raise error by @hjlarry in fix: gemini model use some tools raise error #9993
• add tidb spend limit config by @JohnJyong in add tidb spend limit config #9999
• Added OceanBase as an option for the vector store in Dify by @powerfooI in Added OceanBase as an option for the vector store in Dify #10010
• chore: add tidb-on-qdrant configuration in env and docker-compose file by @hwzhuhao in chore: add tidb-on-qdrant configuration in env and docker-compose file #10015
• Fix content-type header case sensitivity by @fujita-h in Fix content-type header case sensitivity #9961
• fix(llm-node): handle NoneSegment variables properly by @laipz8200 in fix(llm-node): handle NoneSegment variables properly #9978
• fix: conversation variable may not change in the answer node by @hjlarry in fix: conversation variable may not change in the answer node #10034
• Added: README_PT.md in Brazilian Portuguese by @lc-rezende in Added: README_PT.md in Brazilian Portuguese #10026
• Fix Pydantic error: TIDB_ON_QDRANT_CLIENT_TIMEOUT #10023 : error in docker-compose.yaml about TIDB_ON_QDRANT_CLIENT… by @mabuchs in Fix #10023 : error in docker-compose.yaml about TIDB_ON_QDRANT_CLIENT… #10025
• chore: Add aliyun oss tests by @yaoice in chore: Add aliyun oss tests #10031
• add rerank check when doing mutil-retrieval by @JohnJyong in add rerank check when doing mutil-retrieval #9998
• fix update_by_api batch field issue by @JohnJyong in fix update_by_api batch field issue #10001
• chore: improve validation and handler of logging timezone with TimezoneName by @bowenliang123 in chore: improve validation and handler of logging timezone with TimezoneName #9595
• add PROMPT_GENERATION_MAX_TOKENS and CODE_GENERATION_MAX_TOKENS in docker enviromment by @XiaoLey in add PROMPT_GENERATION_MAX_TOKENS and CODE_GENERATION_MAX_TOKENS in docker enviromment #10040
• feat: add YAML type in document extractor node by @hwzhuhao in feat: add YAML type in document extractor node #9997
• feat: /conversations api response add 'update_at' field，and update api docs add sort_by parameter by @rchlz in feat: /conversations api response add 'update_at' field，and update api docs add sort_by parameter #10043
• chore: use dify_config.TIDB_SPEND_LIMIT instead of constant value by @hwzhuhao in chore: use dify_config.TIDB_SPEND_LIMIT instead of constant value #10038
• fix: resolve the incorrect model name of hunyuan-standard-256k by @hwzhuhao in fix: resolve the incorrect model name of hunyuan-standard-256k #10052
• chore: mount config file of sandbox by @hjlarry in chore: mount config file of sandbox #8576
• fix(workflow): refine variable type checks in LLMNode by @laipz8200 in fix(workflow): refine variable type checks in LLMNode #10051
• fix: fix poetry install command in devcontainer by @22mSqRi in fix: fix poetry install command in devcontainer #9507
• fix: prevent onChange during IME composition by @Fog3211 in fix: prevent onChange during IME composition #10059
• chore: Set file size limits for video and audio uploads from docker env by @fujita-h in chore: Set file size limits for video and audio uploads from docker env #10063
• Fixed the issue where recall the knowledge base in the iteration of the workflow and report errors when executing by @wangiii in Fixed the issue where recall the knowledge base in the iteration of the workflow and report errors when executing #10060
• fix the typos in the hit testing template by @sacryu in fix the typos in the hit testing template #10072
• Revert "chore: improve validation and handler of logging timezone with TimezoneName" by @crazywoola in Revert "chore: improve validation and handler of logging timezone with TimezoneName" #10077
• fix azure chatgpt o1 parameter error by @charli117 in fix azure chatgpt o1 parameter error #10067
• improve: significantly speed up the server launching time by async preloading tool providers by @bowenliang123 in improve: significantly speed up the server launching time by async preloading tool providers #9146
• chore: update type definition to resolve lint error in Base usage at text-editor.tsx by @Kota-Yamaguchi in chore: update type definition to resolve lint error in Base usage at text-editor.tsx #10083
• build: update docker login action by @AkaraChen in build: update docker login action #10050
• feat: enhance comfyui workflow by @hjlarry in feat: enhance comfyui workflow #10085
• chore: remove an unnecessary link by @hjlarry in chore: remove an unnecessary link #10088
• fix: view logs in prompt, no response when clicked by @beginnerZhang in fix: view logs in prompt, no response when clicked #10093
• refactor(version): simplify version comparison logic by @laipz8200 in refactor(version): simplify version comparison logic #10109
• chore: save uploaded file extension as lower case by @hjlarry in chore: save uploaded file extension as lower case #10111
• feat(app_dsl_service): enhance error handling and DSL version management by @laipz8200 in feat(app_dsl_service): enhance error handling and DSL version management #10108
• fix: Version '1:1.3.dfsg+really1.3.1-1' for 'zlib1g' was not found by @ZuzooVn in fix: Version '1:1.3.dfsg+really1.3.1-1' for 'zlib1g' was not found #10096
• fix issue: update document segment setting failed by @JohnJyong in fix issue: update document segment setting failed #10107
• fix: log detail panel not showing any message when total count greate… by @xuzuodong in fix: log detail panel not showing any message when total count greate… #10119
• fix(Dockerfile): conditionally install zlib1g based on architecture by @laipz8200 in fix(Dockerfile): conditionally install zlib1g based on architecture #10118
• fix: optimize unique document filtering with set by @y-omr in fix: optimize unique document filtering with set #10082
• Feat/update knowledge api url by @JohnJyong in Feat/update knowledge api url #10102
• Fix/rerank validation issue by @zxhlyh in Fix/rerank validation issue #10131
• fix issue: query is none when doing retrieval by @JohnJyong in fix issue: query is none when doing retrieval #10129
• fix: bar chart issue with duplicate x-axis labels being incorrectly ignored by @llinvokerl in fix: bar chart issue with duplicate x-axis labels being incorrectly ignored #10134
• fix: avoid unexpected error when create knowledge base with baidu vector database and wenxin embedding model by @WayneCao in fix: avoid unexpected error when create knowledge base with baidu vector database and wenxin embedding model #10130
• add llm: ernie-4.0-turbo-128k of wenxin by @yaohongfenglove in add llm: ernie-4.0-turbo-128k of wenxin #10135
• Refined README for better reading experience. by @Theysua in Refined README for better reading experience. #10143
• feat: synchronize input/output variables in the panel with generated code by the code generator by @Kota-Yamaguchi in feat: synchronize input/output variables in the panel with generated code by the code generator #10150
• Add VESSL AI OpenAI API-compatible model provider and LLM model by @larcane97 in Add VESSL AI OpenAI API-compatible model provider and LLM model #9474
• refactor(service): handle unsupported DSL version with warning by @laipz8200 in refactor(service): handle unsupported DSL version with warning #10151
• clean un-allowed special charters when doing indexing estimate by @JohnJyong in clean un-allowed special charters when doing indexing estimate #10153
• fix: upload remote image preview by @zxhlyh in fix: upload remote image preview #9952
• Feat/add-remote-file-upload-api by @laipz8200 in Feat/add-remote-file-upload-api #9906
• refactor(migration/model): update column types for workflow schema by @laipz8200 in refactor(migration/model): update column types for workflow schema #10160
• refactor(tools): Avoid warnings. by @laipz8200 in refactor(tools): Avoid warnings. #10161
• feat: add gpustack model provider by @gitlawr in feat: add gpustack model provider #10158
• fix: Cannot find declaration to go to CLEAN_DAY_SETTING by @jiangbo721 in fix: Cannot find declaration to go to CLEAN_DAY_SETTING #10157
• fix(workflow model): ensure consistent timestamp updating by @laipz8200 in fix(workflow model): ensure consistent timestamp updating #10172
• [fix] fix the bug that modify document name not effective by @ProseGuys in [fix] fix the bug that modify document name not effective #10154
• fix(tools): suppress RuntimeWarnings in podcast audio generator by @laipz8200 in fix(tools): suppress RuntimeWarnings in podcast audio generator #10182
• feat(document_extractor): integrate unstructured API for PPTX extraction by @laipz8200 in feat(document_extractor): integrate unstructured API for PPTX extraction #10180
• fix(api): replace current_user with end_user in file upload by @laipz8200 in fix(api): replace current_user with end_user in file upload #10194
• fix: webapp upload file by @zxhlyh in fix: webapp upload file #10195
• chore : code generator preview hint by @Kota-Yamaguchi in chore : code generator preview hint #10188
• chore: enable vision support for models in OpenRouter that should have supported vision by @XiaoLey in chore: enable vision support for models in OpenRouter that should have supported vision #10191
• Feat : add LLM model indicator in prompt generator by @Kota-Yamaguchi in Feat : add LLM model indicator in prompt generator #10187
• refactor(document_extractor): update base exception class by @laipz8200 in refactor(document_extractor): update base exception class #10208
• refactor(list_operator): refine exception handling for error specificity by @laipz8200 in refactor(list_operator): refine exception handling for error specificity #10206
• refactor(validation): improve input validation logic by @laipz8200 in refactor(validation): improve input validation logic #10175
• Fix/10199 application error a client side exception has occurred see the browser console for more information by @crazywoola in Fix/10199 application error a client side exception has occurred see the browser console for more information #10211
• Add Lindorm as a VDB choice by @AlwaysBluer in Add Lindorm as a VDB choice #10202
• Modify translation by @HanqingZ in Modify translation #10213
• fix the ssrf of docx file extractor external images by @JohnJyong in fix the ssrf of docx file extractor external images #10237
• chore(llm_node): remove unnecessary type ignore for context assignment by @laipz8200 in chore(llm_node): remove unnecessary type ignore for context assignment #10216
• refactor(workflow): introduce specific exceptions for code validation by @laipz8200 in refactor(workflow): introduce specific exceptions for code validation #10218
• refactor(http_request): add custom exception handling for HTTP request nodes by @laipz8200 in refactor(http_request): add custom exception handling for HTTP request nodes #10219
• refactor(workflow): introduce specific error handling for LLM nodes by @laipz8200 in refactor(workflow): introduce specific error handling for LLM nodes #10221
• refactor(list_operator): replace ValueError with InvalidKeyError by @laipz8200 in refactor(list_operator): replace ValueError with InvalidKeyError #10222
• fix: missing working directory parameter in script by @shisaru292 in fix: missing working directory parameter in script #10226
• feat(workflow): add configurable workflow file upload limit by @laipz8200 in feat(workflow): add configurable workflow file upload limit #10176
• Using a dedicated interface to obtain the token credential for the gitee.ai provider by @fchange in Using a dedicated interface to obtain the token credential for the gitee.ai provider #10243
• chore(Dockerfile): upgrade zlib arm64 by @laipz8200 in chore(Dockerfile): upgrade zlib arm64 #10244
• fix(validation): allow to use 0 in the inputs form by @laipz8200 in fix(validation): allow to use 0 in the inputs form #10255
• fix: buitin tool aippt by @guogeer in fix: buitin tool aippt #10234
• refactor(parameter_extractor): implement custom error classes by @laipz8200 in refactor(parameter_extractor): implement custom error classes #10260
• feat: support Claude 3.5 Haiku on Amazon Bedrock by @mazyu36 in feat: support Claude 3.5 Haiku on Amazon Bedrock #10265
• feat(document_extractor): support tool file in document extractor by @laipz8200 in feat(document_extractor): support tool file in document extractor #10217
• fix(workflow): handle else condition branch addition error in if-else node by @GeorgeCaoJ in fix(workflow): handle else condition branch addition error in if-else node #10257
• feat: Iteration node support parallel mode by @Nov1c444 in feat: Iteration node support parallel mode #9493
• Updates: Add mplfonts library for customizing matplotlib fonts and Va… by @BenjaminX in Updates: Add mplfonts library for customizing matplotlib fonts and Va… #9903
• chore: translate i18n files by @github-actions in chore: translate i18n files #10273
• refactor the logic of refreshing access_token by @douxc in refactor the logic of refreshing access_token #10068
• fix(node): correct file property name in function switch by @laipz8200 in fix(node): correct file property name in function switch #10284
• feat(model): add validation for custom disclaimer length by @laipz8200 in feat(model): add validation for custom disclaimer length #10287
• fix(model_runtime): fix wrong max_tokens for Claude 3.5 Haiku on Amazon Bedrock by @mazyu36 in fix(model_runtime): fix wrong max_tokens for Claude 3.5 Haiku on Amazon Bedrock #10286
• feat(model_runtime): add new model 'claude-3-5-haiku-20241022' by @mazyu36 in feat(model_runtime): add new model 'claude-3-5-haiku-20241022' #10285
• feat: add xAI model provider by @hjlarry in feat: add xAI model provider #10272
• fix: borken faq url in CONTRIBUTING.md by @euxx in fix: borken faq url in CONTRIBUTING.md #10275
• fix: handle KeyError when accessing rules in CleanProcessor.clean by @pinsily in fix: handle KeyError when accessing rules in CleanProcessor.clean #10258
• fix typo: writeOpner to writeOpener by @mazyu36 in fix typo: writeOpner to writeOpener #10290
• fix(http_request): improve parameter initialization and reorganize tests by @laipz8200 in fix(http_request): improve parameter initialization and reorganize tests #10297
• fix: iteration none output error by @Nov1c444 in fix: iteration none output error #10295
• chore: update version to 0.11.0 across all relevant files by @laipz8200 in chore: update version to 0.11.0 across all relevant files #10278

New Contributors

• @roadgoat19 made their first contribution in feat: couchbase integration #6165
• @powerfooI made their first contribution in Added OceanBase as an option for the vector store in Dify #10010
• @lc-rezende made their first contribution in Added: README_PT.md in Brazilian Portuguese #10026
• @22mSqRi made their first contribution in fix: fix poetry install command in devcontainer #9507
• @Fog3211 made their first contribution in fix: prevent onChange during IME composition #10059
• @sacryu made their first contribution in fix the typos in the hit testing template #10072
• @beginnerZhang made their first contribution in fix: view logs in prompt, no response when clicked #10093
• @llinvokerl made their first contribution in fix: bar chart issue with duplicate x-axis labels being incorrectly ignored #10134
• @yaohongfenglove made their first contribution in add llm: ernie-4.0-turbo-128k of wenxin #10135
• @larcane97 made their first contribution in Add VESSL AI OpenAI API-compatible model provider and LLM model #9474
• @gitlawr made their first contribution in feat: add gpustack model provider #10158
• @jiangbo721 made their first contribution in fix: Cannot find declaration to go to CLEAN_DAY_SETTING #10157
• @ProseGuys made their first contribution in [fix] fix the bug that modify document name not effective #10154
• @AlwaysBluer made their first contribution in Add Lindorm as a VDB choice #10202
• @shisaru292 made their first contribution in fix: missing working directory parameter in script #10226
• @mazyu36 made their first contribution in feat: support Claude 3.5 Haiku on Amazon Bedrock #10265
• @GeorgeCaoJ made their first contribution in fix(workflow): handle else condition branch addition error in if-else node #10257
• @Nov1c444 made their first contribution in feat: Iteration node support parallel mode #9493
• @euxx made their first contribution in fix: borken faq url in CONTRIBUTING.md #10275

Full Changelog: 0.10.2...0.11.0

---

This discussion was created from the release v0.11.0.

[dsnetgo]

Google Search Api not Working. Please Fix it

[BryceWG]

Why am I getting a login authentication not configured on the login page after updating to v0.11 using docker?

[laipz8200]

Just wait for the api server to start and give it another try.

[laipz8200]

Google Search Api not Working. Please Fix it

maybe you need to submit an issue.