Replies: 1 comment 4 replies
-
|
Hey @jay-jjwu! 👋 I'm here to assist you with any bugs, questions, or contributions you have. Let's squash those bugs together! You can integrate the ChatGLM model into Dify. Dify supports ZHIPU (ChatGLM) as a provider for both System Inference Models and Embedding Models. Additionally, Dify can connect to locally deployed Xinference models, which include support for ChatGLM. To deploy Xinference locally and integrate it with Dify, follow these steps:
Click "Save" to use the model in the Dify application. For more detailed information, you can refer to the Xinference documentation [1][2][3]. |
Beta Was this translation helpful? Give feedback.
-
|
but this is not my aimming, i dont have enough hardware to run models in xinference locally, that's why i'm looking for integrate 3rd party modeling like chatglm or llama3 from aliyun. |
Beta Was this translation helpful? Give feedback.
-
|
Yes, you can integrate third-party models like ChatGLM or LLaMA3 from Aliyun into Dify without running them locally. You need to obtain the API key from the model provider's official website and set it in Dify's For specific integration methods, you can refer to the documentation for each provider: |
Beta Was this translation helpful? Give feedback.
-
|
yes, but all above you mentioned are local models. Ii already have an api-key from aliyun, is it possible to connect model like llama3 via aliyun provider channel? |
Beta Was this translation helpful? Give feedback.
-
|
Yes, it is possible to connect the LLaMA3 model from Aliyun to Dify using the Aliyun provider channel with an API key. You need to configure the provider: tongyi
label:
zh_Hans: 通义千问
en_US: TONGYI
icon_small:
en_US: icon_s_en.png
icon_large:
zh_Hans: icon_l_zh.png
en_US: icon_l_en.png
background: "#EFF1FE"
help:
title:
en_US: Get your API key from AliCloud
zh_Hans: 从阿里云获取 API Key
url:
en_US: https://dashscope.console.aliyun.com/api-key_management
supported_model_types:
- llm
- tts
- text-embedding
configurate_methods:
- predefined-model
provider_credential_schema:
credential_form_schemas:
- variable: dashscope_api_key
label:
en_US: API Key
type: secret-input
required: true
placeholder:
zh_Hans: 在此输入您的 API Key
en_US: Enter your API KeyYou need to obtain the API key from AliCloud and enter it in the required field to connect the model [1]. |
Beta Was this translation helpful? Give feedback.
-
did anyone try to add 3rd party models to dify?
i did try to add yaml confogi file to integrate chatglm form aliyun to dify, but the log shows only qwen models are currently supported as below:
//*********
ERROR [Dummy-2] [base_app_generate_response_converter.py:128] - Not support model: chatglm3-6b, currently only support qwen models.
so the 3rd party models are not supported?
Beta Was this translation helpful? Give feedback.
All reactions