Skip to content

A Dify plugin for RMinte inference engine. Provides LLM, embedding, and reranking models with zero-configuration deployment.

License

Notifications You must be signed in to change notification settings

massif-01/RM_Dify_Plugin

Repository files navigation

RMinte Model Provider Plugin for Dify

English | 中文


English

A Dify plugin that provides seamless integration with RMinte self-developed inference engine. Supports LLM, text embedding, and reranking models with hardcoded endpoints for zero-configuration deployment.

Features

  • Three Predefined Models

    • RM-01 LLM (Chat completion)
    • RM-01 Embedding (Text embedding)
    • RM-01 Reranker (Document reranking)
  • Zero Configuration - All API endpoints are preconfigured

  • OpenAI Compatible - Uses OpenAI-compatible API format

Installation

Important: Since this plugin is not signed by Dify, you need to modify the Dify configuration file before installation. Follow these steps:

  1. Navigate to the Dify docker directory:

    cd dify/docker
  2. Edit the .env file:

    nano .env
  3. Modify the plugin-related variables:

    • Press Ctrl+W to search for FORCE_VERIFYING_SIGNATURE
    • Change FORCE_VERIFYING_SIGNATURE to FORCE_VERIFYING_SIGNATURE=false
    • Find the line below ENFORCE_LANGGENIUS_PLUGIN_SIGNATURES and change it to ENFORCE_LANGGENIUS_PLUGIN_SIGNATURES=false
    • Press Ctrl+X, then type Y and press Enter to save and exit
  4. Download the .difypkg file from Releases

  5. Go to Dify → Settings → Model Providers → Install Plugin

  6. Upload the .difypkg file

  7. Configure the provider with any name and save

Hardcoded Endpoints

Model Type API Endpoint
LLM http://10.10.99.98:58000/v1
Embedding http://10.10.99.98:58080/v1
Reranker http://10.10.99.98:58081/v1

License

Apache License 2.0


中文

一个为 Dify 提供 RMinte 自研推理引擎无缝集成的插件。支持 LLM、文本嵌入和重排序模型,API 地址预配置,开箱即用。

功能特性

  • 三个预定义模型

    • RM-01 LLM(对话补全)
    • RM-01 Embedding(文本嵌入)
    • RM-01 Reranker(文档重排序)
  • 零配置 - 所有 API 地址已预配置

  • OpenAI 兼容 - 使用 OpenAI 兼容的 API 格式

安装方法

重要提示: 由于本插件没有经过 Dify 签名,故需修改 Dify 配置文件才可安装,步骤如下:

  1. 进入 Dify docker 目录:

    cd dify/docker
  2. 编辑 .env 文件:

    nano .env
  3. 修改插件相关的变量:

    • Ctrl+W 找到 FORCE_VERIFYING_SIGNATURE
    • FORCE_VERIFYING_SIGNATURE 改为 FORCE_VERIFYING_SIGNATURE=false
    • 下面一行的 ENFORCE_LANGGENIUS_PLUGIN_SIGNATURES 改为 ENFORCE_LANGGENIUS_PLUGIN_SIGNATURES=false
    • 然后按 Ctrl+X 后输入 Y 回车保存退出
  4. Releases 下载 .difypkg 文件

  5. 进入 Dify → 设置 → 模型供应商 → 安装插件

  6. 上传 .difypkg 文件

  7. 配置提供者名称(任意)并保存

预配置的 API 地址

模型类型 API 地址
LLM http://10.10.99.98:58000/v1
Embedding http://10.10.99.98:58080/v1
Reranker http://10.10.99.98:58081/v1

许可证

Apache License 2.0

About

A Dify plugin for RMinte inference engine. Provides LLM, embedding, and reranking models with zero-configuration deployment.

Topics

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages