[docker ragflow數據遷移]目錄
- 背景
- 一、我的配置文件
- ? 數據存儲路徑一覽(基于你的配置文件)
- 關于這些 `volumes` 的說明
- 📁 如何查看這些卷在本地的具體位置?
- 可能用到的docker 命令如下。
- 📦 總結建議
- 🛠? 如果想自定義這些路徑
- TODO 未完 待續 。。。
背景
通過 docker compose -f docker-compose.yml -p ragflow up -d 部署了 ragflow本地服務,現在想遷移到另一臺服務器上,服務可以通過github 拉取最新的 https://github.com/infiniflow/ragflow 代碼,重新配置啟動。
但是原服務器上添加過的數據,比如知識庫,怎么遷移到新服務器,避免重復添加,重復操作呢?
一、我的配置文件
啟動 ragflow 基礎配置文件如下 : docker-compose-base.yml
可以看到,各個基礎服務的 volumes 數據卷名稱和掛載信息
(base) root@hostname:/usr/local/soft/ai/rag/v0.19.0/ragflow/docker# vim docker-compose-base.ymlservices:es01:container_name: ragflow-es-01profiles:- elasticsearchimage: elasticsearch:${STACK_VERSION}volumes:- esdata01:/usr/share/elasticsearch/dataports:- ${ES_PORT}:9200env_file: .envenvironment:- node.name=es01- ELASTIC_PASSWORD=${ELASTIC_PASSWORD}- bootstrap.memory_lock=false- discovery.type=single-node- xpack.security.enabled=true- xpack.security.http.ssl.enabled=false- xpack.security.transport.ssl.enabled=false- cluster.routing.allocation.disk.watermark.low=5gb- cluster.routing.allocation.disk.watermark.high=3gb- cluster.routing.allocation.disk.watermark.flood_stage=2gb- TZ=${TIMEZONE}mem_limit: ${MEM_LIMIT}ulimits:memlock:soft: -1hard: -1healthcheck:test: ["CMD-SHELL", "curl http://localhost:9200"]interval: 10stimeout: 10sretries: 120networks:- ragflowrestart: on-failureopensearch01:container_name: ragflow-opensearch-01profiles:- opensearchimage: hub.icert.top/opensearchproject/opensearch:2.19.1volumes:- osdata01:/usr/share/opensearch/dataports:- ${OS_PORT}:9201env_file: .envenvironment:- node.name=opensearch01- OPENSEARCH_PASSWORD=${OPENSEARCH_PASSWORD}- OPENSEARCH_INITIAL_ADMIN_PASSWORD=${OPENSEARCH_PASSWORD}- bootstrap.memory_lock=false- discovery.type=single-node- plugins.security.disabled=false- plugins.security.ssl.http.enabled=false- plugins.security.ssl.transport.enabled=true- cluster.routing.allocation.disk.watermark.low=5gb- cluster.routing.allocation.disk.watermark.high=3gb- cluster.routing.allocation.disk.watermark.flood_stage=2gb- TZ=${TIMEZONE}- http.port=9201mem_limit: ${MEM_LIMIT}ulimits:memlock:soft: -1hard: -1healthcheck:test: ["CMD-SHELL", "curl http://localhost:9201"]interval: 10stimeout: 10sretries: 120networks:- ragflowrestart: on-failureinfinity:container_name: ragflow-infinityprofiles:- infinityimage: infiniflow/infinity:v0.6.0-dev3volumes:- infinity_data:/var/infinity- ./infinity_conf.toml:/infinity_conf.tomlcommand: ["-f", "/infinity_conf.toml"]ports:- ${INFINITY_THRIFT_PORT}:23817- ${INFINITY_HTTP_PORT}:23820- ${INFINITY_PSQL_PORT}:5432env_file: .envenvironment:- TZ=${TIMEZONE}mem_limit: ${MEM_LIMIT}ulimits:nofile:soft: 500000hard: 500000networks:- ragflowhealthcheck:test: ["CMD", "curl", "http://localhost:23820/admin/node/current"]interval: 10stimeout: 10sretries: 120restart: on-failuresandbox-executor-manager:container_name: ragflow-sandbox-executor-managerprofiles:- sandboximage: ${SANDBOX_EXECUTOR_MANAGER_IMAGE-infiniflow/sandbox-executor-manager:latest}privileged: trueports:- ${SANDBOX_EXECUTOR_MANAGER_PORT-9385}:9385env_file: .envvolumes:- /var/run/docker.sock:/var/run/docker.socknetworks:- ragflowsecurity_opt:- no-new-privileges:trueenvironment:- TZ=${TIMEZONE}- SANDBOX_EXECUTOR_MANAGER_POOL_SIZE=${SANDBOX_EXECUTOR_MANAGER_POOL_SIZE:-3}- SANDBOX_BASE_PYTHON_IMAGE=${SANDBOX_BASE_PYTHON_IMAGE:-infiniflow/sandbox-base-python:latest}- SANDBOX_BASE_NODEJS_IMAGE=${SANDBOX_BASE_NODEJS_IMAGE:-infiniflow/sandbox-base-nodejs:latest}- SANDBOX_ENABLE_SECCOMP=${SANDBOX_ENABLE_SECCOMP:-false}- SANDBOX_MAX_MEMORY=${SANDBOX_MAX_MEMORY:-256m}- SANDBOX_TIMEOUT=${SANDBOX_TIMEOUT:-10s}healthcheck:test: ["CMD", "curl", "http://localhost:9385/healthz"]interval: 10stimeout: 5sretries: 5restart: on-failuremysql:# mysql:5.7 linux/arm64 image is unavailable.image: mysql:8.0.39container_name: ragflow-mysqlenv_file: .envenvironment:- MYSQL_ROOT_PASSWORD=${MYSQL_PASSWORD}- TZ=${TIMEZONE}command:--max_connections=1000--character-set-server=utf8mb4--collation-server=utf8mb4_unicode_ci--default-authentication-plugin=mysql_native_password--tls_version="TLSv1.2,TLSv1.3"--init-file /data/application/init.sql--binlog_expire_logs_seconds=604800ports:- ${MYSQL_PORT}:3306volumes:- mysql_data:/var/lib/mysql- ./init.sql:/data/application/init.sqlnetworks:- ragflowhealthcheck:test: ["CMD", "mysqladmin" ,"ping", "-uroot", "-p${MYSQL_PASSWORD}"]interval: 10stimeout: 10sretries: 3restart: on-failureminio:image: quay.io/minio/minio:RELEASE.2025-06-13T11-33-47Zcontainer_name: ragflow-miniocommand: server --console-address ":9001" /dataports:- ${MINIO_PORT}:9000- ${MINIO_CONSOLE_PORT}:9001env_file: .envenvironment:- MINIO_ROOT_USER=${MINIO_USER}- MINIO_ROOT_PASSWORD=${MINIO_PASSWORD}- TZ=${TIMEZONE}volumes:- minio_data:/datanetworks:- ragflowrestart: on-failurehealthcheck:test: ["CMD", "curl", "-f", "http://localhost:9000/minio/health/live"]interval: 30stimeout: 20sretries: 3redis:# swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/valkey/valkey:8image: valkey/valkey:8container_name: ragflow-rediscommand: redis-server --requirepass ${REDIS_PASSWORD} --maxmemory 128mb --maxmemory-policy allkeys-lruenv_file: .envports:- ${REDIS_PORT}:6379volumes:- redis_data:/datanetworks:- ragflowrestart: on-failurehealthcheck:test: ["CMD", "redis-cli", "-a", "${REDIS_PASSWORD}", "ping"]interval: 5stimeout: 3sretries: 3start_period: 10svolumes:esdata01:driver: localosdata01:driver: localinfinity_data:driver: localmysql_data:driver: localminio_data:driver: localredis_data:driver: localnetworks:ragflow:driver: bridg
根據上面提供的 docker-compose-base.yml
配置文件內容,下面是 RAGFlow 各個組件在本地的數據存儲路徑說明:
? 數據存儲路徑一覽(基于你的配置文件)
組件 | 容器內路徑 | 本地路徑(默認) | 用途說明 |
---|---|---|---|
MySQL | /var/lib/mysql | mysql_data (默認在 Docker 管理的 volume 中) | 存儲用戶、文檔元數據等結構化信息 |
MinIO | /data | minio_data (Docker volume) | 存儲上傳的原始文檔、處理后的文本等 |
Elasticsearch (es01) | /usr/share/elasticsearch/data | esdata01 (Docker volume) | 存儲關鍵詞搜索索引數據 |
OpenSearch (opensearch01) | /usr/share/opensearch/data | osdata01 (Docker volume) | 可選搜索引擎,用于檢索 |
Infinity(向量數據庫) | /var/infinity | infinity_data (Docker volume) | 存儲向量索引 |
Redis | /data | redis_data (Docker volume) | 緩存數據、任務狀態等 |
Sandbox Executor Manager | 無持久化數據 | 無 | 用于運行沙箱任務,不持久化 |
關于這些 volumes
的說明
你在 docker-compose-base.yml
文件末尾定義了如下 volume:
volumes:esdata01:driver: localosdata01:driver: localinfinity_data:driver: localmysql_data:driver: localminio_data:driver: localredis_data:driver: local
這些 volumes
是 Docker 管理的命名卷(named volumes),默認情況下它們會存儲在 Docker 的默認數據目錄中:
- Linux 系統下通常為:
/var/lib/docker/volumes/<volume_name>/_data
例如:
- MySQL 數據實際路徑為:
/var/lib/docker/volumes/mysql_data/_data
- MinIO 數據實際路徑為:
/var/lib/docker/volumes/minio_data/_data
📁 如何查看這些卷在本地的具體位置?
可能用到的docker 命令如下。
📦 總結建議
目標 | 建議 |
---|---|
查看數據存儲位置 | 使用 docker volume inspect <volume_name> |
備份數據 | 備份對應路徑,如 /var/lib/docker/volumes/mysql_data/_data |
自定義路徑 | 修改 docker-compose-base.yml 中的 volumes 配置 |
清理數據 | 刪除對應 volume,如 docker volume rm mysql_data |
所以,我們想查看某個 volume 的實際路徑,可以有兩種方法:
- find / -name ‘esdata01’
- docker volume inspect xxxx
本次我們使用如下命令,esdata01 是從上面配置文件中獲悉:
(base) root@hostname:/home/ltkj# docker volume inspect esdata01
[]
Error response from daemon: get esdata01: no such volume(base) root@hostname:/home/ltkj# docker volume inspect ragflow_esdata01
輸出示例:
[{"CreatedAt": "2025-06-13T10:52:28Z","Driver": "local","Labels": {"com.docker.compose.config-hash": "3bcef595c5f477c290ccaa07cbf05671d287fef95c1fa4b67fad841e66481794","com.docker.compose.project": "ragflow","com.docker.compose.version": "2.34.0","com.docker.compose.volume": "esdata01"},"Mountpoint": "/var/lib/docker/volumes/ragflow_esdata01/_data","Name": "ragflow_esdata01","Options": null,"Scope": "local"}
]
這樣就能知道 esdata01,minio,MySQL 等基礎服務的數據存在哪里了。
🛠? 如果想自定義這些路徑
可以在 volumes
配置中指定本地路徑,例如:
volumes:mysql_data:driver: localdriver_opts:type: noneo: binddevice: /opt/ragflow/mysql_data
這樣 MySQL 數據就會存在 /opt/ragflow/mysql_data
。