背景
R2R是一個采用Python編寫的開源AI RAG框架項目，與PostgreSQL技術棧集成度高，運行需求資源少（主要是本人的Macbook air m1內存只有8G）的特點，對部署本地私有化化AI RAG應用友好。
Resource Recommendations
When running R2R, we recommend:
- At least 4 vCPU cores
- 8+GB of RAM (16GB preferred)
- 50gb + 4x raw data size (size of data to be ingested after converting to TXT) of disk space
安裝R2R light
First, install the R2R CLI with the additional light dependencies:
hbu@Pauls-MacBook-Air dragon-flight % pip install 'r2r[core,ingestion-bundle]'
The core and ingestion-bundle dependencies, combined with a Postgres database, provide the necessary components to deploy a user-facing R2R application into production.
If you need advanced features like orchestration or parsing with Unstructured.io then refer to the full installation .
Ref: Configure Postgres database in R2R
環境設置
主要是向量數據庫
R2R requires connections to various services. Set up the following environment variables based on your needs:
# Set Postgres+pgvector settingsexport R2R_POSTGRES_USER=r2rexport R2R_POSTGRES_PASSWORD="*********"export R2R_POSTGRES_HOST=127.0.0.1export R2R_POSTGRES_PORT=5432export R2R_POSTGRES_DBNAME=hbuexport R2R_PROJECT_NAME="dragon"export R2R_POSTGRES_MAX_CONNECTIONS=80
Postgres+pgvector
With R2R you can connect to your own instance of Postgres+pgvector or a remote cloud instance. Refer here for detailed documentation on configuring Postgres inside R2R.
ALTER USER r2r WITH PASSWORD 'password';
R2R配置
R2R uses a TOML configuration file for managing settings, which you can read about here. For local setup, we’ll use the default local_llm configuration. This can be customized to your needs by setting up a standalone project.
R2R Configure
配置內容
hbu@Pauls-MacBook-Air dragon-flight % cat local_llm.toml
[completion]
provider = "litellm"
concurrent_request_limit = 1[completion.generation_config]model = "qwen2:0.5b"temperature = 0.1top_p = 1max_tokens_to_sample = 1_024stream = falseadd_generation_kwargs = { }[database]
provider = "postgres"
user = "hbu"
password = "hbu"
host = "localhost"
port = "5432"
db_name = "hbu"
your_project_name = "dragon_flight"[embedding]
provider = "ollama"
base_model = "mxbai-embed-large"
base_dimension = 1_024
batch_size = 32
add_title_as_prefix = true
concurrent_request_limit = 32[ingestion]
excluded_parsers = [ "mp4" ]
運行R2R
本地大模型
r2r serve --config-path=./ai/R2R/local_llm.toml
檢查運行狀態
http://localhost:7272/v3/health
準備本地大模型
hbu@Pauls-MacBook-Air dragon-flight % ollama list
NAME ID SIZE MODIFIED
qwen2:1.5b f6daf2b25194 934 MB 4 months ago
deepseek-coder:latest 3ddd2d3fc8d2 776 MB 4 months ago
qwen2:0.5b 6f48b936a09f 352 MB 4 months ago
llama2-chinese:latest cee11d703eee 3.8 GB 4 months ago
hbu@Pauls-MacBook-Air dragon-flight % ollama run qwen2:0.5b
>>> Send a message (/? for help)
檢查向量數據庫postgres
hbu=# \dn架構模式列表名稱 | 擁有者
-------------------+-------------------dragon | hbudragon-flight | hbupublic | pg_database_ownerr2r_dragon_flight | hbu
(4 行記錄)hbu=# \dn+架構模式列表名稱 | 擁有者 | 存取權限 | 描述
-------------------+-------------------+----------------------------------------+------------------------dragon | hbu | | dragon-flight | hbu | | public | pg_database_owner | pg_database_owner=UC/pg_database_owner+| standard public schema| | =U/pg_database_owner | r2r_dragon_flight | hbu | |
(4 行記錄)
導入Samples數據
導入數據
# R2R toml配置文件問題，導致數據導入失敗
hbu@Pauls-MacBook-Air dragon-flight % r2r documents create-samples
/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/pydantic/_internal/_config.py:345: UserWarning: Valid config keys have changed in V2:
* 'fields' has been removedwarnings.warn(message, UserWarning)
Ingesting file: /var/folders/mh/l6_b7c0x7m3bq41r5m25snqc0000gn/T/tmpglpon8br_pg_essay_3.html
Request failed: [Errno 8] nodename nor servname provided, or not known## 采用dragon-flight/ai/R2R/alpha_llm.toml，啟動R2R服務，導入數據成功
hbu@Pauls-MacBook-Air R2R % r2r documents create py/core/examples/data/got.txt
/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/pydantic/_internal/_config.py:345: UserWarning: Valid config keys have changed in V2:
* 'fields' has been removedwarnings.warn(message, UserWarning)
Processing file 1/1: py/core/examples/data/got.txt
{"results": {"message": "Document created and ingested successfully.","task_id": null,"document_id": "6e134818-b245-571d-8073-6581c0a175d8"}
}
----------------------------------------
Time taken: 27.58 secondsProcessed 1 files successfully.
備注：驗證導入數據仍存在問題，主要表現為部分導入數據不成功。
問題與方案
1、R22配置文件中LLM模型選擇問題？
目前只有事例中的模型，支持導入，配置文件需要參考官方提供的信息，其中配置信息如dragon-flight/ai/R2R/alpha_llm.toml能夠成功啟動。
)
