步驟一： 下載基礎鏡像

# 配置docker DNS
vi /etc/docker/daemon.json

# daemon.json文件中

{ "insecure-registries": ["https://swr.cn-east-317.qdrgznjszx.com"], "registry-mirrors": ["https://docker.mirrors.ustc.edu.cn"] }

systemctl restart docker.service 
docker pull swr.cn-east-317.qdrgznjszx.com/donggang/llama-factory-ascend910b:cann8-py310-torch2.2.0-ubuntu18.04 
mkdir /root/llama_factory_model

步驟二：新建基礎容器?

docker create -it -u root --ipc=host --net=host --name=llama-factory   -e LANG="C.UTF-8"\--device=/dev/davinci0 \--device=/dev/davinci1 \--device=/dev/davinci2 \--device=/dev/davinci3 \--device=/dev/davinci4 \--device=/dev/davinci5 \--device=/dev/davinci6 \--device=/dev/davinci7 \--device=/dev/davinci_manager \--device=/dev/devmm_svm \--device=/dev/hisi_hdc \-v /usr/local/Ascend/driver:/usr/local/Ascend/driver \-v /usr/local/Ascend/add-ons/:/usr/local/Ascend/add-ons/ \-v /usr/local/sbin/npu-smi:/usr/local/sbin/npu-smi \-v /mnt/:/mnt/ \-v /root/llama_factory_model:/root/llama_factory_model \-v /var/log/npu:/usr/slog swr.cn-east-317.qdrgznjszx.com/donggang/llama-factory-ascend910b:cann8-py310-torch2.2.0-ubuntu18.04 \/bin/bash \

步驟三：安裝llamafactory

docker start llama-factory
docker exec -it llama-factory bash# 安裝llama-factory
wget https://codeload.github.com/hiyouga/LLaMA-Factory/zip/refs/heads/main -O LLaMA-Factory.zip
unzip LLaMA-Factory.zip
mv LLaMA-Factory-main LLaMA-Factorycd LLaMA-Factory
pip install -e ".[torch-npu,metrics]" 
apt install libsndfile1# 激活昇騰環境變量（建議加入 ~/.bashrc中）
source /usr/local/Ascend/ascend-toolkit/set_env.sh#使用以下指令對 LLaMA-Factory × 昇騰的安裝進行校驗
llamafactory-cli env

# 運行llamafactory webui（訪問本機7860端口）
nohup llamafactory-cli webui> llama_factory_output.log 2>&1 &
# 查看llamafactory運行日志
tail -f /home/HwHiAiUser/LLaMA-Factory/llama_factory_output.log

解決報錯

問題描述

RuntimeError: Failed to import transformers.generation.utils because of the following error (look up to see its traceback):

/usr/local/python3.10.13/lib/python3.10/site-packages/sklearn/utils/../../scikit_learn.libs/libgomp-d22c30c5.so.1.0.0: cannot allocate memory in static TLS block

解決思路

vim ~/.bashrc#文檔末尾添加
export LD_PRELOAD=/usr/local/python3.10.13/lib/python3.10/site-packages/sklearn/utils/../../scikit_learn.libs/libgomp-d22c30c5.so.1.0.0source ~/.bashrc