參考:
https://huggingface.co/deepseek-ai/DeepSeek-R1-0528-Qwen3-8B
量化版本:
https://huggingface.co/unsloth/DeepSeek-R1-0528-Qwen3-8B-GGUF
https://docs.unsloth.ai/basics/deepseek-r1-0528-how-to-run-locally
1、ollama運行
升級ollama版本到0.9.0
支持直接下載:Ollama拉取huggingface社區或modelscope社區的GGUF模型并部署
https://blog.csdn.net/qq_39780701/article/details/144522063