mlc-llm
內置RedPajama
hf示例模型?TheBloke/Mistral-7B-Instruct-v0.2-GGUF
https://github.com/mlc-ai/mlc-llm/tree/main
llama.cpp
https://github.com/ggml-org/llama.cpp
reference
---
MLC-LLM:大模型如何部署到瀏覽器 / 手機?完整流程復現
https://blog.csdn.net/sinat_28461591/article/details/147140479