linux- deepseek私有化部署(ollama,docker)

2025-02-05 16:55:05 阅读:25 编辑

安装docker

修改docker配置

{
  "registry-mirrors": [
    "https://docker-0.unsee.tech"
  ]
}
docker pull ollama/ollama
docker run -d -v /opt/ollama:/root/.ollama -p 11434:11434 --name ollama ollama/ollama

https://ollama.com/library/deepseek-r1:1.5b

运行最小的deepseek r1的模型1.5b

docker exec -it ollama ollama run deepseek-r1:1.5b
curl http://127.0.0.1:11434/api/generate -d '{
  "model": "deepseek-r1:1.5b",
  "prompt":"Who are you?",
  "stream": false
}'

指定CPU的核数num_thread,默认将占总CPU的50%

https://blog.darkthread.net/blog/ollama-cpu-usage-issue/

curl http://127.0.0.1:11434/api/generate -d '{"model": "deepseek-r1:8b","prompt":"我要给一年级的女儿说明deepseek的牛逼,以及我们国家人工智能的水平,对他未来的影响,如何陈述或表达","stream": true,"options":{"num_thread":12}}'