自学内容网 自学内容网

linux下的ollama

refs:

https://github.com/ollama/ollama/blob/main/docs/linux.md

1)安装 

curl -fsSL https://ollama.com/install.sh | sh

2)修改服务配置,打开端口允许所有IP地址 

refs(https://github.com/ollama/ollama/blob/main/docs/faq.md#where-are-models-stored)

Create a service file in /etc/systemd/system/ollama.service

[Unit]
Description=Ollama Service
After=network-online.target

[Service]
ExecStart=/usr/local/bin/ollama serve
User=ollama
Group=ollama
Restart=always
RestartSec=3
Environment="OLLAMA_HOST=0.0.0.0"
Environment="PATH=/home/dtjk/bin:/home/dtjk/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/home/dtjk/.dotnet/tools:/home/dtjk/.dotnet/tools"

[Install]
WantedBy=default.target

 3)更新配置

sudo systemctl daemon-reload
sudo service ollama restart   

4)check端口状况

~$ sudo lsof -i:11434
COMMAND   PID   USER   FD   TYPE    DEVICE SIZE/OFF NODE NAME
ollama  17243 ollama    3u  IPv6 416111630      0t0  TCP *:11434 (LISTEN)


原文地址:https://blog.csdn.net/Henry_Wu001/article/details/136297950

免责声明:本站文章内容转载自网络资源,如本站内容侵犯了原著者的合法权益,可联系本站删除。更多内容请关注自学内容网(zxcms.com)!