自学内容网 自学内容网

关于ollama 在mac的部署问题

安装

官网链接

直接按需求下载即可

默认模型下载地址

macOS: ~/.ollama/models
Linux: /usr/share/ollama/.ollama/models
Windows: C:\Users<username>.ollama\models

根据需要的平台设置相应的环境变量: OLLAMA_MODELS
如Mac 设置 ~/.zshrc

export  OLLAMA_MODELS = "/your_path/"

接着运行命令 ollama run qwen2:7b
可以开始本地大模型了

path_helper: ndk.path.save: Permission denied
(base) chendongming@chendongmingdeMac-mini ~ % ollama run qwen2:7b
pulling manifest 
pulling 43f7a214e532... 100% ▕██████████████████████████████████████████████████████████▏ 4.4 GB                         
pulling 77c91b422cc9... 100% ▕██████████████████████████████████████████████████████████▏ 1.4 KB                         
pulling c156170b718e... 100% ▕██████████████████████████████████████████████████████████▏  11 KB                         
pulling f02dd72bb242... 100% ▕██████████████████████████████████████████████████████████▏   59 B                         
pulling 75357d685f23... 100% ▕██████████████████████████████████████████████████████████▏   28 B                         
pulling 648f809ced2b... 100% ▕██████████████████████████████████████████████████████████▏  485 B                         
verifying sha256 digest 
writing manifest 
success 
>>> hello
Hello! How can I help you today? Is there something specific you would like to know or discuss? I'm here to answer 
any questions you might have, whether they're about general knowledge, specific topics, or just need advice on 
certain issues. Feel free to ask anything you'd like.


原文地址:https://blog.csdn.net/monk96/article/details/142438446

免责声明:本站文章内容转载自网络资源,如本站内容侵犯了原著者的合法权益,可联系本站删除。更多内容请关注自学内容网(zxcms.com)!