[论文笔记] pai-megatron-patch 环境安装
Installation — Transformer Engine 1.8.0 documentation
除了官方repo中的requirement.txt
icetk
ftfy
hjson
ninja
tokenizers
transformers>=4.38.2
accelerate>=0.23.0
datasets==2.16.1
wcwidth==0.2.12
pyarrow==12.0.1
jieba
sentencepiece
rjieba
sqlitedict
sacrebleu
datasets
tensorboard
lm_dataformat
tiktoken还需要安装 flash-attn2.5、transformer-engine
pip install flash-attn -i https://pypi.tuna.tsinghua.edu.cn/simple --no-build-isolation
pip install git+https://github.com/NVIDIA/TransformerEngine.git@stable
原文地址：https://blog.csdn.net/Trance95/article/details/140720187
免责声明：本站文章内容转载自网络资源，如本站内容侵犯了原著者的合法权益，可联系本站删除。更多内容请关注自学内容网（zxcms.com）！