New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Document] 更新Mac部署 #3

Merged

yfyang86 merged 1 commit into main from mac-m1-dev

May 3, 2023

Owner

yfyang86 commented May 3, 2023

[Document] 更新Mac部署

FILE: README.md/README_end.md
ADD: OPENMP; MPS

具体内容

以chatglm-6b-int4量化模型为例，做如下配置：

安装libomp的步骤;
对量化后模型等配置gcc编译项；
量化后模型启用MPS的解释；
缩短文本长度。


           [Document] 更新Mac部署

2ac5b22

 [Document] 更新Mac部署
- FILE: README.md/README_end.md
- ADD: OPENMP; MPS

# 具体内容

以[chatglm-6b-int4](https://huggingface.co/THUDM/chatglm-6b-int4)量化模型为例，做如下配置：

- 安装libomp的步骤;
- 对量化后模型等配置gcc编译项；
- 量化后模型启用MPS的解释；
- 缩短文本长度。

yfyang86 merged commit cf0240c into main

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet