Skip to content

Commit

Permalink
change palchat
Browse files Browse the repository at this point in the history
  • Loading branch information
hahuyhoang411 committed Nov 27, 2023
1 parent d91670f commit 5f2d7c3
Showing 1 changed file with 3 additions and 3 deletions.
6 changes: 3 additions & 3 deletions docs/docs/examples/palchat.md
Original file line number Diff line number Diff line change
Expand Up @@ -16,15 +16,15 @@ Pal is a mobile app available on the App Store. It offers a customizable chat pl
**1. Start Nitro server**

Open your terminal:
```
```bash title="Run Nitro"
nitro
```

**2. Download Model**

Use these commands to download and save the [Llama2 7B chat model](https://huggingface.co/TheBloke/Llama-2-7B-Chat-GGUF/tree/main):

```bash
```bash title="Get a model"
mkdir model && cd model
wget -O llama-2-7b-model.gguf https://huggingface.co/TheBloke/Llama-2-7B-Chat-GGUF/resolve/main/llama-2-7b-chat.Q5_K_M.gguf?download=true
```
Expand All @@ -35,7 +35,7 @@ wget -O llama-2-7b-model.gguf https://huggingface.co/TheBloke/Llama-2-7B-Chat-GG

To load the model, use the following command:

```
```bash title="Load model to the server"
curl http://localhost:3928/inferences/llamacpp/loadmodel \
-H 'Content-Type: application/json' \
-d '{
Expand Down

0 comments on commit 5f2d7c3

Please sign in to comment.