Trelis Basic Inference

This repo provides basic scripts for deploying language models.

You can purchase lifetime access to the ADVANCED version of this repo at: https://trelis.com/ADVANCED-inference

Find other tutorials by subscribing to either:

• the Trelis Newsletter
• the Trelis Youtube Channel

Repo Contents:

• basic-postgres-rag: Scripts to setup up a basic retrieval system with postgres.
• multi-lora: Scripts to run multi-lora inference using LoRAX.