Trelis Basic Inference

This repo provides basic scripts for deploying language models.

You can purchase lifetime access to the ADVANCED version of this repo at: https://trelis.com/ADVANCED-inference

Find other tutorials by subscribing to either:

Repo Contents:

basic-postgres-rag: Scripts to setup up a basic retrieval system with postgres.
multi-lora: Scripts to run multi-lora inference using LoRAX.