Usage

Assuming you setup everything correctly, you can run any UI (interchangeably, but not in parallel) using the command:

docker compose --profile [ui] up --build

where [ui] is one of hlky, auto, auto-cpu, and lstein.

In the docker-compose.yml you can change the CLI_ARGS variable for all of the available UIs.

hlky

By default: --optimized-turbo is given, which allow you to use this model on a 6GB GPU. However, some features might not be available in the mode. You can find the full list of cli arguments here.

auto

By default: --medvram --opt-split-attention are given, which allow you to use this model on a 6GB GPU, you can also use --lowvram for lower end GPUs. You can find the full list of cli arguments here.

auto-cpu

CPU instance of the above, requires --no-half --precision full for it to run.

lstein

No config at this time!