Features/vllm-base-pipeline

[p-ferreira]

• add llm module
• adds base pipeline
• adds vllm pipeline and vllm model abstractions
• replaces zephyr with vllm model
• adds unit tests

https://wandb.ai/opentensor-dev/alpha-validators/runs/uzvbtwgc?workspace=user-opentensor-pedro

[mccrindlebrian]

LGTM. I do have a request that this should be merging into pre-staging, and that the changes for reworking the locations of miners should be included here. This will simplify things greatly when moving this work into streaming

[mccrindlebrian]

Also just remember to remove the name main lines and replace with proper tests.

[p-ferreira]

Also just remember to remove the name main lines and replace with proper tests.

The main lines there serve as support of maintenance for the file, so it can be easily instantiated + simple example of how to use it.

Regarding the tests, they were just added in my last commit.

[p-ferreira]

LGTM. I do have a request that this should be merging into pre-staging, and that the changes for reworking the locations of miners should be included here. This will simplify things greatly when moving this work into streaming

I'm not sure if this will be released at the same time than streaming, bringing this up pre-staging could make things more difficult if we plan to release this feature earlier. Let's discuss the release plan for those features, in any case it will be a couple of clicks of work to change this.

[steffencruz]

Great work. Looking forward to seeing this go over the finish line soon