v1.2.0 #153

mccrindlebrian · 2024-03-11T22:23:07Z

Adds utility scripts to facilitate environment setup by @mccrindlebrian in new setup script for generic CPU/GPU ubuntu machines new setup script for generic CPU/GPU ubuntu machines #139
Refactors validator code to facilitate support on multiple llm pipelines by @p-ferreira in Features/vllm-base-pipeline #138
Implement vllm pipeline by @p-ferreira in Features/vllm-base-pipeline #138
Adds install.sh script to facilitate installation by @p-ferreira in Features/vllm changelogs #158

Co-authored-by: Steffen Cruz <[email protected]>

new setup script for generic CPU/GPU ubuntu machines

…ompting into features/vllm-test

Features/vllm-base-pipeline

Features/vllm changelogs

updates release note date

steffencruz and others added 29 commits February 28, 2024 20:30

isolates llms into specific module

a6d2185

implement base and hf pipeline

76284e0

adds base llm class

21fa3ce

adds vllm model wrapper and pipeline + overall improvements

b28ad5f

drop-in replacement for hf zephyr

f9de780

Merge branch 'main' into features/vllm-test

e76136e

update pipeline param type on tasks

76aedc2

improving variable name, removes unused commented code

145b3cb

new setup script for generic CPU/GPU ubuntu machines

4304e8c

remove openai requirements install

145215a

include script information in the readme

d79c8be

fix broken tests

5aaccd5

code declaration improvement on base_llm

27c02bf

unit test + overall adjustments

7e035bf

runs black on new changes

195aa33

adds gpu calc utils functions + update vllm_llm

ac3dee5

update readme with vllm gpu device limitation

40aac18

updates unit test

4f4e9ac

upgrade load_vllm to handle max-len vs kv cache exceptional scenarios

5cd27ca

runs black on vllm file

f3245cc

refactor vllm load second attempt approach

d70dc3a

adds extra cuda sync before mem_get_info

7895c88

fix imports of vllm_llm

b58ee03

adds tests for new vllm functionality

9bc6060

Update neurons/miners/zephyr/miner.py

75c8a4e

Co-authored-by: Steffen Cruz <[email protected]>

pr adjustments: file renaming + vllm requirements

c8b9e28

fix renaming imports

7244789

rollback on requirements

fb3eb98

Merge pull request #139 from opentensor/issues/bash-setup

d689527

new setup script for generic CPU/GPU ubuntu machines

mccrindlebrian requested a review from steffencruz March 11, 2024 22:23

mccrindlebrian requested a review from p-ferreira March 11, 2024 22:23

p-ferreira and others added 17 commits March 12, 2024 11:03

Merge branch 'main' into features/vllm-test

3a0517b

fix merging issues

f5e241a

adds changelog dir and file

d3821a2

adjust cuda mock on unit test

31dbfb9

Merge branch 'features/vllm-test' of https://github.com/opentensor/pr…

1cb5a1e

…ompting into features/vllm-test

mock cuda device call on unit test

12769d9

fix mock target on patch

e3545ac

initial release note draft

d9b8d0d

improving changelog text

9b8da12

updates versioning

aaed120

add reference to readme on changelog

dc45daa

add install bash script to facilitate installation

342525d

Merge pull request #138 from opentensor/features/vllm-test

7e7481c

Features/vllm-base-pipeline

update release notes

adc72c8

Merge pull request #158 from opentensor/features/vllm-changelogs

08a2a7b

Features/vllm changelogs

updates release note date

9fc83b9

Merge pull request #166 from opentensor/hotfix/change-logs-date

70d6a3a

updates release note date

p-ferreira changed the title ~~Staging~~ v1.2.0 Mar 19, 2024

p-ferreira approved these changes Mar 19, 2024

View reviewed changes

p-ferreira merged commit 21ca696 into main Mar 19, 2024
3 checks passed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

v1.2.0 #153

v1.2.0 #153

mccrindlebrian commented Mar 11, 2024 •

edited by p-ferreira

Loading

v1.2.0 #153

v1.2.0 #153

Conversation

mccrindlebrian commented Mar 11, 2024 • edited by p-ferreira Loading

mccrindlebrian commented Mar 11, 2024 •

edited by p-ferreira

Loading