Code

Features/streaming#103

Code

Merged

steffencruz merged 82 commits intopre-stagingmacrocosm-os/prompting:pre-stagingfrom features/streamingmacrocosm-os/prompting:features/streamingCopy head branch name to clipboardMar 12, 2024

Commits

Commits on Feb 13, 2024

• dsstore gitignore, change miner base

  mccrindlebrian

  committed
  32e2fbf

  Copy full SHA for 32e2fbf

• edit StreamPromptingSynapse, and add _forward to BaseStreamMinerNeuron

  mccrindlebrian

  committed
  cd45132

  Copy full SHA for cd45132

• OpenAIUtils

  mccrindlebrian

  committed
  4c1902b

  Copy full SHA for 4c1902b

• change llm pipeline for streaming

  mccrindlebrian

  committed
  c5066ce

  Copy full SHA for c5066ce

• hf_miner to streaming

  mccrindlebrian

  committed
  76b7806

  Copy full SHA for 76b7806

• openai stream miner

  mccrindlebrian

  committed
  0cd3820

  Copy full SHA for 0cd3820

• echo miner

  mccrindlebrian

  committed
  7f983b4

  Copy full SHA for 7f983b4

• phrase miner

  mccrindlebrian

  committed
  2b30a33

  Copy full SHA for 2b30a33

• fix bugs

  mccrindlebrian

  committed
  898b4b8

  Copy full SHA for 898b4b8

• black entire workspace

  mccrindlebrian

  committed
  85c46a2

  Copy full SHA for 85c46a2

• add try except in langchain miners

  mccrindlebrian

  committed
  9ad977a

  Copy full SHA for 9ad977a

• format_send on HuggingFaceMiner

  mccrindlebrian

  committed
  4b4af19

  Copy full SHA for 4b4af19

• mock miner

  mccrindlebrian

  committed
  f1e5e57

  Copy full SHA for f1e5e57

• add handle_response for StreamMiners

  mccrindlebrian

  committed
  4438f15

  Copy full SHA for 4438f15

• remove streaming docs

  mccrindlebrian

  committed
  b6cf4a5

  Copy full SHA for b6cf4a5

Commits on Feb 14, 2024

• remove streaming docs

  mccrindlebrian

  committed
  0735046

  Copy full SHA for 0735046

• add client-side querying

  mccrindlebrian

  committed
  5fe465d

  Copy full SHA for 5fe465d

• black, debugging

  mccrindlebrian

  committed
  1e5e9cb

  Copy full SHA for 1e5e9cb

• remove format send bc broke streaming

  mccrindlebrian

  committed
  5478ecd

  Copy full SHA for 5478ecd

• remove format_send

  mccrindlebrian

  committed
  41d3b5c

  Copy full SHA for 41d3b5c

• Merge branch 'features/hf-miner' into features/streaming

  mccrindlebrian

  authored
  aa58e8d

  Copy full SHA for aa58e8d

• remove .DS_Store

  mccrindlebrian

  committed
  ae8392e

  Copy full SHA for ae8392e

• add tool miner

  mccrindlebrian

  committed
  a129564

  Copy full SHA for a129564

• add timeout checking to stop streaming tokens

  mccrindlebrian

  committed
  da90d8e

  Copy full SHA for da90d8e

• add timeout checking to all miners

  mccrindlebrian

  committed
  1b63bcd

  Copy full SHA for 1b63bcd

Commits on Feb 15, 2024

• add return_streamer logic

  mccrindlebrian

  committed
  78a8281

  Copy full SHA for 78a8281

• remove force

  mccrindlebrian

  committed
  c7b52c6

  Copy full SHA for c7b52c6

Commits on Feb 16, 2024

• add thread closing and queue clearing for huggingface models

  mccrindlebrian

  committed
  5eeabb7

  Copy full SHA for 5eeabb7

• add docstrings, more logic for cleaning

  mccrindlebrian

  committed
  1f5e54f

  Copy full SHA for 1f5e54f

• add timeout check to openai

  mccrindlebrian

  committed
  f3ec3fc

  Copy full SHA for f3ec3fc

Commits on Feb 21, 2024

• add streaming_batch_size to config

  mccrindlebrian

  committed
  ab81674

  Copy full SHA for ab81674

• remove dep

  mccrindlebrian

  committed
  723b64c

  Copy full SHA for 723b64c

• add wandb logging if wandb.on

  mccrindlebrian

  committed
  5792dfc

  Copy full SHA for 5792dfc

• remove get_openai_callback, black repo

  mccrindlebrian

  committed
  3b4df22

  Copy full SHA for 3b4df22

• fix batch size bug in config

  mccrindlebrian

  committed
  784b100

  Copy full SHA for 784b100

• add try except to hf miners

  mccrindlebrian

  committed
  516fb25

  Copy full SHA for 516fb25

• add try except to tool_miner

  mccrindlebrian

  committed
  1abe949

  Copy full SHA for 1abe949

• Merge branch 'features/streaming' of github.com:opentensor/prompting into features/streaming

  mccrindlebrian

  committed
  38b9a85

  Copy full SHA for 38b9a85

• add try except to tool_miner

  mccrindlebrian

  committed
  e1f6ddb

  Copy full SHA for e1f6ddb

• add back in blacklist and priorty, test working

  mccrindlebrian

  committed
  c86431f

  Copy full SHA for c86431f

• change back logging time

  mccrindlebrian

  committed
  6bae36a

  Copy full SHA for 6bae36a

Commits on Feb 22, 2024

• develop mock dendrite for testing

  mccrindlebrian

  committed
  22d562a

  Copy full SHA for 22d562a

• remove dep

  mccrindlebrian

  committed
  f0de609

  Copy full SHA for f0de609

• add tests for stream miners

  mccrindlebrian

  committed
  425b31d

  Copy full SHA for 425b31d

Commits on Feb 23, 2024

• add docstrings

  mccrindlebrian

  committed
  5f31d16

  Copy full SHA for 5f31d16

• Merge branch 'features/hf-miner' into features/streaming

  mccrindlebrian

  authored
  13c4bea

  Copy full SHA for 13c4bea

• change process timing

  mccrindlebrian

  committed
  157a9f9

  Copy full SHA for 157a9f9

• add constants

  mccrindlebrian

  committed
  d3bfcfb

  Copy full SHA for d3bfcfb

• add default port/id

  mccrindlebrian

  committed
  38232b1

  Copy full SHA for 38232b1

Commits on Feb 28, 2024

• merge staging

  mccrindlebrian

  committed
  07a73f3

  Copy full SHA for 07a73f3

• remove todo

  mccrindlebrian

  committed
  8f12375

  Copy full SHA for 8f12375

Commits on Feb 29, 2024

• add docstrings

  mccrindlebrian

  committed
  8957ff9

  Copy full SHA for 8957ff9

• move exception clause

  mccrindlebrian

  committed
  4f573fb

  Copy full SHA for 4f573fb

• remove all agents from PR to separate from features/hf-miners

  mccrindlebrian

  committed
  d31ec32

  Copy full SHA for d31ec32

• merge pre-staging, resolve conflicts

  mccrindlebrian

  committed
  64d67e7

  Copy full SHA for 64d67e7

Commits on Mar 1, 2024

• test precommit hook

  mccrindlebrian

  committed
  f9863b7

  Copy full SHA for f9863b7

Commits on Mar 2, 2024

• merge pre-staging, resolve conflicts, delete stream_tutorial docs

  mccrindlebrian

  committed
  e12e2fc

  Copy full SHA for e12e2fc

• change test output type

  mccrindlebrian

  committed
  10aae24

  Copy full SHA for 10aae24

Commits on Mar 4, 2024

• fix breaking tests

  mccrindlebrian

  committed
  e72b60a

  Copy full SHA for e72b60a

• fix streaming test with percentage comparison on timeout:

  mccrindlebrian

  committed
  e826bfa

  Copy full SHA for e826bfa

• rework where process_time is calculated to minimize time inconsistancies

  mccrindlebrian

  committed
  15e6c91

  Copy full SHA for 15e6c91

• check if process_time >= timeout

  mccrindlebrian

  committed
  c13bfff

  Copy full SHA for c13bfff

Commits on Mar 7, 2024

• black

  mccrindlebrian

  committed
  d44228c

  Copy full SHA for d44228c

Commits on Mar 11, 2024

• merge pre-staging

  mccrindlebrian

  committed
  ab5f6b2

  Copy full SHA for ab5f6b2

• remove tokenizer mapping for models that use different tokenizers than name

  mccrindlebrian

  committed
  66c7dbd

  Copy full SHA for 66c7dbd

• remove unfinished wording is docstring

  mccrindlebrian

  committed
  acf3f0a

  Copy full SHA for acf3f0a

Commits on Mar 12, 2024

• remove debugging

  mccrindlebrian

  committed
  bbfdcfe

  Copy full SHA for bbfdcfe

• add new readme for pre-staging experiments

  mccrindlebrian

  committed
  d969897

  Copy full SHA for d969897

• remove old docs

  mccrindlebrian

  committed
  e316e93

  Copy full SHA for e316e93

• add docs for streaming, and change output types of miners

  mccrindlebrian

  committed
  b847daa

  Copy full SHA for b847daa

• fix typo

  mccrindlebrian

  committed
  fe6782c

  Copy full SHA for fe6782c

• fix client script

  mccrindlebrian

  committed
  c7caf1a

  Copy full SHA for c7caf1a

• add more to readme

  mccrindlebrian

  committed
  5f9c591

  Copy full SHA for 5f9c591

• format docs to stream_miner_template

  mccrindlebrian

  committed
  aaed470

  Copy full SHA for aaed470

• Update prompting/mock.py

  Show description for 8b0a3aa
  

  mccrindlebrian

  and

  steffencruz

  authored
  8b0a3aa

  Copy full SHA for 8b0a3aa

• Update prompting/miners/hf_miner.py

  Show description for 9885128
  

  mccrindlebrian

  and

  steffencruz

  authored
  9885128

  Copy full SHA for 9885128

• Update prompting/utils/config.py

  steffencruz

  authored
  deacce0

  Copy full SHA for deacce0

• remove partial kwargs

  mccrindlebrian

  committed
  9b490b4

  Copy full SHA for 9b490b4

• Merge branch 'pre-staging' into features/streaming

  mccrindlebrian

  authored
  f879b48

  Copy full SHA for f879b48

• Apply suggestions from code review

  Show description for 720ec70
  

  mccrindlebrian

  and

  steffencruz

  authored
  720ec70

  Copy full SHA for 720ec70

• remove depreciated miners

  mccrindlebrian

  committed
  439fb15

  Copy full SHA for 439fb15

• Merge branch 'features/streaming' of github.com:opentensor/prompting into features/streaming

  mccrindlebrian

  committed
  e6359ff

  Copy full SHA for e6359ff