Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

v2.17.6 #621

Merged
merged 82 commits into from
Mar 12, 2025
Merged
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
82 commits
Select commit Hold shift + click to select a range
1a77872
Add fallback
dbobrenko Feb 20, 2025
4299e3f
Add fallback json
dbobrenko Feb 20, 2025
4ed705e
Enhance fallback
dbobrenko Feb 20, 2025
cd7a215
Clean up
dbobrenko Feb 20, 2025
d4f6985
Fix loop runner issues
dbobrenko Feb 20, 2025
670f85c
Fix offset datetimes in loop runner
dbobrenko Feb 20, 2025
4317ddc
Check is website is dict
bkb2135 Feb 20, 2025
a96a85b
Merge pull request #618 from macrocosm-os/fix-attr-errors-in-web-retr…
dbobrenko Feb 20, 2025
e2d4be4
Increasing Miner Availability frequency
richwardle Feb 20, 2025
f3c1448
Merge branches 'staging' and 'staging' of github.com:macrocosm-os/pro…
richwardle Feb 20, 2025
a8949ad
Update .gitignore
bkb2135 Feb 20, 2025
63e59d9
Delete past_websites.csv
bkb2135 Feb 20, 2025
089bd8a
Fix deps issue; add uids fallback
dbobrenko Feb 20, 2025
3aee09b
Add proper fallback
dbobrenko Feb 20, 2025
099f4dc
Poetry lock
dbobrenko Feb 20, 2025
9eb7413
Run pre-commit
dbobrenko Feb 20, 2025
bd58940
Merge pull request #620 from macrocosm-os/api/fallback
dbobrenko Feb 20, 2025
feabaa2
Flattening lists in staging
richwardle Feb 20, 2025
2fcf2ea
Merge branch 'staging' of github.com:macrocosm-os/prompting into staging
richwardle Feb 20, 2025
56af3bd
Merge pull request #619 from macrocosm-os/Remove-Past-Websites
bkb2135 Feb 20, 2025
cec4b57
api/prod
dbobrenko Feb 20, 2025
8ae8925
Default to random miners
bkb2135 Feb 20, 2025
92d478d
Improving CoT prompt engineering
richwardle Feb 20, 2025
5d52d2e
Merge branch 'staging' into hotfix/default-to-random-miners
bkb2135 Feb 20, 2025
10290db
Remove Notebooks
bkb2135 Feb 20, 2025
93f89bf
Precommit FFixes
bkb2135 Feb 20, 2025
a583f3e
Add one-shot example
bkb2135 Feb 20, 2025
0e56e0f
Merge pull request #623 from macrocosm-os/remove-notebooks
bkb2135 Feb 20, 2025
5d9e453
Teardown wandb at exit
bkb2135 Feb 24, 2025
69565a5
Linting
bkb2135 Feb 24, 2025
0b19292
Merge branch 'staging' into hotfix/default-to-random-miners
bkb2135 Feb 24, 2025
6da14ce
Merge pull request #622 from macrocosm-os/hotfix/default-to-random-mi…
bkb2135 Feb 24, 2025
57e6205
Handle Exit with excepts
bkb2135 Feb 24, 2025
34cba84
Linting
bkb2135 Feb 24, 2025
4b161a3
Don't share unecessary miner failure
richwardle Feb 24, 2025
930eeb2
Clean Up Random error raise
richwardle Feb 24, 2025
9e4693c
Silence Some Web Retrieval Logging
richwardle Feb 24, 2025
19b51a4
finish wandb in mp loop
richwardle Feb 25, 2025
afb286c
Adding cache (#625)
Hollyqui Feb 25, 2025
2533323
use wandb sdk to terminate runs
bkb2135 Feb 25, 2025
2cef7a2
Make WebRetrievalRewardModel hashable (#629)
Hollyqui Feb 25, 2025
834cd24
Add API systemd start/stop scripts (#626)
dbobrenko Feb 25, 2025
4558912
Precommit Fix
bkb2135 Feb 25, 2025
4055c6d
Making Reward Function Async & Various Optimisations (#628)
Hollyqui Feb 27, 2025
034ed18
SN1-406-improve-api-docs (#627)
richwardle Feb 27, 2025
dad7cb9
Add Past Websites Files (#630)
richwardle Feb 27, 2025
665bfc1
Seperate Prompting, Remove TTI Endpoint, Add Json Flag
bkb2135 Feb 28, 2025
97096e7
Add Await To Inference Reward Model
richwardle Feb 28, 2025
6ae46ce
Precommit Changes
richwardle Feb 28, 2025
15c951d
Precommit Fix
bkb2135 Mar 3, 2025
cb29ad8
Improving TTI Final Prompt, Add Unittests for Prompts
richwardle Mar 3, 2025
2464424
Merge branch 'SN1-423-restructure-prompting' of github.com:macrocosm-…
richwardle Mar 3, 2025
4039cf2
Remove Comments
bkb2135 Mar 3, 2025
2f96a50
Await Reward Models
richwardle Mar 3, 2025
a6132c0
Add Next Action For Final Prompt
richwardle Mar 3, 2025
fc470bf
Add Detailed Log For Scoring Response Failed
richwardle Mar 3, 2025
5948dbb
Precommit Fixes
bkb2135 Mar 3, 2025
f801392
Readd exiting with system exit code 1
bkb2135 Mar 3, 2025
8b9dea8
Merge pull request #632 from macrocosm-os/fix/reward-coroutine-attrib…
bkb2135 Mar 3, 2025
baa3f98
Fix pydantic types; move autoawq to poetry
dbobrenko Mar 4, 2025
baa1dc0
Run pre-commit
dbobrenko Mar 4, 2025
93e70d8
Check if past websites is not empty
dbobrenko Mar 4, 2025
9a5ebb3
Simplify Prompt Structure
richwardle Mar 4, 2025
0245a2a
Fix Unittest and Precommit
bkb2135 Mar 4, 2025
3f7b463
Merge pull request #635 from macrocosm-os/fix/pydantic-poetry
dbobrenko Mar 4, 2025
3e39b90
Merge pull request #633 from macrocosm-os/SN1-423-restructure-prompting
bkb2135 Mar 4, 2025
b641085
Add Async Timeout
richwardle Mar 5, 2025
a4e3132
Precommit Fix
richard-wardle Mar 5, 2025
467dab1
Merge pull request #636 from macrocosm-os/fix/web_retrieval_timeout
bkb2135 Mar 5, 2025
ebfe369
fix timeout
richwardle Mar 6, 2025
9f3bfcb
Merge pull request #637 from macrocosm-os/fix/pass_timeout_through
bkb2135 Mar 6, 2025
48d0092
Merge pull request #624 from macrocosm-os/features/teardown-wandb-at-…
bkb2135 Mar 10, 2025
b588037
Hotfix HF model initialization
dbobrenko Mar 11, 2025
18770f7
Add params to miner model
dbobrenko Mar 11, 2025
5bf219d
Run pre-commit
dbobrenko Mar 11, 2025
2ac95a3
Fix settings device
dbobrenko Mar 11, 2025
5ed22db
Merge pull request #638 from macrocosm-os/hotfix/SN1-431-model-init
dbobrenko Mar 11, 2025
747a563
Allow langflow arguments to be properly parsed by completion endpoint
bkb2135 Mar 12, 2025
f399305
Default to Inference in Serializer
bkb2135 Mar 12, 2025
ea38621
Allow multiple api schemas
richwardle Mar 12, 2025
67b6cb0
Linting
richwardle Mar 12, 2025
07eba87
Merge pull request #640 from macrocosm-os/SN1-433-update-serializer-t…
bkb2135 Mar 12, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Fix Unittest and Precommit
  • Loading branch information
bkb2135 committed Mar 4, 2025
commit 0245a2ac981b034c9e99d3489a22263462693ea0
7 changes: 5 additions & 2 deletions shared/prompts/test_time_inference.py
Original file line number Diff line number Diff line change
@@ -1,12 +1,13 @@
import textwrap


def intro_prompt() -> str:
"""
Returns the intro prompt.
"""

intro = textwrap.dedent(
"""\
"""\
You are a world-class expert in analytical reasoning and problem-solving. Your task is to break down complex problems through rigorous step-by-step analysis, carefully examining each aspect before moving forward. For each reasoning step:

OUTPUT FORMAT:
Expand Down Expand Up @@ -79,19 +80,21 @@ def intro_prompt() -> str:

return intro


def system_acceptance_prompt() -> str:
"""
Returns the system acceptance prompt.
"""

system_acceptance = textwrap.dedent(
"""\
"""\
I understand. I will now analyze the problem systematically, following the structured reasoning process while maintaining high standards of analytical rigor and self-criticism.
"""
).strip()

return system_acceptance


def final_answer_prompt() -> str:
"""
Returns the final answer prompt.
Expand Down
6 changes: 4 additions & 2 deletions tests/prompting/shared/test_get_prompt.py
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
import pytest
from shared.prompts.test_time_inference import intro_prompt, system_acceptance_prompt, final_answer_prompt
from shared.prompts.test_time_inference import final_answer_prompt, intro_prompt, system_acceptance_prompt


def test_intro_prompt():
"""Test that intro_prompt returns the correct prompt."""
Expand All @@ -11,12 +11,14 @@ def test_intro_prompt():
assert "REQUIREMENTS:" in prompt
assert "CRITICAL THINKING CHECKLIST:" in prompt


def test_system_acceptance_prompt():
"""Test that system_acceptance_prompt returns the correct prompt."""
prompt = system_acceptance_prompt()
assert isinstance(prompt, str)
assert "I understand. I will now analyze the problem systematically" in prompt


def test_final_answer_prompt():
"""Test that final_answer_prompt returns the correct prompt."""
prompt = final_answer_prompt()
Expand Down
6 changes: 2 additions & 4 deletions validator_api/test_time_inference.py
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@

from prompting.llms.apis.llm_messages import LLMMessage, LLMMessages
from prompting.llms.apis.llm_wrapper import LLMWrapper
from shared.prompts.test_time_inference import intro_prompt, system_acceptance_prompt, final_answer_prompt
from shared.prompts.test_time_inference import final_answer_prompt, intro_prompt, system_acceptance_prompt
from shared.timer import Timer
from validator_api.chat_completion import chat_completion

Expand Down Expand Up @@ -199,12 +199,10 @@ async def generate_response(
step_count += 1
yield steps, None

final_answer_prompt = final_answer_prompt()

messages.append(
{
"role": "user",
"content": final_answer_prompt,
"content": final_answer_prompt(),
}
)

Expand Down