Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Pre staging #112

Merged
merged 82 commits into from
Feb 21, 2024
Merged

Pre staging #112

merged 82 commits into from
Feb 21, 2024

Conversation

steffencruz
Copy link
Collaborator

@steffencruz steffencruz commented Feb 20, 2024 •
edited
Loading

bkb2135 and others added 30 commits January 30, 2024 19:15
@bkb2135
Add Date and Math Tasks
a812a8a
@bkb2135
Date Scoring
337ffd4
@bkb2135
Update Float Scoring
d704d21
@bkb2135
cleanup date.py
c1515d6
@bkb2135
update requirements
25bd780
@bkb2135
Update requirements.txt
29711c1
@bkb2135
Gaussian Date Scoring
38427b9
@bkb2135
Merge branch 'features/task-expansion' of https://github.com/opentens…
3f50e30 
…or/prompting into features/task-expansion
@bkb2135
Add unit tests
980c41e
@bkb2135
Update unittests
b21d1fb
@bkb2135 @steffencruz
Update tests/test_scoring.py
ef1ec4f 
Co-authored-by: Steffen Cruz <[email protected]>
@bkb2135 @steffencruz
Update tests/test_scoring.py
b2ec0fe 
Co-authored-by: Steffen Cruz <[email protected]>
@bkb2135 @steffencruz
Update tests/test_scoring.py
e0678e2 
Co-authored-by: Steffen Cruz <[email protected]>
@bkb2135 @steffencruz
Update tests/test_scoring.py
dde74ac 
Co-authored-by: Steffen Cruz <[email protected]>
@bkb2135 @steffencruz
Update tests/test_scoring.py
5288dce 
Co-authored-by: Steffen Cruz <[email protected]>
@bkb2135 @steffencruz
Update prompting/rewards/float_diff.py
65df744 
Co-authored-by: Steffen Cruz <[email protected]>
@bkb2135 @steffencruz
Update prompting/rewards/float_diff.py
cf236b9 
Co-authored-by: Steffen Cruz <[email protected]>
@bkb2135 @steffencruz
Update prompting/rewards/float_diff.py
13b62f6 
Co-authored-by: Steffen Cruz <[email protected]>
@bkb2135 @steffencruz
Update prompting/rewards/float_diff.py
769d8b5 
Co-authored-by: Steffen Cruz <[email protected]>
@bkb2135 @steffencruz
Update prompting/rewards/float_diff.py
69ff1f2 
Co-authored-by: Steffen Cruz <[email protected]>
@bkb2135 @steffencruz
Update prompting/rewards/float_diff.py
2c73013 
Co-authored-by: Steffen Cruz <[email protected]>
@bkb2135
Add documentation to date and float
7731850
@bkb2135
Add forward_words to unit test
5d7a525
@dougsillars
Update README.md
382c7e4 
2 spelling fixes
@steffencruz
Update mock objects for more control and improved testing
01cfa4e
@steffencruz
Add tests for mock objects
e61c512
@steffencruz
Remove comment
cfae3bb
@steffencruz
Improved validator logging
cc7432f
@steffencruz
Improved miner logging
b61168e
@steffencruz
Increment miner step counter on forward
7617ded
steffencruz and others added 22 commits February 19, 2024 13:28
@steffencruz
Import TASKS from tasks submodule
a57a491
@steffencruz
Remove redundant args
a58c973
@steffencruz
Remove redundant args
9694848
@steffencruz
Remove redundant args
9229eac
@steffencruz
Add more task fields to tests
0dbd3f0
@steffencruz
Add tests for reward and penalty definitions and make test_task_field…
77ee3ed 
…_is_not_null more explicit
@steffencruz
Ensure a default wallet exists in test environemt
811d93a
@steffencruz
Add pre-staging to workflows
565212c
@steffencruz
Add config for decay_alpha
3486027
@steffencruz
Apply score decay
c4ee6c1
@steffencruz
Remove hanging reference to score decay
5112b47
@bkb2135
Update math.py
24e434e
@steffencruz
Merge pull request #111 from opentensor/features/decay-scores
14149c2 
Features/decay scores
@p-ferreira
fix broken unit test by adding a mock wallet to mock dendrite
dd74a4c
@bkb2135
Update config.py
8586a99
@steffencruz
Merge pull request #109 from opentensor/features/context
3d7b577 
Features/context
@steffencruz
Merge pull request #107 from opentensor/mock/tests
a5db577 
Mock/tests
@steffencruz
Merge pull request #108 from opentensor/logging/neuron-info
6af33ec 
Logging/neuron info
@bkb2135
Merge remote-tracking branch 'origin/pre-staging' into features/task-…
c7ff221 
…expansion
@bkb2135
Update Math Task to use context
e6ffa46
@steffencruz
Merge pull request #105 from dougsillars/main
dfca67b 
Update README.md
@steffencruz
Merge pull request #88 from opentensor/features/task-expansion
1200586 
Add Date and Math Tasks
@steffencruz
Copy link
Collaborator Author

steffencruz commented Feb 21, 2024 •
edited by schampoux
Loading

Tracked experiment: https://wandb.ai/opentensor-dev/alpha-validators/runs/y78dnu4y/overview?workspace=user-opentensor-steffen

Acceptance criteria:

  • Each task has the same occurrence rate (25% for all four tasks)
  • Each task has stable rewards distribution
  • Rewards for both old and new tasks are consistent with other validators over same time period
  • Status codes are nominal and consistent with other validators over same time period

@steffencruz steffencruz merged commit f751e10 into staging Feb 21, 2024
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@p-ferreira p-ferreira p-ferreira approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@steffencruz @p-ferreira @bkb2135 @dougsillars