Staging #340

mccrindlebrian · 2025-01-27T20:14:42Z

This is the important release towards utilizing the full functionality of the Global Job Pool. This PR includes:

New functionalities for MinerRegistry, EvaluationRegistry, and RewardRegistry Create MinerRegistry and Evaluation Pipelines #334 @mccrindlebrian
Rewrite of the database Store to use the global job pool instead of the local sql database Validator rewrite for V0 of gjp release #342 @Sarkosos
Move docs around for the Macrocosmos Docs page @mccrindlebrian
Utilize the credibility information inside of the MinerRegistry, including saving and loading to disk similar to validator weights Make tests + add credibility #346 @mccrindlebrian
Create the functional pipeline for the Global Job Pool that includes RQLite nodes and the use of the eval pipelines V1.5.0 Release of Global Job Pool #347 @Sarkosos
Implement Reward sharing via the GJP Features/reward sharing #350 @mccrindlebrian @Sarkosos
New base miner that's compatible with the GJP Features/folding miner gjp #344 @schampoux

Create MinerRegistry and Evaluation Pipelines

…ng, make s3 handler optional during testing

…ation

Co-authored-by: Spunion <[email protected]>

Co-authored-by: Szymon Fonau <[email protected]>

…ct directory from the base neuron

…iner.

…ieval errors

Features/folding miner gjp

…on with job priority

…ate logic

…assignment logic

… get_all_miner_uids function for miner UID retrieval

… miner launch instructions

Update mining documentation to clarify Global Job Pool usage and base miner launch

schampoux

lgtm

mccrindlebrian and others added 27 commits January 16, 2025 19:17

add more documentation

7dadd32

create MinerRegistry with credibilities

b91a83f

add RewardRegistry

b80757e

add priority

3e2799d

add forward method to basereward

022a2c2

reward tasks are list

0414379

add job_type to the Job store so that we can call this reward pipeline

2139c50

job_type to upload_job

9240d10

move process_md_output to SyntheticMDReward

7dafb8c

remove RewardRegistry and make EvaluationRegistry

17e447f

make evaluators

9bfe1dc

move synthetic evaluations into SyntheticMDEvaluator

c142e91

pass in the velm array data location

4361451

change names to have Evaluator

e6e5094

docstring

479f1ea

move registries into their own folder

30dd3f8

referencing

b4910c3

create md reward pipelines

749680b

remove priority from evaluators

d8eb730

remove dependancies in __init__, make evaludation registry

32b1ec8

remove calculate rewards from miner registry

84b4a60

make credibilities and load

7ee30fc

miner_registry reset if resync

6057d50

Merge branch 'staging' into refactor-validator

9acedab

Merge pull request #334 from macrocosm-os/refactor-validator

cd3bd73

Create MinerRegistry and Evaluation Pipelines

change names for evaluators and rewards to be the same for easy mappi…

ecf31f2

…ng, make s3 handler optional during testing

black

7a14511

mccrindlebrian changed the base branch from main to black January 28, 2025 06:04

mccrindlebrian changed the base branch from black to main January 28, 2025 06:07

add s3 off for debugging, fix evaluation dict, and credibility aggreg…

527644b

…ation

mccrindlebrian and others added 28 commits February 5, 2025 21:53

Merge branch 'features/gjp-validator' into features/folding-miner-gjp

babaac3

Update documentation/background.md

9887723

Co-authored-by: Spunion <[email protected]>

Update documentation/background.md

e6ed0aa

Co-authored-by: Spunion <[email protected]>

Apply suggestions from code review

f881a8d

Co-authored-by: Spunion <[email protected]>

remove whitespace

a2a45db

Co-authored-by: Szymon Fonau <[email protected]>

Merge branch 'staging' into features/folding-miner-gjp

9f3936f

remove query_rqlite from utils, not in use

fe421fb

remove static variables and make them class attributes. Use the proje…

200fe24

…ct directory from the base neuron

create class attribute for base neuron for sself.rqlite_data_dir

6add03d

remove restart rqlite function and use start_rqlite() from the base m…

e0b9474

…iner.

Making sure to pass the system_kwargs to the system config

9dae4b2

remove rqlited startup from run_miner

7f07bcf

Fix response handling in SQLiteJobStore to correctly process job retr…

e93c473

…ieval errors

removed testing script

2d31654

Merge pull request #344 from macrocosm-os/features/folding-miner-gjp

c913d2c

Features/folding miner gjp

Refactor energy validation logic and update reward model initializati…

aa9ba85

…on with job priority

Update SQLiteJobStore to handle computed rewards and simplify job upd…

b6c71af

…ate logic

Remove redundant hotkey check in MDReward class to streamline reward …

9971786

…assignment logic

removed testing code

2569633

put scoring loop in an actual loop

8a681ca

v2.0.0

e3e19b9

update method now closes the job

41f1a68

Refactor get_inactive_queue method to accept string timestamp and add…

4b3440e

… get_all_miner_uids function for miner UID retrieval

dont load gjp job if fails to load to s3

e8dc813

Update mining documentation to clarify Global Job Pool usage and base…

ee9c012

… miner launch instructions

remove the testing code

bc33d41

added init file

9244690

Merge pull request #352 from macrocosm-os/fix/miner-docs-update

5abad64

Update mining documentation to clarify Global Job Pool usage and base miner launch

schampoux approved these changes Feb 6, 2025

View reviewed changes

schampoux merged commit a8e80a1 into main Feb 6, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Staging #340

Staging #340

mccrindlebrian commented Jan 27, 2025 •

edited by Sarkosos

Loading

schampoux left a comment

Staging #340

Staging #340

Conversation

mccrindlebrian commented Jan 27, 2025 • edited by Sarkosos Loading

schampoux left a comment

Choose a reason for hiding this comment

mccrindlebrian commented Jan 27, 2025 •

edited by Sarkosos

Loading