Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Addressing PR comments #528

Merged
merged 17 commits into from
Apr 30, 2024
Merged

Conversation

juliaputko
Copy link
Contributor

…ssing PR comments

Copy link

codecov bot commented Mar 29, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

❗ No coverage uploaded for pull request base (preview@7bcb149). Click here to learn what that means.

❗ Current head 86746da differs from pull request most recent head 9de5069. Consider uploading reports for the commit 9de5069 to get more accurate results

Additional details and impacted files

Impacted file tree graph

@@            Coverage Diff             @@
##             preview     #528   +/-   ##
==========================================
  Coverage           ?   90.70%           
==========================================
  Files              ?       66           
  Lines              ?     4636           
  Branches           ?        0           
==========================================
  Hits               ?     4205           
  Misses             ?      431           
  Partials           ?        0           
Files Coverage Δ
smartsim/_core/control/controller.py 86.05% <100.00%> (ø)
smartsim/_core/control/previewrenderer.py 96.07% <100.00%> (ø)
smartsim/entity/dbobject.py 67.88% <ø> (ø)
smartsim/entity/ensemble.py 99.26% <100.00%> (ø)
smartsim/error/errors.py 100.00% <100.00%> (ø)
smartsim/experiment.py 87.50% <100.00%> (ø)

@juliaputko juliaputko requested a review from ankona April 12, 2024 21:53
Copy link
Contributor

@ankona ankona left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good.

I'd really like if we could avoid changing the templates if the directory structure changes. If we can't do that, all that's left are a couple nitpicks on docstrings.

Copy link
Contributor

@amandarichardsonn amandarichardsonn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Super nice work and incredible amount of code, I can definitely tell a lot of hard work went into this! Here is what I came up with:

Documentation:
I have some suggestions below of where to include information on preview.

  1. Make sure the new Experiment.preview is added to doc/api/smartsim_api.rst
  2. Add preview to this chart here
  3. Add preview as an Example step here

Preview templates:

  1. I would add the path for Ensemble, Model and Orchestrator to the previews! It is possible that a user specifies their own path and therefore it is not located in the exp_path. The path arguments for Orch and Ensemble have been pushed to develop.
  2. I notice that in an Experiment with multiple databases, the db_identifier for the standalone dbs are given, even if one is not provided. A colo db identifier is only shown if provided even though the identifier would be default: orchestrator -> should we show the colo db_identifier name always like for std?

Possible Bug 1:
I am running the two Model script below:

model = exp.create_model("hello_world", settings, path="./")
model_2 = exp.create_model("hello", settings, path="./")
model_2.colocate_db_tcp()
exp.preview(model, model_2)
exp.start(model, model_2)

The preview output is:

== Models ==

    = Model Name: hello_world =
        Colocated:
          Connection Type: TCP
          TCP/IP Port(s):
            6379
        Client Configuration:
            Database Backend: redis
            Connection Type: TCP
            TCP/IP Port(s):
              6379
            Type: Colocated


    = Model Name: hello =
        Colocated:
          Connection Type: TCP
          TCP/IP Port(s):
            6379
        Client Configuration:
            Database Backend: redis
            Connection Type: TCP
            TCP/IP Port(s):
              6379
            Type: Colocated

The preview suggests that both of the Models are colocated rather than the 1? Am I misunderstanding?

Document with more suggestions find here

… replicas and perm strat to ensemble, fiixed error with missing torch scripts; spacing error
Julia Putko added 3 commits April 25, 2024 19:58
…nges in tests, verbosity checking, pylint suppressing in experiment.py, deleting unncessary .dat file
@juliaputko juliaputko marked this pull request as ready for review April 29, 2024 16:32
@juliaputko juliaputko merged commit 1410265 into CrayLabs:preview Apr 30, 2024
33 of 34 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants