Code

Wrap up initial data access refactor#570

Code

Merged

jenhagg merged 18 commits intodata_access_refactorBreakthrough-Energy/PowerSimData:data_access_refactorfrom jon/refactorBreakthrough-Energy/PowerSimData:jon/refactorCopy head branch name to clipboardFeb 9, 2022

+367-427

Commits

Commits on Feb 7, 2022

• refactor: remove move_to and simplify csv persistence

  

  Jon Hagg

  committed
  af4888a

  Copy full SHA for af4888a

• fix: filename convention for execute state

  

  Jon Hagg

  committed
  2e712fd

  Copy full SHA for 2e712fd

• fix: makedirs if needed and minor cleanup

  

  Jon Hagg

  committed
  05a5c9d

  Copy full SHA for 05a5c9d

• ci: default to no coverage report

  

  Jon Hagg

  committed
  aa752ca

  Copy full SHA for aa752ca

• feat: use multi fs to wrap remote storage

  

  Jon Hagg

  committed
  9e42654

  Copy full SHA for 9e42654

• refactor: consolidate fallback logic

  

  Jon Hagg

  committed
  cf58f3a

  Copy full SHA for cf58f3a

• fix: more useful logging, update MultiFS definition to match expected priority

  

  Jon Hagg

  committed
  d346e90

  Copy full SHA for d346e90

• refactor: use callback to handle reading various file types

  

  Jon Hagg

  committed
  c36be4c

  Copy full SHA for c36be4c

• fix: checksum, path handling, refactor callbacks

  

  Jon Hagg

  committed
  76bc9c2

  Copy full SHA for 76bc9c2

• fix: exec_command, refactor write to use context manager

  

  Jon Hagg

  committed
  8e9b083

  Copy full SHA for 8e9b083

• fix: write local csv, remove unused method

  

  Jon Hagg

  committed
  e8d28cb

  Copy full SHA for e8d28cb

• test: wip testing scenario lifecycle with temp fs

  

  Jon Hagg

  committed
  adde960

  Copy full SHA for adde960

• refactor: decouple csv persistence from local disk

  

  Jon Hagg

  committed
  31a5a45

  Copy full SHA for 31a5a45

• test: use singleton mock object, add test profile fs

  

  Jon Hagg

  committed
  9f8b6a8

  Copy full SHA for 9f8b6a8

• refactor: move mock context to own file

  

  Jon Hagg

  committed
  542bdc3

  Copy full SHA for 542bdc3

• test: delete state functionality and enable state change earlier starting in execute state

  

  Jon Hagg

  committed
  5615367

  Copy full SHA for 5615367

• refactor: specify fs when using glob pattern to delete, control flow for partial deletes

  

  Jon Hagg

  committed
  1b0dfa1

  Copy full SHA for 1b0dfa1

Commits on Feb 9, 2022

• fix: move -> copy, specify base dir for matching files in delete state

  

  Jon Hagg

  committed
  f3a543d

  Copy full SHA for f3a543d