Dagster+ keeps on going with venv instead of of my github repo

[jarichb]

I keep on getting this error when trying to deploy:

dagster._core.errors.DagsterUserCodeLoadError: Error occurred during the loading of Dagster definitions in
executable_path=/venvs/8aefc23caae7/bin/python3.8, module_name=dlt_sources.definitions, working_directory=dlt_sources

  File "/venvs/c1d67faef4c6/lib/python3.8/site-packages/dagster/_grpc/server.py", line 421, in __init__
    self._loaded_repositories: Optional[LoadedRepositories] = LoadedRepositories(
  File "/venvs/c1d67faef4c6/lib/python3.8/site-packages/dagster/_grpc/server.py", line 255, in __init__
    loadable_targets = get_loadable_targets(
  File "/usr/local/lib/python3.8/contextlib.py", line 131, in __exit__
    self.gen.throw(type, value, traceback)
  File "/venvs/c1d67faef4c6/lib/python3.8/site-packages/dagster/_core/errors.py", line 297, in user_code_error_boundary
    raise new_error from e

The above exception was caused by the following exception:
dagster_dbt.errors.DagsterDbtProjectNotFoundError: project_dir /venvs/8aefc23caae7/lib/python3.8/site-packages/dbt_peak_dwh does not exist.

  File "/venvs/c1d67faef4c6/lib/python3.8/site-packages/dagster/_core/errors.py", line 287, in user_code_error_boundary
    yield
  File "/venvs/c1d67faef4c6/lib/python3.8/site-packages/dagster/_grpc/server.py", line 255, in __init__
    loadable_targets = get_loadable_targets(
  File "/venvs/c1d67faef4c6/lib/python3.8/site-packages/dagster/_grpc/utils.py", line 50, in get_loadable_targets
    else loadable_targets_from_python_module(module_name, working_directory)
  File "/venvs/c1d67faef4c6/lib/python3.8/site-packages/dagster/_core/workspace/autodiscovery.py", line 31, in loadable_targets_from_python_module
    module = load_python_module(
  File "/venvs/c1d67faef4c6/lib/python3.8/site-packages/dagster/_core/code_pointer.py", line 134, in load_python_module
    return importlib.import_module(module_name)
  File "/usr/local/lib/python3.8/importlib/__init__.py", line 127, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1014, in _gcd_import
  File "<frozen importlib._bootstrap>", line 991, in _find_and_load
  File "<frozen importlib._bootstrap>", line 975, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 671, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 843, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/venvs/8aefc23caae7/lib/python3.8/site-packages/dlt_sources/definitions.py", line 7, in <module>
    from . import assets
  File "/venvs/8aefc23caae7/lib/python3.8/site-packages/dlt_sources/assets.py", line 5, in <module>
    from .project import dbt_project
  File "/venvs/8aefc23caae7/lib/python3.8/site-packages/dlt_sources/project.py", line 5, in <module>
    dbt_project = DbtProject(
  File "/venvs/c1d67faef4c6/lib/python3.8/site-packages/dagster_dbt/dbt_project.py", line 222, in __new__
    raise DagsterDbtProjectNotFoundError(f"project_dir {project_dir} does not exist.")

It makes sense to me that this folder doesn't exist but it does exist in the github repo.
My project.py file looks like this, which I thought would take the current directory and get a relative path from that but it just doesn't work. Any help would be appreciated!

from pathlib import Path

from dagster_dbt import DbtProject

dbt_project = DbtProject(
    project_dir=Path(__file__).joinpath("..", "..", "dbt_peak_dwh").resolve()
)

dbt_project.prepare_if_dev()

[garethbrickman]

Hey @jarichb I believe Dagster Support helped you to solve this. If you're comfortable please share the solution here for others 👍

[gbabeleda]

Hi I am getting the same error when trying to use the serverless deploys. Would love to hear how it was solved