Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Windows [WinError 5] Access is denied - Pipeline execution failed at stage extract #2339

Open
bwint opened this issue Feb 21, 2025 · 0 comments

Comments

@bwint
Copy link

bwint commented Feb 21, 2025

dlt version

1.7.0

Describe the problem

I've tried to load a csv file into a MSSQL database and every time I try to run the pipeline I get the following error:

Exception has occurred: PipelineStepFailed
Pipeline execution failed at stage extract when processing package 1740126056.952863 with exception:

<class 'PermissionError'>
[WinError 5] Zugriff verweigert: 'C:\\Users\\Windows_Username\\.dlt\\pipelines\\pipeline_name\\normalize\\8c1d4e27ee47f6e1\\abbf4e7cde7268b5' -> 'C:\\Users\\Windows_Username\\.dlt\\pipelines\\pipeline_name\\normalize\\8c1d4e27ee47f6e1\\1740126056.952863\\schema.json'

I also tried it on two different windows machines (Win 10 and Win 11) and got the same error on both machines.

It looks to me like some kind of Windows filesystem permission error within the temporary .dlt folder within the user folder.

Expected behavior

No response

Steps to reproduce

This is the code I try to run:

import dlt
from dlt.sources.filesystem import filesystem, read_csv

filesystem_pipe = filesystem(bucket_url=os.path.join(cwd, data_folder), file_glob="*.csv") | read_csv()
pipeline = dlt.pipeline(pipeline_name="pipeline_name", destination="mssql")
load_info = pipeline.run(filesystem_pipe.with_name("dlt_test"))
print(load_info)

Operating system

Windows

Runtime environment

Local

Python version

3.12

dlt data source

Local csv file

dlt destination

MSSQL

Other deployment details

No response

Additional information

Debug log output of another run before the error:

2025-02-21 09:40:40,835|[DEBUG]|25872|6732|dlt|data_item_storage.py|close_writers:81|Closing writer for 1740127238.846641.pipeline_name.dlt_test with file <gzip _io.BufferedWriter name='C:\\Users\\Windows_Username\\.dlt\\pipelines\\pipeline_name\\normalize\\13fd3b39c9cce8fb\\1740127238.846641\\new_jobs\\dlt_test.3b4954552e.0.typed-jsonl' 0x13651504880> and actual name C:\Users\Windows_Username\.dlt\pipelines\pipeline_name\normalize\13fd3b39c9cce8fb\1740127238.846641\new_jobs\dlt_test.3b4954552e.0.typed-jsonl
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Todo
Development

No branches or pull requests

1 participant