Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

tests.system.test_transfer_manager: test_upload_chunks_concurrently failed #1154

Closed
flaky-bot bot opened this issue Oct 9, 2023 · 1 comment
Closed
Labels
api: storage Issues related to the googleapis/python-storage API. flakybot: issue An issue filed by the Flaky Bot. Should not be added manually. priority: p1 Important issue which blocks shipping the next release. Will be fixed prior to next release. type: bug Error or flaw in code with unintended results or allowing sub-optimal usage patterns.

Comments

@flaky-bot
Copy link

flaky-bot bot commented Oct 9, 2023

This test failed!

To configure my behavior, see the Flaky Bot documentation.

If I'm commenting on this issue too often, add the flakybot: quiet label and
I will stop commenting.


commit: a3a1159
buildURL: Build Status, Sponge
status: failed

Test output
concurrent.futures.process._RemoteTraceback: 
"""
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/concurrent/futures/process.py", line 239, in _process_worker
    r = call_item.fn(*call_item.args, **call_item.kwargs)
  File "/tmpfs/src/github/python-storage/google/cloud/storage/transfer_manager.py", line 1102, in _upload_part
    part.upload(client._http)
  File "/tmpfs/src/github/python-storage/.nox/system-3-8/lib/python3.8/site-packages/google/resumable_media/requests/upload.py", line 760, in upload
    return _request_helpers.wait_and_retry(
  File "/tmpfs/src/github/python-storage/.nox/system-3-8/lib/python3.8/site-packages/google/resumable_media/requests/_request_helpers.py", line 178, in wait_and_retry
    raise error
  File "/tmpfs/src/github/python-storage/.nox/system-3-8/lib/python3.8/site-packages/google/resumable_media/requests/_request_helpers.py", line 155, in wait_and_retry
    response = func()
  File "/tmpfs/src/github/python-storage/.nox/system-3-8/lib/python3.8/site-packages/google/resumable_media/requests/upload.py", line 756, in retriable_request
    self._process_upload_response(result)
  File "/tmpfs/src/github/python-storage/.nox/system-3-8/lib/python3.8/site-packages/google/resumable_media/_upload.py", line 1305, in _process_upload_response
    _helpers.require_status_code(
  File "/tmpfs/src/github/python-storage/.nox/system-3-8/lib/python3.8/site-packages/google/resumable_media/_helpers.py", line 108, in require_status_code
    raise common.InvalidResponse(
google.resumable_media.common.InvalidResponse: ('Request failed with status code', 503, 'Expected one of', )
"""

The above exception was the direct cause of the following exception:

shared_bucket = <Bucket: gcp-systest-1696869300933>
file_data = {'big': {'hash': b'cEome4a+NYd7YIXzXQnR5Q==', 'path': '/tmpfs/src/github/python-storage/tests/data/five-point-one-mb-f...g'}, 'simple': {'hash': b'3Hkwjv2WvCnKjNR6Z3CboA==', 'path': '/tmpfs/src/github/python-storage/tests/data/simple.txt'}}
blobs_to_delete = [<Blob: gcp-systest-1696869300933, mpu_file, None>]

def test_upload_chunks_concurrently(shared_bucket, file_data, blobs_to_delete):
    source_file = file_data["big"]
    filename = source_file["path"]
    blob_name = "mpu_file"
    upload_blob = shared_bucket.blob(blob_name)
    chunk_size = 5 * 1024 * 1024  # Minimum supported by XML MPU API
    assert os.path.getsize(filename) > chunk_size  # Won't make a good test otherwise

    blobs_to_delete.append(upload_blob)
  transfer_manager.upload_chunks_concurrently(
        filename, upload_blob, chunk_size=chunk_size, deadline=DEADLINE
    )

tests/system/test_transfer_manager.py:198:


google/cloud/storage/transfer_manager.py:1060: in upload_chunks_concurrently
part_number, etag = future.result()
/usr/local/lib/python3.8/concurrent/futures/_base.py:437: in result
return self.__get_result()


self = None

def __get_result(self):
    if self._exception:
        try:
          raise self._exception

E google.resumable_media.common.InvalidResponse: (503, 'Expected one of', <HTTPStatus.OK: 200>)

/usr/local/lib/python3.8/concurrent/futures/_base.py:389: InvalidResponse

@flaky-bot flaky-bot bot added flakybot: issue An issue filed by the Flaky Bot. Should not be added manually. priority: p1 Important issue which blocks shipping the next release. Will be fixed prior to next release. type: bug Error or flaw in code with unintended results or allowing sub-optimal usage patterns. labels Oct 9, 2023
@product-auto-label product-auto-label bot added the api: storage Issues related to the googleapis/python-storage API. label Oct 9, 2023
@flaky-bot
Copy link
Author

flaky-bot bot commented Oct 9, 2023

Test passed for commit 3a0f551 (Build Status, Sponge)! Closing this issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
api: storage Issues related to the googleapis/python-storage API. flakybot: issue An issue filed by the Flaky Bot. Should not be added manually. priority: p1 Important issue which blocks shipping the next release. Will be fixed prior to next release. type: bug Error or flaw in code with unintended results or allowing sub-optimal usage patterns.
Projects
None yet
Development

No branches or pull requests

0 participants