Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error: Invalid request. The number of bytes uploaded is required to be equal or greater than 262144 , While trying to upload file #1044

Closed
aneesv opened this issue Jan 4, 2016 · 7 comments
Assignees
Labels
api: storage Issues related to the Cloud Storage API.

Comments

@aneesv
Copy link

aneesv commented Jan 4, 2016

Getting error

Error: Invalid request. The number of bytes uploaded is required to be equal or greater than 262144, except for the final request (it's recommended to be the exact multiple of 262144). The received request contained 229591 bytes, which does not meet this requirement.
while trying to upload file

@stephenplusplus
Copy link
Contributor

Is this reproducible every time? (can you retry the upload?)

Does this occur with other files? What type of file is it? If possible, can you share the file or another one that fails consistently?

@stephenplusplus stephenplusplus added the api: storage Issues related to the Cloud Storage API. label Jan 4, 2016
@aneesv
Copy link
Author

aneesv commented Jan 4, 2016

@stephenplusplus Its occuring with one particular file (9.4 MB)

I have attached error trace

Error: Invalid request. The number of bytes uploaded is required to be equal or greater than 262144, except for the final request (it's recommended to be the exact multiple of 262144). The received request contained 229591 bytes, which does not meet this requirement. at Request._callback (/node_modules/gcloud/node_modules/gcs-resumable-upload/index.js:218:25) at Request.self.callback (/node_modules/request/request.js:198:22) at Request.emit (events.js:110:17) at Request.<anonymous> (/node_modules/request/request.js:1082:10) at Request.emit (events.js:129:20) at IncomingMessage.<anonymous> (/node_modules/request/request.js:1009:12) at IncomingMessage.emit (events.js:129:20) at _stream_readable.js:908:16 at process._tickDomainCallback (node.js:381:11)

@stephenplusplus
Copy link
Contributor

Can you show the gcloud-node code you're using?

@aneesv
Copy link
Author

aneesv commented Jan 4, 2016

@stephenplusplus
I am using a wrapper , Code is working perfectly for all files expect one file. I tried reuploading it same error

CloudStorage.prototype.uploadFile = function(localPath,cloudPath,options){
    options = options || {};
    var q = Q.defer();
    cloudPath = this.parseUrl(cloudPath);
    if(!options.destination)
        options.destination = cloudPath.path;
    this.gcs.bucket(cloudPath.bucket).upload(localPath,options,function(err, file) {
        if (!err) {
            q.resolve(file);
        }else{
            q.reject(err);
        }
    });
    return q.promise;
};

CloudStorage.prototype.parseUrl = function(url) {
    if(typeof url !== 'string') {
        throw new Error('only string parameter supported! ');
    }
    url = url.replace('gs://', '');
    var data = {};
    var bits = url.split('/');

    data.bucket = bits.shift();
    data.path = bits.join('/');

    return data;
};

@stephenplusplus
Copy link
Contributor

I haven't been able to reproduce using a file of the same size. The library reporting the error is actually gcs-resumable-upload. It creates/re-uses a JSON file to store the progress of the resumable upload. Can you check ~/.config/configstore/gcloud-node.json and remove it to see if that solves it?

@aneesv
Copy link
Author

aneesv commented Jan 4, 2016

@stephenplusplus Thanks it worked ! Between name of file was ~/.config/configstore/gcs-resumable-upload.json

@aneesv aneesv closed this as completed Jan 4, 2016
@stephenplusplus
Copy link
Contributor

Oh, sorry, thanks for correcting. Glad it worked!

sofisl pushed a commit that referenced this issue Jan 17, 2023
* chore: remove obsolete service config files

PiperOrigin-RevId: 472492863

Source-Link: googleapis/googleapis@725381d

Source-Link: googleapis/googleapis-gen@16aebe2
Copy-Tag: eyJwIjoiLmdpdGh1Yi8uT3dsQm90LnlhbWwiLCJoIjoiMTZhZWJlMjRlODE3YzI0ZTYxOTI3NDZlZGM1MjJkNzAwMzZkZDc3MiJ9

* 🦉 Updates from OwlBot post-processor

See https://github.com/googleapis/repo-automation-bots/blob/main/packages/owl-bot/README.md

* docs: update comments for image annotator OCR models

PiperOrigin-RevId: 474070246

Source-Link: googleapis/googleapis@346e2f2

Source-Link: googleapis/googleapis-gen@50b3451
Copy-Tag: eyJwIjoiLmdpdGh1Yi8uT3dsQm90LnlhbWwiLCJoIjoiNTBiMzQ1MTVmYTg5NTI1OTg5MDIxYmU0YjY5ODlkNDkwNTlkOGQyNiJ9

* 🦉 Updates from OwlBot post-processor

See https://github.com/googleapis/repo-automation-bots/blob/main/packages/owl-bot/README.md

* chore: use gapic-generator-typescript v2.17.0

PiperOrigin-RevId: 474338479

Source-Link: googleapis/googleapis@d5d35e0

Source-Link: googleapis/googleapis-gen@efcd3f9
Copy-Tag: eyJwIjoiLmdpdGh1Yi8uT3dsQm90LnlhbWwiLCJoIjoiZWZjZDNmOTM5NjJhMTAzZjY4ZjAwM2UyYTFlZWNkZTZmYTIxNmEyNyJ9

* 🦉 Updates from OwlBot post-processor

See https://github.com/googleapis/repo-automation-bots/blob/main/packages/owl-bot/README.md

* test: use fully qualified request type name in tests

PiperOrigin-RevId: 475685359

Source-Link: googleapis/googleapis@7a12973

Source-Link: googleapis/googleapis-gen@370c729
Copy-Tag: eyJwIjoiLmdpdGh1Yi8uT3dsQm90LnlhbWwiLCJoIjoiMzcwYzcyOWUyYmEwNjJhMTY3NDQ5YzI3ODgyYmE1ZjM3OWM1YzM0ZCJ9

* 🦉 Updates from OwlBot post-processor

See https://github.com/googleapis/repo-automation-bots/blob/main/packages/owl-bot/README.md

* test: make test pass

Co-authored-by: Owl Bot <gcf-owl-bot[bot]@users.noreply.github.com>
Co-authored-by: Alexander Fenster <[email protected]>
sofisl pushed a commit that referenced this issue Jan 17, 2023
🤖 I have created a release *beep* *boop*
---


## [3.0.1](googleapis/nodejs-vision@v3.0.0...v3.0.1) (2022-09-21)


### Bug Fixes

* Preserve default values in x-goog-request-params header ([#1044](googleapis/nodejs-vision#1044)) ([a5baeca](googleapis/nodejs-vision@a5baeca))

---
This PR was generated with [Release Please](https://github.com/googleapis/release-please). See [documentation](https://github.com/googleapis/release-please#release-please).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
api: storage Issues related to the Cloud Storage API.
Projects
None yet
Development

No branches or pull requests

2 participants