endpoint(qingstor/s3/fs): Modified the method of multipart upload in the copy task

[abyss-w]

Originally, for large files, it was split into parts and uploaded in units of parts. But in this case, the last part is stipulated to be uploaded last, and uploads will not be complete until the last part is uploaded.
Now upload large files in units of objects, adding a configuration:

• wokers
  • The total number of workers for multipart uploads, the default value is 100.
  • example:

type: copy

source:
  type: s3
  path: /path/to/source
  options:
    ......

destination:
  type: qingstor
  path: /path/to/destination
  options:
    ......

multipart_boundary_size: 2147483648
ignore_existing: last_modified

ignore_before: 2023-01-30 12:00:00
rate_limit: 1000

workers: 100