duplicity-talk
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Duplicity-talk] How to backup stuff>5GB


From: Kenneth Loafman
Subject: Re: [Duplicity-talk] How to backup stuff>5GB
Date: Fri, 25 Feb 2022 10:42:59 -0600

Hi Tashrif,

The sigtar size problem has been around forever.  For now I suggest splitting the backup into smaller portions.

I am surprised the aws command completes properly.  Did it split the file in the bucket?

...Ken


On Thu, Feb 24, 2022 at 10:57 PM Tashrif via Duplicity-talk <duplicity-talk@nongnu.org> wrote:
During a backup task, duplicity created a 7.5 GB file at the very end: duplicity-full-signatures.20220222T150726Z.sigtar.gz. However, its upload fails with the following traceback:

```
  File "min3-duply/lib/python3.9/site-packages/boto/s3/key.py", line 760, in send_file
    self._send_file_internal(fp, headers=headers, cb=cb, num_cb=num_cb,
  File "min3-duply/lib/python3.9/site-packages/boto/s3/key.py", line 957, in _send_file_internal
    resp = self.bucket.connection.make_request(
  File "min3-duply/lib/python3.9/site-packages/boto/s3/connection.py", line 667, in make_request
    return super(S3Connection, self).make_request(
  File "min3-duply/lib/python3.9/site-packages/boto/connection.py", line 1077, in make_request
    return self._mexe(http_request, sender, override_num_retries,
  File "min3-duply/lib/python3.9/site-packages/boto/connection.py", line 946, in _mexe
    response = sender(connection, request.method, request.path,
  File "min3-duply/lib/python3.9/site-packages/boto/s3/key.py", line 895, in sender
    raise provider.storage_response_error(
 boto.exception.S3ResponseError: S3ResponseError: 400 Bad Request
<?xml version="1.0" encoding="UTF-8"?>
<Error><Code>EntityTooLarge</Code><Message>Your proposed upload exceeds the maximum allowed size</Message><ProposedSize>7422574715</ProposedSize><MaxSizeAllowed>5368709120</MaxSizeAllowed><RequestId>HJD8DQ49S18RBFWQ</RequestId><HostId>7t7enU1YX/HY7ho7qA74knGEIzerBk/hDogp=</HostId></Error>

Attempt of move Nr. 1 failed. S3ResponseError: Bad Request
```

Meanwhile, `aws s3 cp duplicity-full-signatures.20220222T150726Z.sigtar.gz s3://my_bucket/` succeeds gracefully. That said, how do I enable duply/duplicity to upload files larger than 5GB?

Thank you,
Tashrif
_______________________________________________
Duplicity-talk mailing list
Duplicity-talk@nongnu.org
https://lists.nongnu.org/mailman/listinfo/duplicity-talk

reply via email to

[Prev in Thread] Current Thread [Next in Thread]