"rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Azure Blob, Azure Files, Yandex Files
Go azure-blobazure-blob-storageazure-filesbackblaze-b2cloud-storagedropboxencryptionftpfuse-filesystemgogolanggoogle-cloud-storagegoogle-driveonedriveopenstack-swiftrclones3sftpsyncwebdav
s3: disable signing Accept-Encoding for Ceph and Linode - fixes #8206
Adityaea589de94157
diff --git a/backend/s3/provider/Ceph.yaml b/backend/s3/provider/Ceph.yamlindex 32285726d..17aa311ff 100644--- a/backend/s3/provider/Ceph.yaml+++ b/backend/s3/provider/Ceph.yaml@@ -19,3 +19,7 @@ quirks:force_path_style: truelist_url_encode: falseuse_already_exists: false+ # Ceph RGW (and reverse proxies such as Cloudflare in front of it) can+ # mutate Accept-Encoding and break SigV4 when that header is signed.+ # See: https://github.com/rclone/rclone/issues/8206+ sign_accept_encoding: falsediff --git a/backend/s3/provider/Linode.yaml b/backend/s3/provider/Linode.yamlindex 2e6054174..77b39d1aa 100644--- a/backend/s3/provider/Linode.yaml+++ b/backend/s3/provider/Linode.yaml@@ -24,3 +24,8 @@ endpoint:us-iad-10.linodeobjects.com: Washington, DC, US (us-iad-10)acl: {}bucket_acl: true+quirks:+ # Linode Object Storage is Ceph-backed; signing Accept-Encoding causes+ # SignatureDoesNotMatch with rclone 1.68+. Match the Ceph quirk.+ # See: https://github.com/rclone/rclone/issues/8206+ sign_accept_encoding: falsediff --git a/docs/content/s3.md b/docs/content/s3.mdindex 98962229d..9fdf5d864 100644--- a/docs/content/s3.md+++ b/docs/content/s3.md@@ -5159,6 +5159,12 @@ parameter `--s3-upload-cutoff 0` or put this in the config file as`upload_cutoff 0` to work around a bug which causes uploading of smallfiles to fail.+Rclone defaults `sign_accept_encoding` to false for the Ceph provider.+That avoids `SignatureDoesNotMatch` errors when a reverse proxy (for+example Cloudflare) rewrites the `Accept-Encoding` request header. You+can override this with `--s3-sign-accept-encoding` / `sign_accept_encoding`+if needed.+Note also that Ceph sometimes puts `/` in the passwords it givesusers. If you read the secret access key using the command line toolsyou will get a JSON blob with the `/` escaped as `\/`. Make sure you@@ -7477,6 +7483,10 @@ secret_access_key = SECRET_ACCESS_KEYendpoint = eu-central-1.linodeobjects.com```+Linode Object Storage is Ceph-backed. Rclone defaults+`sign_accept_encoding` to false for this provider so SigV4 requests do+not fail with `SignatureDoesNotMatch` (see the [Ceph](#ceph) section).+### Magalu {#magalu}Here is an example of making a [Magalu Object Storage](https://magalu.cloud/object-storage/)