"rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Azure Blob, Azure Files, Yandex Files
Go azure-blobazure-blob-storageazure-filesbackblaze-b2cloud-storagedropboxencryptionftpfuse-filesystemgogolanggoogle-cloud-storagegoogle-driveonedriveopenstack-swiftrclones3sftpsyncwebdav
Version v1.70.0
Nick Craig-Wood9d464e8e9a56
diff --git a/MANUAL.html b/MANUAL.htmlindex 29c5bfac1..8b1bf934d 100644--- a/MANUAL.html+++ b/MANUAL.html@@ -81,8 +81,75 @@<header id="title-block-header"><h1 class="title">rclone(1) User Manual</h1><p class="author">Nick Craig-Wood</p>-<p class="date">Jan 12, 2025</p>+<p class="date">Jun 17, 2025</p></header>+<h1 id="name">NAME</h1>+<p>rclone - manage files on cloud storage</p>+<h1 id="synopsis">SYNOPSIS</h1>+<pre><code>Usage:+ rclone [flags]+ rclone [command]++Available commands:+ about Get quota information from the remote.+ authorize Remote authorization.+ backend Run a backend-specific command.+ bisync Perform bidirectional synchronization between two paths.+ cat Concatenates any files and sends them to stdout.+ check Checks the files in the source and destination match.+ checksum Checks the files in the destination against a SUM file.+ cleanup Clean up the remote if possible.+ completion Output completion script for a given shell.+ config Enter an interactive configuration session.+ convmv Convert file and directory names in place.+ copy Copy files from source to dest, skipping identical files.+ copyto Copy files from source to dest, skipping identical files.+ copyurl Copy the contents of the URL supplied content to dest:path.+ cryptcheck Cryptcheck checks the integrity of an encrypted remote.+ cryptdecode Cryptdecode returns unencrypted file names.+ dedupe Interactively find duplicate filenames and delete/rename them.+ delete Remove the files in path.+ deletefile Remove a single file from remote.+ gendocs Output markdown docs for rclone to the directory supplied.+ gitannex Speaks with git-annex over stdin/stdout.+ hashsum Produces a hashsum file for all the objects in the path.+ help Show help for rclone commands, flags and backends.+ link Generate public link to file/folder.+ listremotes List all the remotes in the config file and defined in environment variables.+ ls List the objects in the path with size and path.+ lsd List all directories/containers/buckets in the path.+ lsf List directories and objects in remote:path formatted for parsing.+ lsjson List directories and objects in the path in JSON format.+ lsl List the objects in path with modification time, size and path.+ md5sum Produces an md5sum file for all the objects in the path.+ mkdir Make the path if it doesn't already exist.+ mount Mount the remote as file system on a mountpoint.+ move Move files from source to dest.+ moveto Move file or directory from source to dest.+ ncdu Explore a remote with a text based user interface.+ nfsmount Mount the remote as file system on a mountpoint.+ obscure Obscure password for use in the rclone config file.+ purge Remove the path and all of its contents.+ rc Run a command against a running rclone.+ rcat Copies standard input to file on remote.+ rcd Run rclone listening to remote control commands only.+ rmdir Remove the empty directory at path.+ rmdirs Remove empty directories under the path.+ selfupdate Update the rclone binary.+ serve Serve a remote over a protocol.+ settier Changes storage class/tier of objects in remote.+ sha1sum Produces an sha1sum file for all the objects in the path.+ size Prints the total size and number of objects in remote:path.+ sync Make source and dest identical, modifying destination only.+ test Run a test command+ touch Create new file or change file modification time.+ tree List the contents of the remote in a tree like fashion.+ version Show the version number.++Use "rclone [command] --help" for more information about a command.+Use "rclone help flags" for to see the global flags.+Use "rclone help backends" for a list of supported services.+</code></pre><h1 id="rclone-syncs-your-files-to-cloud-storage">Rclone syncs your files to cloud storage</h1><p><img width="50%" src="https://rclone.org/img/logo_on_light__horizontal_color.svg" alt="rclone logo" style="float:right; padding: 5px;" ></p><ul>@@ -156,6 +223,8 @@<li>Enterprise File Fabric</li><li>Fastmail Files</li><li>Files.com</li>+<li>FileLu Cloud Storage</li>+<li>FlashBlade</li><li>FTP</li><li>Gofile</li><li>Google Cloud Storage</li>@@ -180,7 +249,8 @@<li>Magalu</li><li>Mail.ru Cloud</li><li>Memset Memstore</li>-<li>Mega</li>+<li>MEGA</li>+<li>MEGA S4</li><li>Memory</li><li>Microsoft Azure Blob Storage</li><li>Microsoft Azure Files Storage</li>@@ -411,7 +481,7 @@ kill %1</code></pre><h2 id="snap">Snap installation</h2><p><a href="https://snapcraft.io/rclone"><img src="https://snapcraft.io/static/images/badges/en/snap-store-black.svg" alt="Get it from the Snap Store" /></a></p><p>Make sure you have <a href="https://snapcraft.io/docs/installing-snapd">Snapd installed</a></p>-<div class="sourceCode" id="cb23"><pre class="sourceCode bash"><code class="sourceCode bash"><span id="cb23-1"><a href="#cb23-1" aria-hidden="true"></a>$ <span class="fu">sudo</span> snap install rclone</span></code></pre></div>+<div class="sourceCode" id="cb24"><pre class="sourceCode bash"><code class="sourceCode bash"><span id="cb24-1"><a href="#cb24-1" aria-hidden="true"></a>$ <span class="fu">sudo</span> snap install rclone</span></code></pre></div><p>Due to the strict confinement of Snap, rclone snap cannot access real /home/$USER/.config/rclone directory, default config path is as below.</p><ul><li>Default config directory:@@ -424,7 +494,7 @@ kill %1</code></pre><p>Note that this is controlled by <a href="https://github.com/boukendesho/rclone-snap">community maintainer</a> not the rclone developers so it may be out of date. Its current version is as below.</p><p><a href="https://snapcraft.io/rclone"><img src="https://snapcraft.io/rclone/badge.svg" alt="rclone" /></a></p><h2 id="source">Source installation</h2>-<p>Make sure you have git and <a href="https://golang.org/">Go</a> installed. Go version 1.18 or newer is required, the latest release is recommended. You can get it from your package manager, or download it from <a href="https://golang.org/dl/">golang.org/dl</a>. Then you can run the following:</p>+<p>Make sure you have git and <a href="https://golang.org/">Go</a> installed. Go version 1.22 or newer is required, the latest release is recommended. You can get it from your package manager, or download it from <a href="https://golang.org/dl/">golang.org/dl</a>. Then you can run the following:</p><pre><code>git clone https://github.com/rclone/rclone.gitcd rclonego build</code></pre>@@ -519,6 +589,7 @@ go build</code></pre><li><a href="https://rclone.org/koofr/#digi-storage">Digi Storage</a></li><li><a href="https://rclone.org/dropbox/">Dropbox</a></li><li><a href="https://rclone.org/filefabric/">Enterprise File Fabric</a></li>+<li><a href="https://rclone.org/filelu/">FileLu Cloud Storage</a></li><li><a href="https://rclone.org/filescom/">Files.com</a></li><li><a href="https://rclone.org/ftp/">FTP</a></li><li><a href="https://rclone.org/gofile/">Gofile</a></li>@@ -585,7 +656,7 @@ rclone copy /local/path remote:path # copies /local/path to the remoterclone sync --interactive /local/path remote:path # syncs /local/path to the remote</code></pre><h1 id="rclone-config">rclone config</h1><p>Enter an interactive configuration session.</p>-<h2 id="synopsis">Synopsis</h2>+<h2 id="synopsis-1">Synopsis</h2><p>Enter an interactive configuration session where you can setup new remotes and manage existing ones. You may also set or remove a password to protect your configuration.</p><pre><code>rclone config [flags]</code></pre><h2 id="options">Options</h2>@@ -613,7 +684,7 @@ rclone sync --interactive /local/path remote:path # syncs /local/path to the rem</ul><h1 id="rclone-copy">rclone copy</h1><p>Copy files from source to dest, skipping identical files.</p>-<h2 id="synopsis-1">Synopsis</h2>+<h2 id="synopsis-2">Synopsis</h2><p>Copy the source to the destination. Does not transfer files that are identical on source and destination, testing by size and modification time or MD5SUM. Doesn't delete files from the destination. If you want to also delete files from destination, to make it match source, use the <a href="https://rclone.org/commands/rclone_sync/">sync</a> command instead.</p><p>Note that it is always the contents of the directory that is synced, not the directory itself. So when source:path is a directory, it's the contents of source:path that are copied, not the directory name and contents.</p><p>To copy single files, use the <a href="https://rclone.org/commands/rclone_copyto/">copyto</a> command instead.</p>@@ -666,6 +737,7 @@ destpath/sourcepath/two.txt</code></pre>--multi-thread-cutoff SizeSuffix Use multi-thread downloads for files above this size (default 256Mi)--multi-thread-streams int Number of streams to use for multi-thread downloads (default 4)--multi-thread-write-buffer-size SizeSuffix In memory buffer size for writing when in multi-thread mode (default 128Ki)+ --name-transform stringArray Transform paths during the copy process--no-check-dest Don't check the destination, copy regardless--no-traverse Don't traverse destination file system on copy--no-update-dir-modtime Don't update directory modification times@@ -692,6 +764,7 @@ destpath/sourcepath/two.txt</code></pre>--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -716,7 +789,7 @@ destpath/sourcepath/two.txt</code></pre></ul><h1 id="rclone-sync">rclone sync</h1><p>Make source and dest identical, modifying destination only.</p>-<h2 id="synopsis-2">Synopsis</h2>+<h2 id="synopsis-3">Synopsis</h2><p>Sync the source to the destination, changing the destination only. Doesn't transfer files that are identical on source and destination, testing by size and modification time or MD5SUM. Destination is updated to match source, including deleting files if necessary (except duplicate objects, see below). If you don't want to delete files from destination, use the <a href="https://rclone.org/commands/rclone_copy/">copy</a> command instead.</p><p><strong>Important</strong>: Since this can cause data loss, test first with the <code>--dry-run</code> or the <code>--interactive</code>/<code>-i</code> flag.</p><pre><code>rclone sync --interactive SOURCE remote:DESTINATION</code></pre>@@ -793,6 +866,7 @@ destpath/sourcepath/two.txt</code></pre>--multi-thread-cutoff SizeSuffix Use multi-thread downloads for files above this size (default 256Mi)--multi-thread-streams int Number of streams to use for multi-thread downloads (default 4)--multi-thread-write-buffer-size SizeSuffix In memory buffer size for writing when in multi-thread mode (default 128Ki)+ --name-transform stringArray Transform paths during the copy process--no-check-dest Don't check the destination, copy regardless--no-traverse Don't traverse destination file system on copy--no-update-dir-modtime Don't update directory modification times@@ -812,6 +886,7 @@ destpath/sourcepath/two.txt</code></pre>--delete-during When synchronizing, delete files during transfer--fix-case Force rename of case insensitive dest to match source--ignore-errors Delete even if there are I/O errors+ --list-cutoff int To save memory, sort directory listings on disk above this threshold (default 1000000)--max-delete int When synchronizing, limit the number of deletes (default -1)--max-delete-size SizeSuffix When synchronizing, limit the total size of deletes (default off)--suffix string Suffix to add to changed files@@ -833,6 +908,7 @@ destpath/sourcepath/two.txt</code></pre>--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -857,7 +933,7 @@ destpath/sourcepath/two.txt</code></pre></ul><h1 id="rclone-move">rclone move</h1><p>Move files from source to dest.</p>-<h2 id="synopsis-3">Synopsis</h2>+<h2 id="synopsis-4">Synopsis</h2><p>Moves the contents of the source directory to the destination directory. Rclone will error if the source and destination overlap and the remote does not support a server-side directory move operation.</p><p>To move single files, use the <a href="https://rclone.org/commands/rclone_moveto/">moveto</a> command instead.</p><p>If no filters are in use and if possible this will server-side move <code>source:path</code> into <code>dest:path</code>. After this <code>source:path</code> will no longer exist.</p>@@ -898,6 +974,7 @@ destpath/sourcepath/two.txt</code></pre>--multi-thread-cutoff SizeSuffix Use multi-thread downloads for files above this size (default 256Mi)--multi-thread-streams int Number of streams to use for multi-thread downloads (default 4)--multi-thread-write-buffer-size SizeSuffix In memory buffer size for writing when in multi-thread mode (default 128Ki)+ --name-transform stringArray Transform paths during the copy process--no-check-dest Don't check the destination, copy regardless--no-traverse Don't traverse destination file system on copy--no-update-dir-modtime Don't update directory modification times@@ -924,6 +1001,7 @@ destpath/sourcepath/two.txt</code></pre>--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -948,7 +1026,7 @@ destpath/sourcepath/two.txt</code></pre></ul><h1 id="rclone-delete">rclone delete</h1><p>Remove the files in path.</p>-<h2 id="synopsis-4">Synopsis</h2>+<h2 id="synopsis-5">Synopsis</h2><p>Remove the files in path. Unlike <a href="https://rclone.org/commands/rclone_purge/">purge</a> it obeys include/exclude filters so can be used to selectively delete files.</p><p><code>rclone delete</code> only deletes files but leaves the directory structure alone. If you want to delete a directory and all of its contents use the <a href="https://rclone.org/commands/rclone_purge/">purge</a> command.</p><p>If you supply the <code>--rmdirs</code> flag, it will remove all empty directories along with it. You can also use the separate command <a href="https://rclone.org/commands/rclone_rmdir/">rmdir</a> or <a href="https://rclone.org/commands/rclone_rmdirs/">rmdirs</a> to delete empty directories only.</p>@@ -979,6 +1057,7 @@ rclone --dry-run --min-size 100M delete remote:path</code></pre>--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -1003,8 +1082,9 @@ rclone --dry-run --min-size 100M delete remote:path</code></pre></ul><h1 id="rclone-purge">rclone purge</h1><p>Remove the path and all of its contents.</p>-<h2 id="synopsis-5">Synopsis</h2>+<h2 id="synopsis-6">Synopsis</h2><p>Remove the path and all of its contents. Note that this does not obey include/exclude filters - everything will be removed. Use the <a href="https://rclone.org/commands/rclone_delete/">delete</a> command if you want to selectively delete files. To delete empty directories only, use command <a href="https://rclone.org/commands/rclone_rmdir/">rmdir</a> or <a href="https://rclone.org/commands/rclone_rmdirs/">rmdirs</a>.</p>+<p>The concurrency of this operation is controlled by the <code>--checkers</code> global flag. However, some backends will implement this command directly, in which case <code>--checkers</code> will be ignored.</p><p><strong>Important</strong>: Since this can cause data loss, test first with the <code>--dry-run</code> or the <code>--interactive</code>/<code>-i</code> flag.</p><pre><code>rclone purge remote:path [flags]</code></pre><h2 id="options-5">Options</h2>@@ -1036,7 +1116,7 @@ rclone --dry-run --min-size 100M delete remote:path</code></pre></ul><h1 id="rclone-rmdir">rclone rmdir</h1><p>Remove the empty directory at path.</p>-<h2 id="synopsis-6">Synopsis</h2>+<h2 id="synopsis-7">Synopsis</h2><p>This removes empty directory given by path. Will not remove the path if it has any objects in it, not even empty subdirectories. Use command <a href="https://rclone.org/commands/rclone_rmdirs/">rmdirs</a> (or <a href="https://rclone.org/commands/rclone_delete/">delete</a> with option <code>--rmdirs</code>) to do that.</p><p>To delete a path and any objects in it, use <a href="https://rclone.org/commands/rclone_purge/">purge</a> command.</p><pre><code>rclone rmdir remote:path [flags]</code></pre>@@ -1054,7 +1134,7 @@ rclone --dry-run --min-size 100M delete remote:path</code></pre></ul><h1 id="rclone-check">rclone check</h1><p>Checks the files in the source and destination match.</p>-<h2 id="synopsis-7">Synopsis</h2>+<h2 id="synopsis-8">Synopsis</h2><p>Checks the files in the source and destination match. It compares sizes and hashes (MD5 or SHA1) and logs a report of files that don't match. It doesn't alter the source or destination.</p><p>For the <a href="https://rclone.org/crypt/">crypt</a> remote there is a dedicated command, <a href="https://rclone.org/commands/rclone_cryptcheck/">cryptcheck</a>, that are able to check the checksums of the encrypted files.</p><p>If you supply the <code>--size-only</code> flag, it will only compare the sizes not the hashes as well. Use this for a quick check.</p>@@ -1097,6 +1177,7 @@ rclone --dry-run --min-size 100M delete remote:path</code></pre>--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -1121,7 +1202,7 @@ rclone --dry-run --min-size 100M delete remote:path</code></pre></ul><h1 id="rclone-ls">rclone ls</h1><p>List the objects in the path with size and path.</p>-<h2 id="synopsis-8">Synopsis</h2>+<h2 id="synopsis-9">Synopsis</h2><p>Lists the objects in the source path to standard output in a human readable format with size and path. Recurses by default.</p><p>Eg</p><pre><code>$ rclone ls swift:bucket@@ -1156,6 +1237,7 @@ rclone --dry-run --min-size 100M delete remote:path</code></pre>--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -1180,7 +1262,7 @@ rclone --dry-run --min-size 100M delete remote:path</code></pre></ul><h1 id="rclone-lsd">rclone lsd</h1><p>List all directories/containers/buckets in the path.</p>-<h2 id="synopsis-9">Synopsis</h2>+<h2 id="synopsis-10">Synopsis</h2><p>Lists the directories in the source path to standard output. Does not recurse by default. Use the <code>-R</code> flag to recurse.</p><p>This command lists the total size of the directory (if known, -1 if not), the modification time (if known, the current time if not), the number of objects in the directory (if known, -1 if not) and the name of the directory, Eg</p><pre><code>$ rclone lsd swift:@@ -1220,6 +1302,7 @@ rclone --dry-run --min-size 100M delete remote:path</code></pre>--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -1244,7 +1327,7 @@ rclone --dry-run --min-size 100M delete remote:path</code></pre></ul><h1 id="rclone-lsl">rclone lsl</h1><p>List the objects in path with modification time, size and path.</p>-<h2 id="synopsis-10">Synopsis</h2>+<h2 id="synopsis-11">Synopsis</h2><p>Lists the objects in the source path to standard output in a human readable format with modification time, size and path. Recurses by default.</p><p>Eg</p><pre><code>$ rclone lsl swift:bucket@@ -1279,6 +1362,7 @@ rclone --dry-run --min-size 100M delete remote:path</code></pre>--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -1303,7 +1387,7 @@ rclone --dry-run --min-size 100M delete remote:path</code></pre></ul><h1 id="rclone-md5sum">rclone md5sum</h1><p>Produces an md5sum file for all the objects in the path.</p>-<h2 id="synopsis-11">Synopsis</h2>+<h2 id="synopsis-12">Synopsis</h2><p>Produces an md5sum file for all the objects in the path. This is in the same format as the standard md5sum tool produces.</p><p>By default, the hash is requested from the remote. If MD5 is not supported by the remote, no hash will be returned. With the download flag, the file will be downloaded from the remote and hashed locally enabling MD5 for any remote.</p><p>For other algorithms, see the <a href="https://rclone.org/commands/rclone_hashsum/">hashsum</a> command. Running <code>rclone md5sum remote:path</code> is equivalent to running <code>rclone hashsum MD5 remote:path</code>.</p>@@ -1326,6 +1410,7 @@ rclone --dry-run --min-size 100M delete remote:path</code></pre>--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -1350,7 +1435,7 @@ rclone --dry-run --min-size 100M delete remote:path</code></pre></ul><h1 id="rclone-sha1sum">rclone sha1sum</h1><p>Produces an sha1sum file for all the objects in the path.</p>-<h2 id="synopsis-12">Synopsis</h2>+<h2 id="synopsis-13">Synopsis</h2><p>Produces an sha1sum file for all the objects in the path. This is in the same format as the standard sha1sum tool produces.</p><p>By default, the hash is requested from the remote. If SHA-1 is not supported by the remote, no hash will be returned. With the download flag, the file will be downloaded from the remote and hashed locally enabling SHA-1 for any remote.</p><p>For other algorithms, see the <a href="https://rclone.org/commands/rclone_hashsum/">hashsum</a> command. Running <code>rclone sha1sum remote:path</code> is equivalent to running <code>rclone hashsum SHA1 remote:path</code>.</p>@@ -1374,6 +1459,7 @@ rclone --dry-run --min-size 100M delete remote:path</code></pre>--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -1398,7 +1484,7 @@ rclone --dry-run --min-size 100M delete remote:path</code></pre></ul><h1 id="rclone-size">rclone size</h1><p>Prints the total size and number of objects in remote:path.</p>-<h2 id="synopsis-13">Synopsis</h2>+<h2 id="synopsis-14">Synopsis</h2><p>Counts objects in the path and calculates the total size. Prints the result to standard output.</p><p>By default the output is in human-readable format, but shows values in both human-readable format as well as the raw numbers (global option <code>--human-readable</code> is not considered). Use option <code>--json</code> to format output as JSON instead.</p><p>Recurses by default, use <code>--max-depth 1</code> to stop the recursion.</p>@@ -1418,6 +1504,7 @@ rclone --dry-run --min-size 100M delete remote:path</code></pre>--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -1442,7 +1529,7 @@ rclone --dry-run --min-size 100M delete remote:path</code></pre></ul><h1 id="rclone-version">rclone version</h1><p>Show the version number.</p>-<h2 id="synopsis-14">Synopsis</h2>+<h2 id="synopsis-15">Synopsis</h2><p>Show the rclone version number, the go version, the build target OS and architecture, the runtime OS and kernel version and bitness, build tags and the type of executable (static or dynamic).</p><p>For example:</p><pre><code>$ rclone version@@ -1467,9 +1554,11 @@ latest: 1.42 (released 2018-06-16)upgrade: https://downloads.rclone.org/v1.42beta: 1.42.0.5 (released 2018-06-17)upgrade: https://beta.rclone.org/v1.42-005-g56e1e820</code></pre>+<p>If you supply the --deps flag then rclone will print a list of all the packages it depends on and their versions along with some other information about the build.</p><pre><code>rclone version [flags]</code></pre><h2 id="options-15">Options</h2><pre><code> --check Check for new version+ --deps Show the Go dependencies-h, --help help for version</code></pre><p>See the <a href="https://rclone.org/flags/">global flags page</a> for global options not listed here.</p><h2 id="see-also-15">See Also</h2>@@ -1478,7 +1567,7 @@ beta: 1.42.0.5 (released 2018-06-17)</ul><h1 id="rclone-cleanup">rclone cleanup</h1><p>Clean up the remote if possible.</p>-<h2 id="synopsis-15">Synopsis</h2>+<h2 id="synopsis-16">Synopsis</h2><p>Clean up the remote if possible. Empty the trash or delete old file versions. Not supported by all remotes.</p><pre><code>rclone cleanup remote:path [flags]</code></pre><h2 id="options-16">Options</h2>@@ -1495,7 +1584,7 @@ beta: 1.42.0.5 (released 2018-06-17)</ul><h1 id="rclone-dedupe">rclone dedupe</h1><p>Interactively find duplicate filenames and delete/rename them.</p>-<h2 id="synopsis-16">Synopsis</h2>+<h2 id="synopsis-17">Synopsis</h2><p>By default <code>dedupe</code> interactively finds files with duplicate names and offers to delete all but one or rename them to be different. This is known as deduping by name.</p><p>Deduping by name is only useful with a small group of backends (e.g. Google Drive, Opendrive) that can have duplicate file names. It can be run on wrapping backends (e.g. crypt) if they wrap a backend which supports duplicate file names.</p><p>However if <code>--by-hash</code> is passed in then dedupe will find files with duplicate hashes instead which will work on any backend which supports at least one hash. This can be used to find files with duplicate content. This is known as deduping by hash.</p>@@ -1579,7 +1668,7 @@ two-3.txt: renamed from: two.txt</code></pre></ul><h1 id="rclone-about">rclone about</h1><p>Get quota information from the remote.</p>-<h2 id="synopsis-17">Synopsis</h2>+<h2 id="synopsis-18">Synopsis</h2><p>Prints quota information about a remote to standard output. The output is typically used, free, quota and trash contents.</p><p>E.g. Typical output from <code>rclone about remote:</code> is:</p><pre><code>Total: 17 GiB@@ -1625,11 +1714,12 @@ Other: 8849156022</code></pre></ul><h1 id="rclone-authorize">rclone authorize</h1><p>Remote authorization.</p>-<h2 id="synopsis-18">Synopsis</h2>+<h2 id="synopsis-19">Synopsis</h2><p>Remote authorization. Used to authorize a remote or headless rclone from a machine with a browser - use as instructed by rclone config.</p>+<p>The command requires 1-3 arguments: - fs name (e.g., "drive", "s3", etc.) - Either a base64 encoded JSON blob obtained from a previous rclone config session - Or a client_id and client_secret pair obtained from the remote service</p><p>Use --auth-no-open-browser to prevent rclone to open auth link in default browser automatically.</p><p>Use --template to generate HTML output via a custom Go template. If a blank string is provided as an argument to this flag, the default template is used.</p>-<pre><code>rclone authorize [flags]</code></pre>+<pre><code>rclone authorize <fs name> [base64_json_blob | client_id client_secret] [flags]</code></pre><h2 id="options-19">Options</h2><pre><code> --auth-no-open-browser Do not automatically open auth link in default browser-h, --help help for authorize@@ -1641,7 +1731,7 @@ Other: 8849156022</code></pre></ul><h1 id="rclone-backend">rclone backend</h1><p>Run a backend-specific command.</p>-<h2 id="synopsis-19">Synopsis</h2>+<h2 id="synopsis-20">Synopsis</h2><p>This runs a backend-specific command. The commands themselves (except for "help" and "features") are defined by the backends and you should see the backend docs for definitions.</p><p>You can discover what commands a backend implements by using</p><pre><code>rclone backend help remote:@@ -1670,7 +1760,7 @@ rclone backend help <backendname></code></pre></ul><h1 id="rclone-bisync">rclone bisync</h1><p>Perform bidirectional synchronization between two paths.</p>-<h2 id="synopsis-20">Synopsis</h2>+<h2 id="synopsis-21">Synopsis</h2><p>Perform bidirectional synchronization between two paths.</p><p><a href="https://rclone.org/bisync/">Bisync</a> provides a bidirectional cloud sync solution in rclone. It retains the Path1 and Path2 filesystem listings from the prior run. On each successive run it will: - list files on Path1 and Path2, and check for changes on each side. Changes include <code>New</code>, <code>Newer</code>, <code>Older</code>, and <code>Deleted</code> files. - Propagate changes on Path1 to Path2, and vice-versa.</p><p>Bisync is <strong>in beta</strong> and is considered an <strong>advanced command</strong>, so use with care. Make sure you have read and understood the entire <a href="https://rclone.org/bisync">manual</a> (especially the <a href="https://rclone.org/bisync/#limitations">Limitations</a> section) before using, or data loss can result. Questions can be asked in the <a href="https://forum.rclone.org/">Rclone Forum</a>.</p>@@ -1727,6 +1817,7 @@ rclone backend help <backendname></code></pre>--multi-thread-cutoff SizeSuffix Use multi-thread downloads for files above this size (default 256Mi)--multi-thread-streams int Number of streams to use for multi-thread downloads (default 4)--multi-thread-write-buffer-size SizeSuffix In memory buffer size for writing when in multi-thread mode (default 128Ki)+ --name-transform stringArray Transform paths during the copy process--no-check-dest Don't check the destination, copy regardless--no-traverse Don't traverse destination file system on copy--no-update-dir-modtime Don't update directory modification times@@ -1753,6 +1844,7 @@ rclone backend help <backendname></code></pre>--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -1773,7 +1865,7 @@ rclone backend help <backendname></code></pre></ul><h1 id="rclone-cat">rclone cat</h1><p>Concatenates any files and sends them to stdout.</p>-<h2 id="synopsis-21">Synopsis</h2>+<h2 id="synopsis-22">Synopsis</h2><p>Sends any files to standard output.</p><p>You can use it like this to output a single file</p><pre><code>rclone cat remote:path/to/file</code></pre>@@ -1809,6 +1901,7 @@ rclone backend help <backendname></code></pre>--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -1833,7 +1926,7 @@ rclone backend help <backendname></code></pre></ul><h1 id="rclone-checksum">rclone checksum</h1><p>Checks the files in the destination against a SUM file.</p>-<h2 id="synopsis-22">Synopsis</h2>+<h2 id="synopsis-23">Synopsis</h2><p>Checks that hashsums of destination files match the SUM file. It compares hashes (MD5, SHA1, etc) and logs a report of files which don't match. It doesn't alter the file system.</p><p>The sumfile is treated as the source and the dst:path is treated as the destination for the purposes of the output.</p><p>If you supply the <code>--download</code> flag, it will download the data from the remote and calculate the content hash on the fly. This can be useful for remotes that don't support hashes or if you really want to check all the data.</p>@@ -1871,6 +1964,7 @@ rclone backend help <backendname></code></pre>--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -1895,7 +1989,7 @@ rclone backend help <backendname></code></pre></ul><h1 id="rclone-completion">rclone completion</h1><p>Output completion script for a given shell.</p>-<h2 id="synopsis-23">Synopsis</h2>+<h2 id="synopsis-24">Synopsis</h2><p>Generates a shell completion script for rclone. Run with <code>--help</code> to list the supported shells.</p><h2 id="options-24">Options</h2><pre><code> -h, --help help for completion</code></pre>@@ -1910,7 +2004,7 @@ rclone backend help <backendname></code></pre></ul><h1 id="rclone-completion-bash">rclone completion bash</h1><p>Output bash completion script for rclone.</p>-<h2 id="synopsis-24">Synopsis</h2>+<h2 id="synopsis-25">Synopsis</h2><p>Generates a bash shell autocompletion script for rclone.</p><p>By default, when run without any arguments,</p><pre><code>rclone completion bash</code></pre>@@ -1933,7 +2027,7 @@ rclone backend help <backendname></code></pre></ul><h1 id="rclone-completion-fish">rclone completion fish</h1><p>Output fish completion script for rclone.</p>-<h2 id="synopsis-25">Synopsis</h2>+<h2 id="synopsis-26">Synopsis</h2><p>Generates a fish autocompletion script for rclone.</p><p>This writes to /etc/fish/completions/rclone.fish by default so will probably need to be run with sudo or as root, e.g.</p><pre><code>sudo rclone completion fish</code></pre>@@ -1951,7 +2045,7 @@ rclone backend help <backendname></code></pre></ul><h1 id="rclone-completion-powershell">rclone completion powershell</h1><p>Output powershell completion script for rclone.</p>-<h2 id="synopsis-26">Synopsis</h2>+<h2 id="synopsis-27">Synopsis</h2><p>Generate the autocompletion script for powershell.</p><p>To load completions in your current shell session:</p><pre><code>rclone completion powershell | Out-String | Invoke-Expression</code></pre>@@ -1967,7 +2061,7 @@ rclone backend help <backendname></code></pre></ul><h1 id="rclone-completion-zsh">rclone completion zsh</h1><p>Output zsh completion script for rclone.</p>-<h2 id="synopsis-27">Synopsis</h2>+<h2 id="synopsis-28">Synopsis</h2><p>Generates a zsh autocompletion script for rclone.</p><p>This writes to /usr/share/zsh/vendor-completions/_rclone by default so will probably need to be run with sudo or as root, e.g.</p><pre><code>sudo rclone completion zsh</code></pre>@@ -1985,7 +2079,7 @@ rclone backend help <backendname></code></pre></ul><h1 id="rclone-config-create">rclone config create</h1><p>Create a new remote with name, type and options.</p>-<h2 id="synopsis-28">Synopsis</h2>+<h2 id="synopsis-29">Synopsis</h2><p>Create a new remote of <code>name</code> with <code>type</code> and options. The options should be passed in pairs of <code>key</code> <code>value</code> or as <code>key=value</code>.</p><p>For example, to make a swift remote of name myremote using auto config you would do:</p><pre><code>rclone config create myremote swift env_auth true@@ -2045,6 +2139,7 @@ rclone config create myremote swift env_auth=true</code></pre>--continue Continue the configuration process with an answer-h, --help help for create--no-obscure Force any passwords not to be obscured+ --no-output Don't provide any output--non-interactive Don't interact with user and return questions--obscure Force any passwords to be obscured--result string Result - use with --continue@@ -2066,7 +2161,7 @@ rclone config create myremote swift env_auth=true</code></pre></ul><h1 id="rclone-config-disconnect">rclone config disconnect</h1><p>Disconnects user from remote</p>-<h2 id="synopsis-29">Synopsis</h2>+<h2 id="synopsis-30">Synopsis</h2><p>This disconnects the remote: passed in to the cloud storage system.</p><p>This normally means revoking the oauth token.</p><p>To reconnect use "rclone config reconnect".</p>@@ -2090,7 +2185,7 @@ rclone config create myremote swift env_auth=true</code></pre></ul><h1 id="rclone-config-edit">rclone config edit</h1><p>Enter an interactive configuration session.</p>-<h2 id="synopsis-30">Synopsis</h2>+<h2 id="synopsis-31">Synopsis</h2><p>Enter an interactive configuration session where you can setup new remotes and manage existing ones. You may also set or remove a password to protect your configuration.</p><pre><code>rclone config edit [flags]</code></pre><h2 id="options-33">Options</h2>@@ -2102,7 +2197,7 @@ rclone config create myremote swift env_auth=true</code></pre></ul><h1 id="rclone-config-encryption">rclone config encryption</h1><p>set, remove and check the encryption for the config file</p>-<h2 id="synopsis-31">Synopsis</h2>+<h2 id="synopsis-32">Synopsis</h2><p>This command sets, clears and checks the encryption for the config file using the subcommands below.</p><h2 id="options-34">Options</h2><pre><code> -h, --help help for encryption</code></pre>@@ -2116,7 +2211,7 @@ rclone config create myremote swift env_auth=true</code></pre></ul><h1 id="rclone-config-encryption-check">rclone config encryption check</h1><p>Check that the config file is encrypted</p>-<h2 id="synopsis-32">Synopsis</h2>+<h2 id="synopsis-33">Synopsis</h2><p>This checks the config file is encrypted and that you can decrypt it.</p><p>It will attempt to decrypt the config using the password you supply.</p><p>If decryption fails it will return a non-zero exit code if using <code>--password-command</code>, otherwise it will prompt again for the password.</p>@@ -2131,7 +2226,7 @@ rclone config create myremote swift env_auth=true</code></pre></ul><h1 id="rclone-config-encryption-remove">rclone config encryption remove</h1><p>Remove the config file encryption password</p>-<h2 id="synopsis-33">Synopsis</h2>+<h2 id="synopsis-34">Synopsis</h2><p>Remove the config file encryption password</p><p>This removes the config file encryption, returning it to un-encrypted.</p><p>If <code>--password-command</code> is in use, this will be called to supply the old config password.</p>@@ -2146,12 +2241,12 @@ rclone config create myremote swift env_auth=true</code></pre></ul><h1 id="rclone-config-encryption-set">rclone config encryption set</h1><p>Set or change the config file encryption password</p>-<h2 id="synopsis-34">Synopsis</h2>+<h2 id="synopsis-35">Synopsis</h2><p>This command sets or changes the config file encryption password.</p><p>If there was no config password set then it sets a new one, otherwise it changes the existing config password.</p><p>Note that if you are changing an encryption password using <code>--password-command</code> then this will be called once to decrypt the config using the old password and then again to read the new password to re-encrypt the config.</p>-<p>When <code>--password-command</code> is called to change the password then the environment variable <code>RCLONE_PASSWORD_CHANGE=1</code> will be set. So if changing passwords programatically you can use the environment variable to distinguish which password you must supply.</p>-<p>Alternatively you can remove the password first (with <code>rclone config encryption remove</code>), then set it again with this command which may be easier if you don't mind the unecrypted config file being on the disk briefly.</p>+<p>When <code>--password-command</code> is called to change the password then the environment variable <code>RCLONE_PASSWORD_CHANGE=1</code> will be set. So if changing passwords programmatically you can use the environment variable to distinguish which password you must supply.</p>+<p>Alternatively you can remove the password first (with <code>rclone config encryption remove</code>), then set it again with this command which may be easier if you don't mind the unencrypted config file being on the disk briefly.</p><pre><code>rclone config encryption set [flags]</code></pre><h2 id="options-37">Options</h2><pre><code> -h, --help help for set</code></pre>@@ -2172,7 +2267,7 @@ rclone config create myremote swift env_auth=true</code></pre></ul><h1 id="rclone-config-password">rclone config password</h1><p>Update password in an existing remote.</p>-<h2 id="synopsis-35">Synopsis</h2>+<h2 id="synopsis-36">Synopsis</h2><p>Update an existing remote's password. The password should be passed in pairs of <code>key</code> <code>password</code> or as <code>key=password</code>. The <code>password</code> should be passed in in clear (unobscured).</p><p>For example, to set password of a remote of name myremote you would do:</p><pre><code>rclone config password myremote fieldname mypassword@@ -2208,7 +2303,7 @@ rclone config password myremote fieldname=mypassword</code></pre></ul><h1 id="rclone-config-reconnect">rclone config reconnect</h1><p>Re-authenticates user with remote.</p>-<h2 id="synopsis-36">Synopsis</h2>+<h2 id="synopsis-37">Synopsis</h2><p>This reconnects remote: passed in to the cloud storage system.</p><p>To disconnect the remote use "rclone config disconnect".</p><p>This normally means going through the interactive oauth flow again.</p>@@ -2222,7 +2317,7 @@ rclone config password myremote fieldname=mypassword</code></pre></ul><h1 id="rclone-config-redacted">rclone config redacted</h1><p>Print redacted (decrypted) config file, or the redacted config for a single remote.</p>-<h2 id="synopsis-37">Synopsis</h2>+<h2 id="synopsis-38">Synopsis</h2><p>This prints a redacted copy of the config file, either the whole config file or for a given remote.</p><p>The config file will be redacted by replacing all passwords and other sensitive info with XXX.</p><p>This makes the config file suitable for posting online for support.</p>@@ -2257,7 +2352,7 @@ rclone config password myremote fieldname=mypassword</code></pre></ul><h1 id="rclone-config-update">rclone config update</h1><p>Update options in an existing remote.</p>-<h2 id="synopsis-38">Synopsis</h2>+<h2 id="synopsis-39">Synopsis</h2><p>Update an existing remote's options. The options should be passed in pairs of <code>key</code> <code>value</code> or as <code>key=value</code>.</p><p>For example, to update the env_auth field of a remote of name myremote you would do:</p><pre><code>rclone config update myremote env_auth true@@ -2317,6 +2412,7 @@ rclone config update myremote env_auth=true</code></pre>--continue Continue the configuration process with an answer-h, --help help for update--no-obscure Force any passwords not to be obscured+ --no-output Don't provide any output--non-interactive Don't interact with user and return questions--obscure Force any passwords to be obscured--result string Result - use with --continue@@ -2328,7 +2424,7 @@ rclone config update myremote env_auth=true</code></pre></ul><h1 id="rclone-config-userinfo">rclone config userinfo</h1><p>Prints info about logged in user of remote.</p>-<h2 id="synopsis-39">Synopsis</h2>+<h2 id="synopsis-40">Synopsis</h2><p>This prints the details of the person logged in to the cloud storage system.</p><pre><code>rclone config userinfo remote: [flags]</code></pre><h2 id="options-47">Options</h2>@@ -2339,9 +2435,403 @@ rclone config update myremote env_auth=true</code></pre><ul><li><a href="https://rclone.org/commands/rclone_config/">rclone config</a> - Enter an interactive configuration session.</li></ul>+<h1 id="rclone-convmv">rclone convmv</h1>+<p>Convert file and directory names in place.</p>+<h2 id="synopsis-41">Synopsis</h2>+<p>convmv supports advanced path name transformations for converting and renaming files and directories by applying prefixes, suffixes, and other alterations.</p>+<table>+<colgroup>+<col style="width: 50%" />+<col style="width: 50%" />+</colgroup>+<thead>+<tr class="header">+<th>Command</th>+<th>Description</th>+</tr>+</thead>+<tbody>+<tr class="odd">+<td><code>--name-transform prefix=XXXX</code></td>+<td>Prepends XXXX to the file name.</td>+</tr>+<tr class="even">+<td><code>--name-transform suffix=XXXX</code></td>+<td>Appends XXXX to the file name after the extension.</td>+</tr>+<tr class="odd">+<td><code>--name-transform suffix_keep_extension=XXXX</code></td>+<td>Appends XXXX to the file name while preserving the original file extension.</td>+</tr>+<tr class="even">+<td><code>--name-transform trimprefix=XXXX</code></td>+<td>Removes XXXX if it appears at the start of the file name.</td>+</tr>+<tr class="odd">+<td><code>--name-transform trimsuffix=XXXX</code></td>+<td>Removes XXXX if it appears at the end of the file name.</td>+</tr>+<tr class="even">+<td><code>--name-transform regex=/pattern/replacement/</code></td>+<td>Applies a regex-based transformation.</td>+</tr>+<tr class="odd">+<td><code>--name-transform replace=old:new</code></td>+<td>Replaces occurrences of old with new in the file name.</td>+</tr>+<tr class="even">+<td><code>--name-transform date={YYYYMMDD}</code></td>+<td>Appends or prefixes the specified date format.</td>+</tr>+<tr class="odd">+<td><code>--name-transform truncate=N</code></td>+<td>Truncates the file name to a maximum of N characters.</td>+</tr>+<tr class="even">+<td><code>--name-transform base64encode</code></td>+<td>Encodes the file name in Base64.</td>+</tr>+<tr class="odd">+<td><code>--name-transform base64decode</code></td>+<td>Decodes a Base64-encoded file name.</td>+</tr>+<tr class="even">+<td><code>--name-transform encoder=ENCODING</code></td>+<td>Converts the file name to the specified encoding (e.g., ISO-8859-1, Windows-1252, Macintosh).</td>+</tr>+<tr class="odd">+<td><code>--name-transform decoder=ENCODING</code></td>+<td>Decodes the file name from the specified encoding.</td>+</tr>+<tr class="even">+<td><code>--name-transform charmap=MAP</code></td>+<td>Applies a character mapping transformation.</td>+</tr>+<tr class="odd">+<td><code>--name-transform lowercase</code></td>+<td>Converts the file name to lowercase.</td>+</tr>+<tr class="even">+<td><code>--name-transform uppercase</code></td>+<td>Converts the file name to UPPERCASE.</td>+</tr>+<tr class="odd">+<td><code>--name-transform titlecase</code></td>+<td>Converts the file name to Title Case.</td>+</tr>+<tr class="even">+<td><code>--name-transform ascii</code></td>+<td>Strips non-ASCII characters.</td>+</tr>+<tr class="odd">+<td><code>--name-transform url</code></td>+<td>URL-encodes the file name.</td>+</tr>+<tr class="even">+<td><code>--name-transform nfc</code></td>+<td>Converts the file name to NFC Unicode normalization form.</td>+</tr>+<tr class="odd">+<td><code>--name-transform nfd</code></td>+<td>Converts the file name to NFD Unicode normalization form.</td>+</tr>+<tr class="even">+<td><code>--name-transform nfkc</code></td>+<td>Converts the file name to NFKC Unicode normalization form.</td>+</tr>+<tr class="odd">+<td><code>--name-transform nfkd</code></td>+<td>Converts the file name to NFKD Unicode normalization form.</td>+</tr>+<tr class="even">+<td><code>--name-transform command=/path/to/my/programfile names.</code></td>+<td>Executes an external program to transform</td>+</tr>+</tbody>+</table>+<p>Conversion modes:</p>+<pre><code>none+nfc+nfd+nfkc+nfkd+replace+prefix+suffix+suffix_keep_extension+trimprefix+trimsuffix+index+date+truncate+base64encode+base64decode+encoder+decoder+ISO-8859-1+Windows-1252+Macintosh+charmap+lowercase+uppercase+titlecase+ascii+url+regex+command </code></pre>+<p>Char maps:</p>+<pre><code>+IBM-Code-Page-037+IBM-Code-Page-437+IBM-Code-Page-850+IBM-Code-Page-852+IBM-Code-Page-855+Windows-Code-Page-858+IBM-Code-Page-860+IBM-Code-Page-862+IBM-Code-Page-863+IBM-Code-Page-865+IBM-Code-Page-866+IBM-Code-Page-1047+IBM-Code-Page-1140+ISO-8859-1+ISO-8859-2+ISO-8859-3+ISO-8859-4+ISO-8859-5+ISO-8859-6+ISO-8859-7+ISO-8859-8+ISO-8859-9+ISO-8859-10+ISO-8859-13+ISO-8859-14+ISO-8859-15+ISO-8859-16+KOI8-R+KOI8-U+Macintosh+Macintosh-Cyrillic+Windows-874+Windows-1250+Windows-1251+Windows-1252+Windows-1253+Windows-1254+Windows-1255+Windows-1256+Windows-1257+Windows-1258+X-User-Defined </code></pre>+<p>Encoding masks:</p>+<pre><code>Asterisk+ BackQuote+ BackSlash+ Colon+ CrLf+ Ctl+ Del+ Dollar+ Dot+ DoubleQuote+ Exclamation+ Hash+ InvalidUtf8+ LeftCrLfHtVt+ LeftPeriod+ LeftSpace+ LeftTilde+ LtGt+ None+ Percent+ Pipe+ Question+ Raw+ RightCrLfHtVt+ RightPeriod+ RightSpace+ Semicolon+ SingleQuote+ Slash+ SquareBracket </code></pre>+<p>Examples:</p>+<pre><code>rclone convmv "stories/The Quick Brown Fox!.txt" --name-transform "all,uppercase"+// Output: STORIES/THE QUICK BROWN FOX!.TXT</code></pre>+<pre><code>rclone convmv "stories/The Quick Brown Fox!.txt" --name-transform "all,replace=Fox:Turtle" --name-transform "all,replace=Quick:Slow"+// Output: stories/The Slow Brown Turtle!.txt</code></pre>+<pre><code>rclone convmv "stories/The Quick Brown Fox!.txt" --name-transform "all,base64encode"+// Output: c3Rvcmllcw==/VGhlIFF1aWNrIEJyb3duIEZveCEudHh0</code></pre>+<pre><code>rclone convmv "c3Rvcmllcw==/VGhlIFF1aWNrIEJyb3duIEZveCEudHh0" --name-transform "all,base64decode"+// Output: stories/The Quick Brown Fox!.txt</code></pre>+<pre><code>rclone convmv "stories/The Quick Brown 🦊 Fox Went to the Café!.txt" --name-transform "all,nfc"+// Output: stories/The Quick Brown 🦊 Fox Went to the Café!.txt</code></pre>+<pre><code>rclone convmv "stories/The Quick Brown 🦊 Fox Went to the Café!.txt" --name-transform "all,nfd"+// Output: stories/The Quick Brown 🦊 Fox Went to the Café!.txt</code></pre>+<pre><code>rclone convmv "stories/The Quick Brown 🦊 Fox!.txt" --name-transform "all,ascii"+// Output: stories/The Quick Brown Fox!.txt</code></pre>+<pre><code>rclone convmv "stories/The Quick Brown Fox!.txt" --name-transform "all,trimsuffix=.txt"+// Output: stories/The Quick Brown Fox!</code></pre>+<pre><code>rclone convmv "stories/The Quick Brown Fox!.txt" --name-transform "all,prefix=OLD_"+// Output: OLD_stories/OLD_The Quick Brown Fox!.txt</code></pre>+<pre><code>rclone convmv "stories/The Quick Brown 🦊 Fox Went to the Café!.txt" --name-transform "all,charmap=ISO-8859-7"+// Output: stories/The Quick Brown _ Fox Went to the Caf_!.txt</code></pre>+<pre><code>rclone convmv "stories/The Quick Brown Fox: A Memoir [draft].txt" --name-transform "all,encoder=Colon,SquareBracket"+// Output: stories/The Quick Brown Fox: A Memoir [draft].txt</code></pre>+<pre><code>rclone convmv "stories/The Quick Brown 🦊 Fox Went to the Café!.txt" --name-transform "all,truncate=21"+// Output: stories/The Quick Brown 🦊 Fox</code></pre>+<pre><code>rclone convmv "stories/The Quick Brown Fox!.txt" --name-transform "all,command=echo"+// Output: stories/The Quick Brown Fox!.txt</code></pre>+<pre><code>rclone convmv "stories/The Quick Brown Fox!" --name-transform "date=-{YYYYMMDD}"+// Output: stories/The Quick Brown Fox!-20250617</code></pre>+<pre><code>rclone convmv "stories/The Quick Brown Fox!" --name-transform "date=-{macfriendlytime}"+// Output: stories/The Quick Brown Fox!-2025-06-17 0551PM</code></pre>+<pre><code>rclone convmv "stories/The Quick Brown Fox!.txt" --name-transform "all,regex=[\\.\\w]/ab"+// Output: ababababababab/ababab ababababab ababababab ababab!abababab</code></pre>+<p>Multiple transformations can be used in sequence, applied in the order they are specified on the command line.</p>+<p>The <code>--name-transform</code> flag is also available in <code>sync</code>, <code>copy</code>, and <code>move</code>.</p>+<h1 id="files-vs-directories">Files vs Directories</h1>+<p>By default <code>--name-transform</code> will only apply to file names. The means only the leaf file name will be transformed. However some of the transforms would be better applied to the whole path or just directories. To choose which which part of the file path is affected some tags can be added to the <code>--name-transform</code></p>+<table>+<colgroup>+<col style="width: 50%" />+<col style="width: 50%" />+</colgroup>+<thead>+<tr class="header">+<th>Tag</th>+<th>Effect</th>+</tr>+</thead>+<tbody>+<tr class="odd">+<td><code>file</code></td>+<td>Only transform the leaf name of files (DEFAULT)</td>+</tr>+<tr class="even">+<td><code>dir</code></td>+<td>Only transform name of directories - these may appear anywhere in the path</td>+</tr>+<tr class="odd">+<td><code>all</code></td>+<td>Transform the entire path for files and directories</td>+</tr>+</tbody>+</table>+<p>This is used by adding the tag into the transform name like this: <code>--name-transform file,prefix=ABC</code> or <code>--name-transform dir,prefix=DEF</code>.</p>+<p>For some conversions using all is more likely to be useful, for example <code>--name-transform all,nfc</code></p>+<p>Note that <code>--name-transform</code> may not add path separators <code>/</code> to the name. This will cause an error.</p>+<h1 id="ordering-and-conflicts">Ordering and Conflicts</h1>+<ul>+<li>Transformations will be applied in the order specified by the user.+<ul>+<li>If the <code>file</code> tag is in use (the default) then only the leaf name of files will be transformed.</li>+<li>If the <code>dir</code> tag is in use then directories anywhere in the path will be transformed</li>+<li>If the <code>all</code> tag is in use then directories and files anywhere in the path will be transformed</li>+<li>Each transformation will be run one path segment at a time.</li>+<li>If a transformation adds a <code>/</code> or ends up with an empty path segment then that will be an error.</li>+</ul></li>+<li>It is up to the user to put the transformations in a sensible order.+<ul>+<li>Conflicting transformations, such as <code>prefix</code> followed by <code>trimprefix</code> or <code>nfc</code> followed by <code>nfd</code>, are possible.</li>+<li>Instead of enforcing mutual exclusivity, transformations are applied in sequence as specified by the user, allowing for intentional use cases (e.g., trimming one prefix before adding another).</li>+<li>Users should be aware that certain combinations may lead to unexpected results and should verify transformations using <code>--dry-run</code> before execution.</li>+</ul></li>+</ul>+<h1 id="race-conditions-and-non-deterministic-behavior">Race Conditions and Non-Deterministic Behavior</h1>+<p>Some transformations, such as <code>replace=old:new</code>, may introduce conflicts where multiple source files map to the same destination name. This can lead to race conditions when performing concurrent transfers. It is up to the user to anticipate these. * If two files from the source are transformed into the same name at the destination, the final state may be non-deterministic. * Running rclone check after a sync using such transformations may erroneously report missing or differing files due to overwritten results.</p>+<ul>+<li>To minimize risks, users should:+<ul>+<li>Carefully review transformations that may introduce conflicts.</li>+<li>Use <code>--dry-run</code> to inspect changes before executing a sync (but keep in mind that it won't show the effect of non-deterministic transformations).</li>+<li>Avoid transformations that cause multiple distinct source files to map to the same destination name.</li>+<li>Consider disabling concurrency with <code>--transfers=1</code> if necessary.</li>+<li>Certain transformations (e.g. <code>prefix</code>) will have a multiplying effect every time they are used. Avoid these when using <code>bisync</code>.</li>+</ul></li>+</ul>+<pre><code>rclone convmv dest:path --name-transform XXX [flags]</code></pre>+<h2 id="options-48">Options</h2>+<pre><code> --create-empty-src-dirs Create empty source dirs on destination after move+ --delete-empty-src-dirs Delete empty source dirs after move+ -h, --help help for convmv</code></pre>+<p>Options shared with other commands are described next. See the <a href="https://rclone.org/flags/">global flags page</a> for global options not listed here.</p>+<h3 id="copy-options-4">Copy Options</h3>+<p>Flags for anything which can copy a file</p>+<pre><code> --check-first Do all the checks before starting transfers+ -c, --checksum Check for changes with size & checksum (if available, or fallback to size only)+ --compare-dest stringArray Include additional server-side paths during comparison+ --copy-dest stringArray Implies --compare-dest but also copies files from paths into destination+ --cutoff-mode HARD|SOFT|CAUTIOUS Mode to stop transfers when reaching the max transfer limit HARD|SOFT|CAUTIOUS (default HARD)+ --ignore-case-sync Ignore case when synchronizing+ --ignore-checksum Skip post copy check of checksums+ --ignore-existing Skip all files that exist on destination+ --ignore-size Ignore size when skipping use modtime or checksum+ -I, --ignore-times Don't skip items that match size and time - transfer all unconditionally+ --immutable Do not modify files, fail if existing files have been modified+ --inplace Download directly to destination file instead of atomic download to temp/rename+ -l, --links Translate symlinks to/from regular files with a '.rclonelink' extension+ --max-backlog int Maximum number of objects in sync or check backlog (default 10000)+ --max-duration Duration Maximum duration rclone will transfer data for (default 0s)+ --max-transfer SizeSuffix Maximum size of data to transfer (default off)+ -M, --metadata If set, preserve metadata when copying objects+ --modify-window Duration Max time diff to be considered the same (default 1ns)+ --multi-thread-chunk-size SizeSuffix Chunk size for multi-thread downloads / uploads, if not set by filesystem (default 64Mi)+ --multi-thread-cutoff SizeSuffix Use multi-thread downloads for files above this size (default 256Mi)+ --multi-thread-streams int Number of streams to use for multi-thread downloads (default 4)+ --multi-thread-write-buffer-size SizeSuffix In memory buffer size for writing when in multi-thread mode (default 128Ki)+ --name-transform stringArray Transform paths during the copy process+ --no-check-dest Don't check the destination, copy regardless+ --no-traverse Don't traverse destination file system on copy+ --no-update-dir-modtime Don't update directory modification times+ --no-update-modtime Don't update destination modtime if files identical+ --order-by string Instructions on how to order the transfers, e.g. 'size,descending'+ --partial-suffix string Add partial-suffix to temporary file name when --inplace is not used (default ".partial")+ --refresh-times Refresh the modtime of remote files+ --server-side-across-configs Allow server-side operations (e.g. copy) to work across different configs+ --size-only Skip based on size only, not modtime or checksum+ --streaming-upload-cutoff SizeSuffix Cutoff for switching to chunked upload if file size is unknown, upload starts after reaching cutoff or when file ends (default 100Ki)+ -u, --update Skip files that are newer on the destination</code></pre>+<h3 id="important-options-11">Important Options</h3>+<p>Important flags useful for most commands</p>+<pre><code> -n, --dry-run Do a trial run with no permanent changes+ -i, --interactive Enable interactive mode+ -v, --verbose count Print lots more stuff (repeat for more)</code></pre>+<h3 id="filter-options-14">Filter Options</h3>+<p>Flags for filtering directory listings</p>+<pre><code> --delete-excluded Delete files on dest excluded from sync+ --exclude stringArray Exclude files matching pattern+ --exclude-from stringArray Read file exclude patterns from file (use - to read from stdin)+ --exclude-if-present stringArray Exclude directories if filename is present+ --files-from stringArray Read list of source-file names from file (use - to read from stdin)+ --files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)+ -f, --filter stringArray Add a file filtering rule+ --filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n+ --ignore-case Ignore case in filters (case insensitive)+ --include stringArray Include files matching pattern+ --include-from stringArray Read file include patterns from file (use - to read from stdin)+ --max-age Duration Only transfer files younger than this in s or suffix ms|s|m|h|d|w|M|y (default off)+ --max-depth int If set limits the recursion depth to this (default -1)+ --max-size SizeSuffix Only transfer files smaller than this in KiB or suffix B|K|M|G|T|P (default off)+ --metadata-exclude stringArray Exclude metadatas matching pattern+ --metadata-exclude-from stringArray Read metadata exclude patterns from file (use - to read from stdin)+ --metadata-filter stringArray Add a metadata filtering rule+ --metadata-filter-from stringArray Read metadata filtering patterns from a file (use - to read from stdin)+ --metadata-include stringArray Include metadatas matching pattern+ --metadata-include-from stringArray Read metadata include patterns from file (use - to read from stdin)+ --min-age Duration Only transfer files older than this in s or suffix ms|s|m|h|d|w|M|y (default off)+ --min-size SizeSuffix Only transfer files bigger than this in KiB or suffix B|K|M|G|T|P (default off)</code></pre>+<h3 id="listing-options-13">Listing Options</h3>+<p>Flags for listing directories</p>+<pre><code> --default-time Time Time to show if modtime is unknown for files and directories (default 2000-01-01T00:00:00Z)+ --fast-list Use recursive list if available; uses more memory but fewer transactions</code></pre>+<h2 id="see-also-48">See Also</h2>+<ul>+<li><a href="https://rclone.org/commands/rclone/">rclone</a> - Show help for rclone commands, flags and backends.</li>+</ul><h1 id="rclone-copyto">rclone copyto</h1><p>Copy files from source to dest, skipping identical files.</p>-<h2 id="synopsis-40">Synopsis</h2>+<h2 id="synopsis-42">Synopsis</h2><p>If source:path is a file or directory then it copies it to a file or directory named dest:path.</p><p>This can be used to upload single files to other than their current name. If the source is a directory then it acts exactly like the <a href="https://rclone.org/commands/rclone_copy/">copy</a> command.</p><p>So</p>@@ -2354,12 +2844,13 @@ if src is directorycopy it to dst, overwriting existing files if they existsee copy command for full details</code></pre><p>This doesn't transfer files that are identical on src and dst, testing by size and modification time or MD5SUM. It doesn't delete files from the destination.</p>+<p><em>If you are looking to copy just a byte range of a file, please see 'rclone cat --offset X --count Y'</em></p><p><strong>Note</strong>: Use the <code>-P</code>/<code>--progress</code> flag to view real-time transfer statistics</p><pre><code>rclone copyto source:path dest:path [flags]</code></pre>-<h2 id="options-48">Options</h2>+<h2 id="options-49">Options</h2><pre><code> -h, --help help for copyto</code></pre><p>Options shared with other commands are described next. See the <a href="https://rclone.org/flags/">global flags page</a> for global options not listed here.</p>-<h3 id="copy-options-4">Copy Options</h3>+<h3 id="copy-options-5">Copy Options</h3><p>Flags for anything which can copy a file</p><pre><code> --check-first Do all the checks before starting transfers-c, --checksum Check for changes with size & checksum (if available, or fallback to size only)@@ -2383,6 +2874,7 @@ if src is directory--multi-thread-cutoff SizeSuffix Use multi-thread downloads for files above this size (default 256Mi)--multi-thread-streams int Number of streams to use for multi-thread downloads (default 4)--multi-thread-write-buffer-size SizeSuffix In memory buffer size for writing when in multi-thread mode (default 128Ki)+ --name-transform stringArray Transform paths during the copy process--no-check-dest Don't check the destination, copy regardless--no-traverse Don't traverse destination file system on copy--no-update-dir-modtime Don't update directory modification times@@ -2394,12 +2886,12 @@ if src is directory--size-only Skip based on size only, not modtime or checksum--streaming-upload-cutoff SizeSuffix Cutoff for switching to chunked upload if file size is unknown, upload starts after reaching cutoff or when file ends (default 100Ki)-u, --update Skip files that are newer on the destination</code></pre>-<h3 id="important-options-11">Important Options</h3>+<h3 id="important-options-12">Important Options</h3><p>Important flags useful for most commands</p><pre><code> -n, --dry-run Do a trial run with no permanent changes-i, --interactive Enable interactive mode-v, --verbose count Print lots more stuff (repeat for more)</code></pre>-<h3 id="filter-options-14">Filter Options</h3>+<h3 id="filter-options-15">Filter Options</h3><p>Flags for filtering directory listings</p><pre><code> --delete-excluded Delete files on dest excluded from sync--exclude stringArray Exclude files matching pattern@@ -2409,6 +2901,7 @@ if src is directory--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -2423,23 +2916,23 @@ if src is directory--metadata-include-from stringArray Read metadata include patterns from file (use - to read from stdin)--min-age Duration Only transfer files older than this in s or suffix ms|s|m|h|d|w|M|y (default off)--min-size SizeSuffix Only transfer files bigger than this in KiB or suffix B|K|M|G|T|P (default off)</code></pre>-<h3 id="listing-options-13">Listing Options</h3>+<h3 id="listing-options-14">Listing Options</h3><p>Flags for listing directories</p><pre><code> --default-time Time Time to show if modtime is unknown for files and directories (default 2000-01-01T00:00:00Z)--fast-list Use recursive list if available; uses more memory but fewer transactions</code></pre>-<h2 id="see-also-48">See Also</h2>+<h2 id="see-also-49">See Also</h2><ul><li><a href="https://rclone.org/commands/rclone/">rclone</a> - Show help for rclone commands, flags and backends.</li></ul><h1 id="rclone-copyurl">rclone copyurl</h1><p>Copy the contents of the URL supplied content to dest:path.</p>-<h2 id="synopsis-41">Synopsis</h2>+<h2 id="synopsis-43">Synopsis</h2><p>Download a URL's content and copy it to the destination without saving it in temporary storage.</p><p>Setting <code>--auto-filename</code> will attempt to automatically determine the filename from the URL (after any redirections) and used in the destination path.</p>-<p>With <code>--auto-filename-header</code> in addition, if a specific filename is set in HTTP headers, it will be used instead of the name from the URL. With <code>--print-filename</code> in addition, the resulting file name will be printed.</p>+<p>With <code>--header-filename</code> in addition, if a specific filename is set in HTTP headers, it will be used instead of the name from the URL. With <code>--print-filename</code> in addition, the resulting file name will be printed.</p><p>Setting <code>--no-clobber</code> will prevent overwriting file on the destination if there is one with the same name.</p><p>Setting <code>--stdout</code> or making the output file name <code>-</code> will cause the output to be written to standard output.</p>-<h2 id="troublshooting">Troublshooting</h2>+<h2 id="troubleshooting">Troubleshooting</h2><p>If you can't get <code>rclone copyurl</code> to work then here are some things you can try:</p><ul><li><code>--disable-http2</code> rclone will use HTTP2 if available - try disabling it</li>@@ -2449,7 +2942,7 @@ if src is directory<li>Make sure the site works with <code>curl</code> directly</li></ul><pre><code>rclone copyurl https://example.com dest:path [flags]</code></pre>-<h2 id="options-49">Options</h2>+<h2 id="options-50">Options</h2><pre><code> -a, --auto-filename Get the file name from the URL and use it for destination file path--header-filename Get the file name from the Content-Disposition header-h, --help help for copyurl@@ -2457,18 +2950,18 @@ if src is directory-p, --print-filename Print the resulting name from --auto-filename--stdout Write the output to stdout rather than a file</code></pre><p>Options shared with other commands are described next. See the <a href="https://rclone.org/flags/">global flags page</a> for global options not listed here.</p>-<h3 id="important-options-12">Important Options</h3>+<h3 id="important-options-13">Important Options</h3><p>Important flags useful for most commands</p><pre><code> -n, --dry-run Do a trial run with no permanent changes-i, --interactive Enable interactive mode-v, --verbose count Print lots more stuff (repeat for more)</code></pre>-<h2 id="see-also-49">See Also</h2>+<h2 id="see-also-50">See Also</h2><ul><li><a href="https://rclone.org/commands/rclone/">rclone</a> - Show help for rclone commands, flags and backends.</li></ul><h1 id="rclone-cryptcheck">rclone cryptcheck</h1><p>Cryptcheck checks the integrity of an encrypted remote.</p>-<h2 id="synopsis-42">Synopsis</h2>+<h2 id="synopsis-44">Synopsis</h2><p>Checks a remote against a <a href="https://rclone.org/crypt/">crypted</a> remote. This is the equivalent of running rclone <a href="https://rclone.org/commands/rclone_check/">check</a>, but able to check the checksums of the encrypted remote.</p><p>For it to work the underlying remote of the cryptedremote must support some kind of checksum.</p><p>It works by reading the nonce from each file on the cryptedremote: and using that to encrypt each file on the remote:. It then checks the checksum of the underlying file on the cryptedremote: against the checksum of the file it has just encrypted.</p>@@ -2489,7 +2982,7 @@ if src is directory</ul><p>The default number of parallel checks is 8. See the <a href="https://rclone.org/docs/#checkers-n">--checkers=N</a> option for more information.</p><pre><code>rclone cryptcheck remote:path cryptedremote:path [flags]</code></pre>-<h2 id="options-50">Options</h2>+<h2 id="options-51">Options</h2><pre><code> --combined string Make a combined report of changes to this file--differ string Report all non-matching files to this file--error string Report all files with errors (hashing or reading) to this file@@ -2502,7 +2995,7 @@ if src is directory<h3 id="check-options-1">Check Options</h3><p>Flags used for check commands</p><pre><code> --max-backlog int Maximum number of objects in sync or check backlog (default 10000)</code></pre>-<h3 id="filter-options-15">Filter Options</h3>+<h3 id="filter-options-16">Filter Options</h3><p>Flags for filtering directory listings</p><pre><code> --delete-excluded Delete files on dest excluded from sync--exclude stringArray Exclude files matching pattern@@ -2512,6 +3005,7 @@ if src is directory--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -2526,17 +3020,17 @@ if src is directory--metadata-include-from stringArray Read metadata include patterns from file (use - to read from stdin)--min-age Duration Only transfer files older than this in s or suffix ms|s|m|h|d|w|M|y (default off)--min-size SizeSuffix Only transfer files bigger than this in KiB or suffix B|K|M|G|T|P (default off)</code></pre>-<h3 id="listing-options-14">Listing Options</h3>+<h3 id="listing-options-15">Listing Options</h3><p>Flags for listing directories</p><pre><code> --default-time Time Time to show if modtime is unknown for files and directories (default 2000-01-01T00:00:00Z)--fast-list Use recursive list if available; uses more memory but fewer transactions</code></pre>-<h2 id="see-also-50">See Also</h2>+<h2 id="see-also-51">See Also</h2><ul><li><a href="https://rclone.org/commands/rclone/">rclone</a> - Show help for rclone commands, flags and backends.</li></ul><h1 id="rclone-cryptdecode">rclone cryptdecode</h1><p>Cryptdecode returns unencrypted file names.</p>-<h2 id="synopsis-43">Synopsis</h2>+<h2 id="synopsis-45">Synopsis</h2><p>Returns unencrypted file names when provided with a list of encrypted file names. List limit is 10 items.</p><p>If you supply the <code>--reverse</code> flag, it will return encrypted file names.</p><p>use it like this</p>@@ -2545,88 +3039,88 @@ if src is directoryrclone cryptdecode --reverse encryptedremote: filename1 filename2</code></pre><p>Another way to accomplish this is by using the <code>rclone backend encode</code> (or <code>decode</code>) command. See the documentation on the <a href="https://rclone.org/crypt/">crypt</a> overlay for more info.</p><pre><code>rclone cryptdecode encryptedremote: encryptedfilename [flags]</code></pre>-<h2 id="options-51">Options</h2>+<h2 id="options-52">Options</h2><pre><code> -h, --help help for cryptdecode--reverse Reverse cryptdecode, encrypts filenames</code></pre><p>See the <a href="https://rclone.org/flags/">global flags page</a> for global options not listed here.</p>-<h2 id="see-also-51">See Also</h2>+<h2 id="see-also-52">See Also</h2><ul><li><a href="https://rclone.org/commands/rclone/">rclone</a> - Show help for rclone commands, flags and backends.</li></ul><h1 id="rclone-deletefile">rclone deletefile</h1><p>Remove a single file from remote.</p>-<h2 id="synopsis-44">Synopsis</h2>+<h2 id="synopsis-46">Synopsis</h2><p>Remove a single file from remote. Unlike <code>delete</code> it cannot be used to remove a directory and it doesn't obey include/exclude filters - if the specified file exists, it will always be removed.</p><pre><code>rclone deletefile remote:path [flags]</code></pre>-<h2 id="options-52">Options</h2>+<h2 id="options-53">Options</h2><pre><code> -h, --help help for deletefile</code></pre><p>Options shared with other commands are described next. See the <a href="https://rclone.org/flags/">global flags page</a> for global options not listed here.</p>-<h3 id="important-options-13">Important Options</h3>+<h3 id="important-options-14">Important Options</h3><p>Important flags useful for most commands</p><pre><code> -n, --dry-run Do a trial run with no permanent changes-i, --interactive Enable interactive mode-v, --verbose count Print lots more stuff (repeat for more)</code></pre>-<h2 id="see-also-52">See Also</h2>+<h2 id="see-also-53">See Also</h2><ul><li><a href="https://rclone.org/commands/rclone/">rclone</a> - Show help for rclone commands, flags and backends.</li></ul><h1 id="rclone-gendocs">rclone gendocs</h1><p>Output markdown docs for rclone to the directory supplied.</p>-<h2 id="synopsis-45">Synopsis</h2>+<h2 id="synopsis-47">Synopsis</h2><p>This produces markdown docs for the rclone commands to the directory supplied. These are in a format suitable for hugo to render into the rclone.org website.</p><pre><code>rclone gendocs output_directory [flags]</code></pre>-<h2 id="options-53">Options</h2>+<h2 id="options-54">Options</h2><pre><code> -h, --help help for gendocs</code></pre><p>See the <a href="https://rclone.org/flags/">global flags page</a> for global options not listed here.</p>-<h2 id="see-also-53">See Also</h2>+<h2 id="see-also-54">See Also</h2><ul><li><a href="https://rclone.org/commands/rclone/">rclone</a> - Show help for rclone commands, flags and backends.</li></ul><h1 id="rclone-gitannex">rclone gitannex</h1><p>Speaks with git-annex over stdin/stdout.</p>-<h2 id="synopsis-46">Synopsis</h2>+<h2 id="synopsis-48">Synopsis</h2><p>Rclone's <code>gitannex</code> subcommand enables <a href="https://git-annex.branchable.com/">git-annex</a> to store and retrieve content from an rclone remote. It is meant to be run by git-annex, not directly by users.</p><h2 id="installation-on-linux">Installation on Linux</h2><ol type="1"><li><p>Skip this step if your version of git-annex is <a href="https://git-annex.branchable.com/news/version_10.20240430/">10.20240430</a> or newer. Otherwise, you must create a symlink somewhere on your PATH with a particular name. This symlink helps git-annex tell rclone it wants to run the "gitannex" subcommand.</p>-<div class="sourceCode" id="cb253"><pre class="sourceCode sh"><code class="sourceCode bash"><span id="cb253-1"><a href="#cb253-1" aria-hidden="true"></a><span class="co"># Create the helper symlink in "$HOME/bin".</span></span>-<span id="cb253-2"><a href="#cb253-2" aria-hidden="true"></a><span class="fu">ln</span> -s <span class="st">"</span><span class="va">$(</span><span class="ex">realpath</span> rclone<span class="va">)</span><span class="st">"</span> <span class="st">"</span><span class="va">$HOME</span><span class="st">/bin/git-annex-remote-rclone-builtin"</span></span>-<span id="cb253-3"><a href="#cb253-3" aria-hidden="true"></a></span>-<span id="cb253-4"><a href="#cb253-4" aria-hidden="true"></a><span class="co"># Verify the new symlink is on your PATH.</span></span>-<span id="cb253-5"><a href="#cb253-5" aria-hidden="true"></a><span class="fu">which</span> git-annex-remote-rclone-builtin</span></code></pre></div></li>+<div class="sourceCode" id="cb279"><pre class="sourceCode sh"><code class="sourceCode bash"><span id="cb279-1"><a href="#cb279-1" aria-hidden="true"></a><span class="co"># Create the helper symlink in "$HOME/bin".</span></span>+<span id="cb279-2"><a href="#cb279-2" aria-hidden="true"></a><span class="fu">ln</span> -s <span class="st">"</span><span class="va">$(</span><span class="ex">realpath</span> rclone<span class="va">)</span><span class="st">"</span> <span class="st">"</span><span class="va">$HOME</span><span class="st">/bin/git-annex-remote-rclone-builtin"</span></span>+<span id="cb279-3"><a href="#cb279-3" aria-hidden="true"></a></span>+<span id="cb279-4"><a href="#cb279-4" aria-hidden="true"></a><span class="co"># Verify the new symlink is on your PATH.</span></span>+<span id="cb279-5"><a href="#cb279-5" aria-hidden="true"></a><span class="fu">which</span> git-annex-remote-rclone-builtin</span></code></pre></div></li><li><p>Add a new remote to your git-annex repo. This new remote will connect git-annex with the <code>rclone gitannex</code> subcommand.</p><p>Start by asking git-annex to describe the remote's available configuration parameters.</p>-<div class="sourceCode" id="cb254"><pre class="sourceCode sh"><code class="sourceCode bash"><span id="cb254-1"><a href="#cb254-1" aria-hidden="true"></a><span class="co"># If you skipped step 1:</span></span>-<span id="cb254-2"><a href="#cb254-2" aria-hidden="true"></a><span class="fu">git</span> annex initremote MyRemote type=rclone --whatelse</span>-<span id="cb254-3"><a href="#cb254-3" aria-hidden="true"></a></span>-<span id="cb254-4"><a href="#cb254-4" aria-hidden="true"></a><span class="co"># If you created a symlink in step 1:</span></span>-<span id="cb254-5"><a href="#cb254-5" aria-hidden="true"></a><span class="fu">git</span> annex initremote MyRemote type=external externaltype=rclone-builtin --whatelse</span></code></pre></div>+<div class="sourceCode" id="cb280"><pre class="sourceCode sh"><code class="sourceCode bash"><span id="cb280-1"><a href="#cb280-1" aria-hidden="true"></a><span class="co"># If you skipped step 1:</span></span>+<span id="cb280-2"><a href="#cb280-2" aria-hidden="true"></a><span class="fu">git</span> annex initremote MyRemote type=rclone --whatelse</span>+<span id="cb280-3"><a href="#cb280-3" aria-hidden="true"></a></span>+<span id="cb280-4"><a href="#cb280-4" aria-hidden="true"></a><span class="co"># If you created a symlink in step 1:</span></span>+<span id="cb280-5"><a href="#cb280-5" aria-hidden="true"></a><span class="fu">git</span> annex initremote MyRemote type=external externaltype=rclone-builtin --whatelse</span></code></pre></div><blockquote><p><strong>NOTE</strong>: If you're porting an existing <a href="https://github.com/git-annex-remote-rclone/git-annex-remote-rclone">git-annex-remote-rclone</a> remote to use <code>rclone gitannex</code>, you can probably reuse the configuration parameters verbatim without renaming them. Check parameter synonyms with <code>--whatelse</code> as shown above.</p></blockquote><p>The following example creates a new git-annex remote named "MyRemote" that will use the rclone remote named "SomeRcloneRemote". That rclone remote must be one configured in your rclone.conf file, which can be located with <code>rclone config file</code>.</p>-<div class="sourceCode" id="cb255"><pre class="sourceCode sh"><code class="sourceCode bash"><span id="cb255-1"><a href="#cb255-1" aria-hidden="true"></a><span class="fu">git</span> annex initremote MyRemote <span class="kw">\</span></span>-<span id="cb255-2"><a href="#cb255-2" aria-hidden="true"></a> <span class="va">type=</span>external <span class="kw">\</span></span>-<span id="cb255-3"><a href="#cb255-3" aria-hidden="true"></a> <span class="va">externaltype=</span>rclone-builtin <span class="kw">\</span></span>-<span id="cb255-4"><a href="#cb255-4" aria-hidden="true"></a> <span class="va">encryption=</span>none <span class="kw">\</span></span>-<span id="cb255-5"><a href="#cb255-5" aria-hidden="true"></a> <span class="va">rcloneremotename=</span>SomeRcloneRemote <span class="kw">\</span></span>-<span id="cb255-6"><a href="#cb255-6" aria-hidden="true"></a> <span class="va">rcloneprefix=</span>git-annex-content <span class="kw">\</span></span>-<span id="cb255-7"><a href="#cb255-7" aria-hidden="true"></a> <span class="va">rclonelayout=</span>nodir</span></code></pre></div></li>+<div class="sourceCode" id="cb281"><pre class="sourceCode sh"><code class="sourceCode bash"><span id="cb281-1"><a href="#cb281-1" aria-hidden="true"></a><span class="fu">git</span> annex initremote MyRemote <span class="kw">\</span></span>+<span id="cb281-2"><a href="#cb281-2" aria-hidden="true"></a> <span class="va">type=</span>external <span class="kw">\</span></span>+<span id="cb281-3"><a href="#cb281-3" aria-hidden="true"></a> <span class="va">externaltype=</span>rclone-builtin <span class="kw">\</span></span>+<span id="cb281-4"><a href="#cb281-4" aria-hidden="true"></a> <span class="va">encryption=</span>none <span class="kw">\</span></span>+<span id="cb281-5"><a href="#cb281-5" aria-hidden="true"></a> <span class="va">rcloneremotename=</span>SomeRcloneRemote <span class="kw">\</span></span>+<span id="cb281-6"><a href="#cb281-6" aria-hidden="true"></a> <span class="va">rcloneprefix=</span>git-annex-content <span class="kw">\</span></span>+<span id="cb281-7"><a href="#cb281-7" aria-hidden="true"></a> <span class="va">rclonelayout=</span>nodir</span></code></pre></div></li><li><p>Before you trust this command with your precious data, be sure to <strong>test the remote</strong>. This command is very new and has not been tested on many rclone backends. Caveat emptor!</p>-<div class="sourceCode" id="cb256"><pre class="sourceCode sh"><code class="sourceCode bash"><span id="cb256-1"><a href="#cb256-1" aria-hidden="true"></a><span class="fu">git</span> annex testremote MyRemote</span></code></pre></div></li>+<div class="sourceCode" id="cb282"><pre class="sourceCode sh"><code class="sourceCode bash"><span id="cb282-1"><a href="#cb282-1" aria-hidden="true"></a><span class="fu">git</span> annex testremote MyRemote</span></code></pre></div></li></ol><p>Happy annexing!</p><pre><code>rclone gitannex [flags]</code></pre>-<h2 id="options-54">Options</h2>+<h2 id="options-55">Options</h2><pre><code> -h, --help help for gitannex</code></pre><p>See the <a href="https://rclone.org/flags/">global flags page</a> for global options not listed here.</p>-<h2 id="see-also-54">See Also</h2>+<h2 id="see-also-55">See Also</h2><ul><li><a href="https://rclone.org/commands/rclone/">rclone</a> - Show help for rclone commands, flags and backends.</li></ul><h1 id="rclone-hashsum">rclone hashsum</h1><p>Produces a hashsum file for all the objects in the path.</p>-<h2 id="synopsis-47">Synopsis</h2>+<h2 id="synopsis-49">Synopsis</h2><p>Produces a hash file for all the objects in the path using the hash named. The output is in the same format as the standard md5sum/sha1sum tool.</p><p>By default, the hash is requested from the remote. If the hash is not supported by the remote, no hash will be returned. With the download flag, the file will be downloaded from the remote and hashed locally enabling any hash for any remote.</p><p>For the MD5 and SHA1 algorithms there are also dedicated commands, <a href="https://rclone.org/commands/rclone_md5sum/">md5sum</a> and <a href="https://rclone.org/commands/rclone_sha1sum/">sha1sum</a>.</p>@@ -2638,19 +3132,20 @@ Supported hashes are:* sha1* whirlpool* crc32- * sha256</code></pre>+ * sha256+ * sha512</code></pre><p>Then</p><pre><code>$ rclone hashsum MD5 remote:path</code></pre><p>Note that hash names are case insensitive and values are output in lower case.</p><pre><code>rclone hashsum [<hash> remote:path] [flags]</code></pre>-<h2 id="options-55">Options</h2>+<h2 id="options-56">Options</h2><pre><code> --base64 Output base64 encoded hashsum-C, --checkfile string Validate hashes against a given SUM file instead of printing them--download Download the file and hash it locally; if this flag is not specified, the hash is requested from the remote-h, --help help for hashsum--output-file string Output hashsums to a file rather than the terminal</code></pre><p>Options shared with other commands are described next. See the <a href="https://rclone.org/flags/">global flags page</a> for global options not listed here.</p>-<h3 id="filter-options-16">Filter Options</h3>+<h3 id="filter-options-17">Filter Options</h3><p>Flags for filtering directory listings</p><pre><code> --delete-excluded Delete files on dest excluded from sync--exclude stringArray Exclude files matching pattern@@ -2660,6 +3155,7 @@ Supported hashes are:--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -2674,17 +3170,17 @@ Supported hashes are:--metadata-include-from stringArray Read metadata include patterns from file (use - to read from stdin)--min-age Duration Only transfer files older than this in s or suffix ms|s|m|h|d|w|M|y (default off)--min-size SizeSuffix Only transfer files bigger than this in KiB or suffix B|K|M|G|T|P (default off)</code></pre>-<h3 id="listing-options-15">Listing Options</h3>+<h3 id="listing-options-16">Listing Options</h3><p>Flags for listing directories</p><pre><code> --default-time Time Time to show if modtime is unknown for files and directories (default 2000-01-01T00:00:00Z)--fast-list Use recursive list if available; uses more memory but fewer transactions</code></pre>-<h2 id="see-also-55">See Also</h2>+<h2 id="see-also-56">See Also</h2><ul><li><a href="https://rclone.org/commands/rclone/">rclone</a> - Show help for rclone commands, flags and backends.</li></ul><h1 id="rclone-link">rclone link</h1><p>Generate public link to file/folder.</p>-<h2 id="synopsis-48">Synopsis</h2>+<h2 id="synopsis-50">Synopsis</h2><p>Create, retrieve or remove a public link to the given file or folder.</p><pre><code>rclone link remote:path/to/filerclone link remote:path/to/folder/@@ -2694,23 +3190,23 @@ rclone link --expire 1d remote:path/to/file</code></pre><p>Use the --unlink flag to remove existing public links to the file or folder. <strong>Note</strong> not all backends support "--unlink" flag - those that don't will just ignore it.</p><p>If successful, the last line of the output will contain the link. Exact capabilities depend on the remote, but the link will always by default be created with the least constraints – e.g. no expiry, no password protection, accessible without account.</p><pre><code>rclone link remote:path [flags]</code></pre>-<h2 id="options-56">Options</h2>+<h2 id="options-57">Options</h2><pre><code> --expire Duration The amount of time that the link will be valid (default off)-h, --help help for link--unlink Remove existing public link to file/folder</code></pre><p>See the <a href="https://rclone.org/flags/">global flags page</a> for global options not listed here.</p>-<h2 id="see-also-56">See Also</h2>+<h2 id="see-also-57">See Also</h2><ul><li><a href="https://rclone.org/commands/rclone/">rclone</a> - Show help for rclone commands, flags and backends.</li></ul><h1 id="rclone-listremotes">rclone listremotes</h1><p>List all the remotes in the config file and defined in environment variables.</p>-<h2 id="synopsis-49">Synopsis</h2>+<h2 id="synopsis-51">Synopsis</h2><p>Lists all the available remotes from the config file, or the remotes matching an optional filter.</p><p>Prints the result in human-readable format by default, and as a simple list of remote names, or if used with flag <code>--long</code> a tabular format including the remote names, types and descriptions. Using flag <code>--json</code> produces machine-readable output instead, which always includes all attributes - including the source (file or environment).</p><p>Result can be filtered by a filter argument which applies to all attributes, and/or filter flags specific for each attribute. The values must be specified according to regular rclone filtering pattern syntax.</p><pre><code>rclone listremotes [<filter>] [flags]</code></pre>-<h2 id="options-57">Options</h2>+<h2 id="options-58">Options</h2><pre><code> --description string Filter remotes by description-h, --help help for listremotes--json Format output as JSON@@ -2720,13 +3216,13 @@ rclone link --expire 1d remote:path/to/file</code></pre>--source string Filter remotes by source, e.g. 'file' or 'environment'--type string Filter remotes by type</code></pre><p>See the <a href="https://rclone.org/flags/">global flags page</a> for global options not listed here.</p>-<h2 id="see-also-57">See Also</h2>+<h2 id="see-also-58">See Also</h2><ul><li><a href="https://rclone.org/commands/rclone/">rclone</a> - Show help for rclone commands, flags and backends.</li></ul><h1 id="rclone-lsf">rclone lsf</h1><p>List directories and objects in remote:path formatted for parsing.</p>-<h2 id="synopsis-50">Synopsis</h2>+<h2 id="synopsis-52">Synopsis</h2><p>List the contents of the source path (directories and objects) to standard output in a form which is easy to parse by scripts. By default this will just be the names of the objects and directories, one per line. The directories will have a / suffix.</p><p>Eg</p><pre><code>$ rclone lsf swift:bucket@@ -2805,7 +3301,7 @@ rclone lsf remote:path --format pt --time-format max</code></pre><p>The other list commands <code>lsd</code>,<code>lsf</code>,<code>lsjson</code> do not recurse by default - use <code>-R</code> to make them recurse.</p><p>Listing a nonexistent directory will produce an error except for remotes which can't have empty directories (e.g. s3, swift, or gcs - the bucket-based remotes).</p><pre><code>rclone lsf remote:path [flags]</code></pre>-<h2 id="options-58">Options</h2>+<h2 id="options-59">Options</h2><pre><code> --absolute Put a leading / in front of path names--csv Output in CSV format-d, --dir-slash Append a slash to directory names (default true)@@ -2818,7 +3314,7 @@ rclone lsf remote:path --format pt --time-format max</code></pre>-s, --separator string Separator for the items in the format (default ";")-t, --time-format string Specify a custom time format, or 'max' for max precision supported by remote (default: 2006-01-02 15:04:05)</code></pre><p>Options shared with other commands are described next. See the <a href="https://rclone.org/flags/">global flags page</a> for global options not listed here.</p>-<h3 id="filter-options-17">Filter Options</h3>+<h3 id="filter-options-18">Filter Options</h3><p>Flags for filtering directory listings</p><pre><code> --delete-excluded Delete files on dest excluded from sync--exclude stringArray Exclude files matching pattern@@ -2828,6 +3324,7 @@ rclone lsf remote:path --format pt --time-format max</code></pre>--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -2842,17 +3339,17 @@ rclone lsf remote:path --format pt --time-format max</code></pre>--metadata-include-from stringArray Read metadata include patterns from file (use - to read from stdin)--min-age Duration Only transfer files older than this in s or suffix ms|s|m|h|d|w|M|y (default off)--min-size SizeSuffix Only transfer files bigger than this in KiB or suffix B|K|M|G|T|P (default off)</code></pre>-<h3 id="listing-options-16">Listing Options</h3>+<h3 id="listing-options-17">Listing Options</h3><p>Flags for listing directories</p><pre><code> --default-time Time Time to show if modtime is unknown for files and directories (default 2000-01-01T00:00:00Z)--fast-list Use recursive list if available; uses more memory but fewer transactions</code></pre>-<h2 id="see-also-58">See Also</h2>+<h2 id="see-also-59">See Also</h2><ul><li><a href="https://rclone.org/commands/rclone/">rclone</a> - Show help for rclone commands, flags and backends.</li></ul><h1 id="rclone-lsjson">rclone lsjson</h1><p>List directories and objects in the path in JSON format.</p>-<h2 id="synopsis-51">Synopsis</h2>+<h2 id="synopsis-53">Synopsis</h2><p>List directories and objects in the path in JSON format.</p><p>The output is an array of Items, where each Item looks like this:</p><pre><code>{@@ -2910,7 +3407,7 @@ rclone lsf remote:path --format pt --time-format max</code></pre><p>The other list commands <code>lsd</code>,<code>lsf</code>,<code>lsjson</code> do not recurse by default - use <code>-R</code> to make them recurse.</p><p>Listing a nonexistent directory will produce an error except for remotes which can't have empty directories (e.g. s3, swift, or gcs - the bucket-based remotes).</p><pre><code>rclone lsjson remote:path [flags]</code></pre>-<h2 id="options-59">Options</h2>+<h2 id="options-60">Options</h2><pre><code> --dirs-only Show only directories in the listing--encrypted Show the encrypted names--files-only Show only files in the listing@@ -2924,7 +3421,7 @@ rclone lsf remote:path --format pt --time-format max</code></pre>-R, --recursive Recurse into the listing--stat Just return the info for the pointed to file</code></pre><p>Options shared with other commands are described next. See the <a href="https://rclone.org/flags/">global flags page</a> for global options not listed here.</p>-<h3 id="filter-options-18">Filter Options</h3>+<h3 id="filter-options-19">Filter Options</h3><p>Flags for filtering directory listings</p><pre><code> --delete-excluded Delete files on dest excluded from sync--exclude stringArray Exclude files matching pattern@@ -2934,6 +3431,7 @@ rclone lsf remote:path --format pt --time-format max</code></pre>--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -2948,17 +3446,17 @@ rclone lsf remote:path --format pt --time-format max</code></pre>--metadata-include-from stringArray Read metadata include patterns from file (use - to read from stdin)--min-age Duration Only transfer files older than this in s or suffix ms|s|m|h|d|w|M|y (default off)--min-size SizeSuffix Only transfer files bigger than this in KiB or suffix B|K|M|G|T|P (default off)</code></pre>-<h3 id="listing-options-17">Listing Options</h3>+<h3 id="listing-options-18">Listing Options</h3><p>Flags for listing directories</p><pre><code> --default-time Time Time to show if modtime is unknown for files and directories (default 2000-01-01T00:00:00Z)--fast-list Use recursive list if available; uses more memory but fewer transactions</code></pre>-<h2 id="see-also-59">See Also</h2>+<h2 id="see-also-60">See Also</h2><ul><li><a href="https://rclone.org/commands/rclone/">rclone</a> - Show help for rclone commands, flags and backends.</li></ul><h1 id="rclone-mount">rclone mount</h1><p>Mount the remote as file system on a mountpoint.</p>-<h2 id="synopsis-52">Synopsis</h2>+<h2 id="synopsis-54">Synopsis</h2><p>Rclone mount allows Linux, FreeBSD, macOS and Windows to mount any of Rclone's cloud storage systems as a file system with FUSE.</p><p>First set up your remote using <code>rclone config</code>. Check it works with <code>rclone ls</code> etc.</p><p>On Linux and macOS, you can run mount in either foreground or background (aka daemon) mode. Mount runs in foreground mode by default. Use the <code>--daemon</code> flag to force background mode. On Windows you can run mount in foreground only, the flag is ignored.</p>@@ -3131,7 +3629,7 @@ WantedBy=multi-user.target</code></pre><p>If run with <code>-vv</code> rclone will print the location of the file cache. The files are stored in the user cache file area which is OS dependent but can be controlled with <code>--cache-dir</code> or setting the appropriate environment variable.</p><p>The cache has 4 different modes selected by <code>--vfs-cache-mode</code>. The higher the cache mode the more compatible rclone becomes at the cost of using disk space.</p><p>Note that files are written back to the remote only when they are closed and if they haven't been accessed for <code>--vfs-write-back</code> seconds. If rclone is quit or dies with files that haven't been uploaded, these will be uploaded next time rclone is run with the same flags.</p>-<p>If using <code>--vfs-cache-max-size</code> or <code>--vfs-cache-min-free-size</code> note that the cache may exceed these quotas for two reasons. Firstly because it is only checked every <code>--vfs-cache-poll-interval</code>. Secondly because open files cannot be evicted from the cache. When <code>--vfs-cache-max-size</code> or <code>--vfs-cache-min-free-size</code> is exceeded, rclone will attempt to evict the least accessed files from the cache first. rclone will start with files that haven't been accessed for the longest. This cache flushing strategy is efficient and more relevant files are likely to remain cached.</p>+<p>If using <code>--vfs-cache-max-size</code> or <code>--vfs-cache-min-free-space</code> note that the cache may exceed these quotas for two reasons. Firstly because it is only checked every <code>--vfs-cache-poll-interval</code>. Secondly because open files cannot be evicted from the cache. When <code>--vfs-cache-max-size</code> or <code>--vfs-cache-min-free-space</code> is exceeded, rclone will attempt to evict the least accessed files from the cache first. rclone will start with files that haven't been accessed for the longest. This cache flushing strategy is efficient and more relevant files are likely to remain cached.</p><p>The <code>--vfs-cache-max-age</code> will evict files from the cache after the set time since last access has passed. The default value of 1 hour will start evicting files from cache that haven't been accessed for 1 hour. When a cached file is accessed the 1 hour timer is reset to 0 and will wait for 1 more hour before evicting. Specify the time with standard notation, s, m, h, d, w .</p><p>You <strong>should not</strong> run two copies of rclone using the same VFS cache with the same or overlapping remotes if using <code>--vfs-cache-mode > off</code>. This can potentially cause data corruption if you do. You can work around this by giving each rclone its own cache hierarchy with <code>--cache-dir</code>. You don't need to worry about this if the remotes in use don't overlap.</p><h3 id="vfs-cache-mode-off">--vfs-cache-mode off</h3>@@ -3242,8 +3740,31 @@ WantedBy=multi-user.target</code></pre><h2 id="alternate-report-of-used-bytes">Alternate report of used bytes</h2><p>Some backends, most notably S3, do not report the amount of bytes used. If you need this information to be available when running <code>df</code> on the filesystem, then pass the flag <code>--vfs-used-is-size</code> to rclone. With this flag set, instead of relying on the backend to report this information, rclone will scan the whole remote similar to <code>rclone size</code> and compute the total used space itself.</p><p><em>WARNING.</em> Contrary to <code>rclone size</code>, this flag ignores filters so that the result is accurate. However, this is very inefficient and may cost lots of API calls resulting in extra charges. Use it as a last resort and only with caching.</p>+<h2 id="vfs-metadata">VFS Metadata</h2>+<p>If you use the <code>--vfs-metadata-extension</code> flag you can get the VFS to expose files which contain the <a href="https://rclone.org/docs/#metadata">metadata</a> as a JSON blob. These files will not appear in the directory listing, but can be <code>stat</code>-ed and opened and once they have been they <strong>will</strong> appear in directory listings until the directory cache expires.</p>+<p>Note that some backends won't create metadata unless you pass in the <code>--metadata</code> flag.</p>+<p>For example, using <code>rclone mount</code> with <code>--metadata --vfs-metadata-extension .metadata</code> we get</p>+<pre><code>$ ls -l /mnt/+total 1048577+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++$ cat /mnt/1G.metadata+{+ "atime": "2025-03-04T17:34:22.317069787Z",+ "btime": "2025-03-03T16:03:37.708253808Z",+ "gid": "1000",+ "mode": "100664",+ "mtime": "2025-03-03T16:03:39.640238323Z",+ "uid": "1000"+}++$ ls -l /mnt/+total 1048578+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+-rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata</code></pre>+<p>If the file has no metadata it will be returned as <code>{}</code> and if there is an error reading the metadata the error will be returned as <code>{"error":"error string"}</code>.</p><pre><code>rclone mount remote:path /path/to/mountpoint [flags]</code></pre>-<h2 id="options-60">Options</h2>+<h2 id="options-61">Options</h2><pre><code> --allow-non-empty Allow mounting over a non-empty directory (not supported on Windows)--allow-other Allow access to other users (not supported on Windows)--allow-root Allow access to root user (not supported on Windows)@@ -3286,6 +3807,7 @@ WantedBy=multi-user.target</code></pre>--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a '.rclonelink' extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached ('off' is unlimited) (default off)@@ -3298,7 +3820,7 @@ WantedBy=multi-user.target</code></pre>--volname string Set the volume name (supported on Windows and OSX only)--write-back-cache Makes kernel buffer writes before sending them to rclone (without this, writethrough caching is used) (not supported on Windows)</code></pre><p>Options shared with other commands are described next. See the <a href="https://rclone.org/flags/">global flags page</a> for global options not listed here.</p>-<h3 id="filter-options-19">Filter Options</h3>+<h3 id="filter-options-20">Filter Options</h3><p>Flags for filtering directory listings</p><pre><code> --delete-excluded Delete files on dest excluded from sync--exclude stringArray Exclude files matching pattern@@ -3308,6 +3830,7 @@ WantedBy=multi-user.target</code></pre>--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -3322,13 +3845,13 @@ WantedBy=multi-user.target</code></pre>--metadata-include-from stringArray Read metadata include patterns from file (use - to read from stdin)--min-age Duration Only transfer files older than this in s or suffix ms|s|m|h|d|w|M|y (default off)--min-size SizeSuffix Only transfer files bigger than this in KiB or suffix B|K|M|G|T|P (default off)</code></pre>-<h2 id="see-also-60">See Also</h2>+<h2 id="see-also-61">See Also</h2><ul><li><a href="https://rclone.org/commands/rclone/">rclone</a> - Show help for rclone commands, flags and backends.</li></ul><h1 id="rclone-moveto">rclone moveto</h1><p>Move file or directory from source to dest.</p>-<h2 id="synopsis-53">Synopsis</h2>+<h2 id="synopsis-55">Synopsis</h2><p>If source:path is a file or directory then it moves it to a file or directory named dest:path.</p><p>This can be used to rename files or upload single files to other than their existing name. If the source is a directory then it acts exactly like the <a href="https://rclone.org/commands/rclone_move/">move</a> command.</p><p>So</p>@@ -3344,10 +3867,10 @@ if src is directory<p><strong>Important</strong>: Since this can cause data loss, test first with the <code>--dry-run</code> or the <code>--interactive</code>/<code>-i</code> flag.</p><p><strong>Note</strong>: Use the <code>-P</code>/<code>--progress</code> flag to view real-time transfer statistics.</p><pre><code>rclone moveto source:path dest:path [flags]</code></pre>-<h2 id="options-61">Options</h2>+<h2 id="options-62">Options</h2><pre><code> -h, --help help for moveto</code></pre><p>Options shared with other commands are described next. See the <a href="https://rclone.org/flags/">global flags page</a> for global options not listed here.</p>-<h3 id="copy-options-5">Copy Options</h3>+<h3 id="copy-options-6">Copy Options</h3><p>Flags for anything which can copy a file</p><pre><code> --check-first Do all the checks before starting transfers-c, --checksum Check for changes with size & checksum (if available, or fallback to size only)@@ -3371,6 +3894,7 @@ if src is directory--multi-thread-cutoff SizeSuffix Use multi-thread downloads for files above this size (default 256Mi)--multi-thread-streams int Number of streams to use for multi-thread downloads (default 4)--multi-thread-write-buffer-size SizeSuffix In memory buffer size for writing when in multi-thread mode (default 128Ki)+ --name-transform stringArray Transform paths during the copy process--no-check-dest Don't check the destination, copy regardless--no-traverse Don't traverse destination file system on copy--no-update-dir-modtime Don't update directory modification times@@ -3382,12 +3906,12 @@ if src is directory--size-only Skip based on size only, not modtime or checksum--streaming-upload-cutoff SizeSuffix Cutoff for switching to chunked upload if file size is unknown, upload starts after reaching cutoff or when file ends (default 100Ki)-u, --update Skip files that are newer on the destination</code></pre>-<h3 id="important-options-14">Important Options</h3>+<h3 id="important-options-15">Important Options</h3><p>Important flags useful for most commands</p><pre><code> -n, --dry-run Do a trial run with no permanent changes-i, --interactive Enable interactive mode-v, --verbose count Print lots more stuff (repeat for more)</code></pre>-<h3 id="filter-options-20">Filter Options</h3>+<h3 id="filter-options-21">Filter Options</h3><p>Flags for filtering directory listings</p><pre><code> --delete-excluded Delete files on dest excluded from sync--exclude stringArray Exclude files matching pattern@@ -3397,6 +3921,7 @@ if src is directory--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -3411,17 +3936,17 @@ if src is directory--metadata-include-from stringArray Read metadata include patterns from file (use - to read from stdin)--min-age Duration Only transfer files older than this in s or suffix ms|s|m|h|d|w|M|y (default off)--min-size SizeSuffix Only transfer files bigger than this in KiB or suffix B|K|M|G|T|P (default off)</code></pre>-<h3 id="listing-options-18">Listing Options</h3>+<h3 id="listing-options-19">Listing Options</h3><p>Flags for listing directories</p><pre><code> --default-time Time Time to show if modtime is unknown for files and directories (default 2000-01-01T00:00:00Z)--fast-list Use recursive list if available; uses more memory but fewer transactions</code></pre>-<h2 id="see-also-61">See Also</h2>+<h2 id="see-also-62">See Also</h2><ul><li><a href="https://rclone.org/commands/rclone/">rclone</a> - Show help for rclone commands, flags and backends.</li></ul><h1 id="rclone-ncdu">rclone ncdu</h1><p>Explore a remote with a text based user interface.</p>-<h2 id="synopsis-54">Synopsis</h2>+<h2 id="synopsis-56">Synopsis</h2><p>This displays a text based user interface allowing the navigation of a remote. It is most useful for answering the question - "What is using all my disk space?".</p><p>To make the user interface it first scans the entire remote given and builds an in memory representation. rclone ncdu can be used during this scanning phase and you will see it building up the directory structure as it goes along.</p><p>You can interact with the user interface using key presses, press '?' to toggle the help on and off. The supported keys are:</p>@@ -3460,10 +3985,10 @@ if src is directory<p>Note that it might take some time to delete big files/directories. The UI won't respond in the meantime since the deletion is done synchronously.</p><p>For a non-interactive listing of the remote, see the <a href="https://rclone.org/commands/rclone_tree/">tree</a> command. To just get the total size of the remote you can also use the <a href="https://rclone.org/commands/rclone_size/">size</a> command.</p><pre><code>rclone ncdu remote:path [flags]</code></pre>-<h2 id="options-62">Options</h2>+<h2 id="options-63">Options</h2><pre><code> -h, --help help for ncdu</code></pre><p>Options shared with other commands are described next. See the <a href="https://rclone.org/flags/">global flags page</a> for global options not listed here.</p>-<h3 id="filter-options-21">Filter Options</h3>+<h3 id="filter-options-22">Filter Options</h3><p>Flags for filtering directory listings</p><pre><code> --delete-excluded Delete files on dest excluded from sync--exclude stringArray Exclude files matching pattern@@ -3473,6 +3998,7 @@ if src is directory--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -3487,17 +4013,17 @@ if src is directory--metadata-include-from stringArray Read metadata include patterns from file (use - to read from stdin)--min-age Duration Only transfer files older than this in s or suffix ms|s|m|h|d|w|M|y (default off)--min-size SizeSuffix Only transfer files bigger than this in KiB or suffix B|K|M|G|T|P (default off)</code></pre>-<h3 id="listing-options-19">Listing Options</h3>+<h3 id="listing-options-20">Listing Options</h3><p>Flags for listing directories</p><pre><code> --default-time Time Time to show if modtime is unknown for files and directories (default 2000-01-01T00:00:00Z)--fast-list Use recursive list if available; uses more memory but fewer transactions</code></pre>-<h2 id="see-also-62">See Also</h2>+<h2 id="see-also-63">See Also</h2><ul><li><a href="https://rclone.org/commands/rclone/">rclone</a> - Show help for rclone commands, flags and backends.</li></ul><h1 id="rclone-nfsmount">rclone nfsmount</h1><p>Mount the remote as file system on a mountpoint.</p>-<h2 id="synopsis-55">Synopsis</h2>+<h2 id="synopsis-57">Synopsis</h2><p>Rclone nfsmount allows Linux, FreeBSD, macOS and Windows to mount any of Rclone's cloud storage systems as a file system with FUSE.</p><p>First set up your remote using <code>rclone config</code>. Check it works with <code>rclone ls</code> etc.</p><p>On Linux and macOS, you can run mount in either foreground or background (aka daemon) mode. Mount runs in foreground mode by default. Use the <code>--daemon</code> flag to force background mode. On Windows you can run mount in foreground only, the flag is ignored.</p>@@ -3670,7 +4196,7 @@ WantedBy=multi-user.target</code></pre><p>If run with <code>-vv</code> rclone will print the location of the file cache. The files are stored in the user cache file area which is OS dependent but can be controlled with <code>--cache-dir</code> or setting the appropriate environment variable.</p><p>The cache has 4 different modes selected by <code>--vfs-cache-mode</code>. The higher the cache mode the more compatible rclone becomes at the cost of using disk space.</p><p>Note that files are written back to the remote only when they are closed and if they haven't been accessed for <code>--vfs-write-back</code> seconds. If rclone is quit or dies with files that haven't been uploaded, these will be uploaded next time rclone is run with the same flags.</p>-<p>If using <code>--vfs-cache-max-size</code> or <code>--vfs-cache-min-free-size</code> note that the cache may exceed these quotas for two reasons. Firstly because it is only checked every <code>--vfs-cache-poll-interval</code>. Secondly because open files cannot be evicted from the cache. When <code>--vfs-cache-max-size</code> or <code>--vfs-cache-min-free-size</code> is exceeded, rclone will attempt to evict the least accessed files from the cache first. rclone will start with files that haven't been accessed for the longest. This cache flushing strategy is efficient and more relevant files are likely to remain cached.</p>+<p>If using <code>--vfs-cache-max-size</code> or <code>--vfs-cache-min-free-space</code> note that the cache may exceed these quotas for two reasons. Firstly because it is only checked every <code>--vfs-cache-poll-interval</code>. Secondly because open files cannot be evicted from the cache. When <code>--vfs-cache-max-size</code> or <code>--vfs-cache-min-free-space</code> is exceeded, rclone will attempt to evict the least accessed files from the cache first. rclone will start with files that haven't been accessed for the longest. This cache flushing strategy is efficient and more relevant files are likely to remain cached.</p><p>The <code>--vfs-cache-max-age</code> will evict files from the cache after the set time since last access has passed. The default value of 1 hour will start evicting files from cache that haven't been accessed for 1 hour. When a cached file is accessed the 1 hour timer is reset to 0 and will wait for 1 more hour before evicting. Specify the time with standard notation, s, m, h, d, w .</p><p>You <strong>should not</strong> run two copies of rclone using the same VFS cache with the same or overlapping remotes if using <code>--vfs-cache-mode > off</code>. This can potentially cause data corruption if you do. You can work around this by giving each rclone its own cache hierarchy with <code>--cache-dir</code>. You don't need to worry about this if the remotes in use don't overlap.</p><h3 id="vfs-cache-mode-off-1">--vfs-cache-mode off</h3>@@ -3781,8 +4307,31 @@ WantedBy=multi-user.target</code></pre><h2 id="alternate-report-of-used-bytes-1">Alternate report of used bytes</h2><p>Some backends, most notably S3, do not report the amount of bytes used. If you need this information to be available when running <code>df</code> on the filesystem, then pass the flag <code>--vfs-used-is-size</code> to rclone. With this flag set, instead of relying on the backend to report this information, rclone will scan the whole remote similar to <code>rclone size</code> and compute the total used space itself.</p><p><em>WARNING.</em> Contrary to <code>rclone size</code>, this flag ignores filters so that the result is accurate. However, this is very inefficient and may cost lots of API calls resulting in extra charges. Use it as a last resort and only with caching.</p>+<h2 id="vfs-metadata-1">VFS Metadata</h2>+<p>If you use the <code>--vfs-metadata-extension</code> flag you can get the VFS to expose files which contain the <a href="https://rclone.org/docs/#metadata">metadata</a> as a JSON blob. These files will not appear in the directory listing, but can be <code>stat</code>-ed and opened and once they have been they <strong>will</strong> appear in directory listings until the directory cache expires.</p>+<p>Note that some backends won't create metadata unless you pass in the <code>--metadata</code> flag.</p>+<p>For example, using <code>rclone mount</code> with <code>--metadata --vfs-metadata-extension .metadata</code> we get</p>+<pre><code>$ ls -l /mnt/+total 1048577+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++$ cat /mnt/1G.metadata+{+ "atime": "2025-03-04T17:34:22.317069787Z",+ "btime": "2025-03-03T16:03:37.708253808Z",+ "gid": "1000",+ "mode": "100664",+ "mtime": "2025-03-03T16:03:39.640238323Z",+ "uid": "1000"+}++$ ls -l /mnt/+total 1048578+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+-rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata</code></pre>+<p>If the file has no metadata it will be returned as <code>{}</code> and if there is an error reading the metadata the error will be returned as <code>{"error":"error string"}</code>.</p><pre><code>rclone nfsmount remote:path /path/to/mountpoint [flags]</code></pre>-<h2 id="options-63">Options</h2>+<h2 id="options-64">Options</h2><pre><code> --addr string IPaddress:Port or :Port to bind server to--allow-non-empty Allow mounting over a non-empty directory (not supported on Windows)--allow-other Allow access to other users (not supported on Windows)@@ -3830,6 +4379,7 @@ WantedBy=multi-user.target</code></pre>--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a '.rclonelink' extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached ('off' is unlimited) (default off)@@ -3842,7 +4392,7 @@ WantedBy=multi-user.target</code></pre>--volname string Set the volume name (supported on Windows and OSX only)--write-back-cache Makes kernel buffer writes before sending them to rclone (without this, writethrough caching is used) (not supported on Windows)</code></pre><p>Options shared with other commands are described next. See the <a href="https://rclone.org/flags/">global flags page</a> for global options not listed here.</p>-<h3 id="filter-options-22">Filter Options</h3>+<h3 id="filter-options-23">Filter Options</h3><p>Flags for filtering directory listings</p><pre><code> --delete-excluded Delete files on dest excluded from sync--exclude stringArray Exclude files matching pattern@@ -3852,6 +4402,7 @@ WantedBy=multi-user.target</code></pre>--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -3866,13 +4417,13 @@ WantedBy=multi-user.target</code></pre>--metadata-include-from stringArray Read metadata include patterns from file (use - to read from stdin)--min-age Duration Only transfer files older than this in s or suffix ms|s|m|h|d|w|M|y (default off)--min-size SizeSuffix Only transfer files bigger than this in KiB or suffix B|K|M|G|T|P (default off)</code></pre>-<h2 id="see-also-63">See Also</h2>+<h2 id="see-also-64">See Also</h2><ul><li><a href="https://rclone.org/commands/rclone/">rclone</a> - Show help for rclone commands, flags and backends.</li></ul><h1 id="rclone-obscure">rclone obscure</h1><p>Obscure password for use in the rclone config file.</p>-<h2 id="synopsis-56">Synopsis</h2>+<h2 id="synopsis-58">Synopsis</h2><p>In the rclone config file, human-readable passwords are obscured. Obscuring them is done by encrypting them and writing them out in base64. This is <strong>not</strong> a secure way of encrypting these passwords as rclone can decrypt them - it is to prevent "eyedropping" - namely someone seeing a password in the rclone config file by accident.</p><p>Many equally important things (like access tokens) are not obscured in the config file. However it is very hard to shoulder surf a 64 character hex token.</p><p>This command can also accept a password through STDIN instead of an argument by passing a hyphen as an argument. This will use the first line of STDIN as the password not including the trailing newline.</p>@@ -3880,16 +4431,16 @@ WantedBy=multi-user.target</code></pre><p>If there is no data on STDIN to read, rclone obscure will default to obfuscating the hyphen itself.</p><p>If you want to encrypt the config file then please use config file encryption - see <a href="https://rclone.org/commands/rclone_config/">rclone config</a> for more info.</p><pre><code>rclone obscure password [flags]</code></pre>-<h2 id="options-64">Options</h2>+<h2 id="options-65">Options</h2><pre><code> -h, --help help for obscure</code></pre><p>See the <a href="https://rclone.org/flags/">global flags page</a> for global options not listed here.</p>-<h2 id="see-also-64">See Also</h2>+<h2 id="see-also-65">See Also</h2><ul><li><a href="https://rclone.org/commands/rclone/">rclone</a> - Show help for rclone commands, flags and backends.</li></ul><h1 id="rclone-rc">rclone rc</h1><p>Run a command against a running rclone.</p>-<h2 id="synopsis-57">Synopsis</h2>+<h2 id="synopsis-59">Synopsis</h2><p>This runs a command against a running rclone. Use the <code>--url</code> flag to specify an non default URL to connect on. This can be either a ":port" which is taken to mean "http://localhost:port" or a "host:port" which is taken to mean "http://host:port"</p><p>A username and password can be passed in with <code>--user</code> and <code>--pass</code>.</p><p>Note that <code>--rc-addr</code>, <code>--rc-user</code>, <code>--rc-pass</code> will be read also for <code>--url</code>, <code>--user</code>, <code>--pass</code>.</p>@@ -3913,7 +4464,7 @@ rclone rc --unix-socket /tmp/my.socket core/stats</code></pre><pre><code>rclone rc --loopback operations/about fs=/</code></pre><p>Use <code>rclone rc</code> to see a list of all possible commands.</p><pre><code>rclone rc commands parameter [flags]</code></pre>-<h2 id="options-65">Options</h2>+<h2 id="options-66">Options</h2><pre><code> -a, --arg stringArray Argument placed in the "arg" array-h, --help help for rc--json string Input JSON - use instead of key=value args@@ -3925,13 +4476,13 @@ rclone rc --unix-socket /tmp/my.socket core/stats</code></pre>--url string URL to connect to rclone remote control (default "http://localhost:5572/")--user string Username to use to rclone remote control</code></pre><p>See the <a href="https://rclone.org/flags/">global flags page</a> for global options not listed here.</p>-<h2 id="see-also-65">See Also</h2>+<h2 id="see-also-66">See Also</h2><ul><li><a href="https://rclone.org/commands/rclone/">rclone</a> - Show help for rclone commands, flags and backends.</li></ul><h1 id="rclone-rcat">rclone rcat</h1><p>Copies standard input to file on remote.</p>-<h2 id="synopsis-58">Synopsis</h2>+<h2 id="synopsis-60">Synopsis</h2><p>Reads from standard input (stdin) and copies it to a single remote file.</p><pre><code>echo "hello world" | rclone rcat remote:path/to/fileffmpeg - | rclone rcat remote:path/to/file</code></pre>@@ -3941,22 +4492,22 @@ ffmpeg - | rclone rcat remote:path/to/file</code></pre><p><code>--size</code> should be the exact size of the input stream in bytes. If the size of the stream is different in length to the <code>--size</code> passed in then the transfer will likely fail.</p><p>Note that the upload cannot be retried because the data is not stored. If the backend supports multipart uploading then individual chunks can be retried. If you need to transfer a lot of data, you may be better off caching it locally and then <code>rclone move</code> it to the destination which can use retries.</p><pre><code>rclone rcat remote:path [flags]</code></pre>-<h2 id="options-66">Options</h2>+<h2 id="options-67">Options</h2><pre><code> -h, --help help for rcat--size int File size hint to preallocate (default -1)</code></pre><p>Options shared with other commands are described next. See the <a href="https://rclone.org/flags/">global flags page</a> for global options not listed here.</p>-<h3 id="important-options-15">Important Options</h3>+<h3 id="important-options-16">Important Options</h3><p>Important flags useful for most commands</p><pre><code> -n, --dry-run Do a trial run with no permanent changes-i, --interactive Enable interactive mode-v, --verbose count Print lots more stuff (repeat for more)</code></pre>-<h2 id="see-also-66">See Also</h2>+<h2 id="see-also-67">See Also</h2><ul><li><a href="https://rclone.org/commands/rclone/">rclone</a> - Show help for rclone commands, flags and backends.</li></ul><h1 id="rclone-rcd">rclone rcd</h1><p>Run rclone listening to remote control commands only.</p>-<h2 id="synopsis-59">Synopsis</h2>+<h2 id="synopsis-61">Synopsis</h2><p>This runs rclone so that it only listens to remote control commands.</p><p>This is useful if you are controlling rclone via the rc API.</p><p>If you pass in a path to a directory, rclone will serve that directory for GET requests on the URL passed in. It will also open the URL in the browser when rclone is run.</p>@@ -4092,7 +4643,8 @@ ffmpeg - | rclone rcat remote:path/to/file</code></pre><h3 id="authentication">Authentication</h3><p>By default this will serve files without needing a login.</p><p>You can either use an htpasswd file which can take lots of users, or set a single username and password with the <code>--rc-user</code> and <code>--rc-pass</code> flags.</p>-<p>If no static users are configured by either of the above methods, and client certificates are required by the <code>--client-ca</code> flag passed to the server, the client certificate common name will be considered as the username.</p>+<p>Alternatively, you can have the reverse proxy manage authentication and use the username provided in the configured header with <code>--user-from-header</code> (e.g., <code>--rc---user-from-header=x-remote-user</code>). Ensure the proxy is trusted and headers cannot be spoofed, as misconfiguration may lead to unauthorized access.</p>+<p>If either of the above authentication methods is not configured and client certificates are required by the <code>--client-ca</code> flag passed to the server, the client certificate common name will be considered as the username.</p><p>Use <code>--rc-htpasswd /path/to/htpasswd</code> to provide an htpasswd file. This is in standard apache format and supports MD5, SHA1 and BCrypt for basic authentication. Bcrypt is recommended.</p><p>To create an htpasswd file:</p><pre><code>touch htpasswd@@ -4102,7 +4654,7 @@ htpasswd -B htpasswd anotherUser</code></pre><p>Use <code>--rc-realm</code> to set the authentication realm.</p><p>Use <code>--rc-salt</code> to change the password hashing salt from the default.</p><pre><code>rclone rcd <path to files to serve>* [flags]</code></pre>-<h2 id="options-67">Options</h2>+<h2 id="options-68">Options</h2><pre><code> -h, --help help for rcd</code></pre><p>Options shared with other commands are described next. See the <a href="https://rclone.org/flags/">global flags page</a> for global options not listed here.</p><h3 id="rc-options">RC Options</h3>@@ -4131,40 +4683,41 @@ htpasswd -B htpasswd anotherUser</code></pre>--rc-server-write-timeout Duration Timeout for server writing data (default 1h0m0s)--rc-template string User-specified template--rc-user string User name for authentication+ --rc-user-from-header string User name from a defined HTTP header--rc-web-fetch-url string URL to fetch the releases for webgui (default "https://api.github.com/repos/rclone/rclone-webui-react/releases/latest")--rc-web-gui Launch WebGUI on localhost--rc-web-gui-force-update Force update to latest version of web gui--rc-web-gui-no-open-browser Don't open the browser automatically--rc-web-gui-update Check and update to latest version of web gui</code></pre>-<h2 id="see-also-67">See Also</h2>+<h2 id="see-also-68">See Also</h2><ul><li><a href="https://rclone.org/commands/rclone/">rclone</a> - Show help for rclone commands, flags and backends.</li></ul><h1 id="rclone-rmdirs">rclone rmdirs</h1><p>Remove empty directories under the path.</p>-<h2 id="synopsis-60">Synopsis</h2>+<h2 id="synopsis-62">Synopsis</h2><p>This recursively removes any empty directories (including directories that only contain empty directories), that it finds under the path. The root path itself will also be removed if it is empty, unless you supply the <code>--leave-root</code> flag.</p><p>Use command <a href="https://rclone.org/commands/rclone_rmdir/">rmdir</a> to delete just the empty directory given by path, not recurse.</p><p>This is useful for tidying up remotes that rclone has left a lot of empty directories in. For example the <a href="https://rclone.org/commands/rclone_delete/">delete</a> command will delete files but leave the directory structure (unless used with option <code>--rmdirs</code>).</p><p>This will delete <code>--checkers</code> directories concurrently so if you have thousands of empty directories consider increasing this number.</p><p>To delete a path and any objects in it, use the <a href="https://rclone.org/commands/rclone_purge/">purge</a> command.</p><pre><code>rclone rmdirs remote:path [flags]</code></pre>-<h2 id="options-68">Options</h2>+<h2 id="options-69">Options</h2><pre><code> -h, --help help for rmdirs--leave-root Do not remove root directory if empty</code></pre><p>Options shared with other commands are described next. See the <a href="https://rclone.org/flags/">global flags page</a> for global options not listed here.</p>-<h3 id="important-options-16">Important Options</h3>+<h3 id="important-options-17">Important Options</h3><p>Important flags useful for most commands</p><pre><code> -n, --dry-run Do a trial run with no permanent changes-i, --interactive Enable interactive mode-v, --verbose count Print lots more stuff (repeat for more)</code></pre>-<h2 id="see-also-68">See Also</h2>+<h2 id="see-also-69">See Also</h2><ul><li><a href="https://rclone.org/commands/rclone/">rclone</a> - Show help for rclone commands, flags and backends.</li></ul><h1 id="rclone-selfupdate">rclone selfupdate</h1><p>Update the rclone binary.</p>-<h2 id="synopsis-61">Synopsis</h2>+<h2 id="synopsis-63">Synopsis</h2><p>This command downloads the latest release of rclone and replaces the currently running binary. The download is verified with a hashsum and cryptographically signed signature; see <a href="https://rclone.org/release_signing/">the release signing docs</a> for details.</p><p>If used without flags (or with implied <code>--stable</code> flag), this command will install the latest stable release. However, some issues may be fixed (or features added) only in the latest beta release. In such cases you should run the command with the <code>--beta</code> flag, i.e. <code>rclone selfupdate --beta</code>. You can check in advance what version would be installed by adding the <code>--check</code> flag, then repeat the command without it when you are satisfied.</p><p>Sometimes the rclone team may recommend you a concrete beta or stable rclone release to troubleshoot your issue or add a bleeding edge feature. The <code>--version VER</code> flag, if given, will update to the concrete version instead of the latest one. If you omit micro version from <code>VER</code> (for example <code>1.53</code>), the latest matching micro version will be used.</p>@@ -4174,7 +4727,7 @@ htpasswd -B htpasswd anotherUser</code></pre><p>Note: Windows forbids deletion of a currently running executable so this command will rename the old executable to 'rclone.old.exe' upon success.</p><p>Please note that this command was not available before rclone version 1.55. If it fails for you with the message <code>unknown command "selfupdate"</code> then you will need to update manually following the install instructions located at https://rclone.org/install/</p><pre><code>rclone selfupdate [flags]</code></pre>-<h2 id="options-69">Options</h2>+<h2 id="options-70">Options</h2><pre><code> --beta Install beta release--check Check for latest release, do not download-h, --help help for selfupdate@@ -4183,21 +4736,21 @@ htpasswd -B htpasswd anotherUser</code></pre>--stable Install stable release (this is the default)--version string Install the given rclone version (default: latest)</code></pre><p>See the <a href="https://rclone.org/flags/">global flags page</a> for global options not listed here.</p>-<h2 id="see-also-69">See Also</h2>+<h2 id="see-also-70">See Also</h2><ul><li><a href="https://rclone.org/commands/rclone/">rclone</a> - Show help for rclone commands, flags and backends.</li></ul><h1 id="rclone-serve">rclone serve</h1><p>Serve a remote over a protocol.</p>-<h2 id="synopsis-62">Synopsis</h2>+<h2 id="synopsis-64">Synopsis</h2><p>Serve a remote over a given protocol. Requires the use of a subcommand to specify the protocol, e.g.</p><pre><code>rclone serve http remote:</code></pre><p>Each subcommand has its own options which you can see in their help.</p><pre><code>rclone serve <protocol> [opts] <remote> [flags]</code></pre>-<h2 id="options-70">Options</h2>+<h2 id="options-71">Options</h2><pre><code> -h, --help help for serve</code></pre><p>See the <a href="https://rclone.org/flags/">global flags page</a> for global options not listed here.</p>-<h2 id="see-also-70">See Also</h2>+<h2 id="see-also-71">See Also</h2><ul><li><a href="https://rclone.org/commands/rclone/">rclone</a> - Show help for rclone commands, flags and backends.</li><li><a href="https://rclone.org/commands/rclone_serve_dlna/">rclone serve dlna</a> - Serve remote:path over DLNA</li>@@ -4212,7 +4765,7 @@ htpasswd -B htpasswd anotherUser</code></pre></ul><h1 id="rclone-serve-dlna">rclone serve dlna</h1><p>Serve remote:path over DLNA</p>-<h2 id="synopsis-63">Synopsis</h2>+<h2 id="synopsis-65">Synopsis</h2><p>Run a DLNA media server for media stored in an rclone remote. Many devices, such as the Xbox and PlayStation, can automatically discover this server in the LAN and play audio/video from it. VLC is also supported. Service discovery uses UDP multicast packets (SSDP) and will thus only work on LANs.</p><p>Rclone will list all files present in the remote, without filtering based on media formats or file extensions. Additionally, there is no media transcoding support. This means that some players might show files that they are not able to play back correctly.</p><p>Rclone will add external subtitle files (.srt) to videos if they have the same filename as the video file itself (except the extension), either in the same directory as the video, or in a "Subs" subdirectory.</p>@@ -4254,7 +4807,7 @@ htpasswd -B htpasswd anotherUser</code></pre><p>If run with <code>-vv</code> rclone will print the location of the file cache. The files are stored in the user cache file area which is OS dependent but can be controlled with <code>--cache-dir</code> or setting the appropriate environment variable.</p><p>The cache has 4 different modes selected by <code>--vfs-cache-mode</code>. The higher the cache mode the more compatible rclone becomes at the cost of using disk space.</p><p>Note that files are written back to the remote only when they are closed and if they haven't been accessed for <code>--vfs-write-back</code> seconds. If rclone is quit or dies with files that haven't been uploaded, these will be uploaded next time rclone is run with the same flags.</p>-<p>If using <code>--vfs-cache-max-size</code> or <code>--vfs-cache-min-free-size</code> note that the cache may exceed these quotas for two reasons. Firstly because it is only checked every <code>--vfs-cache-poll-interval</code>. Secondly because open files cannot be evicted from the cache. When <code>--vfs-cache-max-size</code> or <code>--vfs-cache-min-free-size</code> is exceeded, rclone will attempt to evict the least accessed files from the cache first. rclone will start with files that haven't been accessed for the longest. This cache flushing strategy is efficient and more relevant files are likely to remain cached.</p>+<p>If using <code>--vfs-cache-max-size</code> or <code>--vfs-cache-min-free-space</code> note that the cache may exceed these quotas for two reasons. Firstly because it is only checked every <code>--vfs-cache-poll-interval</code>. Secondly because open files cannot be evicted from the cache. When <code>--vfs-cache-max-size</code> or <code>--vfs-cache-min-free-space</code> is exceeded, rclone will attempt to evict the least accessed files from the cache first. rclone will start with files that haven't been accessed for the longest. This cache flushing strategy is efficient and more relevant files are likely to remain cached.</p><p>The <code>--vfs-cache-max-age</code> will evict files from the cache after the set time since last access has passed. The default value of 1 hour will start evicting files from cache that haven't been accessed for 1 hour. When a cached file is accessed the 1 hour timer is reset to 0 and will wait for 1 more hour before evicting. Specify the time with standard notation, s, m, h, d, w .</p><p>You <strong>should not</strong> run two copies of rclone using the same VFS cache with the same or overlapping remotes if using <code>--vfs-cache-mode > off</code>. This can potentially cause data corruption if you do. You can work around this by giving each rclone its own cache hierarchy with <code>--cache-dir</code>. You don't need to worry about this if the remotes in use don't overlap.</p><h3 id="vfs-cache-mode-off-2">--vfs-cache-mode off</h3>@@ -4365,8 +4918,31 @@ htpasswd -B htpasswd anotherUser</code></pre><h2 id="alternate-report-of-used-bytes-2">Alternate report of used bytes</h2><p>Some backends, most notably S3, do not report the amount of bytes used. If you need this information to be available when running <code>df</code> on the filesystem, then pass the flag <code>--vfs-used-is-size</code> to rclone. With this flag set, instead of relying on the backend to report this information, rclone will scan the whole remote similar to <code>rclone size</code> and compute the total used space itself.</p><p><em>WARNING.</em> Contrary to <code>rclone size</code>, this flag ignores filters so that the result is accurate. However, this is very inefficient and may cost lots of API calls resulting in extra charges. Use it as a last resort and only with caching.</p>+<h2 id="vfs-metadata-2">VFS Metadata</h2>+<p>If you use the <code>--vfs-metadata-extension</code> flag you can get the VFS to expose files which contain the <a href="https://rclone.org/docs/#metadata">metadata</a> as a JSON blob. These files will not appear in the directory listing, but can be <code>stat</code>-ed and opened and once they have been they <strong>will</strong> appear in directory listings until the directory cache expires.</p>+<p>Note that some backends won't create metadata unless you pass in the <code>--metadata</code> flag.</p>+<p>For example, using <code>rclone mount</code> with <code>--metadata --vfs-metadata-extension .metadata</code> we get</p>+<pre><code>$ ls -l /mnt/+total 1048577+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++$ cat /mnt/1G.metadata+{+ "atime": "2025-03-04T17:34:22.317069787Z",+ "btime": "2025-03-03T16:03:37.708253808Z",+ "gid": "1000",+ "mode": "100664",+ "mtime": "2025-03-03T16:03:39.640238323Z",+ "uid": "1000"+}++$ ls -l /mnt/+total 1048578+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+-rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata</code></pre>+<p>If the file has no metadata it will be returned as <code>{}</code> and if there is an error reading the metadata the error will be returned as <code>{"error":"error string"}</code>.</p><pre><code>rclone serve dlna remote:path [flags]</code></pre>-<h2 id="options-71">Options</h2>+<h2 id="options-72">Options</h2><pre><code> --addr string The ip:port or :port to bind the DLNA http server to (default ":7879")--announce-interval Duration The interval between SSDP announcements (default 12m0s)--dir-cache-time Duration Time to cache directory entries for (default 5m0s)@@ -4395,6 +4971,7 @@ htpasswd -B htpasswd anotherUser</code></pre>--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a '.rclonelink' extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached ('off' is unlimited) (default off)@@ -4405,7 +4982,7 @@ htpasswd -B htpasswd anotherUser</code></pre>--vfs-write-back Duration Time to writeback files after last use when using cache (default 5s)--vfs-write-wait Duration Time to wait for in-sequence write before giving error (default 1s)</code></pre><p>Options shared with other commands are described next. See the <a href="https://rclone.org/flags/">global flags page</a> for global options not listed here.</p>-<h3 id="filter-options-23">Filter Options</h3>+<h3 id="filter-options-24">Filter Options</h3><p>Flags for filtering directory listings</p><pre><code> --delete-excluded Delete files on dest excluded from sync--exclude stringArray Exclude files matching pattern@@ -4415,6 +4992,7 @@ htpasswd -B htpasswd anotherUser</code></pre>--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -4429,13 +5007,13 @@ htpasswd -B htpasswd anotherUser</code></pre>--metadata-include-from stringArray Read metadata include patterns from file (use - to read from stdin)--min-age Duration Only transfer files older than this in s or suffix ms|s|m|h|d|w|M|y (default off)--min-size SizeSuffix Only transfer files bigger than this in KiB or suffix B|K|M|G|T|P (default off)</code></pre>-<h2 id="see-also-71">See Also</h2>+<h2 id="see-also-72">See Also</h2><ul><li><a href="https://rclone.org/commands/rclone_serve/">rclone serve</a> - Serve a remote over a protocol.</li></ul><h1 id="rclone-serve-docker">rclone serve docker</h1><p>Serve any remote on docker's volume plugin API.</p>-<h2 id="synopsis-64">Synopsis</h2>+<h2 id="synopsis-66">Synopsis</h2><p>This command implements the Docker volume plugin API allowing docker to use rclone as a data storage mechanism for various cloud providers. rclone provides <a href="/docker">docker volume plugin</a> based on it.</p><p>To create a docker plugin, one must create a Unix or TCP socket that Docker will look for when you use the plugin and then it listens for commands from docker daemon and runs the corresponding code when necessary. Docker plugins can run as a managed plugin under control of the docker daemon or as an independent native service. For testing, you can just run it directly from the command line, for example:</p><pre><code>sudo rclone serve docker --base-dir /tmp/rclone-volumes --socket-addr localhost:8787 -vv</code></pre>@@ -4477,7 +5055,7 @@ htpasswd -B htpasswd anotherUser</code></pre><p>If run with <code>-vv</code> rclone will print the location of the file cache. The files are stored in the user cache file area which is OS dependent but can be controlled with <code>--cache-dir</code> or setting the appropriate environment variable.</p><p>The cache has 4 different modes selected by <code>--vfs-cache-mode</code>. The higher the cache mode the more compatible rclone becomes at the cost of using disk space.</p><p>Note that files are written back to the remote only when they are closed and if they haven't been accessed for <code>--vfs-write-back</code> seconds. If rclone is quit or dies with files that haven't been uploaded, these will be uploaded next time rclone is run with the same flags.</p>-<p>If using <code>--vfs-cache-max-size</code> or <code>--vfs-cache-min-free-size</code> note that the cache may exceed these quotas for two reasons. Firstly because it is only checked every <code>--vfs-cache-poll-interval</code>. Secondly because open files cannot be evicted from the cache. When <code>--vfs-cache-max-size</code> or <code>--vfs-cache-min-free-size</code> is exceeded, rclone will attempt to evict the least accessed files from the cache first. rclone will start with files that haven't been accessed for the longest. This cache flushing strategy is efficient and more relevant files are likely to remain cached.</p>+<p>If using <code>--vfs-cache-max-size</code> or <code>--vfs-cache-min-free-space</code> note that the cache may exceed these quotas for two reasons. Firstly because it is only checked every <code>--vfs-cache-poll-interval</code>. Secondly because open files cannot be evicted from the cache. When <code>--vfs-cache-max-size</code> or <code>--vfs-cache-min-free-space</code> is exceeded, rclone will attempt to evict the least accessed files from the cache first. rclone will start with files that haven't been accessed for the longest. This cache flushing strategy is efficient and more relevant files are likely to remain cached.</p><p>The <code>--vfs-cache-max-age</code> will evict files from the cache after the set time since last access has passed. The default value of 1 hour will start evicting files from cache that haven't been accessed for 1 hour. When a cached file is accessed the 1 hour timer is reset to 0 and will wait for 1 more hour before evicting. Specify the time with standard notation, s, m, h, d, w .</p><p>You <strong>should not</strong> run two copies of rclone using the same VFS cache with the same or overlapping remotes if using <code>--vfs-cache-mode > off</code>. This can potentially cause data corruption if you do. You can work around this by giving each rclone its own cache hierarchy with <code>--cache-dir</code>. You don't need to worry about this if the remotes in use don't overlap.</p><h3 id="vfs-cache-mode-off-3">--vfs-cache-mode off</h3>@@ -4588,8 +5166,31 @@ htpasswd -B htpasswd anotherUser</code></pre><h2 id="alternate-report-of-used-bytes-3">Alternate report of used bytes</h2><p>Some backends, most notably S3, do not report the amount of bytes used. If you need this information to be available when running <code>df</code> on the filesystem, then pass the flag <code>--vfs-used-is-size</code> to rclone. With this flag set, instead of relying on the backend to report this information, rclone will scan the whole remote similar to <code>rclone size</code> and compute the total used space itself.</p><p><em>WARNING.</em> Contrary to <code>rclone size</code>, this flag ignores filters so that the result is accurate. However, this is very inefficient and may cost lots of API calls resulting in extra charges. Use it as a last resort and only with caching.</p>+<h2 id="vfs-metadata-3">VFS Metadata</h2>+<p>If you use the <code>--vfs-metadata-extension</code> flag you can get the VFS to expose files which contain the <a href="https://rclone.org/docs/#metadata">metadata</a> as a JSON blob. These files will not appear in the directory listing, but can be <code>stat</code>-ed and opened and once they have been they <strong>will</strong> appear in directory listings until the directory cache expires.</p>+<p>Note that some backends won't create metadata unless you pass in the <code>--metadata</code> flag.</p>+<p>For example, using <code>rclone mount</code> with <code>--metadata --vfs-metadata-extension .metadata</code> we get</p>+<pre><code>$ ls -l /mnt/+total 1048577+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++$ cat /mnt/1G.metadata+{+ "atime": "2025-03-04T17:34:22.317069787Z",+ "btime": "2025-03-03T16:03:37.708253808Z",+ "gid": "1000",+ "mode": "100664",+ "mtime": "2025-03-03T16:03:39.640238323Z",+ "uid": "1000"+}++$ ls -l /mnt/+total 1048578+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+-rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata</code></pre>+<p>If the file has no metadata it will be returned as <code>{}</code> and if there is an error reading the metadata the error will be returned as <code>{"error":"error string"}</code>.</p><pre><code>rclone serve docker [flags]</code></pre>-<h2 id="options-72">Options</h2>+<h2 id="options-73">Options</h2><pre><code> --allow-non-empty Allow mounting over a non-empty directory (not supported on Windows)--allow-other Allow access to other users (not supported on Windows)--allow-root Allow access to root user (not supported on Windows)@@ -4637,6 +5238,7 @@ htpasswd -B htpasswd anotherUser</code></pre>--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a '.rclonelink' extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached ('off' is unlimited) (default off)@@ -4649,7 +5251,7 @@ htpasswd -B htpasswd anotherUser</code></pre>--volname string Set the volume name (supported on Windows and OSX only)--write-back-cache Makes kernel buffer writes before sending them to rclone (without this, writethrough caching is used) (not supported on Windows)</code></pre><p>Options shared with other commands are described next. See the <a href="https://rclone.org/flags/">global flags page</a> for global options not listed here.</p>-<h3 id="filter-options-24">Filter Options</h3>+<h3 id="filter-options-25">Filter Options</h3><p>Flags for filtering directory listings</p><pre><code> --delete-excluded Delete files on dest excluded from sync--exclude stringArray Exclude files matching pattern@@ -4659,6 +5261,7 @@ htpasswd -B htpasswd anotherUser</code></pre>--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -4673,13 +5276,13 @@ htpasswd -B htpasswd anotherUser</code></pre>--metadata-include-from stringArray Read metadata include patterns from file (use - to read from stdin)--min-age Duration Only transfer files older than this in s or suffix ms|s|m|h|d|w|M|y (default off)--min-size SizeSuffix Only transfer files bigger than this in KiB or suffix B|K|M|G|T|P (default off)</code></pre>-<h2 id="see-also-72">See Also</h2>+<h2 id="see-also-73">See Also</h2><ul><li><a href="https://rclone.org/commands/rclone_serve/">rclone serve</a> - Serve a remote over a protocol.</li></ul><h1 id="rclone-serve-ftp">rclone serve ftp</h1><p>Serve remote:path over FTP.</p>-<h2 id="synopsis-65">Synopsis</h2>+<h2 id="synopsis-67">Synopsis</h2><p>Run a basic FTP server to serve a remote over FTP protocol. This can be viewed with a FTP client or you can make a remote of type FTP to read and write it.</p><h2 id="server-options-2">Server options</h2><p>Use --addr to specify which IP address and port the server should listen on, e.g. --addr 1.2.3.4:8000 or --addr :8080 to listen to all IPs. By default it only listens on localhost. You can use port :0 to let the OS choose an available port.</p>@@ -4721,7 +5324,7 @@ htpasswd -B htpasswd anotherUser</code></pre><p>If run with <code>-vv</code> rclone will print the location of the file cache. The files are stored in the user cache file area which is OS dependent but can be controlled with <code>--cache-dir</code> or setting the appropriate environment variable.</p><p>The cache has 4 different modes selected by <code>--vfs-cache-mode</code>. The higher the cache mode the more compatible rclone becomes at the cost of using disk space.</p><p>Note that files are written back to the remote only when they are closed and if they haven't been accessed for <code>--vfs-write-back</code> seconds. If rclone is quit or dies with files that haven't been uploaded, these will be uploaded next time rclone is run with the same flags.</p>-<p>If using <code>--vfs-cache-max-size</code> or <code>--vfs-cache-min-free-size</code> note that the cache may exceed these quotas for two reasons. Firstly because it is only checked every <code>--vfs-cache-poll-interval</code>. Secondly because open files cannot be evicted from the cache. When <code>--vfs-cache-max-size</code> or <code>--vfs-cache-min-free-size</code> is exceeded, rclone will attempt to evict the least accessed files from the cache first. rclone will start with files that haven't been accessed for the longest. This cache flushing strategy is efficient and more relevant files are likely to remain cached.</p>+<p>If using <code>--vfs-cache-max-size</code> or <code>--vfs-cache-min-free-space</code> note that the cache may exceed these quotas for two reasons. Firstly because it is only checked every <code>--vfs-cache-poll-interval</code>. Secondly because open files cannot be evicted from the cache. When <code>--vfs-cache-max-size</code> or <code>--vfs-cache-min-free-space</code> is exceeded, rclone will attempt to evict the least accessed files from the cache first. rclone will start with files that haven't been accessed for the longest. This cache flushing strategy is efficient and more relevant files are likely to remain cached.</p><p>The <code>--vfs-cache-max-age</code> will evict files from the cache after the set time since last access has passed. The default value of 1 hour will start evicting files from cache that haven't been accessed for 1 hour. When a cached file is accessed the 1 hour timer is reset to 0 and will wait for 1 more hour before evicting. Specify the time with standard notation, s, m, h, d, w .</p><p>You <strong>should not</strong> run two copies of rclone using the same VFS cache with the same or overlapping remotes if using <code>--vfs-cache-mode > off</code>. This can potentially cause data corruption if you do. You can work around this by giving each rclone its own cache hierarchy with <code>--cache-dir</code>. You don't need to worry about this if the remotes in use don't overlap.</p><h3 id="vfs-cache-mode-off-4">--vfs-cache-mode off</h3>@@ -4832,6 +5435,29 @@ htpasswd -B htpasswd anotherUser</code></pre><h2 id="alternate-report-of-used-bytes-4">Alternate report of used bytes</h2><p>Some backends, most notably S3, do not report the amount of bytes used. If you need this information to be available when running <code>df</code> on the filesystem, then pass the flag <code>--vfs-used-is-size</code> to rclone. With this flag set, instead of relying on the backend to report this information, rclone will scan the whole remote similar to <code>rclone size</code> and compute the total used space itself.</p><p><em>WARNING.</em> Contrary to <code>rclone size</code>, this flag ignores filters so that the result is accurate. However, this is very inefficient and may cost lots of API calls resulting in extra charges. Use it as a last resort and only with caching.</p>+<h2 id="vfs-metadata-4">VFS Metadata</h2>+<p>If you use the <code>--vfs-metadata-extension</code> flag you can get the VFS to expose files which contain the <a href="https://rclone.org/docs/#metadata">metadata</a> as a JSON blob. These files will not appear in the directory listing, but can be <code>stat</code>-ed and opened and once they have been they <strong>will</strong> appear in directory listings until the directory cache expires.</p>+<p>Note that some backends won't create metadata unless you pass in the <code>--metadata</code> flag.</p>+<p>For example, using <code>rclone mount</code> with <code>--metadata --vfs-metadata-extension .metadata</code> we get</p>+<pre><code>$ ls -l /mnt/+total 1048577+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++$ cat /mnt/1G.metadata+{+ "atime": "2025-03-04T17:34:22.317069787Z",+ "btime": "2025-03-03T16:03:37.708253808Z",+ "gid": "1000",+ "mode": "100664",+ "mtime": "2025-03-03T16:03:39.640238323Z",+ "uid": "1000"+}++$ ls -l /mnt/+total 1048578+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+-rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata</code></pre>+<p>If the file has no metadata it will be returned as <code>{}</code> and if there is an error reading the metadata the error will be returned as <code>{"error":"error string"}</code>.</p><h2 id="auth-proxy">Auth Proxy</h2><p>If you supply the parameter <code>--auth-proxy /path/to/program</code> then rclone will use that program to generate backends on the fly which then are used to authenticate incoming requests. This uses a simple JSON based protocol with input on STDIN and output on STDOUT.</p><p><strong>PLEASE NOTE:</strong> <code>--auth-proxy</code> and <code>--authorized-keys</code> cannot be used together, if <code>--auth-proxy</code> is set the authorized keys option will be ignored.</p>@@ -4863,7 +5489,7 @@ htpasswd -B htpasswd anotherUser</code></pre><p>Note that an internal cache is keyed on <code>user</code> so only use that for configuration, don't use <code>pass</code> or <code>public_key</code>. This also means that if a user's password or public-key is changed the cache will need to expire (which takes 5 mins) before it takes effect.</p><p>This can be used to build general purpose proxies to any kind of backend that rclone supports.</p><pre><code>rclone serve ftp remote:path [flags]</code></pre>-<h2 id="options-73">Options</h2>+<h2 id="options-74">Options</h2><pre><code> --addr string IPaddress:Port or :Port to bind server to (default "localhost:2121")--auth-proxy string A program to use to create the backend from the auth--cert string TLS PEM key (concatenation of certificate and CA certificate)@@ -4895,6 +5521,7 @@ htpasswd -B htpasswd anotherUser</code></pre>--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a '.rclonelink' extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached ('off' is unlimited) (default off)@@ -4905,7 +5532,7 @@ htpasswd -B htpasswd anotherUser</code></pre>--vfs-write-back Duration Time to writeback files after last use when using cache (default 5s)--vfs-write-wait Duration Time to wait for in-sequence write before giving error (default 1s)</code></pre><p>Options shared with other commands are described next. See the <a href="https://rclone.org/flags/">global flags page</a> for global options not listed here.</p>-<h3 id="filter-options-25">Filter Options</h3>+<h3 id="filter-options-26">Filter Options</h3><p>Flags for filtering directory listings</p><pre><code> --delete-excluded Delete files on dest excluded from sync--exclude stringArray Exclude files matching pattern@@ -4915,6 +5542,7 @@ htpasswd -B htpasswd anotherUser</code></pre>--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -4929,13 +5557,13 @@ htpasswd -B htpasswd anotherUser</code></pre>--metadata-include-from stringArray Read metadata include patterns from file (use - to read from stdin)--min-age Duration Only transfer files older than this in s or suffix ms|s|m|h|d|w|M|y (default off)--min-size SizeSuffix Only transfer files bigger than this in KiB or suffix B|K|M|G|T|P (default off)</code></pre>-<h2 id="see-also-73">See Also</h2>+<h2 id="see-also-74">See Also</h2><ul><li><a href="https://rclone.org/commands/rclone_serve/">rclone serve</a> - Serve a remote over a protocol.</li></ul><h1 id="rclone-serve-http">rclone serve http</h1><p>Serve the remote over HTTP.</p>-<h2 id="synopsis-66">Synopsis</h2>+<h2 id="synopsis-68">Synopsis</h2><p>Run a basic web server to serve a remote over HTTP. This can be viewed in a web browser or you can make a remote of type http read from it.</p><p>You can use the filter flags (e.g. <code>--include</code>, <code>--exclude</code>) to control what is served.</p><p>The server will log errors. Use <code>-v</code> to see access logs.</p>@@ -5071,7 +5699,8 @@ htpasswd -B htpasswd anotherUser</code></pre><h3 id="authentication-2">Authentication</h3><p>By default this will serve files without needing a login.</p><p>You can either use an htpasswd file which can take lots of users, or set a single username and password with the <code>--user</code> and <code>--pass</code> flags.</p>-<p>If no static users are configured by either of the above methods, and client certificates are required by the <code>--client-ca</code> flag passed to the server, the client certificate common name will be considered as the username.</p>+<p>Alternatively, you can have the reverse proxy manage authentication and use the username provided in the configured header with <code>--user-from-header</code> (e.g., <code>----user-from-header=x-remote-user</code>). Ensure the proxy is trusted and headers cannot be spoofed, as misconfiguration may lead to unauthorized access.</p>+<p>If either of the above authentication methods is not configured and client certificates are required by the <code>--client-ca</code> flag passed to the server, the client certificate common name will be considered as the username.</p><p>Use <code>--htpasswd /path/to/htpasswd</code> to provide an htpasswd file. This is in standard apache format and supports MD5, SHA1 and BCrypt for basic authentication. Bcrypt is recommended.</p><p>To create an htpasswd file:</p><pre><code>touch htpasswd@@ -5114,7 +5743,7 @@ htpasswd -B htpasswd anotherUser</code></pre><p>If run with <code>-vv</code> rclone will print the location of the file cache. The files are stored in the user cache file area which is OS dependent but can be controlled with <code>--cache-dir</code> or setting the appropriate environment variable.</p><p>The cache has 4 different modes selected by <code>--vfs-cache-mode</code>. The higher the cache mode the more compatible rclone becomes at the cost of using disk space.</p><p>Note that files are written back to the remote only when they are closed and if they haven't been accessed for <code>--vfs-write-back</code> seconds. If rclone is quit or dies with files that haven't been uploaded, these will be uploaded next time rclone is run with the same flags.</p>-<p>If using <code>--vfs-cache-max-size</code> or <code>--vfs-cache-min-free-size</code> note that the cache may exceed these quotas for two reasons. Firstly because it is only checked every <code>--vfs-cache-poll-interval</code>. Secondly because open files cannot be evicted from the cache. When <code>--vfs-cache-max-size</code> or <code>--vfs-cache-min-free-size</code> is exceeded, rclone will attempt to evict the least accessed files from the cache first. rclone will start with files that haven't been accessed for the longest. This cache flushing strategy is efficient and more relevant files are likely to remain cached.</p>+<p>If using <code>--vfs-cache-max-size</code> or <code>--vfs-cache-min-free-space</code> note that the cache may exceed these quotas for two reasons. Firstly because it is only checked every <code>--vfs-cache-poll-interval</code>. Secondly because open files cannot be evicted from the cache. When <code>--vfs-cache-max-size</code> or <code>--vfs-cache-min-free-space</code> is exceeded, rclone will attempt to evict the least accessed files from the cache first. rclone will start with files that haven't been accessed for the longest. This cache flushing strategy is efficient and more relevant files are likely to remain cached.</p><p>The <code>--vfs-cache-max-age</code> will evict files from the cache after the set time since last access has passed. The default value of 1 hour will start evicting files from cache that haven't been accessed for 1 hour. When a cached file is accessed the 1 hour timer is reset to 0 and will wait for 1 more hour before evicting. Specify the time with standard notation, s, m, h, d, w .</p><p>You <strong>should not</strong> run two copies of rclone using the same VFS cache with the same or overlapping remotes if using <code>--vfs-cache-mode > off</code>. This can potentially cause data corruption if you do. You can work around this by giving each rclone its own cache hierarchy with <code>--cache-dir</code>. You don't need to worry about this if the remotes in use don't overlap.</p><h3 id="vfs-cache-mode-off-5">--vfs-cache-mode off</h3>@@ -5225,6 +5854,29 @@ htpasswd -B htpasswd anotherUser</code></pre><h2 id="alternate-report-of-used-bytes-5">Alternate report of used bytes</h2><p>Some backends, most notably S3, do not report the amount of bytes used. If you need this information to be available when running <code>df</code> on the filesystem, then pass the flag <code>--vfs-used-is-size</code> to rclone. With this flag set, instead of relying on the backend to report this information, rclone will scan the whole remote similar to <code>rclone size</code> and compute the total used space itself.</p><p><em>WARNING.</em> Contrary to <code>rclone size</code>, this flag ignores filters so that the result is accurate. However, this is very inefficient and may cost lots of API calls resulting in extra charges. Use it as a last resort and only with caching.</p>+<h2 id="vfs-metadata-5">VFS Metadata</h2>+<p>If you use the <code>--vfs-metadata-extension</code> flag you can get the VFS to expose files which contain the <a href="https://rclone.org/docs/#metadata">metadata</a> as a JSON blob. These files will not appear in the directory listing, but can be <code>stat</code>-ed and opened and once they have been they <strong>will</strong> appear in directory listings until the directory cache expires.</p>+<p>Note that some backends won't create metadata unless you pass in the <code>--metadata</code> flag.</p>+<p>For example, using <code>rclone mount</code> with <code>--metadata --vfs-metadata-extension .metadata</code> we get</p>+<pre><code>$ ls -l /mnt/+total 1048577+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++$ cat /mnt/1G.metadata+{+ "atime": "2025-03-04T17:34:22.317069787Z",+ "btime": "2025-03-03T16:03:37.708253808Z",+ "gid": "1000",+ "mode": "100664",+ "mtime": "2025-03-03T16:03:39.640238323Z",+ "uid": "1000"+}++$ ls -l /mnt/+total 1048578+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+-rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata</code></pre>+<p>If the file has no metadata it will be returned as <code>{}</code> and if there is an error reading the metadata the error will be returned as <code>{"error":"error string"}</code>.</p><h2 id="auth-proxy-1">Auth Proxy</h2><p>If you supply the parameter <code>--auth-proxy /path/to/program</code> then rclone will use that program to generate backends on the fly which then are used to authenticate incoming requests. This uses a simple JSON based protocol with input on STDIN and output on STDOUT.</p><p><strong>PLEASE NOTE:</strong> <code>--auth-proxy</code> and <code>--authorized-keys</code> cannot be used together, if <code>--auth-proxy</code> is set the authorized keys option will be ignored.</p>@@ -5256,20 +5908,20 @@ htpasswd -B htpasswd anotherUser</code></pre><p>Note that an internal cache is keyed on <code>user</code> so only use that for configuration, don't use <code>pass</code> or <code>public_key</code>. This also means that if a user's password or public-key is changed the cache will need to expire (which takes 5 mins) before it takes effect.</p><p>This can be used to build general purpose proxies to any kind of backend that rclone supports.</p><pre><code>rclone serve http remote:path [flags]</code></pre>-<h2 id="options-74">Options</h2>-<pre><code> --addr stringArray IPaddress:Port, :Port or [unix://]/path/to/socket to bind server to (default [127.0.0.1:8080])+<h2 id="options-75">Options</h2>+<pre><code> --addr stringArray IPaddress:Port or :Port to bind server to (default 127.0.0.1:8080)--allow-origin string Origin which cross-domain request (CORS) can be executed from--auth-proxy string A program to use to create the backend from the auth--baseurl string Prefix for URLs - leave blank for root- --cert string Path to TLS PEM public key certificate file (can also include intermediate/CA certificates)- --client-ca string Path to TLS PEM CA file with certificate authorities to verify clients with+ --cert string TLS PEM key (concatenation of certificate and CA certificate)+ --client-ca string Client certificate authority to verify clients with--dir-cache-time Duration Time to cache directory entries for (default 5m0s)--dir-perms FileMode Directory permissions (default 777)--file-perms FileMode File permissions (default 666)--gid uint32 Override the gid field set by the filesystem (not supported on Windows) (default 1000)-h, --help help for http--htpasswd string A htpasswd file - if not provided no authentication is done- --key string Path to TLS PEM private key file+ --key string TLS PEM Private key--link-perms FileMode Link permissions (default 666)--max-header-bytes int Maximum size of request header (default 4096)--min-tls-version string Minimum TLS version that is acceptable (default "tls1.0")@@ -5287,6 +5939,7 @@ htpasswd -B htpasswd anotherUser</code></pre>--uid uint32 Override the uid field set by the filesystem (not supported on Windows) (default 1000)--umask FileMode Override the permission bits set by the filesystem (not supported on Windows) (default 002)--user string User name for authentication+ --user-from-header string User name from a defined HTTP header--vfs-block-norm-dupes If duplicate filenames exist in the same directory (after normalization), log an error and hide the duplicates (may have a performance cost)--vfs-cache-max-age Duration Max time since last access of objects in the cache (default 1h0m0s)--vfs-cache-max-size SizeSuffix Max total size of objects in the cache (default off)@@ -5297,6 +5950,7 @@ htpasswd -B htpasswd anotherUser</code></pre>--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a '.rclonelink' extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached ('off' is unlimited) (default off)@@ -5307,7 +5961,7 @@ htpasswd -B htpasswd anotherUser</code></pre>--vfs-write-back Duration Time to writeback files after last use when using cache (default 5s)--vfs-write-wait Duration Time to wait for in-sequence write before giving error (default 1s)</code></pre><p>Options shared with other commands are described next. See the <a href="https://rclone.org/flags/">global flags page</a> for global options not listed here.</p>-<h3 id="filter-options-26">Filter Options</h3>+<h3 id="filter-options-27">Filter Options</h3><p>Flags for filtering directory listings</p><pre><code> --delete-excluded Delete files on dest excluded from sync--exclude stringArray Exclude files matching pattern@@ -5317,6 +5971,7 @@ htpasswd -B htpasswd anotherUser</code></pre>--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -5331,13 +5986,13 @@ htpasswd -B htpasswd anotherUser</code></pre>--metadata-include-from stringArray Read metadata include patterns from file (use - to read from stdin)--min-age Duration Only transfer files older than this in s or suffix ms|s|m|h|d|w|M|y (default off)--min-size SizeSuffix Only transfer files bigger than this in KiB or suffix B|K|M|G|T|P (default off)</code></pre>-<h2 id="see-also-74">See Also</h2>+<h2 id="see-also-75">See Also</h2><ul><li><a href="https://rclone.org/commands/rclone_serve/">rclone serve</a> - Serve a remote over a protocol.</li></ul><h1 id="rclone-serve-nfs">rclone serve nfs</h1><p>Serve the remote as an NFS mount</p>-<h2 id="synopsis-67">Synopsis</h2>+<h2 id="synopsis-69">Synopsis</h2><p>Create an NFS server that serves the given remote over the network.</p><p>This implements an NFSv3 server to serve any rclone remote via NFS.</p><p>The primary purpose for this command is to enable the <a href="https://rclone.org/commands/rclone_mount/">mount command</a> on recent macOS versions where installing FUSE is very cumbersome.</p>@@ -5346,13 +6001,14 @@ htpasswd -B htpasswd anotherUser</code></pre><p>Modifying files through the NFS protocol requires VFS caching. Usually you will need to specify <code>--vfs-cache-mode</code> in order to be able to write to the mountpoint (<code>full</code> is recommended). If you don't specify VFS cache mode, the mount will be read-only.</p><p><code>--nfs-cache-type</code> controls the type of the NFS handle cache. By default this is <code>memory</code> where new handles will be randomly allocated when needed. These are stored in memory. If the server is restarted the handle cache will be lost and connected NFS clients will get stale handle errors.</p><p><code>--nfs-cache-type disk</code> uses an on disk NFS handle cache. Rclone hashes the path of the object and stores it in a file named after the hash. These hashes are stored on disk the directory controlled by <code>--cache-dir</code> or the exact directory may be specified with <code>--nfs-cache-dir</code>. Using this means that the NFS server can be restarted at will without affecting the connected clients.</p>-<p><code>--nfs-cache-type symlink</code> is similar to <code>--nfs-cache-type disk</code> in that it uses an on disk cache, but the cache entries are held as symlinks. Rclone will use the handle of the underlying file as the NFS handle which improves performance. This sort of cache can't be backed up and restored as the underlying handles will change. This is Linux only. It requres running rclone as root or with <code>CAP_DAC_READ_SEARCH</code>. You can run rclone with this extra permission by doing this to the rclone binary <code>sudo setcap cap_dac_read_search+ep /path/to/rclone</code>.</p>+<p><code>--nfs-cache-type symlink</code> is similar to <code>--nfs-cache-type disk</code> in that it uses an on disk cache, but the cache entries are held as symlinks. Rclone will use the handle of the underlying file as the NFS handle which improves performance. This sort of cache can't be backed up and restored as the underlying handles will change. This is Linux only. It requires running rclone as root or with <code>CAP_DAC_READ_SEARCH</code>. You can run rclone with this extra permission by doing this to the rclone binary <code>sudo setcap cap_dac_read_search+ep /path/to/rclone</code>.</p><p><code>--nfs-cache-handle-limit</code> controls the maximum number of cached NFS handles stored by the caching handler. This should not be set too low or you may experience errors when trying to access files. The default is <code>1000000</code>, but consider lowering this limit if the server's system resource usage causes problems. This is only used by the <code>memory</code> type cache.</p><p>To serve NFS over the network use following command:</p><pre><code>rclone serve nfs remote: --addr 0.0.0.0:$PORT --vfs-cache-mode=full</code></pre><p>This specifies a port that can be used in the mount command. To mount the server under Linux/macOS, use the following command:</p><pre><code>mount -t nfs -o port=$PORT,mountport=$PORT,tcp $HOSTNAME:/ path/to/mountpoint</code></pre><p>Where <code>$PORT</code> is the same port number used in the <code>serve nfs</code> command and <code>$HOSTNAME</code> is the network address of the machine that <code>serve nfs</code> was run on.</p>+<p>If <code>--vfs-metadata-extension</code> is in use then for the <code>--nfs-cache-type disk</code> and <code>--nfs-cache-type cache</code> the metadata files will have the file handle of their parent file suffixed with <code>0x00, 0x00, 0x00, 0x01</code>. This means they can be looked up directly from the parent file handle is desired.</p><p>This command is only available on Unix platforms.</p><h2 id="vfs---virtual-file-system-6">VFS - Virtual File System</h2><p>This command uses the VFS layer. This adapts the cloud storage objects that rclone uses into something which looks much more like a disk filing system.</p>@@ -5388,7 +6044,7 @@ htpasswd -B htpasswd anotherUser</code></pre><p>If run with <code>-vv</code> rclone will print the location of the file cache. The files are stored in the user cache file area which is OS dependent but can be controlled with <code>--cache-dir</code> or setting the appropriate environment variable.</p><p>The cache has 4 different modes selected by <code>--vfs-cache-mode</code>. The higher the cache mode the more compatible rclone becomes at the cost of using disk space.</p><p>Note that files are written back to the remote only when they are closed and if they haven't been accessed for <code>--vfs-write-back</code> seconds. If rclone is quit or dies with files that haven't been uploaded, these will be uploaded next time rclone is run with the same flags.</p>-<p>If using <code>--vfs-cache-max-size</code> or <code>--vfs-cache-min-free-size</code> note that the cache may exceed these quotas for two reasons. Firstly because it is only checked every <code>--vfs-cache-poll-interval</code>. Secondly because open files cannot be evicted from the cache. When <code>--vfs-cache-max-size</code> or <code>--vfs-cache-min-free-size</code> is exceeded, rclone will attempt to evict the least accessed files from the cache first. rclone will start with files that haven't been accessed for the longest. This cache flushing strategy is efficient and more relevant files are likely to remain cached.</p>+<p>If using <code>--vfs-cache-max-size</code> or <code>--vfs-cache-min-free-space</code> note that the cache may exceed these quotas for two reasons. Firstly because it is only checked every <code>--vfs-cache-poll-interval</code>. Secondly because open files cannot be evicted from the cache. When <code>--vfs-cache-max-size</code> or <code>--vfs-cache-min-free-space</code> is exceeded, rclone will attempt to evict the least accessed files from the cache first. rclone will start with files that haven't been accessed for the longest. This cache flushing strategy is efficient and more relevant files are likely to remain cached.</p><p>The <code>--vfs-cache-max-age</code> will evict files from the cache after the set time since last access has passed. The default value of 1 hour will start evicting files from cache that haven't been accessed for 1 hour. When a cached file is accessed the 1 hour timer is reset to 0 and will wait for 1 more hour before evicting. Specify the time with standard notation, s, m, h, d, w .</p><p>You <strong>should not</strong> run two copies of rclone using the same VFS cache with the same or overlapping remotes if using <code>--vfs-cache-mode > off</code>. This can potentially cause data corruption if you do. You can work around this by giving each rclone its own cache hierarchy with <code>--cache-dir</code>. You don't need to worry about this if the remotes in use don't overlap.</p><h3 id="vfs-cache-mode-off-6">--vfs-cache-mode off</h3>@@ -5499,8 +6155,31 @@ htpasswd -B htpasswd anotherUser</code></pre><h2 id="alternate-report-of-used-bytes-6">Alternate report of used bytes</h2><p>Some backends, most notably S3, do not report the amount of bytes used. If you need this information to be available when running <code>df</code> on the filesystem, then pass the flag <code>--vfs-used-is-size</code> to rclone. With this flag set, instead of relying on the backend to report this information, rclone will scan the whole remote similar to <code>rclone size</code> and compute the total used space itself.</p><p><em>WARNING.</em> Contrary to <code>rclone size</code>, this flag ignores filters so that the result is accurate. However, this is very inefficient and may cost lots of API calls resulting in extra charges. Use it as a last resort and only with caching.</p>+<h2 id="vfs-metadata-6">VFS Metadata</h2>+<p>If you use the <code>--vfs-metadata-extension</code> flag you can get the VFS to expose files which contain the <a href="https://rclone.org/docs/#metadata">metadata</a> as a JSON blob. These files will not appear in the directory listing, but can be <code>stat</code>-ed and opened and once they have been they <strong>will</strong> appear in directory listings until the directory cache expires.</p>+<p>Note that some backends won't create metadata unless you pass in the <code>--metadata</code> flag.</p>+<p>For example, using <code>rclone mount</code> with <code>--metadata --vfs-metadata-extension .metadata</code> we get</p>+<pre><code>$ ls -l /mnt/+total 1048577+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++$ cat /mnt/1G.metadata+{+ "atime": "2025-03-04T17:34:22.317069787Z",+ "btime": "2025-03-03T16:03:37.708253808Z",+ "gid": "1000",+ "mode": "100664",+ "mtime": "2025-03-03T16:03:39.640238323Z",+ "uid": "1000"+}++$ ls -l /mnt/+total 1048578+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+-rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata</code></pre>+<p>If the file has no metadata it will be returned as <code>{}</code> and if there is an error reading the metadata the error will be returned as <code>{"error":"error string"}</code>.</p><pre><code>rclone serve nfs remote:path [flags]</code></pre>-<h2 id="options-75">Options</h2>+<h2 id="options-76">Options</h2><pre><code> --addr string IPaddress:Port or :Port to bind server to--dir-cache-time Duration Time to cache directory entries for (default 5m0s)--dir-perms FileMode Directory permissions (default 777)@@ -5528,6 +6207,7 @@ htpasswd -B htpasswd anotherUser</code></pre>--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a '.rclonelink' extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached ('off' is unlimited) (default off)@@ -5538,7 +6218,7 @@ htpasswd -B htpasswd anotherUser</code></pre>--vfs-write-back Duration Time to writeback files after last use when using cache (default 5s)--vfs-write-wait Duration Time to wait for in-sequence write before giving error (default 1s)</code></pre><p>Options shared with other commands are described next. See the <a href="https://rclone.org/flags/">global flags page</a> for global options not listed here.</p>-<h3 id="filter-options-27">Filter Options</h3>+<h3 id="filter-options-28">Filter Options</h3><p>Flags for filtering directory listings</p><pre><code> --delete-excluded Delete files on dest excluded from sync--exclude stringArray Exclude files matching pattern@@ -5548,6 +6228,7 @@ htpasswd -B htpasswd anotherUser</code></pre>--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -5562,13 +6243,13 @@ htpasswd -B htpasswd anotherUser</code></pre>--metadata-include-from stringArray Read metadata include patterns from file (use - to read from stdin)--min-age Duration Only transfer files older than this in s or suffix ms|s|m|h|d|w|M|y (default off)--min-size SizeSuffix Only transfer files bigger than this in KiB or suffix B|K|M|G|T|P (default off)</code></pre>-<h2 id="see-also-75">See Also</h2>+<h2 id="see-also-76">See Also</h2><ul><li><a href="https://rclone.org/commands/rclone_serve/">rclone serve</a> - Serve a remote over a protocol.</li></ul><h1 id="rclone-serve-restic">rclone serve restic</h1><p>Serve the remote for restic's REST API.</p>-<h2 id="synopsis-68">Synopsis</h2>+<h2 id="synopsis-70">Synopsis</h2><p>Run a basic web server to serve a remote over restic's REST backend API over HTTP. This allows restic to use rclone as a data storage mechanism for cloud providers that restic does not support directly.</p><p><a href="https://restic.net/">Restic</a> is a command-line program for doing backups.</p><p>The server will log errors. Use -v to see access logs.</p>@@ -5629,7 +6310,8 @@ $ export RESTIC_REPOSITORY=rest:http://localhost:8080/user2repo/<p>This will socket-activate rclone on the first connection to port 8000 over TCP. ### Authentication</p><p>By default this will serve files without needing a login.</p><p>You can either use an htpasswd file which can take lots of users, or set a single username and password with the <code>--user</code> and <code>--pass</code> flags.</p>-<p>If no static users are configured by either of the above methods, and client certificates are required by the <code>--client-ca</code> flag passed to the server, the client certificate common name will be considered as the username.</p>+<p>Alternatively, you can have the reverse proxy manage authentication and use the username provided in the configured header with <code>--user-from-header</code> (e.g., <code>----user-from-header=x-remote-user</code>). Ensure the proxy is trusted and headers cannot be spoofed, as misconfiguration may lead to unauthorized access.</p>+<p>If either of the above authentication methods is not configured and client certificates are required by the <code>--client-ca</code> flag passed to the server, the client certificate common name will be considered as the username.</p><p>Use <code>--htpasswd /path/to/htpasswd</code> to provide an htpasswd file. This is in standard apache format and supports MD5, SHA1 and BCrypt for basic authentication. Bcrypt is recommended.</p><p>To create an htpasswd file:</p><pre><code>touch htpasswd@@ -5639,17 +6321,17 @@ htpasswd -B htpasswd anotherUser</code></pre><p>Use <code>--realm</code> to set the authentication realm.</p><p>Use <code>--salt</code> to change the password hashing salt from the default.</p><pre><code>rclone serve restic remote:path [flags]</code></pre>-<h2 id="options-76">Options</h2>-<pre><code> --addr stringArray IPaddress:Port, :Port or [unix://]/path/to/socket to bind server to (default [127.0.0.1:8080])+<h2 id="options-77">Options</h2>+<pre><code> --addr stringArray IPaddress:Port or :Port to bind server to (default 127.0.0.1:8080)--allow-origin string Origin which cross-domain request (CORS) can be executed from--append-only Disallow deletion of repository data--baseurl string Prefix for URLs - leave blank for root--cache-objects Cache listed objects (default true)- --cert string Path to TLS PEM public key certificate file (can also include intermediate/CA certificates)- --client-ca string Path to TLS PEM CA file with certificate authorities to verify clients with+ --cert string TLS PEM key (concatenation of certificate and CA certificate)+ --client-ca string Client certificate authority to verify clients with-h, --help help for restic--htpasswd string A htpasswd file - if not provided no authentication is done- --key string Path to TLS PEM private key file+ --key string TLS PEM Private key--max-header-bytes int Maximum size of request header (default 4096)--min-tls-version string Minimum TLS version that is acceptable (default "tls1.0")--pass string Password for authentication@@ -5659,20 +6341,21 @@ htpasswd -B htpasswd anotherUser</code></pre>--server-read-timeout Duration Timeout for server reading data (default 1h0m0s)--server-write-timeout Duration Timeout for server writing data (default 1h0m0s)--stdio Run an HTTP2 server on stdin/stdout- --user string User name for authentication</code></pre>+ --user string User name for authentication+ --user-from-header string User name from a defined HTTP header</code></pre><p>See the <a href="https://rclone.org/flags/">global flags page</a> for global options not listed here.</p>-<h2 id="see-also-76">See Also</h2>+<h2 id="see-also-77">See Also</h2><ul><li><a href="https://rclone.org/commands/rclone_serve/">rclone serve</a> - Serve a remote over a protocol.</li></ul><h1 id="rclone-serve-s3">rclone serve s3</h1><p>Serve remote:path over s3.</p>-<h2 id="synopsis-69">Synopsis</h2>+<h2 id="synopsis-71">Synopsis</h2><p><code>serve s3</code> implements a basic s3 server that serves a remote via s3. This can be viewed with an s3 client, or you can make an <a href="https://rclone.org/s3/">s3 type remote</a> to read and write to it with rclone.</p><p><code>serve s3</code> is considered <strong>Experimental</strong> so use with care.</p><p>S3 server supports Signature Version 4 authentication. Just use <code>--auth-key accessKey,secretKey</code> and set the <code>Authorization</code> header correctly in the request. (See the <a href="https://docs.aws.amazon.com/general/latest/gr/signature-version-4.html">AWS docs</a>).</p><p><code>--auth-key</code> can be repeated for multiple auth pairs. If <code>--auth-key</code> is not provided then <code>serve s3</code> will allow anonymous access.</p>-<p>Please note that some clients may require HTTPS endpoints. See <a href="#ssl-tls">the SSL docs</a> for more information.</p>+<p>Please note that some clients may require HTTPS endpoints. See <a href="#tls-ssl">the SSL docs</a> for more information.</p><p>This command uses the <a href="#vfs-virtual-file-system">VFS directory cache</a>. All the functionality will work with <code>--vfs-cache-mode off</code>. Using <code>--vfs-cache-mode full</code> (or <code>writes</code>) can be used to cache objects locally to improve performance.</p><p>Use <code>--force-path-style=false</code> if you want to use the bucket name as a part of the hostname (such as mybucket.local)</p><p>Use <code>--etag-hash</code> if you want to change the hash uses for the <code>ETag</code>. Note that using anything other than <code>MD5</code> (the default) is likely to cause problems for S3 clients which rely on the Etag being the MD5.</p>@@ -5693,7 +6376,7 @@ endpoint = http://127.0.0.1:8080/access_key_id = ACCESS_KEY_IDsecret_access_key = SECRET_ACCESS_KEYuse_multipart_uploads = false</code></pre>-<p>Note that setting <code>disable_multipart_uploads = true</code> is to work around <a href="#bugs">a bug</a> which will be fixed in due course.</p>+<p>Note that setting <code>use_multipart_uploads = false</code> is to work around <a href="#bugs">a bug</a> which will be fixed in due course.</p><h2 id="bugs">Bugs</h2><p>When uploading multipart files <code>serve s3</code> holds all the parts in memory (see <a href="https://github.com/rclone/rclone/issues/7453">#7453</a>). This is a limitaton of the library rclone uses for serving S3 and will hopefully be fixed at some point.</p><p>Multipart server side copies do not work (see <a href="https://github.com/rclone/rclone/issues/7454">#7454</a>). These take a very long time and eventually fail. The default threshold for multipart server side copies is 5G which is the maximum it can be, so files above this side will fail to be server side copied.</p>@@ -5732,7 +6415,8 @@ use_multipart_uploads = false</code></pre><h3 id="authentication-3">Authentication</h3><p>By default this will serve files without needing a login.</p><p>You can either use an htpasswd file which can take lots of users, or set a single username and password with the <code>--user</code> and <code>--pass</code> flags.</p>-<p>If no static users are configured by either of the above methods, and client certificates are required by the <code>--client-ca</code> flag passed to the server, the client certificate common name will be considered as the username.</p>+<p>Alternatively, you can have the reverse proxy manage authentication and use the username provided in the configured header with <code>--user-from-header</code> (e.g., <code>----user-from-header=x-remote-user</code>). Ensure the proxy is trusted and headers cannot be spoofed, as misconfiguration may lead to unauthorized access.</p>+<p>If either of the above authentication methods is not configured and client certificates are required by the <code>--client-ca</code> flag passed to the server, the client certificate common name will be considered as the username.</p><p>Use <code>--htpasswd /path/to/htpasswd</code> to provide an htpasswd file. This is in standard apache format and supports MD5, SHA1 and BCrypt for basic authentication. Bcrypt is recommended.</p><p>To create an htpasswd file:</p><pre><code>touch htpasswd@@ -5792,7 +6476,7 @@ htpasswd -B htpasswd anotherUser</code></pre><p>If run with <code>-vv</code> rclone will print the location of the file cache. The files are stored in the user cache file area which is OS dependent but can be controlled with <code>--cache-dir</code> or setting the appropriate environment variable.</p><p>The cache has 4 different modes selected by <code>--vfs-cache-mode</code>. The higher the cache mode the more compatible rclone becomes at the cost of using disk space.</p><p>Note that files are written back to the remote only when they are closed and if they haven't been accessed for <code>--vfs-write-back</code> seconds. If rclone is quit or dies with files that haven't been uploaded, these will be uploaded next time rclone is run with the same flags.</p>-<p>If using <code>--vfs-cache-max-size</code> or <code>--vfs-cache-min-free-size</code> note that the cache may exceed these quotas for two reasons. Firstly because it is only checked every <code>--vfs-cache-poll-interval</code>. Secondly because open files cannot be evicted from the cache. When <code>--vfs-cache-max-size</code> or <code>--vfs-cache-min-free-size</code> is exceeded, rclone will attempt to evict the least accessed files from the cache first. rclone will start with files that haven't been accessed for the longest. This cache flushing strategy is efficient and more relevant files are likely to remain cached.</p>+<p>If using <code>--vfs-cache-max-size</code> or <code>--vfs-cache-min-free-space</code> note that the cache may exceed these quotas for two reasons. Firstly because it is only checked every <code>--vfs-cache-poll-interval</code>. Secondly because open files cannot be evicted from the cache. When <code>--vfs-cache-max-size</code> or <code>--vfs-cache-min-free-space</code> is exceeded, rclone will attempt to evict the least accessed files from the cache first. rclone will start with files that haven't been accessed for the longest. This cache flushing strategy is efficient and more relevant files are likely to remain cached.</p><p>The <code>--vfs-cache-max-age</code> will evict files from the cache after the set time since last access has passed. The default value of 1 hour will start evicting files from cache that haven't been accessed for 1 hour. When a cached file is accessed the 1 hour timer is reset to 0 and will wait for 1 more hour before evicting. Specify the time with standard notation, s, m, h, d, w .</p><p>You <strong>should not</strong> run two copies of rclone using the same VFS cache with the same or overlapping remotes if using <code>--vfs-cache-mode > off</code>. This can potentially cause data corruption if you do. You can work around this by giving each rclone its own cache hierarchy with <code>--cache-dir</code>. You don't need to worry about this if the remotes in use don't overlap.</p><h3 id="vfs-cache-mode-off-7">--vfs-cache-mode off</h3>@@ -5903,24 +6587,47 @@ htpasswd -B htpasswd anotherUser</code></pre><h2 id="alternate-report-of-used-bytes-7">Alternate report of used bytes</h2><p>Some backends, most notably S3, do not report the amount of bytes used. If you need this information to be available when running <code>df</code> on the filesystem, then pass the flag <code>--vfs-used-is-size</code> to rclone. With this flag set, instead of relying on the backend to report this information, rclone will scan the whole remote similar to <code>rclone size</code> and compute the total used space itself.</p><p><em>WARNING.</em> Contrary to <code>rclone size</code>, this flag ignores filters so that the result is accurate. However, this is very inefficient and may cost lots of API calls resulting in extra charges. Use it as a last resort and only with caching.</p>+<h2 id="vfs-metadata-7">VFS Metadata</h2>+<p>If you use the <code>--vfs-metadata-extension</code> flag you can get the VFS to expose files which contain the <a href="https://rclone.org/docs/#metadata">metadata</a> as a JSON blob. These files will not appear in the directory listing, but can be <code>stat</code>-ed and opened and once they have been they <strong>will</strong> appear in directory listings until the directory cache expires.</p>+<p>Note that some backends won't create metadata unless you pass in the <code>--metadata</code> flag.</p>+<p>For example, using <code>rclone mount</code> with <code>--metadata --vfs-metadata-extension .metadata</code> we get</p>+<pre><code>$ ls -l /mnt/+total 1048577+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++$ cat /mnt/1G.metadata+{+ "atime": "2025-03-04T17:34:22.317069787Z",+ "btime": "2025-03-03T16:03:37.708253808Z",+ "gid": "1000",+ "mode": "100664",+ "mtime": "2025-03-03T16:03:39.640238323Z",+ "uid": "1000"+}++$ ls -l /mnt/+total 1048578+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+-rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata</code></pre>+<p>If the file has no metadata it will be returned as <code>{}</code> and if there is an error reading the metadata the error will be returned as <code>{"error":"error string"}</code>.</p><pre><code>rclone serve s3 remote:path [flags]</code></pre>-<h2 id="options-77">Options</h2>-<pre><code> --addr stringArray IPaddress:Port, :Port or [unix://]/path/to/socket to bind server to (default [127.0.0.1:8080])+<h2 id="options-78">Options</h2>+<pre><code> --addr stringArray IPaddress:Port or :Port to bind server to (default 127.0.0.1:8080)--allow-origin string Origin which cross-domain request (CORS) can be executed from--auth-key stringArray Set key pair for v4 authorization: access_key_id,secret_access_key--auth-proxy string A program to use to create the backend from the auth--baseurl string Prefix for URLs - leave blank for root- --cert string Path to TLS PEM public key certificate file (can also include intermediate/CA certificates)- --client-ca string Path to TLS PEM CA file with certificate authorities to verify clients with+ --cert string TLS PEM key (concatenation of certificate and CA certificate)+ --client-ca string Client certificate authority to verify clients with--dir-cache-time Duration Time to cache directory entries for (default 5m0s)--dir-perms FileMode Directory permissions (default 777)--etag-hash string Which hash to use for the ETag, or auto or blank for off (default "MD5")--file-perms FileMode File permissions (default 666)- --force-path-style If true use path style access if false use virtual hosted style (default true) (default true)+ --force-path-style If true use path style access if false use virtual hosted style (default true)--gid uint32 Override the gid field set by the filesystem (not supported on Windows) (default 1000)-h, --help help for s3--htpasswd string A htpasswd file - if not provided no authentication is done- --key string Path to TLS PEM private key file+ --key string TLS PEM Private key--link-perms FileMode Link permissions (default 666)--max-header-bytes int Maximum size of request header (default 4096)--min-tls-version string Minimum TLS version that is acceptable (default "tls1.0")@@ -5938,6 +6645,7 @@ htpasswd -B htpasswd anotherUser</code></pre>--uid uint32 Override the uid field set by the filesystem (not supported on Windows) (default 1000)--umask FileMode Override the permission bits set by the filesystem (not supported on Windows) (default 002)--user string User name for authentication+ --user-from-header string User name from a defined HTTP header--vfs-block-norm-dupes If duplicate filenames exist in the same directory (after normalization), log an error and hide the duplicates (may have a performance cost)--vfs-cache-max-age Duration Max time since last access of objects in the cache (default 1h0m0s)--vfs-cache-max-size SizeSuffix Max total size of objects in the cache (default off)@@ -5948,6 +6656,7 @@ htpasswd -B htpasswd anotherUser</code></pre>--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a '.rclonelink' extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached ('off' is unlimited) (default off)@@ -5958,7 +6667,7 @@ htpasswd -B htpasswd anotherUser</code></pre>--vfs-write-back Duration Time to writeback files after last use when using cache (default 5s)--vfs-write-wait Duration Time to wait for in-sequence write before giving error (default 1s)</code></pre><p>Options shared with other commands are described next. See the <a href="https://rclone.org/flags/">global flags page</a> for global options not listed here.</p>-<h3 id="filter-options-28">Filter Options</h3>+<h3 id="filter-options-29">Filter Options</h3><p>Flags for filtering directory listings</p><pre><code> --delete-excluded Delete files on dest excluded from sync--exclude stringArray Exclude files matching pattern@@ -5968,6 +6677,7 @@ htpasswd -B htpasswd anotherUser</code></pre>--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -5982,13 +6692,13 @@ htpasswd -B htpasswd anotherUser</code></pre>--metadata-include-from stringArray Read metadata include patterns from file (use - to read from stdin)--min-age Duration Only transfer files older than this in s or suffix ms|s|m|h|d|w|M|y (default off)--min-size SizeSuffix Only transfer files bigger than this in KiB or suffix B|K|M|G|T|P (default off)</code></pre>-<h2 id="see-also-77">See Also</h2>+<h2 id="see-also-78">See Also</h2><ul><li><a href="https://rclone.org/commands/rclone_serve/">rclone serve</a> - Serve a remote over a protocol.</li></ul><h1 id="rclone-serve-sftp">rclone serve sftp</h1><p>Serve the remote over SFTP.</p>-<h2 id="synopsis-70">Synopsis</h2>+<h2 id="synopsis-72">Synopsis</h2><p>Run an SFTP server to serve a remote over SFTP. This can be used with an SFTP client or you can make a remote of type <a href="/sftp">sftp</a> to use with it.</p><p>You can use the <a href="/filtering">filter</a> flags (e.g. <code>--include</code>, <code>--exclude</code>) to control what is served.</p><p>The server will respond to a small number of shell commands, mainly md5sum, sha1sum and df, which enable it to provide support for checksums and the about feature when accessed from an sftp remote.</p>@@ -6041,7 +6751,7 @@ htpasswd -B htpasswd anotherUser</code></pre><p>If run with <code>-vv</code> rclone will print the location of the file cache. The files are stored in the user cache file area which is OS dependent but can be controlled with <code>--cache-dir</code> or setting the appropriate environment variable.</p><p>The cache has 4 different modes selected by <code>--vfs-cache-mode</code>. The higher the cache mode the more compatible rclone becomes at the cost of using disk space.</p><p>Note that files are written back to the remote only when they are closed and if they haven't been accessed for <code>--vfs-write-back</code> seconds. If rclone is quit or dies with files that haven't been uploaded, these will be uploaded next time rclone is run with the same flags.</p>-<p>If using <code>--vfs-cache-max-size</code> or <code>--vfs-cache-min-free-size</code> note that the cache may exceed these quotas for two reasons. Firstly because it is only checked every <code>--vfs-cache-poll-interval</code>. Secondly because open files cannot be evicted from the cache. When <code>--vfs-cache-max-size</code> or <code>--vfs-cache-min-free-size</code> is exceeded, rclone will attempt to evict the least accessed files from the cache first. rclone will start with files that haven't been accessed for the longest. This cache flushing strategy is efficient and more relevant files are likely to remain cached.</p>+<p>If using <code>--vfs-cache-max-size</code> or <code>--vfs-cache-min-free-space</code> note that the cache may exceed these quotas for two reasons. Firstly because it is only checked every <code>--vfs-cache-poll-interval</code>. Secondly because open files cannot be evicted from the cache. When <code>--vfs-cache-max-size</code> or <code>--vfs-cache-min-free-space</code> is exceeded, rclone will attempt to evict the least accessed files from the cache first. rclone will start with files that haven't been accessed for the longest. This cache flushing strategy is efficient and more relevant files are likely to remain cached.</p><p>The <code>--vfs-cache-max-age</code> will evict files from the cache after the set time since last access has passed. The default value of 1 hour will start evicting files from cache that haven't been accessed for 1 hour. When a cached file is accessed the 1 hour timer is reset to 0 and will wait for 1 more hour before evicting. Specify the time with standard notation, s, m, h, d, w .</p><p>You <strong>should not</strong> run two copies of rclone using the same VFS cache with the same or overlapping remotes if using <code>--vfs-cache-mode > off</code>. This can potentially cause data corruption if you do. You can work around this by giving each rclone its own cache hierarchy with <code>--cache-dir</code>. You don't need to worry about this if the remotes in use don't overlap.</p><h3 id="vfs-cache-mode-off-8">--vfs-cache-mode off</h3>@@ -6152,6 +6862,29 @@ htpasswd -B htpasswd anotherUser</code></pre><h2 id="alternate-report-of-used-bytes-8">Alternate report of used bytes</h2><p>Some backends, most notably S3, do not report the amount of bytes used. If you need this information to be available when running <code>df</code> on the filesystem, then pass the flag <code>--vfs-used-is-size</code> to rclone. With this flag set, instead of relying on the backend to report this information, rclone will scan the whole remote similar to <code>rclone size</code> and compute the total used space itself.</p><p><em>WARNING.</em> Contrary to <code>rclone size</code>, this flag ignores filters so that the result is accurate. However, this is very inefficient and may cost lots of API calls resulting in extra charges. Use it as a last resort and only with caching.</p>+<h2 id="vfs-metadata-8">VFS Metadata</h2>+<p>If you use the <code>--vfs-metadata-extension</code> flag you can get the VFS to expose files which contain the <a href="https://rclone.org/docs/#metadata">metadata</a> as a JSON blob. These files will not appear in the directory listing, but can be <code>stat</code>-ed and opened and once they have been they <strong>will</strong> appear in directory listings until the directory cache expires.</p>+<p>Note that some backends won't create metadata unless you pass in the <code>--metadata</code> flag.</p>+<p>For example, using <code>rclone mount</code> with <code>--metadata --vfs-metadata-extension .metadata</code> we get</p>+<pre><code>$ ls -l /mnt/+total 1048577+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++$ cat /mnt/1G.metadata+{+ "atime": "2025-03-04T17:34:22.317069787Z",+ "btime": "2025-03-03T16:03:37.708253808Z",+ "gid": "1000",+ "mode": "100664",+ "mtime": "2025-03-03T16:03:39.640238323Z",+ "uid": "1000"+}++$ ls -l /mnt/+total 1048578+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+-rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata</code></pre>+<p>If the file has no metadata it will be returned as <code>{}</code> and if there is an error reading the metadata the error will be returned as <code>{"error":"error string"}</code>.</p><h2 id="auth-proxy-2">Auth Proxy</h2><p>If you supply the parameter <code>--auth-proxy /path/to/program</code> then rclone will use that program to generate backends on the fly which then are used to authenticate incoming requests. This uses a simple JSON based protocol with input on STDIN and output on STDOUT.</p><p><strong>PLEASE NOTE:</strong> <code>--auth-proxy</code> and <code>--authorized-keys</code> cannot be used together, if <code>--auth-proxy</code> is set the authorized keys option will be ignored.</p>@@ -6183,7 +6916,7 @@ htpasswd -B htpasswd anotherUser</code></pre><p>Note that an internal cache is keyed on <code>user</code> so only use that for configuration, don't use <code>pass</code> or <code>public_key</code>. This also means that if a user's password or public-key is changed the cache will need to expire (which takes 5 mins) before it takes effect.</p><p>This can be used to build general purpose proxies to any kind of backend that rclone supports.</p><pre><code>rclone serve sftp remote:path [flags]</code></pre>-<h2 id="options-78">Options</h2>+<h2 id="options-79">Options</h2><pre><code> --addr string IPaddress:Port or :Port to bind server to (default "localhost:2022")--auth-proxy string A program to use to create the backend from the auth--authorized-keys string Authorized keys file (default "~/.ssh/authorized_keys")@@ -6215,6 +6948,7 @@ htpasswd -B htpasswd anotherUser</code></pre>--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a '.rclonelink' extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached ('off' is unlimited) (default off)@@ -6225,7 +6959,7 @@ htpasswd -B htpasswd anotherUser</code></pre>--vfs-write-back Duration Time to writeback files after last use when using cache (default 5s)--vfs-write-wait Duration Time to wait for in-sequence write before giving error (default 1s)</code></pre><p>Options shared with other commands are described next. See the <a href="https://rclone.org/flags/">global flags page</a> for global options not listed here.</p>-<h3 id="filter-options-29">Filter Options</h3>+<h3 id="filter-options-30">Filter Options</h3><p>Flags for filtering directory listings</p><pre><code> --delete-excluded Delete files on dest excluded from sync--exclude stringArray Exclude files matching pattern@@ -6235,6 +6969,7 @@ htpasswd -B htpasswd anotherUser</code></pre>--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -6249,13 +6984,13 @@ htpasswd -B htpasswd anotherUser</code></pre>--metadata-include-from stringArray Read metadata include patterns from file (use - to read from stdin)--min-age Duration Only transfer files older than this in s or suffix ms|s|m|h|d|w|M|y (default off)--min-size SizeSuffix Only transfer files bigger than this in KiB or suffix B|K|M|G|T|P (default off)</code></pre>-<h2 id="see-also-78">See Also</h2>+<h2 id="see-also-79">See Also</h2><ul><li><a href="https://rclone.org/commands/rclone_serve/">rclone serve</a> - Serve a remote over a protocol.</li></ul><h1 id="rclone-serve-webdav">rclone serve webdav</h1><p>Serve remote:path over WebDAV.</p>-<h2 id="synopsis-71">Synopsis</h2>+<h2 id="synopsis-73">Synopsis</h2><p>Run a basic WebDAV server to serve a remote over HTTP via the WebDAV protocol. This can be viewed with a WebDAV client, through a web browser, or you can make a remote of type WebDAV to read and write it.</p><h2 id="webdav-options">WebDAV options</h2><h3 id="etag-hash">--etag-hash</h3>@@ -6403,7 +7138,8 @@ htpasswd -B htpasswd anotherUser</code></pre><h3 id="authentication-4">Authentication</h3><p>By default this will serve files without needing a login.</p><p>You can either use an htpasswd file which can take lots of users, or set a single username and password with the <code>--user</code> and <code>--pass</code> flags.</p>-<p>If no static users are configured by either of the above methods, and client certificates are required by the <code>--client-ca</code> flag passed to the server, the client certificate common name will be considered as the username.</p>+<p>Alternatively, you can have the reverse proxy manage authentication and use the username provided in the configured header with <code>--user-from-header</code> (e.g., <code>----user-from-header=x-remote-user</code>). Ensure the proxy is trusted and headers cannot be spoofed, as misconfiguration may lead to unauthorized access.</p>+<p>If either of the above authentication methods is not configured and client certificates are required by the <code>--client-ca</code> flag passed to the server, the client certificate common name will be considered as the username.</p><p>Use <code>--htpasswd /path/to/htpasswd</code> to provide an htpasswd file. This is in standard apache format and supports MD5, SHA1 and BCrypt for basic authentication. Bcrypt is recommended.</p><p>To create an htpasswd file:</p><pre><code>touch htpasswd@@ -6446,7 +7182,7 @@ htpasswd -B htpasswd anotherUser</code></pre><p>If run with <code>-vv</code> rclone will print the location of the file cache. The files are stored in the user cache file area which is OS dependent but can be controlled with <code>--cache-dir</code> or setting the appropriate environment variable.</p><p>The cache has 4 different modes selected by <code>--vfs-cache-mode</code>. The higher the cache mode the more compatible rclone becomes at the cost of using disk space.</p><p>Note that files are written back to the remote only when they are closed and if they haven't been accessed for <code>--vfs-write-back</code> seconds. If rclone is quit or dies with files that haven't been uploaded, these will be uploaded next time rclone is run with the same flags.</p>-<p>If using <code>--vfs-cache-max-size</code> or <code>--vfs-cache-min-free-size</code> note that the cache may exceed these quotas for two reasons. Firstly because it is only checked every <code>--vfs-cache-poll-interval</code>. Secondly because open files cannot be evicted from the cache. When <code>--vfs-cache-max-size</code> or <code>--vfs-cache-min-free-size</code> is exceeded, rclone will attempt to evict the least accessed files from the cache first. rclone will start with files that haven't been accessed for the longest. This cache flushing strategy is efficient and more relevant files are likely to remain cached.</p>+<p>If using <code>--vfs-cache-max-size</code> or <code>--vfs-cache-min-free-space</code> note that the cache may exceed these quotas for two reasons. Firstly because it is only checked every <code>--vfs-cache-poll-interval</code>. Secondly because open files cannot be evicted from the cache. When <code>--vfs-cache-max-size</code> or <code>--vfs-cache-min-free-space</code> is exceeded, rclone will attempt to evict the least accessed files from the cache first. rclone will start with files that haven't been accessed for the longest. This cache flushing strategy is efficient and more relevant files are likely to remain cached.</p><p>The <code>--vfs-cache-max-age</code> will evict files from the cache after the set time since last access has passed. The default value of 1 hour will start evicting files from cache that haven't been accessed for 1 hour. When a cached file is accessed the 1 hour timer is reset to 0 and will wait for 1 more hour before evicting. Specify the time with standard notation, s, m, h, d, w .</p><p>You <strong>should not</strong> run two copies of rclone using the same VFS cache with the same or overlapping remotes if using <code>--vfs-cache-mode > off</code>. This can potentially cause data corruption if you do. You can work around this by giving each rclone its own cache hierarchy with <code>--cache-dir</code>. You don't need to worry about this if the remotes in use don't overlap.</p><h3 id="vfs-cache-mode-off-9">--vfs-cache-mode off</h3>@@ -6557,6 +7293,29 @@ htpasswd -B htpasswd anotherUser</code></pre><h2 id="alternate-report-of-used-bytes-9">Alternate report of used bytes</h2><p>Some backends, most notably S3, do not report the amount of bytes used. If you need this information to be available when running <code>df</code> on the filesystem, then pass the flag <code>--vfs-used-is-size</code> to rclone. With this flag set, instead of relying on the backend to report this information, rclone will scan the whole remote similar to <code>rclone size</code> and compute the total used space itself.</p><p><em>WARNING.</em> Contrary to <code>rclone size</code>, this flag ignores filters so that the result is accurate. However, this is very inefficient and may cost lots of API calls resulting in extra charges. Use it as a last resort and only with caching.</p>+<h2 id="vfs-metadata-9">VFS Metadata</h2>+<p>If you use the <code>--vfs-metadata-extension</code> flag you can get the VFS to expose files which contain the <a href="https://rclone.org/docs/#metadata">metadata</a> as a JSON blob. These files will not appear in the directory listing, but can be <code>stat</code>-ed and opened and once they have been they <strong>will</strong> appear in directory listings until the directory cache expires.</p>+<p>Note that some backends won't create metadata unless you pass in the <code>--metadata</code> flag.</p>+<p>For example, using <code>rclone mount</code> with <code>--metadata --vfs-metadata-extension .metadata</code> we get</p>+<pre><code>$ ls -l /mnt/+total 1048577+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++$ cat /mnt/1G.metadata+{+ "atime": "2025-03-04T17:34:22.317069787Z",+ "btime": "2025-03-03T16:03:37.708253808Z",+ "gid": "1000",+ "mode": "100664",+ "mtime": "2025-03-03T16:03:39.640238323Z",+ "uid": "1000"+}++$ ls -l /mnt/+total 1048578+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+-rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata</code></pre>+<p>If the file has no metadata it will be returned as <code>{}</code> and if there is an error reading the metadata the error will be returned as <code>{"error":"error string"}</code>.</p><h2 id="auth-proxy-3">Auth Proxy</h2><p>If you supply the parameter <code>--auth-proxy /path/to/program</code> then rclone will use that program to generate backends on the fly which then are used to authenticate incoming requests. This uses a simple JSON based protocol with input on STDIN and output on STDOUT.</p><p><strong>PLEASE NOTE:</strong> <code>--auth-proxy</code> and <code>--authorized-keys</code> cannot be used together, if <code>--auth-proxy</code> is set the authorized keys option will be ignored.</p>@@ -6588,13 +7347,13 @@ htpasswd -B htpasswd anotherUser</code></pre><p>Note that an internal cache is keyed on <code>user</code> so only use that for configuration, don't use <code>pass</code> or <code>public_key</code>. This also means that if a user's password or public-key is changed the cache will need to expire (which takes 5 mins) before it takes effect.</p><p>This can be used to build general purpose proxies to any kind of backend that rclone supports.</p><pre><code>rclone serve webdav remote:path [flags]</code></pre>-<h2 id="options-79">Options</h2>-<pre><code> --addr stringArray IPaddress:Port, :Port or [unix://]/path/to/socket to bind server to (default [127.0.0.1:8080])+<h2 id="options-80">Options</h2>+<pre><code> --addr stringArray IPaddress:Port or :Port to bind server to (default 127.0.0.1:8080)--allow-origin string Origin which cross-domain request (CORS) can be executed from--auth-proxy string A program to use to create the backend from the auth--baseurl string Prefix for URLs - leave blank for root- --cert string Path to TLS PEM public key certificate file (can also include intermediate/CA certificates)- --client-ca string Path to TLS PEM CA file with certificate authorities to verify clients with+ --cert string TLS PEM key (concatenation of certificate and CA certificate)+ --client-ca string Client certificate authority to verify clients with--dir-cache-time Duration Time to cache directory entries for (default 5m0s)--dir-perms FileMode Directory permissions (default 777)--disable-dir-list Disable HTML directory list on GET request for a directory@@ -6603,7 +7362,7 @@ htpasswd -B htpasswd anotherUser</code></pre>--gid uint32 Override the gid field set by the filesystem (not supported on Windows) (default 1000)-h, --help help for webdav--htpasswd string A htpasswd file - if not provided no authentication is done- --key string Path to TLS PEM private key file+ --key string TLS PEM Private key--link-perms FileMode Link permissions (default 666)--max-header-bytes int Maximum size of request header (default 4096)--min-tls-version string Minimum TLS version that is acceptable (default "tls1.0")@@ -6621,6 +7380,7 @@ htpasswd -B htpasswd anotherUser</code></pre>--uid uint32 Override the uid field set by the filesystem (not supported on Windows) (default 1000)--umask FileMode Override the permission bits set by the filesystem (not supported on Windows) (default 002)--user string User name for authentication+ --user-from-header string User name from a defined HTTP header--vfs-block-norm-dupes If duplicate filenames exist in the same directory (after normalization), log an error and hide the duplicates (may have a performance cost)--vfs-cache-max-age Duration Max time since last access of objects in the cache (default 1h0m0s)--vfs-cache-max-size SizeSuffix Max total size of objects in the cache (default off)@@ -6631,6 +7391,7 @@ htpasswd -B htpasswd anotherUser</code></pre>--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a '.rclonelink' extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached ('off' is unlimited) (default off)@@ -6641,7 +7402,7 @@ htpasswd -B htpasswd anotherUser</code></pre>--vfs-write-back Duration Time to writeback files after last use when using cache (default 5s)--vfs-write-wait Duration Time to wait for in-sequence write before giving error (default 1s)</code></pre><p>Options shared with other commands are described next. See the <a href="https://rclone.org/flags/">global flags page</a> for global options not listed here.</p>-<h3 id="filter-options-30">Filter Options</h3>+<h3 id="filter-options-31">Filter Options</h3><p>Flags for filtering directory listings</p><pre><code> --delete-excluded Delete files on dest excluded from sync--exclude stringArray Exclude files matching pattern@@ -6651,6 +7412,7 @@ htpasswd -B htpasswd anotherUser</code></pre>--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -6665,13 +7427,13 @@ htpasswd -B htpasswd anotherUser</code></pre>--metadata-include-from stringArray Read metadata include patterns from file (use - to read from stdin)--min-age Duration Only transfer files older than this in s or suffix ms|s|m|h|d|w|M|y (default off)--min-size SizeSuffix Only transfer files bigger than this in KiB or suffix B|K|M|G|T|P (default off)</code></pre>-<h2 id="see-also-79">See Also</h2>+<h2 id="see-also-80">See Also</h2><ul><li><a href="https://rclone.org/commands/rclone_serve/">rclone serve</a> - Serve a remote over a protocol.</li></ul><h1 id="rclone-settier">rclone settier</h1><p>Changes storage class/tier of objects in remote.</p>-<h2 id="synopsis-72">Synopsis</h2>+<h2 id="synopsis-74">Synopsis</h2><p>Changes storage tier or class at remote if supported. Few cloud storage services provides different storage classes on objects, for example AWS S3 and Glacier, Azure Blob storage - Hot, Cool and Archive, Google Cloud Storage, Regional Storage, Nearline, Coldline etc.</p><p>Note that, certain tier changes make objects not available to access immediately. For example tiering to archive in azure blob storage makes objects in frozen state, user can restore by setting tier to Hot/Cool, similarly S3 to Glacier makes object inaccessible.true</p><p>You can use it to tier single object</p>@@ -6681,25 +7443,25 @@ htpasswd -B htpasswd anotherUser</code></pre><p>Or just provide remote directory and all files in directory will be tiered</p><pre><code>rclone settier tier remote:path/dir</code></pre><pre><code>rclone settier tier remote:path [flags]</code></pre>-<h2 id="options-80">Options</h2>+<h2 id="options-81">Options</h2><pre><code> -h, --help help for settier</code></pre><p>See the <a href="https://rclone.org/flags/">global flags page</a> for global options not listed here.</p>-<h2 id="see-also-80">See Also</h2>+<h2 id="see-also-81">See Also</h2><ul><li><a href="https://rclone.org/commands/rclone/">rclone</a> - Show help for rclone commands, flags and backends.</li></ul><h1 id="rclone-test">rclone test</h1><p>Run a test command</p>-<h2 id="synopsis-73">Synopsis</h2>+<h2 id="synopsis-75">Synopsis</h2><p>Rclone test is used to run test commands.</p><p>Select which test command you want with the subcommand, eg</p><pre><code>rclone test memory remote:</code></pre><p>Each subcommand has its own options which you can see in their help.</p><p><strong>NB</strong> Be careful running these commands, they may do strange things so reading their documentation first is recommended.</p>-<h2 id="options-81">Options</h2>+<h2 id="options-82">Options</h2><pre><code> -h, --help help for test</code></pre><p>See the <a href="https://rclone.org/flags/">global flags page</a> for global options not listed here.</p>-<h2 id="see-also-81">See Also</h2>+<h2 id="see-also-82">See Also</h2><ul><li><a href="https://rclone.org/commands/rclone/">rclone</a> - Show help for rclone commands, flags and backends.</li><li><a href="https://rclone.org/commands/rclone_test_changenotify/">rclone test changenotify</a> - Log any change notify requests for the remote passed in.</li>@@ -6712,34 +7474,34 @@ htpasswd -B htpasswd anotherUser</code></pre><h1 id="rclone-test-changenotify">rclone test changenotify</h1><p>Log any change notify requests for the remote passed in.</p><pre><code>rclone test changenotify remote: [flags]</code></pre>-<h2 id="options-82">Options</h2>+<h2 id="options-83">Options</h2><pre><code> -h, --help help for changenotify--poll-interval Duration Time to wait between polling for changes (default 10s)</code></pre><p>See the <a href="https://rclone.org/flags/">global flags page</a> for global options not listed here.</p>-<h2 id="see-also-82">See Also</h2>+<h2 id="see-also-83">See Also</h2><ul><li><a href="https://rclone.org/commands/rclone_test/">rclone test</a> - Run a test command</li></ul><h1 id="rclone-test-histogram">rclone test histogram</h1><p>Makes a histogram of file name characters.</p>-<h2 id="synopsis-74">Synopsis</h2>+<h2 id="synopsis-76">Synopsis</h2><p>This command outputs JSON which shows the histogram of characters used in filenames in the remote:path specified.</p><p>The data doesn't contain any identifying information but is useful for the rclone developers when developing filename compression.</p><pre><code>rclone test histogram [remote:path] [flags]</code></pre>-<h2 id="options-83">Options</h2>+<h2 id="options-84">Options</h2><pre><code> -h, --help help for histogram</code></pre><p>See the <a href="https://rclone.org/flags/">global flags page</a> for global options not listed here.</p>-<h2 id="see-also-83">See Also</h2>+<h2 id="see-also-84">See Also</h2><ul><li><a href="https://rclone.org/commands/rclone_test/">rclone test</a> - Run a test command</li></ul><h1 id="rclone-test-info">rclone test info</h1><p>Discovers file name or other limitations for paths.</p>-<h2 id="synopsis-75">Synopsis</h2>+<h2 id="synopsis-77">Synopsis</h2><p>Discovers what filenames and upload methods are possible to write to the paths passed in and how long they can be. It can take some time. It will write test files into the remote:path passed in. It outputs a bit of go code for each one.</p><p><strong>NB</strong> this can create undeletable files and other hazards - use with care</p><pre><code>rclone test info [remote:path]+ [flags]</code></pre>-<h2 id="options-84">Options</h2>+<h2 id="options-85">Options</h2><pre><code> --all Run all tests--check-base32768 Check can store all possible base32768 characters--check-control Check control characters@@ -6751,14 +7513,14 @@ htpasswd -B htpasswd anotherUser</code></pre>--upload-wait Duration Wait after writing a file (default 0s)--write-json string Write results to file</code></pre><p>See the <a href="https://rclone.org/flags/">global flags page</a> for global options not listed here.</p>-<h2 id="see-also-84">See Also</h2>+<h2 id="see-also-85">See Also</h2><ul><li><a href="https://rclone.org/commands/rclone_test/">rclone test</a> - Run a test command</li></ul><h1 id="rclone-test-makefile">rclone test makefile</h1><p>Make files with random contents of the size given</p><pre><code>rclone test makefile <size> [<file>]+ [flags]</code></pre>-<h2 id="options-85">Options</h2>+<h2 id="options-86">Options</h2><pre><code> --ascii Fill files with random ASCII printable bytes only--chargen Fill files with a ASCII chargen pattern-h, --help help for makefile@@ -6767,14 +7529,14 @@ htpasswd -B htpasswd anotherUser</code></pre>--sparse Make the files sparse (appear to be filled with ASCII 0x00)--zero Fill files with ASCII 0x00</code></pre><p>See the <a href="https://rclone.org/flags/">global flags page</a> for global options not listed here.</p>-<h2 id="see-also-85">See Also</h2>+<h2 id="see-also-86">See Also</h2><ul><li><a href="https://rclone.org/commands/rclone_test/">rclone test</a> - Run a test command</li></ul><h1 id="rclone-test-makefiles">rclone test makefiles</h1><p>Make a random file hierarchy in a directory</p><pre><code>rclone test makefiles <dir> [flags]</code></pre>-<h2 id="options-86">Options</h2>+<h2 id="options-87">Options</h2><pre><code> --ascii Fill files with random ASCII printable bytes only--chargen Fill files with a ASCII chargen pattern--files int Number of files to create (default 1000)@@ -6791,26 +7553,26 @@ htpasswd -B htpasswd anotherUser</code></pre>--sparse Make the files sparse (appear to be filled with ASCII 0x00)--zero Fill files with ASCII 0x00</code></pre><p>See the <a href="https://rclone.org/flags/">global flags page</a> for global options not listed here.</p>-<h2 id="see-also-86">See Also</h2>+<h2 id="see-also-87">See Also</h2><ul><li><a href="https://rclone.org/commands/rclone_test/">rclone test</a> - Run a test command</li></ul><h1 id="rclone-test-memory">rclone test memory</h1><p>Load all the objects at remote:path into memory and report memory stats.</p><pre><code>rclone test memory remote:path [flags]</code></pre>-<h2 id="options-87">Options</h2>+<h2 id="options-88">Options</h2><pre><code> -h, --help help for memory</code></pre><p>See the <a href="https://rclone.org/flags/">global flags page</a> for global options not listed here.</p>-<h2 id="see-also-87">See Also</h2>+<h2 id="see-also-88">See Also</h2><ul><li><a href="https://rclone.org/commands/rclone_test/">rclone test</a> - Run a test command</li></ul><h1 id="rclone-touch">rclone touch</h1><p>Create new file or change file modification time.</p>-<h2 id="synopsis-76">Synopsis</h2>+<h2 id="synopsis-78">Synopsis</h2><p>Set the modification time on file(s) as specified by remote:path to have the current time.</p><p>If remote:path does not exist then a zero sized file will be created, unless <code>--no-create</code> or <code>--recursive</code> is provided.</p>-<p>If <code>--recursive</code> is used then recursively sets the modification time on all existing files that is found under the path. Filters are supported, and you can test with the <code>--dry-run</code> or the <code>--interactive</code>/<code>-i</code> flag.</p>+<p>If <code>--recursive</code> is used then recursively sets the modification time on all existing files that is found under the path. Filters are supported, and you can test with the <code>--dry-run</code> or the <code>--interactive</code>/<code>-i</code> flag. This will touch <code>--transfers</code> files concurrently.</p><p>If <code>--timestamp</code> is used then sets the modification time to that time instead of the current time. Times may be specified as one of:</p><ul><li>'YYMMDD' - e.g. 17.10.30</li>@@ -6819,19 +7581,19 @@ htpasswd -B htpasswd anotherUser</code></pre></ul><p>Note that value of <code>--timestamp</code> is in UTC. If you want local time then add the <code>--localtime</code> flag.</p><pre><code>rclone touch remote:path [flags]</code></pre>-<h2 id="options-88">Options</h2>+<h2 id="options-89">Options</h2><pre><code> -h, --help help for touch--localtime Use localtime for timestamp, not UTC-C, --no-create Do not create the file if it does not exist (implied with --recursive)-R, --recursive Recursively touch all files-t, --timestamp string Use specified time instead of the current time of day</code></pre><p>Options shared with other commands are described next. See the <a href="https://rclone.org/flags/">global flags page</a> for global options not listed here.</p>-<h3 id="important-options-17">Important Options</h3>+<h3 id="important-options-18">Important Options</h3><p>Important flags useful for most commands</p><pre><code> -n, --dry-run Do a trial run with no permanent changes-i, --interactive Enable interactive mode-v, --verbose count Print lots more stuff (repeat for more)</code></pre>-<h3 id="filter-options-31">Filter Options</h3>+<h3 id="filter-options-32">Filter Options</h3><p>Flags for filtering directory listings</p><pre><code> --delete-excluded Delete files on dest excluded from sync--exclude stringArray Exclude files matching pattern@@ -6841,6 +7603,7 @@ htpasswd -B htpasswd anotherUser</code></pre>--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -6855,17 +7618,17 @@ htpasswd -B htpasswd anotherUser</code></pre>--metadata-include-from stringArray Read metadata include patterns from file (use - to read from stdin)--min-age Duration Only transfer files older than this in s or suffix ms|s|m|h|d|w|M|y (default off)--min-size SizeSuffix Only transfer files bigger than this in KiB or suffix B|K|M|G|T|P (default off)</code></pre>-<h3 id="listing-options-20">Listing Options</h3>+<h3 id="listing-options-21">Listing Options</h3><p>Flags for listing directories</p><pre><code> --default-time Time Time to show if modtime is unknown for files and directories (default 2000-01-01T00:00:00Z)--fast-list Use recursive list if available; uses more memory but fewer transactions</code></pre>-<h2 id="see-also-88">See Also</h2>+<h2 id="see-also-89">See Also</h2><ul><li><a href="https://rclone.org/commands/rclone/">rclone</a> - Show help for rclone commands, flags and backends.</li></ul><h1 id="rclone-tree">rclone tree</h1><p>List the contents of the remote in a tree like fashion.</p>-<h2 id="synopsis-77">Synopsis</h2>+<h2 id="synopsis-79">Synopsis</h2><p>Lists the contents of a remote in a similar way to the unix tree command.</p><p>For example</p><pre><code>$ rclone tree remote:path@@ -6882,7 +7645,7 @@ htpasswd -B htpasswd anotherUser</code></pre><p>The tree command has many options for controlling the listing which are compatible with the tree command, for example you can include file sizes with <code>--size</code>. Note that not all of them have short options as they conflict with rclone's short options.</p><p>For a more interactive navigation of the remote see the <a href="https://rclone.org/commands/rclone_ncdu/">ncdu</a> command.</p><pre><code>rclone tree remote:path [flags]</code></pre>-<h2 id="options-89">Options</h2>+<h2 id="options-90">Options</h2><pre><code> -a, --all All files are listed (list . files too)-d, --dirs-only List directories only--dirsfirst List directories before files (-U disables)@@ -6903,7 +7666,7 @@ htpasswd -B htpasswd anotherUser</code></pre>-U, --unsorted Leave files unsorted--version Sort files alphanumerically by version</code></pre><p>Options shared with other commands are described next. See the <a href="https://rclone.org/flags/">global flags page</a> for global options not listed here.</p>-<h3 id="filter-options-32">Filter Options</h3>+<h3 id="filter-options-33">Filter Options</h3><p>Flags for filtering directory listings</p><pre><code> --delete-excluded Delete files on dest excluded from sync--exclude stringArray Exclude files matching pattern@@ -6913,6 +7676,7 @@ htpasswd -B htpasswd anotherUser</code></pre>--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -6927,11 +7691,11 @@ htpasswd -B htpasswd anotherUser</code></pre>--metadata-include-from stringArray Read metadata include patterns from file (use - to read from stdin)--min-age Duration Only transfer files older than this in s or suffix ms|s|m|h|d|w|M|y (default off)--min-size SizeSuffix Only transfer files bigger than this in KiB or suffix B|K|M|G|T|P (default off)</code></pre>-<h3 id="listing-options-21">Listing Options</h3>+<h3 id="listing-options-22">Listing Options</h3><p>Flags for listing directories</p><pre><code> --default-time Time Time to show if modtime is unknown for files and directories (default 2000-01-01T00:00:00Z)--fast-list Use recursive list if available; uses more memory but fewer transactions</code></pre>-<h2 id="see-also-89">See Also</h2>+<h2 id="see-also-90">See Also</h2><ul><li><a href="https://rclone.org/commands/rclone/">rclone</a> - Show help for rclone commands, flags and backends.</li></ul>@@ -7165,9 +7929,10 @@ rclone sync --interactive /path/to/files remote:current-backup</code></pre></table><p>The metadata keys <code>mtime</code> and <code>content-type</code> will take precedence if supplied in the metadata over reading the <code>Content-Type</code> or modification time of the source object.</p><p>Hashes are not included in system metadata as there is a well defined way of reading those already.</p>-<h2 id="options-90">Options</h2>+<h2 id="options-91">Options</h2><p>Rclone has a number of options to control its behaviour.</p><p>Options that take parameters can have the values passed in two ways, <code>--option=value</code> or <code>--option value</code>. However boolean (true/false) options behave slightly differently to the other options in that <code>--boolean</code> sets the option to <code>true</code> and the absence of the flag sets it to <code>false</code>. It is also possible to specify <code>--boolean=false</code> or <code>--boolean=true</code>. Note that <code>--boolean false</code> is not valid - this is parsed as <code>--boolean</code> and the <code>false</code> is parsed as an extra command line argument for rclone.</p>+<p>Options documented to take a <code>stringArray</code> parameter accept multiple values. To pass more than one value, repeat the option; for example: <code>--include value1 --include value2</code>.</p><h3 id="time-option">Time or duration options</h3><p>TIME or DURATION options can be specified as a duration string or a time string.</p><p>A duration string is a possibly signed sequence of decimal numbers, each with optional fraction and a unit suffix, such as "300ms", "-1.5h" or "2h45m". Default units are seconds or the following abbreviations are valid:</p>@@ -7305,9 +8070,10 @@ rclone sync --interactive /path/to/files remote:current-backup</code></pre><li>On Windows: <code>%HOME%</code> if defined, else <code>%USERPROFILE%</code>, or else <code>%HOMEDRIVE%\%HOMEPATH%</code>.</li><li>On Unix: <code>$HOME</code> if defined, else by looking up current user in OS-specific user database (e.g. passwd file), or else use the result from shell command <code>cd && pwd</code>.</li></ul>-<p>If you run <code>rclone config file</code> you will see where the default location is for you.</p>+<p>If you run <code>rclone config file</code> you will see where the default location is for you. Running <code>rclone config touch</code> will ensure a configuration file exists, creating an empty one in the default location if there is none.</p><p>The fact that an existing file <code>rclone.conf</code> in the same directory as the rclone executable is always preferred, means that it is easy to run in "portable" mode by downloading rclone executable to a writable directory and then create an empty file <code>rclone.conf</code> in the same directory.</p>-<p>If the location is set to empty string <code>""</code> or path to a file with name <code>notfound</code>, or the os null device represented by value <code>NUL</code> on Windows and <code>/dev/null</code> on Unix systems, then rclone will keep the config file in memory only.</p>+<p>If the location is set to empty string <code>""</code> or path to a file with name <code>notfound</code>, or the os null device represented by value <code>NUL</code> on Windows and <code>/dev/null</code> on Unix systems, then rclone will keep the configuration file in memory only.</p>+<p>You may see a log message "Config file not found - using defaults" if there is no configuration file. This can be supressed, e.g. if you are using rclone entirely with <a href="https://rclone.org/docs/#backend-path-to-dir">on the fly remotes</a>, by using memory-only configuration file or by creating an empty configuration file, as described above.</p><p>The file format is basic <a href="https://en.wikipedia.org/wiki/INI_file#Format">INI</a>: Sections of text, led by a <code>[section]</code> header and followed by <code>key=value</code> entries on separate lines. In rclone each remote is represented by its own section, where the section name defines the name of the remote. Options are specified as the <code>key=value</code> entries, where the key is the option name without the <code>--backend-</code> prefix, in lowercase and with <code>_</code> instead of <code>-</code>. E.g. option <code>--mega-hard-delete</code> corresponds to key <code>hard_delete</code>. Only backend options can be specified. A special, and required, key <code>type</code> identifies the <a href="https://rclone.org/overview/">storage system</a>, where the value is the internal lowercase name as returned by command <code>rclone help backends</code>. Comments are indicated by <code>;</code> or <code>#</code> at the beginning of a line.</p><p>Example:</p><pre><code>[megaremote]@@ -7459,20 +8225,84 @@ y/n/s/!/q> n</code></pre><p>If you supply this flag then rclone will copy symbolic links from any supported backend backend, and store them as text files, with a <code>.rclonelink</code> suffix in the destination.</p><p>The text file will contain the target of the symbolic link.</p><p>The <code>--links</code> / <code>-l</code> flag enables this feature for all supported backends and the VFS. There are individual flags for just enabling it for the VFS <code>--vfs-links</code> and the local backend <code>--local-links</code> if required.</p>+<h3 id="list-cutoff">--list-cutoff N</h3>+<p>When syncing rclone needs to sort directory entries before comparing them. Below this threshold (1,000,000) by default, rclone will store the directory entries in memory. 1,000,000 entries will take approx 1GB of RAM to store. Above this threshold rclone will store directory entries on disk and sort them without using a lot of memory.</p>+<p>Doing this is slightly less efficient then sorting them in memory and will only work well for the bucket based backends (eg s3, b2, azureblob, swift) but these are the only backends likely to have millions of entries in a directory.</p><h3 id="log-filefile">--log-file=FILE</h3><p>Log all of rclone's output to FILE. This is not active by default. This can be useful for tracking down problems with syncs in combination with the <code>-v</code> flag. See the <a href="#logging">Logging section</a> for more info.</p><p>If FILE exists then rclone will append to it.</p><p>Note that if you are using the <code>logrotate</code> program to manage rclone's logs, then you should use the <code>copytruncate</code> option as rclone doesn't have a signal to rotate logs.</p><h3 id="log-format-list">--log-format LIST</h3>-<p>Comma separated list of log format options. Accepted options are <code>date</code>, <code>time</code>, <code>microseconds</code>, <code>pid</code>, <code>longfile</code>, <code>shortfile</code>, <code>UTC</code>. Any other keywords will be silently ignored. <code>pid</code> will tag log messages with process identifier which useful with <code>rclone mount --daemon</code>. Other accepted options are explained in the <a href="https://pkg.go.dev/log#pkg-constants">go documentation</a>. The default log format is "<code>date</code>,<code>time</code>".</p>+<p>Comma separated list of log format options. The accepted options are:</p>+<ul>+<li><code>date</code> - Add a date in the format YYYY/MM/YY to the log.</li>+<li><code>time</code> - Add a time to the log in format HH:MM:SS.</li>+<li><code>microseconds</code> - Add microseconds to the time in format HH:MM:SS.SSSSSS.</li>+<li><code>UTC</code> - Make the logs in UTC not localtime.</li>+<li><code>longfile</code> - Adds the source file and line number of the log statement.</li>+<li><code>shortfile</code> - Adds the source file and line number of the log statement.</li>+<li><code>pid</code> - Add the process ID to the log - useful with <code>rclone mount --daemon</code>.</li>+<li><code>nolevel</code> - Don't add the level to the log.</li>+<li><code>json</code> - Equivalent to adding <code>--use-json-log</code></li>+</ul>+<p>They are added to the log line in the order above.</p>+<p>The default log format is <code>"date,time"</code>.</p><h3 id="log-level-level">--log-level LEVEL</h3><p>This sets the log level for rclone. The default log level is <code>NOTICE</code>.</p><p><code>DEBUG</code> is equivalent to <code>-vv</code>. It outputs lots of debug info - useful for bug reports and really finding out what rclone is doing.</p><p><code>INFO</code> is equivalent to <code>-v</code>. It outputs information about each transfer and prints stats once a minute by default.</p><p><code>NOTICE</code> is the default log level if no logging flags are supplied. It outputs very little when things are working normally. It outputs warnings and significant events.</p><p><code>ERROR</code> is equivalent to <code>-q</code>. It only outputs error messages.</p>+<h3 id="windows-event-log-level">--windows-event-log LEVEL</h3>+<p>If this is configured (the default is <code>OFF</code>) then logs of this level and above will be logged to the Windows event log in <strong>addition</strong> to the normal logs. These will be logged in JSON format as described below regardless of what format the main logs are configured for.</p>+<p>The Windows event log only has 3 levels of severity <code>Info</code>, <code>Warning</code> and <code>Error</code>. If enabled we map rclone levels like this.</p>+<ul>+<li><code>Error</code> ← <code>ERROR</code> (and above)</li>+<li><code>Warning</code> ← <code>WARNING</code> (note that this level is defined but not currently used).</li>+<li><code>Info</code> ← <code>NOTICE</code>, <code>INFO</code> and <code>DEBUG</code>.</li>+</ul>+<p>Rclone will declare its log source as "rclone" if it is has enough permissions to create the registry key needed. If not then logs will appear as "Application". You can run <code>rclone version --windows-event-log DEBUG</code> once as administrator to create the registry key in advance.</p>+<p><strong>Note</strong> that the <code>--windows-event-log</code> level must be greater (more severe) than or equal to the <code>--log-level</code>. For example to log DEBUG to a log file but ERRORs to the event log you would use</p>+<pre><code>--log-file rclone.log --log-level DEBUG --windows-event-log ERROR</code></pre>+<p>This option is only supported Windows platforms.</p><h3 id="use-json-log">--use-json-log</h3>-<p>This switches the log format to JSON for rclone. The fields of json log are level, msg, source, time.</p>+<p>This switches the log format to JSON for rclone. The fields of JSON log are <code>level</code>, <code>msg</code>, <code>source</code>, <code>time</code>. The JSON logs will be printed on a single line, but are shown expanded here for clarity.</p>+<div class="sourceCode" id="cb654"><pre class="sourceCode json"><code class="sourceCode json"><span id="cb654-1"><a href="#cb654-1" aria-hidden="true"></a><span class="fu">{</span></span>+<span id="cb654-2"><a href="#cb654-2" aria-hidden="true"></a> <span class="dt">"time"</span><span class="fu">:</span> <span class="st">"2025-05-13T17:30:51.036237518+01:00"</span><span class="fu">,</span></span>+<span id="cb654-3"><a href="#cb654-3" aria-hidden="true"></a> <span class="dt">"level"</span><span class="fu">:</span> <span class="st">"debug"</span><span class="fu">,</span></span>+<span id="cb654-4"><a href="#cb654-4" aria-hidden="true"></a> <span class="dt">"msg"</span><span class="fu">:</span> <span class="st">"4 go routines active</span><span class="ch">\n</span><span class="st">"</span><span class="fu">,</span></span>+<span id="cb654-5"><a href="#cb654-5" aria-hidden="true"></a> <span class="dt">"source"</span><span class="fu">:</span> <span class="st">"cmd/cmd.go:298"</span></span>+<span id="cb654-6"><a href="#cb654-6" aria-hidden="true"></a><span class="fu">}</span></span></code></pre></div>+<p>Completed data transfer logs will have extra <code>size</code> information. Logs which are about a particular object will have <code>object</code> and <code>objectType</code> fields also.</p>+<div class="sourceCode" id="cb655"><pre class="sourceCode json"><code class="sourceCode json"><span id="cb655-1"><a href="#cb655-1" aria-hidden="true"></a><span class="fu">{</span></span>+<span id="cb655-2"><a href="#cb655-2" aria-hidden="true"></a> <span class="dt">"time"</span><span class="fu">:</span> <span class="st">"2025-05-13T17:38:05.540846352+01:00"</span><span class="fu">,</span></span>+<span id="cb655-3"><a href="#cb655-3" aria-hidden="true"></a> <span class="dt">"level"</span><span class="fu">:</span> <span class="st">"info"</span><span class="fu">,</span></span>+<span id="cb655-4"><a href="#cb655-4" aria-hidden="true"></a> <span class="dt">"msg"</span><span class="fu">:</span> <span class="st">"Copied (new) to: file2.txt"</span><span class="fu">,</span></span>+<span id="cb655-5"><a href="#cb655-5" aria-hidden="true"></a> <span class="dt">"size"</span><span class="fu">:</span> <span class="dv">6</span><span class="fu">,</span></span>+<span id="cb655-6"><a href="#cb655-6" aria-hidden="true"></a> <span class="dt">"object"</span><span class="fu">:</span> <span class="st">"file.txt"</span><span class="fu">,</span></span>+<span id="cb655-7"><a href="#cb655-7" aria-hidden="true"></a> <span class="dt">"objectType"</span><span class="fu">:</span> <span class="st">"*local.Object"</span><span class="fu">,</span></span>+<span id="cb655-8"><a href="#cb655-8" aria-hidden="true"></a> <span class="dt">"source"</span><span class="fu">:</span> <span class="st">"operations/copy.go:368"</span></span>+<span id="cb655-9"><a href="#cb655-9" aria-hidden="true"></a><span class="fu">}</span></span></code></pre></div>+<p>Stats logs will contain a <code>stats</code> field which is the same as returned from the rc call <a href="https://rclone.org/rc/#core-stats">core/stats</a>.</p>+<div class="sourceCode" id="cb656"><pre class="sourceCode json"><code class="sourceCode json"><span id="cb656-1"><a href="#cb656-1" aria-hidden="true"></a><span class="fu">{</span></span>+<span id="cb656-2"><a href="#cb656-2" aria-hidden="true"></a> <span class="dt">"time"</span><span class="fu">:</span> <span class="st">"2025-05-13T17:38:05.540912847+01:00"</span><span class="fu">,</span></span>+<span id="cb656-3"><a href="#cb656-3" aria-hidden="true"></a> <span class="dt">"level"</span><span class="fu">:</span> <span class="st">"info"</span><span class="fu">,</span></span>+<span id="cb656-4"><a href="#cb656-4" aria-hidden="true"></a> <span class="dt">"msg"</span><span class="fu">:</span> <span class="st">"...text version of the stats..."</span><span class="fu">,</span></span>+<span id="cb656-5"><a href="#cb656-5" aria-hidden="true"></a> <span class="dt">"stats"</span><span class="fu">:</span> <span class="fu">{</span></span>+<span id="cb656-6"><a href="#cb656-6" aria-hidden="true"></a> <span class="dt">"bytes"</span><span class="fu">:</span> <span class="dv">6</span><span class="fu">,</span></span>+<span id="cb656-7"><a href="#cb656-7" aria-hidden="true"></a> <span class="dt">"checks"</span><span class="fu">:</span> <span class="dv">0</span><span class="fu">,</span></span>+<span id="cb656-8"><a href="#cb656-8" aria-hidden="true"></a> <span class="dt">"deletedDirs"</span><span class="fu">:</span> <span class="dv">0</span><span class="fu">,</span></span>+<span id="cb656-9"><a href="#cb656-9" aria-hidden="true"></a> <span class="dt">"deletes"</span><span class="fu">:</span> <span class="dv">0</span><span class="fu">,</span></span>+<span id="cb656-10"><a href="#cb656-10" aria-hidden="true"></a> <span class="dt">"elapsedTime"</span><span class="fu">:</span> <span class="fl">0.000904825</span><span class="fu">,</span></span>+<span id="cb656-11"><a href="#cb656-11" aria-hidden="true"></a> <span class="er">...truncated</span> <span class="er">for</span> <span class="er">clarity...</span></span>+<span id="cb656-12"><a href="#cb656-12" aria-hidden="true"></a> <span class="dt">"totalBytes"</span><span class="fu">:</span> <span class="dv">6</span><span class="fu">,</span></span>+<span id="cb656-13"><a href="#cb656-13" aria-hidden="true"></a> <span class="dt">"totalChecks"</span><span class="fu">:</span> <span class="dv">0</span><span class="fu">,</span></span>+<span id="cb656-14"><a href="#cb656-14" aria-hidden="true"></a> <span class="dt">"totalTransfers"</span><span class="fu">:</span> <span class="dv">1</span><span class="fu">,</span></span>+<span id="cb656-15"><a href="#cb656-15" aria-hidden="true"></a> <span class="dt">"transferTime"</span><span class="fu">:</span> <span class="fl">0.000882794</span><span class="fu">,</span></span>+<span id="cb656-16"><a href="#cb656-16" aria-hidden="true"></a> <span class="dt">"transfers"</span><span class="fu">:</span> <span class="dv">1</span></span>+<span id="cb656-17"><a href="#cb656-17" aria-hidden="true"></a> <span class="fu">},</span></span>+<span id="cb656-18"><a href="#cb656-18" aria-hidden="true"></a> <span class="dt">"source"</span><span class="fu">:</span> <span class="st">"accounting/stats.go:569"</span></span>+<span id="cb656-19"><a href="#cb656-19" aria-hidden="true"></a><span class="fu">}</span></span></code></pre></div><h3 id="low-level-retries-number">--low-level-retries NUMBER</h3><p>This controls the number of low level retries rclone does.</p><p>A low level retry is used to retry a failing operation - typically one HTTP request. This might be uploading a chunk of a big file for example. You will see low level retries in the log with the <code>-v</code> flag.</p>@@ -7484,6 +8314,19 @@ y/n/s/!/q> n</code></pre><p>Setting this large allows rclone to calculate how many files are pending more accurately, give a more accurate estimated finish time and make <code>--order-by</code> work more accurately.</p><p>Setting this small will make rclone more synchronous to the listings of the remote which may be desirable.</p><p>Setting this to a negative number will make the backlog as large as possible.</p>+<h3 id="max-buffer-memory">--max-buffer-memory=SIZE</h3>+<p>If set, don't allocate more than SIZE amount of memory as buffers. If not set or set to <code>0</code> or <code>off</code> this will not limit the amount of memory in use.</p>+<p>This includes memory used by buffers created by the <code>--buffer</code> flag and buffers used by multi-thread transfers.</p>+<p>Most multi-thread transfers do not take additional memory, but some do depending on the backend (eg the s3 backend for uploads). This means there is a tension between total setting <code>--transfers</code> as high as possible and memory use.</p>+<p>Setting <code>--max-buffer-memory</code> allows the buffer memory to be controlled so that it doesn't overwhelm the machine and allows <code>--transfers</code> to be set large.</p>+<h3 id="max-connectionsn">--max-connections=N</h3>+<p>This sets the maximum number of concurrent calls to the backend API. It may not map 1:1 to TCP or HTTP connections depending on the backend in use and the use of HTTP1 vs HTTP2.</p>+<p>When downloading files, backends only limit the initial opening of the stream. The bulk data download is not counted as a connection. This means that the <code>--max--connections</code> flag won't limit the total number of downloads.</p>+<p>Note that it is possible to cause deadlocks with this setting so it should be used with care.</p>+<p>If you are doing a sync or copy then make sure <code>--max-connections</code> is one more than the sum of <code>--transfers</code> and <code>--checkers</code>.</p>+<p>If you use <code>--check-first</code> then <code>--max-connections</code> just needs to be one more than the maximum of <code>--checkers</code> and <code>--transfers</code>.</p>+<p>So for <code>--max-connections 3</code> you'd use <code>--checkers 2 --transfers 2 --check-first</code> or <code>--checkers 1 --transfers 1</code>.</p>+<p>Setting this flag can be useful for backends which do multipart uploads to limit the number of simultaneous parts being transferred.</p><h3 id="max-deleten">--max-delete=N</h3><p>This tells rclone not to delete more than N files. If that limit is exceeded then a fatal error will be generated and rclone will stop the operation in progress.</p><h3 id="max-delete-sizesize">--max-delete-size=SIZE</h3>@@ -7530,55 +8373,55 @@ y/n/s/!/q> n</code></pre><li><code>ID</code> is the source <code>ID</code> of the object if known.</li><li><code>Metadata</code> is the backend specific metadata as described in the backend docs.</li></ul>-<div class="sourceCode" id="cb618"><pre class="sourceCode json"><code class="sourceCode json"><span id="cb618-1"><a href="#cb618-1" aria-hidden="true"></a><span class="fu">{</span></span>-<span id="cb618-2"><a href="#cb618-2" aria-hidden="true"></a> <span class="dt">"SrcFs"</span><span class="fu">:</span> <span class="st">"gdrive:"</span><span class="fu">,</span></span>-<span id="cb618-3"><a href="#cb618-3" aria-hidden="true"></a> <span class="dt">"SrcFsType"</span><span class="fu">:</span> <span class="st">"drive"</span><span class="fu">,</span></span>-<span id="cb618-4"><a href="#cb618-4" aria-hidden="true"></a> <span class="dt">"DstFs"</span><span class="fu">:</span> <span class="st">"newdrive:user"</span><span class="fu">,</span></span>-<span id="cb618-5"><a href="#cb618-5" aria-hidden="true"></a> <span class="dt">"DstFsType"</span><span class="fu">:</span> <span class="st">"onedrive"</span><span class="fu">,</span></span>-<span id="cb618-6"><a href="#cb618-6" aria-hidden="true"></a> <span class="dt">"Remote"</span><span class="fu">:</span> <span class="st">"test.txt"</span><span class="fu">,</span></span>-<span id="cb618-7"><a href="#cb618-7" aria-hidden="true"></a> <span class="dt">"Size"</span><span class="fu">:</span> <span class="dv">6</span><span class="fu">,</span></span>-<span id="cb618-8"><a href="#cb618-8" aria-hidden="true"></a> <span class="dt">"MimeType"</span><span class="fu">:</span> <span class="st">"text/plain; charset=utf-8"</span><span class="fu">,</span></span>-<span id="cb618-9"><a href="#cb618-9" aria-hidden="true"></a> <span class="dt">"ModTime"</span><span class="fu">:</span> <span class="st">"2022-10-11T17:53:10.286745272+01:00"</span><span class="fu">,</span></span>-<span id="cb618-10"><a href="#cb618-10" aria-hidden="true"></a> <span class="dt">"IsDir"</span><span class="fu">:</span> <span class="kw">false</span><span class="fu">,</span></span>-<span id="cb618-11"><a href="#cb618-11" aria-hidden="true"></a> <span class="dt">"ID"</span><span class="fu">:</span> <span class="st">"xyz"</span><span class="fu">,</span></span>-<span id="cb618-12"><a href="#cb618-12" aria-hidden="true"></a> <span class="dt">"Metadata"</span><span class="fu">:</span> <span class="fu">{</span></span>-<span id="cb618-13"><a href="#cb618-13" aria-hidden="true"></a> <span class="dt">"btime"</span><span class="fu">:</span> <span class="st">"2022-10-11T16:53:11Z"</span><span class="fu">,</span></span>-<span id="cb618-14"><a href="#cb618-14" aria-hidden="true"></a> <span class="dt">"content-type"</span><span class="fu">:</span> <span class="st">"text/plain; charset=utf-8"</span><span class="fu">,</span></span>-<span id="cb618-15"><a href="#cb618-15" aria-hidden="true"></a> <span class="dt">"mtime"</span><span class="fu">:</span> <span class="st">"2022-10-11T17:53:10.286745272+01:00"</span><span class="fu">,</span></span>-<span id="cb618-16"><a href="#cb618-16" aria-hidden="true"></a> <span class="dt">"owner"</span><span class="fu">:</span> <span class="st">"[email protected]"</span><span class="fu">,</span></span>-<span id="cb618-17"><a href="#cb618-17" aria-hidden="true"></a> <span class="dt">"permissions"</span><span class="fu">:</span> <span class="st">"..."</span><span class="fu">,</span></span>-<span id="cb618-18"><a href="#cb618-18" aria-hidden="true"></a> <span class="dt">"description"</span><span class="fu">:</span> <span class="st">"my nice file"</span><span class="fu">,</span></span>-<span id="cb618-19"><a href="#cb618-19" aria-hidden="true"></a> <span class="dt">"starred"</span><span class="fu">:</span> <span class="st">"false"</span></span>-<span id="cb618-20"><a href="#cb618-20" aria-hidden="true"></a> <span class="fu">}</span></span>-<span id="cb618-21"><a href="#cb618-21" aria-hidden="true"></a><span class="fu">}</span></span></code></pre></div>+<div class="sourceCode" id="cb658"><pre class="sourceCode json"><code class="sourceCode json"><span id="cb658-1"><a href="#cb658-1" aria-hidden="true"></a><span class="fu">{</span></span>+<span id="cb658-2"><a href="#cb658-2" aria-hidden="true"></a> <span class="dt">"SrcFs"</span><span class="fu">:</span> <span class="st">"gdrive:"</span><span class="fu">,</span></span>+<span id="cb658-3"><a href="#cb658-3" aria-hidden="true"></a> <span class="dt">"SrcFsType"</span><span class="fu">:</span> <span class="st">"drive"</span><span class="fu">,</span></span>+<span id="cb658-4"><a href="#cb658-4" aria-hidden="true"></a> <span class="dt">"DstFs"</span><span class="fu">:</span> <span class="st">"newdrive:user"</span><span class="fu">,</span></span>+<span id="cb658-5"><a href="#cb658-5" aria-hidden="true"></a> <span class="dt">"DstFsType"</span><span class="fu">:</span> <span class="st">"onedrive"</span><span class="fu">,</span></span>+<span id="cb658-6"><a href="#cb658-6" aria-hidden="true"></a> <span class="dt">"Remote"</span><span class="fu">:</span> <span class="st">"test.txt"</span><span class="fu">,</span></span>+<span id="cb658-7"><a href="#cb658-7" aria-hidden="true"></a> <span class="dt">"Size"</span><span class="fu">:</span> <span class="dv">6</span><span class="fu">,</span></span>+<span id="cb658-8"><a href="#cb658-8" aria-hidden="true"></a> <span class="dt">"MimeType"</span><span class="fu">:</span> <span class="st">"text/plain; charset=utf-8"</span><span class="fu">,</span></span>+<span id="cb658-9"><a href="#cb658-9" aria-hidden="true"></a> <span class="dt">"ModTime"</span><span class="fu">:</span> <span class="st">"2022-10-11T17:53:10.286745272+01:00"</span><span class="fu">,</span></span>+<span id="cb658-10"><a href="#cb658-10" aria-hidden="true"></a> <span class="dt">"IsDir"</span><span class="fu">:</span> <span class="kw">false</span><span class="fu">,</span></span>+<span id="cb658-11"><a href="#cb658-11" aria-hidden="true"></a> <span class="dt">"ID"</span><span class="fu">:</span> <span class="st">"xyz"</span><span class="fu">,</span></span>+<span id="cb658-12"><a href="#cb658-12" aria-hidden="true"></a> <span class="dt">"Metadata"</span><span class="fu">:</span> <span class="fu">{</span></span>+<span id="cb658-13"><a href="#cb658-13" aria-hidden="true"></a> <span class="dt">"btime"</span><span class="fu">:</span> <span class="st">"2022-10-11T16:53:11Z"</span><span class="fu">,</span></span>+<span id="cb658-14"><a href="#cb658-14" aria-hidden="true"></a> <span class="dt">"content-type"</span><span class="fu">:</span> <span class="st">"text/plain; charset=utf-8"</span><span class="fu">,</span></span>+<span id="cb658-15"><a href="#cb658-15" aria-hidden="true"></a> <span class="dt">"mtime"</span><span class="fu">:</span> <span class="st">"2022-10-11T17:53:10.286745272+01:00"</span><span class="fu">,</span></span>+<span id="cb658-16"><a href="#cb658-16" aria-hidden="true"></a> <span class="dt">"owner"</span><span class="fu">:</span> <span class="st">"[email protected]"</span><span class="fu">,</span></span>+<span id="cb658-17"><a href="#cb658-17" aria-hidden="true"></a> <span class="dt">"permissions"</span><span class="fu">:</span> <span class="st">"..."</span><span class="fu">,</span></span>+<span id="cb658-18"><a href="#cb658-18" aria-hidden="true"></a> <span class="dt">"description"</span><span class="fu">:</span> <span class="st">"my nice file"</span><span class="fu">,</span></span>+<span id="cb658-19"><a href="#cb658-19" aria-hidden="true"></a> <span class="dt">"starred"</span><span class="fu">:</span> <span class="st">"false"</span></span>+<span id="cb658-20"><a href="#cb658-20" aria-hidden="true"></a> <span class="fu">}</span></span>+<span id="cb658-21"><a href="#cb658-21" aria-hidden="true"></a><span class="fu">}</span></span></code></pre></div><p>The program should then modify the input as desired and send it to STDOUT. The returned <code>Metadata</code> field will be used in its entirety for the destination object. Any other fields will be ignored. Note in this example we translate user names and permissions and add something to the description:</p>-<div class="sourceCode" id="cb619"><pre class="sourceCode json"><code class="sourceCode json"><span id="cb619-1"><a href="#cb619-1" aria-hidden="true"></a><span class="fu">{</span></span>-<span id="cb619-2"><a href="#cb619-2" aria-hidden="true"></a> <span class="dt">"Metadata"</span><span class="fu">:</span> <span class="fu">{</span></span>-<span id="cb619-3"><a href="#cb619-3" aria-hidden="true"></a> <span class="dt">"btime"</span><span class="fu">:</span> <span class="st">"2022-10-11T16:53:11Z"</span><span class="fu">,</span></span>-<span id="cb619-4"><a href="#cb619-4" aria-hidden="true"></a> <span class="dt">"content-type"</span><span class="fu">:</span> <span class="st">"text/plain; charset=utf-8"</span><span class="fu">,</span></span>-<span id="cb619-5"><a href="#cb619-5" aria-hidden="true"></a> <span class="dt">"mtime"</span><span class="fu">:</span> <span class="st">"2022-10-11T17:53:10.286745272+01:00"</span><span class="fu">,</span></span>-<span id="cb619-6"><a href="#cb619-6" aria-hidden="true"></a> <span class="dt">"owner"</span><span class="fu">:</span> <span class="st">"[email protected]"</span><span class="fu">,</span></span>-<span id="cb619-7"><a href="#cb619-7" aria-hidden="true"></a> <span class="dt">"permissions"</span><span class="fu">:</span> <span class="st">"..."</span><span class="fu">,</span></span>-<span id="cb619-8"><a href="#cb619-8" aria-hidden="true"></a> <span class="dt">"description"</span><span class="fu">:</span> <span class="st">"my nice file [migrated from domain1]"</span><span class="fu">,</span></span>-<span id="cb619-9"><a href="#cb619-9" aria-hidden="true"></a> <span class="dt">"starred"</span><span class="fu">:</span> <span class="st">"false"</span></span>-<span id="cb619-10"><a href="#cb619-10" aria-hidden="true"></a> <span class="fu">}</span></span>-<span id="cb619-11"><a href="#cb619-11" aria-hidden="true"></a><span class="fu">}</span></span></code></pre></div>+<div class="sourceCode" id="cb659"><pre class="sourceCode json"><code class="sourceCode json"><span id="cb659-1"><a href="#cb659-1" aria-hidden="true"></a><span class="fu">{</span></span>+<span id="cb659-2"><a href="#cb659-2" aria-hidden="true"></a> <span class="dt">"Metadata"</span><span class="fu">:</span> <span class="fu">{</span></span>+<span id="cb659-3"><a href="#cb659-3" aria-hidden="true"></a> <span class="dt">"btime"</span><span class="fu">:</span> <span class="st">"2022-10-11T16:53:11Z"</span><span class="fu">,</span></span>+<span id="cb659-4"><a href="#cb659-4" aria-hidden="true"></a> <span class="dt">"content-type"</span><span class="fu">:</span> <span class="st">"text/plain; charset=utf-8"</span><span class="fu">,</span></span>+<span id="cb659-5"><a href="#cb659-5" aria-hidden="true"></a> <span class="dt">"mtime"</span><span class="fu">:</span> <span class="st">"2022-10-11T17:53:10.286745272+01:00"</span><span class="fu">,</span></span>+<span id="cb659-6"><a href="#cb659-6" aria-hidden="true"></a> <span class="dt">"owner"</span><span class="fu">:</span> <span class="st">"[email protected]"</span><span class="fu">,</span></span>+<span id="cb659-7"><a href="#cb659-7" aria-hidden="true"></a> <span class="dt">"permissions"</span><span class="fu">:</span> <span class="st">"..."</span><span class="fu">,</span></span>+<span id="cb659-8"><a href="#cb659-8" aria-hidden="true"></a> <span class="dt">"description"</span><span class="fu">:</span> <span class="st">"my nice file [migrated from domain1]"</span><span class="fu">,</span></span>+<span id="cb659-9"><a href="#cb659-9" aria-hidden="true"></a> <span class="dt">"starred"</span><span class="fu">:</span> <span class="st">"false"</span></span>+<span id="cb659-10"><a href="#cb659-10" aria-hidden="true"></a> <span class="fu">}</span></span>+<span id="cb659-11"><a href="#cb659-11" aria-hidden="true"></a><span class="fu">}</span></span></code></pre></div><p>Metadata can be removed here too.</p><p>An example python program might look something like this to implement the above transformations.</p>-<div class="sourceCode" id="cb620"><pre class="sourceCode python"><code class="sourceCode python"><span id="cb620-1"><a href="#cb620-1" aria-hidden="true"></a><span class="im">import</span> sys, json</span>-<span id="cb620-2"><a href="#cb620-2" aria-hidden="true"></a></span>-<span id="cb620-3"><a href="#cb620-3" aria-hidden="true"></a>i <span class="op">=</span> json.load(sys.stdin)</span>-<span id="cb620-4"><a href="#cb620-4" aria-hidden="true"></a>metadata <span class="op">=</span> i[<span class="st">"Metadata"</span>]</span>-<span id="cb620-5"><a href="#cb620-5" aria-hidden="true"></a><span class="co"># Add tag to description</span></span>-<span id="cb620-6"><a href="#cb620-6" aria-hidden="true"></a><span class="cf">if</span> <span class="st">"description"</span> <span class="kw">in</span> metadata:</span>-<span id="cb620-7"><a href="#cb620-7" aria-hidden="true"></a> metadata[<span class="st">"description"</span>] <span class="op">+=</span> <span class="st">" [migrated from domain1]"</span></span>-<span id="cb620-8"><a href="#cb620-8" aria-hidden="true"></a><span class="cf">else</span>:</span>-<span id="cb620-9"><a href="#cb620-9" aria-hidden="true"></a> metadata[<span class="st">"description"</span>] <span class="op">=</span> <span class="st">"[migrated from domain1]"</span></span>-<span id="cb620-10"><a href="#cb620-10" aria-hidden="true"></a><span class="co"># Modify owner</span></span>-<span id="cb620-11"><a href="#cb620-11" aria-hidden="true"></a><span class="cf">if</span> <span class="st">"owner"</span> <span class="kw">in</span> metadata:</span>-<span id="cb620-12"><a href="#cb620-12" aria-hidden="true"></a> metadata[<span class="st">"owner"</span>] <span class="op">=</span> metadata[<span class="st">"owner"</span>].replace(<span class="st">"domain1.com"</span>, <span class="st">"domain2.com"</span>)</span>-<span id="cb620-13"><a href="#cb620-13" aria-hidden="true"></a>o <span class="op">=</span> { <span class="st">"Metadata"</span>: metadata }</span>-<span id="cb620-14"><a href="#cb620-14" aria-hidden="true"></a>json.dump(o, sys.stdout, indent<span class="op">=</span><span class="st">"</span><span class="ch">\t</span><span class="st">"</span>)</span></code></pre></div>+<div class="sourceCode" id="cb660"><pre class="sourceCode python"><code class="sourceCode python"><span id="cb660-1"><a href="#cb660-1" aria-hidden="true"></a><span class="im">import</span> sys, json</span>+<span id="cb660-2"><a href="#cb660-2" aria-hidden="true"></a></span>+<span id="cb660-3"><a href="#cb660-3" aria-hidden="true"></a>i <span class="op">=</span> json.load(sys.stdin)</span>+<span id="cb660-4"><a href="#cb660-4" aria-hidden="true"></a>metadata <span class="op">=</span> i[<span class="st">"Metadata"</span>]</span>+<span id="cb660-5"><a href="#cb660-5" aria-hidden="true"></a><span class="co"># Add tag to description</span></span>+<span id="cb660-6"><a href="#cb660-6" aria-hidden="true"></a><span class="cf">if</span> <span class="st">"description"</span> <span class="kw">in</span> metadata:</span>+<span id="cb660-7"><a href="#cb660-7" aria-hidden="true"></a> metadata[<span class="st">"description"</span>] <span class="op">+=</span> <span class="st">" [migrated from domain1]"</span></span>+<span id="cb660-8"><a href="#cb660-8" aria-hidden="true"></a><span class="cf">else</span>:</span>+<span id="cb660-9"><a href="#cb660-9" aria-hidden="true"></a> metadata[<span class="st">"description"</span>] <span class="op">=</span> <span class="st">"[migrated from domain1]"</span></span>+<span id="cb660-10"><a href="#cb660-10" aria-hidden="true"></a><span class="co"># Modify owner</span></span>+<span id="cb660-11"><a href="#cb660-11" aria-hidden="true"></a><span class="cf">if</span> <span class="st">"owner"</span> <span class="kw">in</span> metadata:</span>+<span id="cb660-12"><a href="#cb660-12" aria-hidden="true"></a> metadata[<span class="st">"owner"</span>] <span class="op">=</span> metadata[<span class="st">"owner"</span>].replace(<span class="st">"domain1.com"</span>, <span class="st">"domain2.com"</span>)</span>+<span id="cb660-13"><a href="#cb660-13" aria-hidden="true"></a>o <span class="op">=</span> { <span class="st">"Metadata"</span>: metadata }</span>+<span id="cb660-14"><a href="#cb660-14" aria-hidden="true"></a>json.dump(o, sys.stdout, indent<span class="op">=</span><span class="st">"</span><span class="ch">\t</span><span class="st">"</span>)</span></code></pre></div><p>You can find this example (slightly expanded) in the rclone source code at <a href="https://github.com/rclone/rclone/blob/master/bin/test_metadata_mapper.py">bin/test_metadata_mapper.py</a>.</p><p>If you want to see the input to the metadata mapper and the output returned from it in the log you can use <code>-vv --dump mapper</code>.</p><p>See the <a href="#metadata">metadata section</a> for more info.</p>@@ -7603,12 +8446,15 @@ y/n/s/!/q> n</code></pre><p>The number of threads used to transfer is controlled by <code>--multi-thread-streams</code>.</p><p>Use <code>-vv</code> if you wish to see info about the threads.</p><p>This will work with the <code>sync</code>/<code>copy</code>/<code>move</code> commands and friends <code>copyto</code>/<code>moveto</code>. Multi thread transfers will be used with <code>rclone mount</code> and <code>rclone serve</code> if <code>--vfs-cache-mode</code> is set to <code>writes</code> or above.</p>+<p>Most multi-thread transfers do not take additional memory, but some do (for example uploading to s3). In the worst case memory usage can be at maximum <code>--transfers</code> * <code>--multi-thread-chunk-size</code> <em> <code>--multi-thread-streams</code> or specifically for the s3 backend <code>--transfers</code> </em> <code>--s3-chunk-size</code> * <code>--s3-concurrency</code>. However you can use the the <a href="https://rclone.org/docs/#max-buffer-memory">--max-buffer-memory</a> flag to control the maximum memory used here.</p><p><strong>NB</strong> that this <strong>only</strong> works with supported backends as the destination but will work with any backend as the source.</p><p><strong>NB</strong> that multi-thread copies are disabled for local to local copies as they are faster without unless <code>--multi-thread-streams</code> is set explicitly.</p><p><strong>NB</strong> on Windows using multi-thread transfers to the local disk will cause the resulting files to be <a href="https://en.wikipedia.org/wiki/Sparse_file">sparse</a>. Use <code>--local-no-sparse</code> to disable sparse files (which may cause long delays at the start of transfers) or disable multi-thread transfers with <code>--multi-thread-streams 0</code></p><h3 id="multi-thread-streamsn">--multi-thread-streams=N</h3><p>When using multi thread transfers (see above <code>--multi-thread-cutoff</code>) this sets the number of streams to use. Set to <code>0</code> to disable multi thread transfers (Default 4).</p><p>If the backend has a <code>--backend-upload-concurrency</code> setting (eg <code>--s3-upload-concurrency</code>) then this setting will be used as the number of transfers instead if it is larger than the value of <code>--multi-thread-streams</code> or <code>--multi-thread-streams</code> isn't set.</p>+<h3 id="name-transform-commandxxxx">--name-transform COMMAND[=XXXX]</h3>+<p><code>--name-transform</code> introduces path name transformations for <code>rclone copy</code>, <code>rclone sync</code>, and <code>rclone move</code>. These transformations enable modifications to source and destination file names by applying prefixes, suffixes, and other alterations during transfer operations. For detailed docs and examples, see <a href="https://rclone.org/commands/rclone_convmv/"><code>convmv</code></a>.</p><h3 id="no-check-dest">--no-check-dest</h3><p>The <code>--no-check-dest</code> can be used with <code>move</code> or <code>copy</code> and it causes rclone not to check the destination at all when copying files.</p><p>This means that:</p>@@ -7991,6 +8837,7 @@ export RCLONE_CONFIG_PASS</code></pre><li><code>--max-size</code></li><li><code>--min-age</code></li><li><code>--max-age</code></li>+<li><code>--hash-filter</code></li><li><code>--dump filters</code></li><li><code>--metadata-include</code></li><li><code>--metadata-include-from</code></li>@@ -8043,7 +8890,7 @@ export RCLONE_CONFIG_PASS</code></pre></ul><h2 id="environment-variables">Environment Variables</h2><p>Rclone can be configured entirely using environment variables. These can be used to set defaults for options or config file entries.</p>-<h3 id="options-91">Options</h3>+<h3 id="options-92">Options</h3><p>Every option in rclone can have its default set by environment variable.</p><p>To find the name of the environment variable, first, take the long option name, strip the leading <code>--</code>, change <code>-</code> to <code>_</code>, make upper case and prepend <code>RCLONE_</code>.</p><p>For example, to always set <code>--stats 5s</code>, set the environment variable <code>RCLONE_STATS=5s</code>. If you set stats on the command line this will override the environment variable setting.</p>@@ -8051,7 +8898,7 @@ export RCLONE_CONFIG_PASS</code></pre><p>Verbosity is slightly different, the environment variable equivalent of <code>--verbose</code> or <code>-v</code> is <code>RCLONE_VERBOSE=1</code>, or for <code>-vv</code>, <code>RCLONE_VERBOSE=2</code>.</p><p>The same parser is used for the options and the environment variables so they take exactly the same form.</p><p>The options set by environment variables can be seen with the <code>-vv</code> flag, e.g. <code>rclone version -vv</code>.</p>-<p>Options that can appear multiple times (type <code>stringArray</code>) are treated slighly differently as environment variables can only be defined once. In order to allow a simple mechanism for adding one or many items, the input is treated as a <a href="https://godoc.org/encoding/csv">CSV encoded</a> string. For example</p>+<p>Options that can appear multiple times (type <code>stringArray</code>) are treated slightly differently as environment variables can only be defined once. In order to allow a simple mechanism for adding one or many items, the input is treated as a <a href="https://godoc.org/encoding/csv">CSV encoded</a> string. For example</p><table><colgroup><col style="width: 52%" />@@ -8623,6 +9470,68 @@ user2/prefect</code></pre><p><code>--min-age</code> applies only to files and not to directories.</p><p>E.g. <code>rclone ls remote: --min-age 2d</code> lists files on <code>remote:</code> of 2 days old or more.</p><p>See <a href="https://rclone.org/docs/#time-option">the time option docs</a> for valid formats.</p>+<h3 id="hash-filter"><code>--hash-filter</code> - Deterministically select a subset of files</h3>+<p>The <code>--hash-filter</code> flag enables selecting a deterministic subset of files, useful for:</p>+<ol type="1">+<li>Running large sync operations across multiple machines.</li>+<li>Checking a subset of files for bitrot.</li>+<li>Any other operations where a sample of files is required.</li>+</ol>+<h4 id="syntax">Syntax</h4>+<p>The flag takes two parameters expressed as a fraction:</p>+<pre><code>--hash-filter K/N</code></pre>+<ul>+<li><code>N</code>: The total number of partitions (must be a positive integer).</li>+<li><code>K</code>: The specific partition to select (an integer from <code>0</code> to <code>N</code>).</li>+</ul>+<p>For example: - <code>--hash-filter 1/3</code>: Selects the first third of the files. - <code>--hash-filter 2/3</code> and <code>--hash-filter 3/3</code>: Select the second and third partitions, respectively.</p>+<p>Each partition is non-overlapping, ensuring all files are covered without duplication.</p>+<h4 id="random-partition-selection">Random Partition Selection</h4>+<p>Use <code>@</code> as <code>K</code> to randomly select a partition:</p>+<pre><code>--hash-filter @/M</code></pre>+<p>For example, <code>--hash-filter @/3</code> will randomly select a number between 0 and 2. This will stay constant across retries.</p>+<h4 id="how-it-works">How It Works</h4>+<ul>+<li>Rclone takes each file's full path, normalizes it to lowercase, and applies Unicode normalization.</li>+<li>It then hashes the normalized path into a 64 bit number.</li>+<li>The hash result is reduced modulo <code>N</code> to assign the file to a partition.</li>+<li>If the calculated partition does not match <code>K</code> the file is excluded.</li>+<li>Other filters may apply if the file is not excluded.</li>+</ul>+<p><strong>Important:</strong> Rclone will traverse all directories to apply the filter.</p>+<h4 id="usage-notes">Usage Notes</h4>+<ul>+<li>Safe to use with <code>rclone sync</code>; source and destination selections will match.</li>+<li><strong>Do not</strong> use with <code>--delete-excluded</code>, as this could delete unselected files.</li>+<li>Ignored if <code>--files-from</code> is used.</li>+</ul>+<h4 id="examples-1">Examples</h4>+<h5 id="dividing-files-into-4-partitions">Dividing files into 4 partitions</h5>+<p>Assuming the current directory contains <code>file1.jpg</code> through <code>file9.jpg</code>:</p>+<pre><code>$ rclone lsf --hash-filter 0/4 .+file1.jpg+file5.jpg++$ rclone lsf --hash-filter 1/4 .+file3.jpg+file6.jpg+file9.jpg++$ rclone lsf --hash-filter 2/4 .+file2.jpg+file4.jpg++$ rclone lsf --hash-filter 3/4 .+file7.jpg+file8.jpg++$ rclone lsf --hash-filter 4/4 . # the same as --hash-filter 0/4+file1.jpg+file5.jpg</code></pre>+<h5 id="syncing-the-first-quarter-of-files">Syncing the first quarter of files</h5>+<pre><code>rclone sync --hash-filter 1/4 source:path destination:path</code></pre>+<h5 id="checking-a-random-1-of-files-for-integrity">Checking a random 1% of files for integrity</h5>+<pre><code>rclone check --download --hash-filter @/100 source:path destination:path</code></pre><h2 id="other-flags">Other flags</h2><h3 id="delete-excluded---delete-files-on-dest-excluded-from-sync"><code>--delete-excluded</code> - Delete files on dest excluded from sync</h3><p><strong>Important</strong> this flag is dangerous to your data - use with <code>--dry-run</code> and <code>-v</code> first.</p>@@ -8691,7 +9600,7 @@ dir1/dir2/dir3/.ignore</code></pre><li>Log out</li></ul><p>(More docs and walkthrough video to come!)</p>-<h2 id="how-it-works">How it works</h2>+<h2 id="how-it-works-1">How it works</h2><p>When you run the <code>rclone rcd --rc-web-gui</code> this is what happens</p><ul><li>Rclone starts but only runs the remote control API ("rc").</li>@@ -8890,7 +9799,10 @@ dir1/dir2/dir3/.ignore</code></pre>}</code></pre><h3 id="setting-config-flags-with-_config">Setting config flags with _config</h3><p>If you wish to set config (the equivalent of the global flags) for the duration of an rc call only then pass in the <code>_config</code> parameter.</p>-<p>This should be in the same format as the <code>config</code> key returned by <a href="#options-get">options/get</a>.</p>+<p>This should be in the same format as the <code>main</code> key returned by <a href="#options-get">options/get</a>.</p>+<pre><code>rclone rc --loopback options/get blocks=main</code></pre>+<p>You can see more help on these options with this command (see <a href="#option-blocks">the options blocks section</a> for more info).</p>+<pre><code>rclone rc --loopback options/info blocks=main</code></pre><p>For example, if you wished to run a sync with the <code>--checksum</code> parameter, you would pass this parameter in your JSON blob.</p><pre><code>"_config":{"CheckSum": true}</code></pre><p>If using <code>rclone rc</code> this could be passed as</p>@@ -8903,6 +9815,9 @@ dir1/dir2/dir3/.ignore</code></pre><h3 id="setting-filter-flags-with-_filter">Setting filter flags with _filter</h3><p>If you wish to set filters for the duration of an rc call only then pass in the <code>_filter</code> parameter.</p><p>This should be in the same format as the <code>filter</code> key returned by <a href="#options-get">options/get</a>.</p>+<pre><code>rclone rc --loopback options/get blocks=filter</code></pre>+<p>You can see more help on these options with this command (see <a href="#option-blocks">the options blocks section</a> for more info).</p>+<pre><code>rclone rc --loopback options/info blocks=filter</code></pre><p>For example, if you wished to run a sync with these flags</p><pre><code>--max-size 1M --max-age 42s --include "a" --include "b"</code></pre><p>you would pass this parameter in your JSON blob.</p>@@ -8961,7 +9876,7 @@ dir1/dir2/dir3/.ignore</code></pre><td>FieldName</td><td>string</td><td>N</td>-<td>name of the field used in the rc - if blank use Name</td>+<td>name of the field used in the rc - if blank use Name. May contain "." for nested fields.</td></tr><tr class="odd"><td>Help</td>@@ -9165,6 +10080,7 @@ rclone rc cache/expire remote=/ withData=true</code></pre><ul><li>obscure - declare passwords are plain and need obscuring</li><li>noObscure - declare passwords are already obscured and don't need obscuring</li>+<li>noOutput - don't print anything to stdout</li><li>nonInteractive - don't interact with a user, return questions</li><li>continue - continue the config process with an answer</li><li>all - ask all the config questions not just the post config ones</li>@@ -9240,6 +10156,7 @@ rclone rc cache/expire remote=/ withData=true</code></pre><ul><li>obscure - declare passwords are plain and need obscuring</li><li>noObscure - declare passwords are already obscured and don't need obscuring</li>+<li>noOutput - don't print anything to stdout</li><li>nonInteractive - don't interact with a user, return questions</li><li>continue - continue the config process with an answer</li><li>all - ask all the config questions not just the post config ones</li>@@ -9373,7 +10290,8 @@ OR<p>If group is not provided then summed up stats for all groups will be returned.</p><p>Parameters</p><ul>-<li>group - name of the stats group (string)</li>+<li>group - name of the stats group (string, optional)</li>+<li>short - if true will not return the transferring and checking arrays (boolean, optional)</li></ul><p>Returns the following values:</p><pre><code>{@@ -9386,6 +10304,7 @@ OR"fatalError": boolean whether there has been at least one fatal error,"lastError": last error string,"renames" : number of files renamed,+ "listed" : number of directory entries listed,"retryError": boolean showing whether there has been at least one non-NoRetryError,"serverSideCopies": number of server side copies done,"serverSideCopyBytes": number bytes server side copied,@@ -10073,6 +10992,93 @@ rclone rc options/set --json '{"main": {"LogLevel": 8}}&<h3 id="rc-noopauth">rc/noopauth: Echo the input to the output parameters requiring auth</h3><p>This echoes the input parameters to the output parameters for testing purposes. It can be used to check that rclone is still alive and to check that parameter passing is working properly.</p><p><strong>Authentication is required for this call.</strong></p>+<h3 id="serve-list">serve/list: Show running servers</h3>+<p>Show running servers with IDs.</p>+<p>This takes no parameters and returns</p>+<ul>+<li>list: list of running serve commands</li>+</ul>+<p>Each list element will have</p>+<ul>+<li>id: ID of the server</li>+<li>addr: address the server is running on</li>+<li>params: parameters used to start the server</li>+</ul>+<p>Eg</p>+<pre><code>rclone rc serve/list</code></pre>+<p>Returns</p>+<div class="sourceCode" id="cb781"><pre class="sourceCode json"><code class="sourceCode json"><span id="cb781-1"><a href="#cb781-1" aria-hidden="true"></a><span class="fu">{</span></span>+<span id="cb781-2"><a href="#cb781-2" aria-hidden="true"></a> <span class="dt">"list"</span><span class="fu">:</span> <span class="ot">[</span></span>+<span id="cb781-3"><a href="#cb781-3" aria-hidden="true"></a> <span class="fu">{</span></span>+<span id="cb781-4"><a href="#cb781-4" aria-hidden="true"></a> <span class="dt">"addr"</span><span class="fu">:</span> <span class="st">"[::]:4321"</span><span class="fu">,</span></span>+<span id="cb781-5"><a href="#cb781-5" aria-hidden="true"></a> <span class="dt">"id"</span><span class="fu">:</span> <span class="st">"nfs-ffc2a4e5"</span><span class="fu">,</span></span>+<span id="cb781-6"><a href="#cb781-6" aria-hidden="true"></a> <span class="dt">"params"</span><span class="fu">:</span> <span class="fu">{</span></span>+<span id="cb781-7"><a href="#cb781-7" aria-hidden="true"></a> <span class="dt">"fs"</span><span class="fu">:</span> <span class="st">"remote:"</span><span class="fu">,</span></span>+<span id="cb781-8"><a href="#cb781-8" aria-hidden="true"></a> <span class="dt">"opt"</span><span class="fu">:</span> <span class="fu">{</span></span>+<span id="cb781-9"><a href="#cb781-9" aria-hidden="true"></a> <span class="dt">"ListenAddr"</span><span class="fu">:</span> <span class="st">":4321"</span></span>+<span id="cb781-10"><a href="#cb781-10" aria-hidden="true"></a> <span class="fu">},</span></span>+<span id="cb781-11"><a href="#cb781-11" aria-hidden="true"></a> <span class="dt">"type"</span><span class="fu">:</span> <span class="st">"nfs"</span><span class="fu">,</span></span>+<span id="cb781-12"><a href="#cb781-12" aria-hidden="true"></a> <span class="dt">"vfsOpt"</span><span class="fu">:</span> <span class="fu">{</span></span>+<span id="cb781-13"><a href="#cb781-13" aria-hidden="true"></a> <span class="dt">"CacheMode"</span><span class="fu">:</span> <span class="st">"full"</span></span>+<span id="cb781-14"><a href="#cb781-14" aria-hidden="true"></a> <span class="fu">}</span></span>+<span id="cb781-15"><a href="#cb781-15" aria-hidden="true"></a> <span class="fu">}</span></span>+<span id="cb781-16"><a href="#cb781-16" aria-hidden="true"></a> <span class="fu">}</span></span>+<span id="cb781-17"><a href="#cb781-17" aria-hidden="true"></a> <span class="ot">]</span></span>+<span id="cb781-18"><a href="#cb781-18" aria-hidden="true"></a><span class="fu">}</span></span></code></pre></div>+<p><strong>Authentication is required for this call.</strong></p>+<h3 id="serve-start">serve/start: Create a new server</h3>+<p>Create a new server with the specified parameters.</p>+<p>This takes the following parameters:</p>+<ul>+<li><code>type</code> - type of server: <code>http</code>, <code>webdav</code>, <code>ftp</code>, <code>sftp</code>, <code>nfs</code>, etc.</li>+<li><code>fs</code> - remote storage path to serve</li>+<li><code>addr</code> - the ip:port to run the server on, eg ":1234" or "localhost:1234"</li>+</ul>+<p>Other parameters are as described in the documentation for the relevant <a href="https://rclone.org/commands/rclone_serve/">rclone serve</a> command line options. To translate a command line option to an rc parameter, remove the leading <code>--</code> and replace <code>-</code> with <code>_</code>, so <code>--vfs-cache-mode</code> becomes <code>vfs_cache_mode</code>. Note that global parameters must be set with <code>_config</code> and <code>_filter</code> as described above.</p>+<p>Examples:</p>+<pre><code>rclone rc serve/start type=nfs fs=remote: addr=:4321 vfs_cache_mode=full+rclone rc serve/start --json '{"type":"nfs","fs":"remote:","addr":":1234","vfs_cache_mode":"full"}'</code></pre>+<p>This will give the reply</p>+<div class="sourceCode" id="cb783"><pre class="sourceCode json"><code class="sourceCode json"><span id="cb783-1"><a href="#cb783-1" aria-hidden="true"></a><span class="fu">{</span></span>+<span id="cb783-2"><a href="#cb783-2" aria-hidden="true"></a> <span class="dt">"addr"</span><span class="fu">:</span> <span class="st">"[::]:4321"</span><span class="fu">,</span> <span class="er">//</span> <span class="er">Address</span> <span class="er">the</span> <span class="er">server</span> <span class="er">was</span> <span class="er">started</span> <span class="er">on</span></span>+<span id="cb783-3"><a href="#cb783-3" aria-hidden="true"></a> <span class="dt">"id"</span><span class="fu">:</span> <span class="st">"nfs-ecfc6852"</span> <span class="er">//</span> <span class="er">Unique</span> <span class="er">identifier</span> <span class="er">for</span> <span class="er">the</span> <span class="er">server</span> <span class="er">instance</span></span>+<span id="cb783-4"><a href="#cb783-4" aria-hidden="true"></a><span class="fu">}</span></span></code></pre></div>+<p>Or an error if it failed to start.</p>+<p>Stop the server with <code>serve/stop</code> and list the running servers with <code>serve/list</code>.</p>+<p><strong>Authentication is required for this call.</strong></p>+<h3 id="serve-stop">serve/stop: Unserve selected active serve</h3>+<p>Stops a running <code>serve</code> instance by ID.</p>+<p>This takes the following parameters:</p>+<ul>+<li>id: as returned by serve/start</li>+</ul>+<p>This will give an empty response if successful or an error if not.</p>+<p>Example:</p>+<pre><code>rclone rc serve/stop id=12345</code></pre>+<p><strong>Authentication is required for this call.</strong></p>+<h3 id="serve-stopall">serve/stopall: Stop all active servers</h3>+<p>Stop all active servers.</p>+<p>This will stop all active servers.</p>+<pre><code>rclone rc serve/stopall</code></pre>+<p><strong>Authentication is required for this call.</strong></p>+<h3 id="serve-types">serve/types: Show all possible serve types</h3>+<p>This shows all possible serve types and returns them as a list.</p>+<p>This takes no parameters and returns</p>+<ul>+<li>types: list of serve types, eg "nfs", "sftp", etc</li>+</ul>+<p>The serve types are strings like "serve", "serve2", "cserve" and can be passed to serve/start as the serveType parameter.</p>+<p>Eg</p>+<pre><code>rclone rc serve/types</code></pre>+<p>Returns</p>+<div class="sourceCode" id="cb787"><pre class="sourceCode json"><code class="sourceCode json"><span id="cb787-1"><a href="#cb787-1" aria-hidden="true"></a><span class="fu">{</span></span>+<span id="cb787-2"><a href="#cb787-2" aria-hidden="true"></a> <span class="dt">"types"</span><span class="fu">:</span> <span class="ot">[</span></span>+<span id="cb787-3"><a href="#cb787-3" aria-hidden="true"></a> <span class="st">"http"</span><span class="ot">,</span></span>+<span id="cb787-4"><a href="#cb787-4" aria-hidden="true"></a> <span class="st">"sftp"</span><span class="ot">,</span></span>+<span id="cb787-5"><a href="#cb787-5" aria-hidden="true"></a> <span class="st">"nfs"</span></span>+<span id="cb787-6"><a href="#cb787-6" aria-hidden="true"></a> <span class="ot">]</span></span>+<span id="cb787-7"><a href="#cb787-7" aria-hidden="true"></a><span class="fu">}</span></span></code></pre></div>+<p><strong>Authentication is required for this call.</strong></p><h3 id="sync-bisync">sync/bisync: Perform bidirectional synchronization between two paths.</h3><p>This takes the following parameters</p><ul>@@ -10160,7 +11166,7 @@ rclone rc options/set --json '{"main": {"LogLevel": 8}}&},],}</code></pre>-<p>The <code>expiry</code> time is the time until the file is elegible for being uploaded in floating point seconds. This may go negative. As rclone only transfers <code>--transfers</code> files at once, only the lowest <code>--transfers</code> expiry times will have <code>uploading</code> as <code>true</code>. So there may be files with negative expiry times for which <code>uploading</code> is <code>false</code>.</p>+<p>The <code>expiry</code> time is the time until the file is eligible for being uploaded in floating point seconds. This may go negative. As rclone only transfers <code>--transfers</code> files at once, only the lowest <code>--transfers</code> expiry times will have <code>uploading</code> as <code>true</code>. So there may be files with negative expiry times for which <code>uploading</code> is <code>false</code>.</p><p>This command takes an "fs" parameter. If this parameter is not supplied and if there is only one VFS in use then that VFS will be used. If there is more than one VFS in use then the "fs" parameter must be supplied.</p><h3 id="vfs-queue-set-expiry">vfs/queue-set-expiry: Set the expiry time for an item queued for upload.</h3><p>Use this to adjust the <code>expiry</code> time for an item in the upload queue. You will need to read the <code>id</code> of the item using <code>vfs/queue</code> before using this call.</p>@@ -10433,6 +11439,15 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total<td style="text-align: center;">-</td></tr><tr class="even">+<td>FileLu Cloud Storage</td>+<td style="text-align: center;">MD5</td>+<td style="text-align: center;">R/W</td>+<td style="text-align: center;">No</td>+<td style="text-align: center;">Yes</td>+<td style="text-align: center;">R</td>+<td style="text-align: center;">-</td>+</tr>+<tr class="odd"><td>Files.com</td><td style="text-align: center;">MD5, CRC32</td><td style="text-align: center;">DR/W</td>@@ -10441,7 +11456,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total<td style="text-align: center;">R</td><td style="text-align: center;">-</td></tr>-<tr class="odd">+<tr class="even"><td>FTP</td><td style="text-align: center;">-</td><td style="text-align: center;">R/W ¹⁰</td>@@ -10450,7 +11465,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total<td style="text-align: center;">-</td><td style="text-align: center;">-</td></tr>-<tr class="even">+<tr class="odd"><td>Gofile</td><td style="text-align: center;">MD5</td><td style="text-align: center;">DR/W</td>@@ -10459,7 +11474,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total<td style="text-align: center;">R</td><td style="text-align: center;">-</td></tr>-<tr class="odd">+<tr class="even"><td>Google Cloud Storage</td><td style="text-align: center;">MD5</td><td style="text-align: center;">R/W</td>@@ -10468,7 +11483,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total<td style="text-align: center;">R/W</td><td style="text-align: center;">-</td></tr>-<tr class="even">+<tr class="odd"><td>Google Drive</td><td style="text-align: center;">MD5, SHA1, SHA256</td><td style="text-align: center;">DR/W</td>@@ -10477,7 +11492,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total<td style="text-align: center;">R/W</td><td style="text-align: center;">DRWU</td></tr>-<tr class="odd">+<tr class="even"><td>Google Photos</td><td style="text-align: center;">-</td><td style="text-align: center;">-</td>@@ -10486,7 +11501,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total<td style="text-align: center;">R</td><td style="text-align: center;">-</td></tr>-<tr class="even">+<tr class="odd"><td>HDFS</td><td style="text-align: center;">-</td><td style="text-align: center;">R/W</td>@@ -10495,7 +11510,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total<td style="text-align: center;">-</td><td style="text-align: center;">-</td></tr>-<tr class="odd">+<tr class="even"><td>HiDrive</td><td style="text-align: center;">HiDrive ¹²</td><td style="text-align: center;">R/W</td>@@ -10504,7 +11519,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total<td style="text-align: center;">-</td><td style="text-align: center;">-</td></tr>-<tr class="even">+<tr class="odd"><td>HTTP</td><td style="text-align: center;">-</td><td style="text-align: center;">R</td>@@ -10513,7 +11528,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total<td style="text-align: center;">R</td><td style="text-align: center;">-</td></tr>-<tr class="odd">+<tr class="even"><td>iCloud Drive</td><td style="text-align: center;">-</td><td style="text-align: center;">R</td>@@ -10522,7 +11537,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total<td style="text-align: center;">-</td><td style="text-align: center;">-</td></tr>-<tr class="even">+<tr class="odd"><td>Internet Archive</td><td style="text-align: center;">MD5, SHA1, CRC32</td><td style="text-align: center;">R/W ¹¹</td>@@ -10531,7 +11546,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total<td style="text-align: center;">-</td><td style="text-align: center;">RWU</td></tr>-<tr class="odd">+<tr class="even"><td>Jottacloud</td><td style="text-align: center;">MD5</td><td style="text-align: center;">R/W</td>@@ -10540,7 +11555,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total<td style="text-align: center;">R</td><td style="text-align: center;">RW</td></tr>-<tr class="even">+<tr class="odd"><td>Koofr</td><td style="text-align: center;">MD5</td><td style="text-align: center;">-</td>@@ -10549,7 +11564,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total<td style="text-align: center;">-</td><td style="text-align: center;">-</td></tr>-<tr class="odd">+<tr class="even"><td>Linkbox</td><td style="text-align: center;">-</td><td style="text-align: center;">R</td>@@ -10558,7 +11573,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total<td style="text-align: center;">-</td><td style="text-align: center;">-</td></tr>-<tr class="even">+<tr class="odd"><td>Mail.ru Cloud</td><td style="text-align: center;">Mailru ⁶</td><td style="text-align: center;">R/W</td>@@ -10567,7 +11582,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total<td style="text-align: center;">-</td><td style="text-align: center;">-</td></tr>-<tr class="odd">+<tr class="even"><td>Mega</td><td style="text-align: center;">-</td><td style="text-align: center;">-</td>@@ -10576,7 +11591,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total<td style="text-align: center;">-</td><td style="text-align: center;">-</td></tr>-<tr class="even">+<tr class="odd"><td>Memory</td><td style="text-align: center;">MD5</td><td style="text-align: center;">R/W</td>@@ -10585,7 +11600,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total<td style="text-align: center;">-</td><td style="text-align: center;">-</td></tr>-<tr class="odd">+<tr class="even"><td>Microsoft Azure Blob Storage</td><td style="text-align: center;">MD5</td><td style="text-align: center;">R/W</td>@@ -10594,7 +11609,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total<td style="text-align: center;">R/W</td><td style="text-align: center;">-</td></tr>-<tr class="even">+<tr class="odd"><td>Microsoft Azure Files Storage</td><td style="text-align: center;">MD5</td><td style="text-align: center;">R/W</td>@@ -10603,7 +11618,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total<td style="text-align: center;">R/W</td><td style="text-align: center;">-</td></tr>-<tr class="odd">+<tr class="even"><td>Microsoft OneDrive</td><td style="text-align: center;">QuickXorHash ⁵</td><td style="text-align: center;">DR/W</td>@@ -10612,7 +11627,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total<td style="text-align: center;">R</td><td style="text-align: center;">DRW</td></tr>-<tr class="even">+<tr class="odd"><td>OpenDrive</td><td style="text-align: center;">MD5</td><td style="text-align: center;">R/W</td>@@ -10621,7 +11636,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total<td style="text-align: center;">-</td><td style="text-align: center;">-</td></tr>-<tr class="odd">+<tr class="even"><td>OpenStack Swift</td><td style="text-align: center;">MD5</td><td style="text-align: center;">R/W</td>@@ -10630,7 +11645,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total<td style="text-align: center;">R/W</td><td style="text-align: center;">-</td></tr>-<tr class="even">+<tr class="odd"><td>Oracle Object Storage</td><td style="text-align: center;">MD5</td><td style="text-align: center;">R/W</td>@@ -10639,7 +11654,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total<td style="text-align: center;">R/W</td><td style="text-align: center;">-</td></tr>-<tr class="odd">+<tr class="even"><td>pCloud</td><td style="text-align: center;">MD5, SHA1 ⁷</td><td style="text-align: center;">R/W</td>@@ -10648,7 +11663,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total<td style="text-align: center;">W</td><td style="text-align: center;">-</td></tr>-<tr class="even">+<tr class="odd"><td>PikPak</td><td style="text-align: center;">MD5</td><td style="text-align: center;">R</td>@@ -10657,7 +11672,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total<td style="text-align: center;">R</td><td style="text-align: center;">-</td></tr>-<tr class="odd">+<tr class="even"><td>Pixeldrain</td><td style="text-align: center;">SHA256</td><td style="text-align: center;">R/W</td>@@ -10666,7 +11681,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total<td style="text-align: center;">R</td><td style="text-align: center;">RW</td></tr>-<tr class="even">+<tr class="odd"><td>premiumize.me</td><td style="text-align: center;">-</td><td style="text-align: center;">-</td>@@ -10675,7 +11690,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total<td style="text-align: center;">R</td><td style="text-align: center;">-</td></tr>-<tr class="odd">+<tr class="even"><td>put.io</td><td style="text-align: center;">CRC-32</td><td style="text-align: center;">R/W</td>@@ -10684,7 +11699,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total<td style="text-align: center;">R</td><td style="text-align: center;">-</td></tr>-<tr class="even">+<tr class="odd"><td>Proton Drive</td><td style="text-align: center;">SHA1</td><td style="text-align: center;">R/W</td>@@ -10693,7 +11708,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total<td style="text-align: center;">R</td><td style="text-align: center;">-</td></tr>-<tr class="odd">+<tr class="even"><td>QingStor</td><td style="text-align: center;">MD5</td><td style="text-align: center;">- ⁹</td>@@ -10702,7 +11717,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total<td style="text-align: center;">R/W</td><td style="text-align: center;">-</td></tr>-<tr class="even">+<tr class="odd"><td>Quatrix by Maytech</td><td style="text-align: center;">-</td><td style="text-align: center;">R/W</td>@@ -10711,7 +11726,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total<td style="text-align: center;">-</td><td style="text-align: center;">-</td></tr>-<tr class="odd">+<tr class="even"><td>Seafile</td><td style="text-align: center;">-</td><td style="text-align: center;">-</td>@@ -10720,7 +11735,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total<td style="text-align: center;">-</td><td style="text-align: center;">-</td></tr>-<tr class="even">+<tr class="odd"><td>SFTP</td><td style="text-align: center;">MD5, SHA1 ²</td><td style="text-align: center;">DR/W</td>@@ -10729,7 +11744,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total<td style="text-align: center;">-</td><td style="text-align: center;">-</td></tr>-<tr class="odd">+<tr class="even"><td>Sia</td><td style="text-align: center;">-</td><td style="text-align: center;">-</td>@@ -10738,7 +11753,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total<td style="text-align: center;">-</td><td style="text-align: center;">-</td></tr>-<tr class="even">+<tr class="odd"><td>SMB</td><td style="text-align: center;">-</td><td style="text-align: center;">R/W</td>@@ -10747,7 +11762,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total<td style="text-align: center;">-</td><td style="text-align: center;">-</td></tr>-<tr class="odd">+<tr class="even"><td>SugarSync</td><td style="text-align: center;">-</td><td style="text-align: center;">-</td>@@ -10756,7 +11771,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total<td style="text-align: center;">-</td><td style="text-align: center;">-</td></tr>-<tr class="even">+<tr class="odd"><td>Storj</td><td style="text-align: center;">-</td><td style="text-align: center;">R</td>@@ -10765,7 +11780,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total<td style="text-align: center;">-</td><td style="text-align: center;">-</td></tr>-<tr class="odd">+<tr class="even"><td>Uloz.to</td><td style="text-align: center;">MD5, SHA256 ¹³</td><td style="text-align: center;">-</td>@@ -10774,7 +11789,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total<td style="text-align: center;">-</td><td style="text-align: center;">-</td></tr>-<tr class="even">+<tr class="odd"><td>Uptobox</td><td style="text-align: center;">-</td><td style="text-align: center;">-</td>@@ -10783,7 +11798,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total<td style="text-align: center;">-</td><td style="text-align: center;">-</td></tr>-<tr class="odd">+<tr class="even"><td>WebDAV</td><td style="text-align: center;">MD5, SHA1 ³</td><td style="text-align: center;">R ⁴</td>@@ -10792,7 +11807,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total<td style="text-align: center;">-</td><td style="text-align: center;">-</td></tr>-<tr class="even">+<tr class="odd"><td>Yandex Disk</td><td style="text-align: center;">MD5</td><td style="text-align: center;">R/W</td>@@ -10801,7 +11816,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total<td style="text-align: center;">R</td><td style="text-align: center;">-</td></tr>-<tr class="odd">+<tr class="even"><td>Zoho WorkDrive</td><td style="text-align: center;">-</td><td style="text-align: center;">-</td>@@ -10810,7 +11825,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total<td style="text-align: center;">-</td><td style="text-align: center;">-</td></tr>-<tr class="even">+<tr class="odd"><td>The local filesystem</td><td style="text-align: center;">All</td><td style="text-align: center;">DR/W</td>@@ -12166,6 +13181,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total--multi-thread-cutoff SizeSuffix Use multi-thread downloads for files above this size (default 256Mi)--multi-thread-streams int Number of streams to use for multi-thread downloads (default 4)--multi-thread-write-buffer-size SizeSuffix In memory buffer size for writing when in multi-thread mode (default 128Ki)+ --name-transform stringArray Transform paths during the copy process--no-check-dest Don't check the destination, copy regardless--no-traverse Don't traverse destination file system on copy--no-update-dir-modtime Don't update directory modification times@@ -12185,6 +13201,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total--delete-during When synchronizing, delete files during transfer--fix-case Force rename of case insensitive dest to match source--ignore-errors Delete even if there are I/O errors+ --list-cutoff int To save memory, sort directory listings on disk above this threshold (default 1000000)--max-delete int When synchronizing, limit the number of deletes (default -1)--max-delete-size SizeSuffix When synchronizing, limit the total size of deletes (default off)--suffix string Suffix to add to changed files@@ -12215,13 +13232,14 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total--header stringArray Set HTTP header for all transactions--header-download stringArray Set HTTP header for download transactions--header-upload stringArray Set HTTP header for upload transactions+ --max-connections int Maximum number of simultaneous backend API connections, 0 for unlimited--no-check-certificate Do not verify the server SSL certificate (insecure)--no-gzip-encoding Don't set Accept-Encoding: gzip--timeout Duration IO idle timeout (default 5m0s)--tpslimit float Limit HTTP transactions per second to this--tpslimit-burst int Max burst of transactions for --tpslimit (default 1)--use-cookies Enable session cookiejar- --user-agent string Set the user-agent to a specified string (default "rclone/v1.69.0")</code></pre>+ --user-agent string Set the user-agent to a specified string (default "rclone/v1.70.0")</code></pre><h2 id="performance">Performance</h2><p>Flags helpful for increasing performance.</p><pre><code> --buffer-size SizeSuffix In memory buffer size when reading files for each --transfer (default 16Mi)@@ -12244,6 +13262,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total-i, --interactive Enable interactive mode--kv-lock-time Duration Maximum time to keep key-value database locked by process (default 1s)--low-level-retries int Number of low level retries to do (default 10)+ --max-buffer-memory SizeSuffix If set, don't allocate more than this amount of memory as buffers (default off)--no-console Hide console window (supported on Windows only)--no-unicode-normalization Don't normalize unicode characters in filenames--password-command SpaceSepList Command for supplying password for encrypted configuration@@ -12269,6 +13288,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -12290,7 +13310,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total<h2 id="logging-1">Logging</h2><p>Flags for logging and statistics.</p><pre><code> --log-file string Log everything to this file- --log-format string Comma separated list of log format options (default "date,time")+ --log-format Bits Comma separated list of log format options (default date,time)--log-level LogLevel Log level DEBUG|INFO|NOTICE|ERROR (default NOTICE)--log-systemd Activate systemd integration for the logger--max-stats-groups int Maximum number of stats groups to keep in memory, on max oldest is discarded (default 1000)@@ -12345,6 +13365,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total--rc-server-write-timeout Duration Timeout for server writing data (default 1h0m0s)--rc-template string User-specified template--rc-user string User name for authentication+ --rc-user-from-header string User name from a defined HTTP header--rc-web-fetch-url string URL to fetch the releases for webgui (default "https://api.github.com/repos/rclone/rclone-webui-react/releases/latest")--rc-web-gui Launch WebGUI on localhost--rc-web-gui-force-update Force update to latest version of web gui@@ -12368,6 +13389,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total--metrics-server-write-timeout Duration Timeout for server writing data (default 1h0m0s)--metrics-template string User-specified template--metrics-user string User name for authentication+ --metrics-user-from-header string User name from a defined HTTP header--rc-enable-metrics Enable the Prometheus metrics path at the remote control server</code></pre><h2 id="backend">Backend</h2><p>Backend-only flags (these can be set in the config file also).</p>@@ -12382,6 +13404,8 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total--azureblob-client-id string The ID of the client in use--azureblob-client-secret string One of the service principal's client secrets--azureblob-client-send-certificate-chain Send the certificate chain when using certificate auth+ --azureblob-copy-concurrency int Concurrency for multipart copy (default 512)+ --azureblob-copy-cutoff SizeSuffix Cutoff for switching to multipart copy (default 8Mi)--azureblob-delete-snapshots string Set to specify how to deal with snapshots on blob deletion--azureblob-description string Description of the remote--azureblob-directory-markers Upload an empty object with a trailing slash when a new directory is created@@ -12405,6 +13429,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total--azureblob-upload-concurrency int Concurrency for multipart uploads (default 16)--azureblob-upload-cutoff string Cutoff for switching to chunked upload (<= 256 MiB) (deprecated)--azureblob-use-az Use Azure CLI tool az for authentication+ --azureblob-use-copy-blob Whether to use the Copy Blob API when copying to the same storage account (default true)--azureblob-use-emulator Uses local storage emulator if provided as 'true'--azureblob-use-msi Use a managed service identity to authenticate (only works in Azure)--azureblob-username string User name (usually an email address)@@ -12417,6 +13442,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total--azurefiles-client-send-certificate-chain Send the certificate chain when using certificate auth--azurefiles-connection-string string Azure Files Connection String--azurefiles-description string Description of the remote+ --azurefiles-disable-instance-discovery Skip requesting Microsoft Entra instance metadata--azurefiles-encoding Encoding The encoding for the backend (default Slash,LtGt,DoubleQuote,Colon,Question,Asterisk,Pipe,BackSlash,Del,Ctl,RightPeriod,InvalidUtf8,Dot)--azurefiles-endpoint string Endpoint for the service--azurefiles-env-auth Read credentials from runtime (environment variables, CLI or MSI)@@ -12431,6 +13457,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total--azurefiles-share-name string Azure Files Share Name--azurefiles-tenant string ID of the service principal's tenant. Also called its directory ID--azurefiles-upload-concurrency int Concurrency for multipart uploads (default 16)+ --azurefiles-use-az Use Azure CLI tool az for authentication--azurefiles-use-msi Use a managed service identity to authenticate (only works in Azure)--azurefiles-username string User name (usually an email address)--b2-account string Account ID or Application Key ID@@ -12493,12 +13520,14 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total--chunker-fail-hard Choose how chunker should handle files with missing or invalid chunks--chunker-hash-type string Choose how chunker handles hash sums (default "md5")--chunker-remote string Remote to chunk/unchunk+ --cloudinary-adjust-media-files-extensions Cloudinary handles media formats as a file attribute and strips it from the name, which is unlike most other file systems (default true)--cloudinary-api-key string Cloudinary API Key--cloudinary-api-secret string Cloudinary API Secret--cloudinary-cloud-name string Cloudinary Environment Name--cloudinary-description string Description of the remote--cloudinary-encoding Encoding The encoding for the backend (default Slash,LtGt,DoubleQuote,Question,Asterisk,Pipe,Hash,Percent,BackSlash,Del,Ctl,RightSpace,InvalidUtf8,Dot)--cloudinary-eventually-consistent-delay Duration Wait N seconds for eventual consistency of the databases that support the backend operation (default 0s)+ --cloudinary-media-extensions stringArray Cloudinary supported media extensions (default 3ds,3g2,3gp,ai,arw,avi,avif,bmp,bw,cr2,cr3,djvu,dng,eps3,fbx,flif,flv,gif,glb,gltf,hdp,heic,heif,ico,indd,jp2,jpe,jpeg,jpg,jxl,jxr,m2ts,mov,mp4,mpeg,mts,mxf,obj,ogv,pdf,ply,png,psd,svg,tga,tif,tiff,ts,u3ma,usdz,wdp,webm,webp,wmv)--cloudinary-upload-prefix string Specify the API endpoint for environments out of the US--cloudinary-upload-preset string Upload Preset to select asset manipulation on upload--combine-description string Description of the remote@@ -12522,6 +13551,10 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total--crypt-show-mapping For all files listed show how the names encrypt--crypt-strict-names If set, this will raise an error when crypt comes across a filename that can't be decrypted--crypt-suffix string If this is set it will override the default suffix of ".bin" (default ".bin")+ --doi-description string Description of the remote+ --doi-doi string The DOI or the doi.org URL+ --doi-doi-resolver-api-url string The URL of the DOI resolver API to use+ --doi-provider string DOI provider--drive-acknowledge-abuse Set to allow files which return cannotDownloadAbusiveFile to be downloaded--drive-allow-import-name-change Allow the filetype to change when uploading Google docs--drive-auth-owner-only Only consider files owned by the authenticated user@@ -12573,7 +13606,6 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total--drive-use-trash Send files to the trash instead of deleting permanently (default true)--drive-v2-download-min-size SizeSuffix If Object's are greater, use drive v2 API to download (default off)--dropbox-auth-url string Auth server URL- --dropbox-batch-commit-timeout Duration Max time to wait for a batch to finish committing (default 10m0s)--dropbox-batch-mode string Upload file batching sync|async|off (default "sync")--dropbox-batch-size int Max number of files in upload batch--dropbox-batch-timeout Duration Max time to allow an idle upload batch before uploading (default 0s)@@ -12583,11 +13615,14 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total--dropbox-client-secret string OAuth Client Secret--dropbox-description string Description of the remote--dropbox-encoding Encoding The encoding for the backend (default Slash,BackSlash,Del,RightSpace,InvalidUtf8,Dot)+ --dropbox-export-formats CommaSepList Comma separated list of preferred formats for exporting files (default html,md)--dropbox-impersonate string Impersonate this user when using a business account--dropbox-pacer-min-sleep Duration Minimum time to sleep between API calls (default 10ms)--dropbox-root-namespace string Specify a different Dropbox namespace ID to use as the root for all paths--dropbox-shared-files Instructs rclone to work on individual shared files--dropbox-shared-folders Instructs rclone to work on shared folders+ --dropbox-show-all-exports Show all exportable files in listings+ --dropbox-skip-exports Skip exportable files in all listings--dropbox-token string OAuth Access Token as a JSON blob--dropbox-token-url string Token server url--fichier-api-key string Your API Key, get it from https://1fichier.com/console/params.pl@@ -12605,6 +13640,9 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total--filefabric-token-expiry string Token expiry time--filefabric-url string URL of the Enterprise File Fabric to connect to--filefabric-version string Version read from the file fabric+ --filelu-description string Description of the remote+ --filelu-encoding Encoding The encoding for the backend (default Slash,LtGt,DoubleQuote,SingleQuote,BackQuote,Dollar,Colon,Question,Asterisk,Pipe,Hash,Percent,BackSlash,CrLf,Del,Ctl,LeftSpace,LeftPeriod,LeftTilde,LeftCrLfHtVt,RightSpace,RightPeriod,RightCrLfHtVt,InvalidUtf8,Dot,SquareBracket,Semicolon,Exclamation)+ --filelu-key string Your FileLu Rclone key from My Account--filescom-api-key string The API key used to authenticate with Files.com--filescom-description string Description of the remote--filescom-encoding Encoding The encoding for the backend (default Slash,BackSlash,Del,Ctl,RightSpace,RightCrLfHtVt,InvalidUtf8,Dot)@@ -12664,7 +13702,6 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total--gofile-list-chunk int Number of items to list in each call (default 1000)--gofile-root-folder-id string ID of the root folder--gphotos-auth-url string Auth server URL- --gphotos-batch-commit-timeout Duration Max time to wait for a batch to finish committing (default 10m0s)--gphotos-batch-mode string Upload file batching sync|async|off (default "sync")--gphotos-batch-size int Max number of files in upload batch--gphotos-batch-timeout Duration Max time to allow an idle upload batch before uploading (default 0s)@@ -12732,6 +13769,8 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total--internetarchive-encoding Encoding The encoding for the backend (default Slash,LtGt,CrLf,Del,Ctl,InvalidUtf8,Dot)--internetarchive-endpoint string IAS3 Endpoint (default "https://s3.us.archive.org")--internetarchive-front-endpoint string Host of InternetArchive Frontend (default "https://archive.org")+ --internetarchive-item-derive Whether to trigger derive on the IA item or not. If set to false, the item will not be derived by IA upon upload (default true)+ --internetarchive-item-metadata stringArray Metadata to be set on the IA item, this is different from file-level metadata that can be set using --metadata-set--internetarchive-secret-access-key string IAS3 Secret Key (password)--internetarchive-wait-archive Duration Timeout for waiting the server's processing tasks (specifically archive and book_op) to finish (default 0s)--jottacloud-auth-url string Auth server URL@@ -12827,6 +13866,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total--onedrive-tenant string ID of the service principal's tenant. Also called its directory ID--onedrive-token string OAuth Access Token as a JSON blob--onedrive-token-url string Token server url+ --onedrive-upload-cutoff SizeSuffix Cutoff for switching to chunked upload (default off)--oos-attempt-resume-upload If true attempt to resume previously started multipart upload for the object--oos-chunk-size SizeSuffix Chunk size to use for uploading (default 5Mi)--oos-compartment string Specify compartment OCID, if you need to list buckets@@ -12852,6 +13892,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total--oos-storage-tier string The storage class to use when storing new objects in storage. https://docs.oracle.com/en-us/iaas/Content/Object/Concepts/understandingstoragetiers.htm (default "Standard")--oos-upload-concurrency int Concurrency for multipart uploads (default 10)--oos-upload-cutoff SizeSuffix Cutoff for switching to chunked upload (default 200Mi)+ --opendrive-access string Files and folders will be uploaded with this access permission (default private) (default "private")--opendrive-chunk-size SizeSuffix Files will be uploaded in chunks this size (default 10Mi)--opendrive-description string Description of the remote--opendrive-encoding Encoding The encoding for the backend (default Slash,LtGt,DoubleQuote,Colon,Question,Asterisk,Pipe,BackSlash,LeftSpace,LeftCrLfHtVt,RightSpace,RightCrLfHtVt,InvalidUtf8,Dot)@@ -12948,6 +13989,8 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total--s3-endpoint string Endpoint for S3 API--s3-env-auth Get AWS credentials from runtime (environment variables or EC2/ECS meta data if no env vars)--s3-force-path-style If true use path style access if false use virtual hosted style (default true)+ --s3-ibm-api-key string IBM API Key to be used to obtain IAM token+ --s3-ibm-resource-instance-id string IBM service instance id--s3-leave-parts-on-error If true avoid calling abort upload on a failure, leaving all successfully uploaded parts on S3 for manual recovery--s3-list-chunk int Size of listing chunk (response list for each ListObject S3 request) (default 1000)--s3-list-url-encode Tristate Whether to url encode listings: true/false/unset (default unset)@@ -12968,6 +14011,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total--s3-server-side-encryption string The server-side encryption algorithm used when storing this object in S3--s3-session-token string An AWS session token--s3-shared-credentials-file string Path to the shared credentials file+ --s3-sign-accept-encoding Tristate Set if rclone should include Accept-Encoding as part of the signature (default unset)--s3-sse-customer-algorithm string If using SSE-C, the server-side encryption algorithm used when storing this object in S3--s3-sse-customer-key string To use SSE-C you may provide the secret encryption key used to encrypt/decrypt your data--s3-sse-customer-key-base64 string If using SSE-C you must provide the secret encryption key encoded in base64 format to encrypt/decrypt your data@@ -12984,6 +14028,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total--s3-use-multipart-uploads Tristate Set if rclone should use multipart uploads (default unset)--s3-use-presigned-request Whether to use a presigned request or PutObject for single part uploads--s3-use-unsigned-payload Tristate Whether to use an unsigned payload in PutObject (default unset)+ --s3-use-x-id Tristate Set if rclone should add x-id URL parameters (default unset)--s3-v2-auth If true use v2 authentication--s3-version-at Time Show file versions as they were at the specified time (default off)--s3-version-deleted Show deleted file markers when using versions@@ -13009,6 +14054,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total--sftp-disable-hashcheck Disable the execution of SSH commands to determine if remote file hashing is available--sftp-host string SSH host to connect to--sftp-host-key-algorithms SpaceSepList Space separated list of host key algorithms, ordered by preference+ --sftp-http-proxy string URL for HTTP CONNECT proxy--sftp-idle-timeout Duration Max time before closing idle connections (default 1m0s)--sftp-key-exchange SpaceSepList Space separated list of key exchange algorithms, ordered by preference--sftp-key-file string Path to PEM-encoded private key file@@ -13063,6 +14109,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total--smb-pass string SMB password (obscured)--smb-port int SMB port number (default 445)--smb-spn string Service principal name+ --smb-use-kerberos Use Kerberos authentication--smb-user string SMB username (default "$USER")--storj-access-grant string Access grant--storj-api-key string API key@@ -13170,7 +14217,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total<p>In the first example we will use the <a href="https://rclone.org/sftp/">SFTP</a> rclone volume with Docker engine on a standalone Ubuntu machine.</p><p>Start from <a href="https://docs.docker.com/engine/install/">installing Docker</a> on the host.</p><p>The <em>FUSE</em> driver is a prerequisite for rclone mounting and should be installed on host:</p>-<pre><code>sudo apt-get -y install fuse</code></pre>+<pre><code>sudo apt-get -y install fuse3</code></pre><p>Create two directories required by rclone docker plugin:</p><pre><code>sudo mkdir -p /var/lib/docker-plugins/rclone/configsudo mkdir -p /var/lib/docker-plugins/rclone/cache</code></pre>@@ -13319,7 +14366,7 @@ systemctl start docker-volume-rclone.socketsystemctl restart docker</code></pre><p>Or run the service directly: - run <code>systemctl daemon-reload</code> to let systemd pick up new config - run <code>systemctl enable docker-volume-rclone.service</code> to make the new service start automatically when you power on your machine. - run <code>systemctl start docker-volume-rclone.service</code> to start the service now. - run <code>systemctl restart docker</code> to restart docker daemon and let it detect the new plugin socket. Note that this step is not needed in managed mode where docker knows about plugin state changes.</p><p>The two methods are equivalent from the user perspective, but I personally prefer socket activation.</p>-<h2 id="troubleshooting">Troubleshooting</h2>+<h2 id="troubleshooting-1">Troubleshooting</h2><p>You can <a href="https://docs.docker.com/engine/extend/#debugging-plugins">see managed plugin settings</a> with</p><pre><code>docker plugin listdocker plugin inspect rclone</code></pre>@@ -13516,7 +14563,7 @@ rclone copy Path1 Path2 [--create-empty-src-dirs]</code></pre><p>As a safety check, if greater than the <code>--max-delete</code> percent of files were deleted on either the Path1 or Path2 filesystem, then bisync will abort with a warning message, without making any changes. The default <code>--max-delete</code> is <code>50%</code>. One way to trigger this limit is to rename a directory that contains more than half of your files. This will appear to bisync as a bunch of deleted files and a bunch of new files. This safety check is intended to block bisync from deleting all of the files on both filesystems due to a temporary network access issue, or if the user had inadvertently deleted the files on one side or the other. To force the sync, either set a different delete percentage limit, e.g. <code>--max-delete 75</code> (allows up to 75% deletion), or use <code>--force</code> to bypass the check.</p><p>Also see the <a href="#all-files-changed">all files changed</a> check.</p><h3 id="filters-file">--filters-file</h3>-<p>By using rclone filter features you can exclude file types or directory sub-trees from the sync. See the <a href="#filtering">bisync filters</a> section and generic <a href="https://rclone.org/filtering/#filter-from-read-filtering-patterns-from-a-file">--filter-from</a> documentation. An <a href="#example-filters-file">example filters file</a> contains filters for non-allowed files for synching with Dropbox.</p>+<p>By using rclone filter features you can exclude file types or directory sub-trees from the sync. See the <a href="#filtering">bisync filters</a> section and generic <a href="https://rclone.org/filtering/#filter-from-read-filtering-patterns-from-a-file">--filter-from</a> documentation. An <a href="#example-filters-file">example filters file</a> contains filters for non-allowed files for syncing with Dropbox.</p><p>If you make changes to your filters file then bisync requires a run with <code>--resync</code>. This is a safety feature, which prevents existing files on the Path1 and/or Path2 side from seeming to disappear from view (since they are excluded in the new listings), which would fool bisync into seeing them as deleted (as compared to the prior run listings), and then bisync would proceed to delete them for real.</p><p>To block this from happening, bisync calculates an MD5 hash of the filters file and stores the hash in a <code>.md5</code> file in the same place as your filters file. On the next run with <code>--filters-file</code> set, bisync re-calculates the MD5 hash of the current filters file and compares it to the hash stored in the <code>.md5</code> file. If they don't match, the run aborts with a critical error and thus forces you to do a <code>--resync</code>, likely avoiding a disaster.</p><h3 id="conflict-resolve">--conflict-resolve CHOICE</h3>@@ -13556,7 +14603,7 @@ rclone copy Path1 Path2 [--create-empty-src-dirs]</code></pre><h3 id="check-sync">--check-sync</h3><p>Enabled by default, the check-sync function checks that all of the same files exist in both the Path1 and Path2 history listings. This <em>check-sync</em> integrity check is performed at the end of the sync run by default. Any untrapped failing copy/deletes between the two paths might result in differences between the two listings and in the untracked file content differences between the two paths. A resync run would correct the error.</p><p>Note that the default-enabled integrity check locally executes a load of both the final Path1 and Path2 listings, and thus adds to the run time of a sync. Using <code>--check-sync=false</code> will disable it and may significantly reduce the sync run times for very large numbers of files.</p>-<p>The check may be run manually with <code>--check-sync=only</code>. It runs only the integrity check and terminates without actually synching.</p>+<p>The check may be run manually with <code>--check-sync=only</code>. It runs only the integrity check and terminates without actually syncing.</p><p>Note that currently, <code>--check-sync</code> <strong>only checks listing snapshots and NOT the actual files on the remotes.</strong> Note also that the listing snapshots will not know about any changes that happened during or after the latest bisync run, as those will be discovered on the next run. Therefore, while listings should always match <em>each other</em> at the end of a bisync run, it is <em>expected</em> that they will not match the underlying remotes, nor will the remotes match each other, if there were changes during or after the run. This is normal, and any differences will be detected and synced on the next run.</p><p>For a robust integrity check of the current state of the remotes (as opposed to just their listing snapshots), consider using <a href="commands/rclone_check/"><code>check</code></a> (or <a href="https://rclone.org/commands/rclone_cryptcheck/"><code>cryptcheck</code></a>, if at least one path is a <code>crypt</code> remote) instead of <code>--check-sync</code>, keeping in mind that differences are expected if files changed during or after your last bisync run.</p><p>For example, a possible sequence could look like this:</p>@@ -13786,7 +14833,7 @@ rclone copy Path1 Path2 [--create-empty-src-dirs]</code></pre><p>See <a href="https://rclone.org/filtering/">filtering documentation</a> for how filter rules are written and interpreted.</p><p>Bisync's <a href="#filters-file"><code>--filters-file</code></a> flag slightly extends the rclone's <a href="https://rclone.org/filtering/#filter-from-read-filtering-patterns-from-a-file">--filter-from</a> filtering mechanism. For a given bisync run you may provide <em>only one</em> <code>--filters-file</code>. The <code>--include*</code>, <code>--exclude*</code>, and <code>--filter</code> flags are also supported.</p><h3 id="how-to-filter-directories">How to filter directories</h3>-<p>Filtering portions of the directory tree is a critical feature for synching.</p>+<p>Filtering portions of the directory tree is a critical feature for syncing.</p><p>Examples of directory trees (always beneath the Path1/Path2 root level) you may want to exclude from your sync: - Directory trees containing only software build intermediate files. - Directory trees containing application temporary files and data such as the Windows <code>C:\Users\MyLogin\AppData\</code> tree. - Directory trees containing files that are large, less important, or are getting thrashed continuously by ongoing processes.</p><p>On the other hand, there may be only select directories that you actually want to sync, and exclude all others. See the <a href="#include-filters">Example include-style filters for Windows user directories</a> below.</p><h3 id="filters-file-writing-guidelines">Filters file writing guidelines</h3>@@ -13853,7 +14900,7 @@ rclone copy Path1 Path2 [--create-empty-src-dirs]</code></pre><p>Note also that Windows implements several "library" links such as <code>C:\Users\MyLogin\My Documents\My Music</code> pointing to <code>C:\Users\MyLogin\Music</code>. rclone sees these as links, so you must add <code>--links</code> to the bisync command line if you which to follow these links. I find that I get permission errors in trying to follow the links, so I don't include the rclone <code>--links</code> flag, but then you get lots of <code>Can't follow symlink…</code> noise from rclone about not following the links. This noise can be quashed by adding <code>--quiet</code> to the bisync command line.</p><h2 id="exclude-filters">Example exclude-style filters files for use with Dropbox</h2><ul>-<li>Dropbox disallows synching the listed temporary and configuration/data files. The `- <filename>` filters exclude these files where ever they may occur in the sync tree. Consider adding similar exclusions for file types you don't need to sync, such as core dump and software build files.</li>+<li>Dropbox disallows syncing the listed temporary and configuration/data files. The `- <filename>` filters exclude these files where ever they may occur in the sync tree. Consider adding similar exclusions for file types you don't need to sync, such as core dump and software build files.</li><li>bisync testing creates <code>/testdir/</code> at the top level of the sync tree, and usually deletes the tree after the test. If a normal sync should run while the <code>/testdir/</code> tree exists the <code>--check-access</code> phase may fail due to unbalanced RCLONE_TEST files. The `- /testdir/` filter blocks this tree from being synched. You don't need this exclusion if you are not doing bisync development testing.</li><li>Everything else beneath the Path1/Path2 root will be synched.</li><li>RCLONE_TEST files may be placed anywhere within the tree, including the root.</li>@@ -14013,7 +15060,7 @@ Options:<p>Note: unlike rclone flags which must be prefixed by double dash (<code>--</code>), the test command flags can be equally prefixed by a single <code>-</code> or double dash.</p><h3 id="running-tests">Running tests</h3><ul>-<li><code>go test . -case basic -remote local -remote2 local</code> runs the <code>test_basic</code> test case using only the local filesystem, synching one local directory with another local directory. Test script output is to the console, while commands within scenario.txt have their output sent to the <code>.../workdir/test.log</code> file, which is finally compared to the golden copy.</li>+<li><code>go test . -case basic -remote local -remote2 local</code> runs the <code>test_basic</code> test case using only the local filesystem, syncing one local directory with another local directory. Test script output is to the console, while commands within scenario.txt have their output sent to the <code>.../workdir/test.log</code> file, which is finally compared to the golden copy.</li><li>The first argument after <code>go test</code> should be a relative name of the directory containing bisync source code. If you run tests right from there, the argument will be <code>.</code> (current directory) as in most examples below. If you run bisync tests from the rclone source directory, the command should be <code>go test ./cmd/bisync ...</code>.</li><li>The test engine will mangle rclone output to ensure comparability with golden listings and logs.</li><li>Test scenarios are located in <code>./cmd/bisync/testdata</code>. The test <code>-case</code> argument should match the full name of a subdirectory under that directory. Every test subdirectory name on disk must start with <code>test_</code>, this prefix can be omitted on command line for brevity. Also, underscores in the name can be replaced by dashes for convenience.</li>@@ -14150,6 +15197,10 @@ Options:<p>Bisync adopts the differential synchronization technique, which is based on keeping history of changes performed by both synchronizing sides. See the <em>Dual Shadow Method</em> section in <a href="https://neil.fraser.name/writing/sync/">Neil Fraser's article</a>.</p><p>Also note a number of academic publications by <a href="http://www.cis.upenn.edu/%7Ebcpierce/papers/index.shtml#File%20Synchronization">Benjamin Pierce</a> about <em>Unison</em> and synchronization in general.</p><h2 id="changelog">Changelog</h2>+<h3 id="v1.69.1"><code>v1.69.1</code></h3>+<ul>+<li>Fixed an issue causing listings to not capture concurrent modifications under certain conditions</li>+</ul><h3 id="v1.68"><code>v1.68</code></h3><ul><li>Fixed an issue affecting backends that round modtimes to a lower precision.</li>@@ -14578,9 +15629,11 @@ e/n/d/r/c/s/q> q</code></pre><li>Liara Object Storage</li><li>Linode Object Storage</li><li>Magalu Object Storage</li>+<li>MEGA S4 Object Storage</li><li>Minio</li><li>Outscale</li><li>Petabox</li>+<li>Pure Storage FlashBlade</li><li>Qiniu Cloud Object Storage (Kodo)</li><li>RackCorp Object Storage</li><li>Rclone Serve S3</li>@@ -15072,7 +16125,7 @@ $ rclone -q --s3-versions ls s3:cleanup-test<ol type="1"><li>This is a policy that can be used when creating bucket. It assumes that <code>USER_NAME</code> has been created.</li><li>The Resource entry must include both resource ARNs, as one implies the bucket and the other implies the bucket's objects.</li>-<li>When using <a href="#s3-no-check-bucket">s3-no-check-bucket</a> and the bucket already exsits, the <code>"arn:aws:s3:::BUCKET_NAME"</code> doesn't have to be included.</li>+<li>When using <a href="#s3-no-check-bucket">s3-no-check-bucket</a> and the bucket already exists, the <code>"arn:aws:s3:::BUCKET_NAME"</code> doesn't have to be included.</li></ol><p>For reference, <a href="https://gist.github.com/ebridges/ebfc9042dd7c756cd101cfa807b7ae2b">here's an Ansible script</a> that will generate one or more buckets that will work with <code>rclone sync</code>.</p><h3 id="key-management-system-kms">Key Management System (KMS)</h3>@@ -15080,7 +16133,7 @@ $ rclone -q --s3-versions ls s3:cleanup-test<h3 id="glacier-and-glacier-deep-archive">Glacier and Glacier Deep Archive</h3><p>You can upload objects using the glacier storage class or transition them to glacier using a <a href="http://docs.aws.amazon.com/AmazonS3/latest/user-guide/create-lifecycle.html">lifecycle policy</a>. The bucket can still be synced or copied into normally, but if rclone tries to access data from the glacier storage class you will see an error like below.</p><pre><code>2017/09/11 19:07:43 Failed to sync: failed to open source object: Object in GLACIER, restore first: path/to/file</code></pre>-<p>In this case you need to <a href="http://docs.aws.amazon.com/AmazonS3/latest/user-guide/restore-archived-objects.html">restore</a> the object(s) in question before using rclone.</p>+<p>In this case you need to <a href="http://docs.aws.amazon.com/AmazonS3/latest/user-guide/restore-archived-objects.html">restore</a> the object(s) in question before accessing object contents. The <a href="#restore">restore</a> section below shows how to do this with rclone.</p><p>Note that rclone only speaks the S3 API it does not speak the Glacier Vault API, so rclone cannot directly access Glacier Vaults.</p><h3 id="object-lock-enabled-s3-bucket">Object-lock enabled S3 bucket</h3><p>According to AWS's <a href="https://docs.aws.amazon.com/AmazonS3/latest/userguide/object-lock-overview.html#object-lock-permission">documentation on S3 Object Lock</a>:</p>@@ -15089,7 +16142,7 @@ $ rclone -q --s3-versions ls s3:cleanup-test</blockquote><p>As mentioned in the <a href="#modification-times-and-hashes">Modification times and hashes</a> section, small files that are not uploaded as multipart, use a different tag, causing the upload to fail. A simple solution is to set the <code>--s3-upload-cutoff 0</code> and force all the files to be uploaded as multipart.</p><h3 id="standard-options-2">Standard options</h3>-<p>Here are the Standard options specific to s3 (Amazon S3 Compliant Storage Providers including AWS, Alibaba, ArvanCloud, Ceph, ChinaMobile, Cloudflare, DigitalOcean, Dreamhost, GCS, HuaweiOBS, IBMCOS, IDrive, IONOS, LyveCloud, Leviia, Liara, Linode, Magalu, Minio, Netease, Outscale, Petabox, RackCorp, Rclone, Scaleway, SeaweedFS, Selectel, StackPath, Storj, Synology, TencentCOS, Wasabi, Qiniu and others).</p>+<p>Here are the Standard options specific to s3 (Amazon S3 Compliant Storage Providers including AWS, Alibaba, ArvanCloud, Ceph, ChinaMobile, Cloudflare, DigitalOcean, Dreamhost, Exaba, FlashBlade, GCS, HuaweiOBS, IBMCOS, IDrive, IONOS, LyveCloud, Leviia, Liara, Linode, Magalu, Mega, Minio, Netease, Outscale, Petabox, RackCorp, Rclone, Scaleway, SeaweedFS, Selectel, StackPath, Storj, Synology, TencentCOS, Wasabi, Qiniu and others).</p><h4 id="s3-provider">--s3-provider</h4><p>Choose your S3 provider.</p><p>Properties:</p>@@ -15132,6 +16185,14 @@ $ rclone -q --s3-versions ls s3:cleanup-test<ul><li>Dreamhost DreamObjects</li></ul></li>+<li>"Exaba"+<ul>+<li>Exaba Object Storage</li>+</ul></li>+<li>"FlashBlade"+<ul>+<li>Pure Storage FlashBlade Object Storage</li>+</ul></li><li>"GCS"<ul><li>Google Cloud Storage</li>@@ -15172,6 +16233,10 @@ $ rclone -q --s3-versions ls s3:cleanup-test<ul><li>Magalu Object Storage</li></ul></li>+<li>"Mega"+<ul>+<li>MEGA S4 Object Storage</li>+</ul></li><li>"Minio"<ul><li>Minio Object Storage</li>@@ -15562,7 +16627,7 @@ $ rclone -q --s3-versions ls s3:cleanup-test<ul><li>Config: acl</li><li>Env Var: RCLONE_S3_ACL</li>-<li>Provider: !Storj,Selectel,Synology,Cloudflare</li>+<li>Provider: !Storj,Selectel,Synology,Cloudflare,FlashBlade,Mega</li><li>Type: string</li><li>Required: false</li><li>Examples:@@ -15726,8 +16791,28 @@ $ rclone -q --s3-versions ls s3:cleanup-test</ul></li></ul></li></ul>+<h4 id="s3-ibm-api-key">--s3-ibm-api-key</h4>+<p>IBM API Key to be used to obtain IAM token</p>+<p>Properties:</p>+<ul>+<li>Config: ibm_api_key</li>+<li>Env Var: RCLONE_S3_IBM_API_KEY</li>+<li>Provider: IBMCOS</li>+<li>Type: string</li>+<li>Required: false</li>+</ul>+<h4 id="s3-ibm-resource-instance-id">--s3-ibm-resource-instance-id</h4>+<p>IBM service instance id</p>+<p>Properties:</p>+<ul>+<li>Config: ibm_resource_instance_id</li>+<li>Env Var: RCLONE_S3_IBM_RESOURCE_INSTANCE_ID</li>+<li>Provider: IBMCOS</li>+<li>Type: string</li>+<li>Required: false</li>+</ul><h3 id="advanced-options-2">Advanced options</h3>-<p>Here are the Advanced options specific to s3 (Amazon S3 Compliant Storage Providers including AWS, Alibaba, ArvanCloud, Ceph, ChinaMobile, Cloudflare, DigitalOcean, Dreamhost, GCS, HuaweiOBS, IBMCOS, IDrive, IONOS, LyveCloud, Leviia, Liara, Linode, Magalu, Minio, Netease, Outscale, Petabox, RackCorp, Rclone, Scaleway, SeaweedFS, Selectel, StackPath, Storj, Synology, TencentCOS, Wasabi, Qiniu and others).</p>+<p>Here are the Advanced options specific to s3 (Amazon S3 Compliant Storage Providers including AWS, Alibaba, ArvanCloud, Ceph, ChinaMobile, Cloudflare, DigitalOcean, Dreamhost, Exaba, FlashBlade, GCS, HuaweiOBS, IBMCOS, IDrive, IONOS, LyveCloud, Leviia, Liara, Linode, Magalu, Mega, Minio, Netease, Outscale, Petabox, RackCorp, Rclone, Scaleway, SeaweedFS, Selectel, StackPath, Storj, Synology, TencentCOS, Wasabi, Qiniu and others).</p><h4 id="s3-bucket-acl">--s3-bucket-acl</h4><p>Canned ACL used when creating buckets.</p><p>For more info visit https://docs.aws.amazon.com/AmazonS3/latest/dev/acl-overview.html#canned-acl</p>@@ -15737,6 +16822,7 @@ $ rclone -q --s3-versions ls s3:cleanup-test<ul><li>Config: bucket_acl</li><li>Env Var: RCLONE_S3_BUCKET_ACL</li>+<li>Provider: !Storj,Selectel,Synology,Cloudflare,FlashBlade</li><li>Type: string</li><li>Required: false</li><li>Examples:@@ -16291,6 +17377,30 @@ Windows: "%USERPROFILE%\.aws\credentials"</code></pre><li>Type: Tristate</li><li>Default: unset</li></ul>+<h4 id="s3-use-x-id">--s3-use-x-id</h4>+<p>Set if rclone should add x-id URL parameters.</p>+<p>You can change this if you want to disable the AWS SDK from adding x-id URL parameters.</p>+<p>This shouldn't be necessary in normal operation.</p>+<p>This should be automatically set correctly for all providers rclone knows about - please make a bug report if not.</p>+<p>Properties:</p>+<ul>+<li>Config: use_x_id</li>+<li>Env Var: RCLONE_S3_USE_X_ID</li>+<li>Type: Tristate</li>+<li>Default: unset</li>+</ul>+<h4 id="s3-sign-accept-encoding">--s3-sign-accept-encoding</h4>+<p>Set if rclone should include Accept-Encoding as part of the signature.</p>+<p>You can change this if you want to stop rclone including Accept-Encoding as part of the signature.</p>+<p>This shouldn't be necessary in normal operation.</p>+<p>This should be automatically set correctly for all providers rclone knows about - please make a bug report if not.</p>+<p>Properties:</p>+<ul>+<li>Config: sign_accept_encoding</li>+<li>Env Var: RCLONE_S3_SIGN_ACCEPT_ENCODING</li>+<li>Type: Tristate</li>+<li>Default: unset</li>+</ul><h4 id="s3-directory-bucket">--s3-directory-bucket</h4><p>Set to use AWS Directory Buckets</p><p>If you are using an AWS Directory Bucket then set this flag.</p>@@ -16440,7 +17550,7 @@ Windows: "%USERPROFILE%\.aws\credentials"</code></pre><pre><code>rclone backend restore remote: [options] [<arguments>+]</code></pre><p>This command can be used to restore one or more objects from GLACIER to normal storage or from INTELLIGENT-TIERING Archive Access / Deep Archive Access tier to the Frequent Access tier.</p><p>Usage Examples:</p>-<pre><code>rclone backend restore s3:bucket/path/to/object -o priority=PRIORITY -o lifetime=DAYS+<pre><code>rclone backend restore s3:bucket/path/to/ --include /object -o priority=PRIORITY -o lifetime=DAYSrclone backend restore s3:bucket/path/to/directory -o priority=PRIORITY -o lifetime=DAYSrclone backend restore s3:bucket -o priority=PRIORITY -o lifetime=DAYSrclone backend restore s3:bucket/path/to/directory -o priority=PRIORITY</code></pre>@@ -17003,7 +18113,7 @@ Choose a number from below, or type in your own value32 / Toronto Flex\ "tor01-flex"location_constraint>1</code></pre>-<ol start="9" type="1">+<ol start="8" type="1"><li>Specify a canned ACL. IBM Cloud (Storage) supports "public-read" and "private". IBM Cloud(Infra) supports all the canned ACLs. On-Premise COS supports all the canned ACLs.</li></ol><pre><code>Canned ACL used when creating buckets and/or storing objects in S3.@@ -17018,7 +18128,7 @@ Choose a number from below, or type in your own value4 / Owner gets FULL_CONTROL. The AuthenticatedUsers group gets READ access. Not supported on Buckets. This acl is available on IBM Cloud (Infra) and On-Premise IBM COS\ "authenticated-read"acl> 1</code></pre>-<ol start="12" type="1">+<ol start="9" type="1"><li>Review the displayed configuration and accept to save the "remote" then quit. The config file should look like this</li></ol><pre><code> [xxx]@@ -17029,7 +18139,7 @@ acl> 1</code></pre>endpoint = s3-api.us-geo.objectstorage.softlayer.netlocation_constraint = us-standardacl = private</code></pre>-<ol start="13" type="1">+<ol start="10" type="1"><li>Execute rclone commands</li></ol><pre><code> 1) Create a bucket.@@ -17047,6 +18157,29 @@ acl> 1</code></pre>rclone copy IBM-COS-XREGION:newbucket/file.txt .6) Delete a file on remote.rclone delete IBM-COS-XREGION:newbucket/file.txt</code></pre>+<h4 id="ibm-iam-authentication">IBM IAM authentication</h4>+<p>If using IBM IAM authentication with IBM API KEY you need to fill in these additional parameters 1. Select false for env_auth 2. Leave <code>access_key_id</code> and <code>secret_access_key</code> blank 3. Paste your <code>ibm_api_key</code></p>+<pre><code>Option ibm_api_key.+IBM API Key to be used to obtain IAM token+Enter a value of type string. Press Enter for the default (1).+ibm_api_key></code></pre>+<ol start="4" type="1">+<li>Paste your <code>ibm_resource_instance_id</code></li>+</ol>+<pre><code>Option ibm_resource_instance_id.+IBM service instance id+Enter a value of type string. Press Enter for the default (2).+ibm_resource_instance_id></code></pre>+<ol start="5" type="1">+<li>In advanced settings type true for <code>v2_auth</code></li>+</ol>+<pre><code>Option v2_auth.+If true use v2 authentication.+If this is false (the default) then rclone will use v4 authentication.+If it is set then rclone will use v2 authentication.+Use this only if v4 signatures don't work, e.g. pre Jewel/v10 CEPH.+Enter a boolean value (true or false). Press Enter for the default (true).+v2_auth></code></pre><h3 id="idrive-e2">IDrive e2</h3><p>Here is an example of making an <a href="https://www.idrive.com/e2/">IDrive e2</a> configuration. First run:</p><pre><code>rclone config</code></pre>@@ -17632,7 +18765,7 @@ region = au-nswendpoint = s3.rackcorp.comlocation_constraint = au-nsw</code></pre><h3 id="rclone">Rclone Serve S3</h3>-<p>Rclone can serve any remote over the S3 protocol. For details see the <a href="https://rclone.org/commands/rclone_serve_http/">rclone serve s3</a> documentation.</p>+<p>Rclone can serve any remote over the S3 protocol. For details see the <a href="https://rclone.org/commands/rclone_serve_s3/">rclone serve s3</a> documentation.</p><p>For example, to serve <code>remote:path</code> over s3, run the server like this:</p><pre><code>rclone serve s3 --auth-key ACCESS_KEY_ID,SECRET_ACCESS_KEY remote:path</code></pre><p>This will be compatible with an rclone remote which is defined like this:</p>@@ -17643,7 +18776,7 @@ endpoint = http://127.0.0.1:8080/access_key_id = ACCESS_KEY_IDsecret_access_key = SECRET_ACCESS_KEYuse_multipart_uploads = false</code></pre>-<p>Note that setting <code>disable_multipart_uploads = true</code> is to work around <a href="https://rclone.org/commands/rclone_serve_http/#bugs">a bug</a> which will be fixed in due course.</p>+<p>Note that setting <code>use_multipart_uploads = false</code> is to work around <a href="https://rclone.org/commands/rclone_serve_s3/#bugs">a bug</a> which will be fixed in due course.</p><h3 id="scaleway">Scaleway</h3><p><a href="https://www.scaleway.com/object-storage/">Scaleway</a> The Object Storage platform allows you to store anything from backups, logs and web assets to documents and photos. Files can be dropped from the Scaleway console or transferred through our API and CLI or using any S3-compatible tool.</p><p>Scaleway provides an S3 interface which can be configured for use with rclone like this:</p>@@ -17718,18 +18851,15 @@ Press Enter to leave empty.2 | E.g. pre Jewel/v10 CEPH.\ (other-v2-signature)region></code></pre>-<p>Choose an endpoint from the list</p>-<pre><code>Endpoint for S3 API.+<p>Enter your Lyve Cloud endpoint. This field cannot be kept empty.</p>+<pre><code>Endpoint for Lyve Cloud S3 API.Required when using an S3 clone.-Choose a number from below, or type in your own value.-Press Enter to leave empty.- 1 / Seagate Lyve Cloud US East 1 (Virginia)- \ (s3.us-east-1.lyvecloud.seagate.com)- 2 / Seagate Lyve Cloud US West 1 (California)- \ (s3.us-west-1.lyvecloud.seagate.com)- 3 / Seagate Lyve Cloud AP Southeast 1 (Singapore)- \ (s3.ap-southeast-1.lyvecloud.seagate.com)-endpoint> 1</code></pre>+Please type in your LyveCloud endpoint.+Examples:+- s3.us-west-1.{account_name}.lyve.seagate.com (US West 1 - California)+- s3.eu-west-1.{account_name}.lyve.seagate.com (US West 1 - Ireland)+Enter a value.+endpoint> s3.us-west-1.global.lyve.seagate.com</code></pre><p>Leave location constraint blank</p><pre><code>Location constraint - must be set to match the Region.Leave blank if not sure. Used when creating buckets only.@@ -18581,27 +19711,49 @@ Option endpoint.Endpoint for Linode Object Storage API.Choose a number from below, or type in your own value.Press Enter to leave empty.- 1 / Atlanta, GA (USA), us-southeast-1+ 1 / Amsterdam (Netherlands), nl-ams-1+ \ (nl-ams-1.linodeobjects.com)+ 2 / Atlanta, GA (USA), us-southeast-1\ (us-southeast-1.linodeobjects.com)- 2 / Chicago, IL (USA), us-ord-1+ 3 / Chennai (India), in-maa-1+ \ (in-maa-1.linodeobjects.com)+ 4 / Chicago, IL (USA), us-ord-1\ (us-ord-1.linodeobjects.com)- 3 / Frankfurt (Germany), eu-central-1+ 5 / Frankfurt (Germany), eu-central-1\ (eu-central-1.linodeobjects.com)- 4 / Milan (Italy), it-mil-1+ 6 / Jakarta (Indonesia), id-cgk-1+ \ (id-cgk-1.linodeobjects.com)+ 7 / London 2 (Great Britain), gb-lon-1+ \ (gb-lon-1.linodeobjects.com)+ 8 / Los Angeles, CA (USA), us-lax-1+ \ (us-lax-1.linodeobjects.com)+ 9 / Madrid (Spain), es-mad-1+ \ (es-mad-1.linodeobjects.com)+10 / Melbourne (Australia), au-mel-1+ \ (au-mel-1.linodeobjects.com)+11 / Miami, FL (USA), us-mia-1+ \ (us-mia-1.linodeobjects.com)+12 / Milan (Italy), it-mil-1\ (it-mil-1.linodeobjects.com)- 5 / Newark, NJ (USA), us-east-1+13 / Newark, NJ (USA), us-east-1\ (us-east-1.linodeobjects.com)- 6 / Paris (France), fr-par-1+14 / Osaka (Japan), jp-osa-1+ \ (jp-osa-1.linodeobjects.com)+15 / Paris (France), fr-par-1\ (fr-par-1.linodeobjects.com)- 7 / Seattle, WA (USA), us-sea-1+16 / São Paulo (Brazil), br-gru-1+ \ (br-gru-1.linodeobjects.com)+17 / Seattle, WA (USA), us-sea-1\ (us-sea-1.linodeobjects.com)- 8 / Singapore ap-south-1+18 / Singapore, ap-south-1\ (ap-south-1.linodeobjects.com)- 9 / Stockholm (Sweden), se-sto-1+19 / Singapore 2, sg-sin-1+ \ (sg-sin-1.linodeobjects.com)+20 / Stockholm (Sweden), se-sto-1\ (se-sto-1.linodeobjects.com)-10 / Washington, DC, (USA), us-iad-1+21 / Washington, DC, (USA), us-iad-1\ (us-iad-1.linodeobjects.com)-endpoint> 3+endpoint> 5Option acl.Canned ACL used when creating buckets and storing or copying objects.@@ -18748,6 +19900,101 @@ provider = Magaluaccess_key_id = ACCESS_KEYsecret_access_key = SECRET_ACCESS_KEYendpoint = br-ne1.magaluobjects.com</code></pre>+<h3 id="mega">MEGA S4</h3>+<p><a href="https://mega.io/objectstorage">MEGA S4 Object Storage</a> is an S3 compatible object storage system. It has a single pricing tier with no additional charges for data transfers or API requests and it is included in existing Pro plans.</p>+<p>Here is an example of making a configuration. First run:</p>+<pre><code>rclone config</code></pre>+<p>This will guide you through an interactive setup process.</p>+<pre><code>No remotes found, make a new one?+n) New remote+s) Set configuration password+q) Quit config+n/s/q> n++Enter name for new remote.+name> megas4++Option Storage.+Type of storage to configure.+Choose a number from below, or type in your own value.+[snip]+XX / Amazon S3 Compliant Storage Providers including AWS,... Mega, ...+ \ (s3)+[snip]+Storage> s3++Option provider.+Choose your S3 provider.+Choose a number from below, or type in your own value.+Press Enter to leave empty.+[snip]+XX / MEGA S4 Object Storage+ \ (Mega)+[snip]+provider> Mega++Option env_auth.+Get AWS credentials from runtime (environment variables or EC2/ECS meta data if no env vars).+Only applies if access_key_id and secret_access_key is blank.+Choose a number from below, or type in your own boolean value (true or false).+Press Enter for the default (false).+ 1 / Enter AWS credentials in the next step.+ \ (false)+ 2 / Get AWS credentials from the environment (env vars or IAM).+ \ (true)+env_auth>++Option access_key_id.+AWS Access Key ID.+Leave blank for anonymous access or runtime credentials.+Enter a value. Press Enter to leave empty.+access_key_id> XXX++Option secret_access_key.+AWS Secret Access Key (password).+Leave blank for anonymous access or runtime credentials.+Enter a value. Press Enter to leave empty.+secret_access_key> XXX++Option endpoint.+Endpoint for S3 API.+Required when using an S3 clone.+Choose a number from below, or type in your own value.+Press Enter to leave empty.+ 1 / Mega S4 eu-central-1 (Amsterdam)+ \ (s3.eu-central-1.s4.mega.io)+ 2 / Mega S4 eu-central-2 (Bettembourg)+ \ (s3.eu-central-2.s4.mega.io)+ 3 / Mega S4 ca-central-1 (Montreal)+ \ (s3.ca-central-1.s4.mega.io)+ 4 / Mega S4 ca-west-1 (Vancouver)+ \ (s3.ca-west-1.s4.mega.io)+endpoint> 1++Edit advanced config?+y) Yes+n) No (default)+y/n> n++Configuration complete.+Options:+- type: s3+- provider: Mega+- access_key_id: XXX+- secret_access_key: XXX+- endpoint: s3.eu-central-1.s4.mega.io+Keep this "megas4" remote?+y) Yes this is OK (default)+e) Edit this remote+d) Delete this remote+y/e/d> y</code></pre>+<p>This will leave the config file looking like this.</p>+<pre><code>[megas4]+type = s3+provider = Mega+access_key_id = XXX+secret_access_key = XXX+endpoint = s3.eu-central-1.s4.mega.io</code></pre><h3 id="arvan-cloud">ArvanCloud</h3><p><a href="https://www.arvancloud.com/en/products/cloud-storage">ArvanCloud</a> ArvanCloud Object Storage goes beyond the limited traditional file storage. It gives you access to backup and archived files and allows sharing. Files like profile image in the app, images sent by users or scanned documents can be stored securely and easily in our Object Storage service.</p><p>ArvanCloud provides an S3 interface which can be configured for use with rclone like this.</p>@@ -18958,7 +20205,7 @@ cos s3</code></pre><p>For Netease NOS configure as per the configurator <code>rclone config</code> setting the provider <code>Netease</code>. This will automatically set <code>force_path_style = false</code> which is necessary for it to run properly.</p><h3 id="petabox">Petabox</h3><p>Here is an example of making a <a href="https://petabox.io/">Petabox</a> configuration. First run:</p>-<div class="sourceCode" id="cb1007"><pre class="sourceCode bash"><code class="sourceCode bash"><span id="cb1007-1"><a href="#cb1007-1" aria-hidden="true"></a><span class="ex">rclone</span> config</span></code></pre></div>+<div class="sourceCode" id="cb1070"><pre class="sourceCode bash"><code class="sourceCode bash"><span id="cb1070-1"><a href="#cb1070-1" aria-hidden="true"></a><span class="ex">rclone</span> config</span></code></pre></div><p>This will guide you through an interactive setup process.</p><pre><code>No remotes found, make a new one?n) New remote@@ -19102,6 +20349,102 @@ access_key_id = YOUR_ACCESS_KEY_IDsecret_access_key = YOUR_SECRET_ACCESS_KEYregion = us-east-1endpoint = s3.petabox.io</code></pre>+<h3 id="pure-storage-flashblade">Pure Storage FlashBlade</h3>+<p><a href="https://www.purestorage.com/products/unstructured-data-storage.html">Pure Storage FlashBlade</a> is a high performance S3-compatible object store.</p>+<p>FlashBlade supports most modern S3 features including:</p>+<ul>+<li>ListObjectsV2</li>+<li>Multipart uploads with AWS-compatible ETags</li>+<li>Advanced checksum algorithms (SHA256, CRC32, CRC32C) with trailer support (Purity//FB 4.4.2+)</li>+<li>Object versioning and lifecycle management</li>+<li>Virtual hosted-style requests (requires DNS configuration)</li>+</ul>+<p>To configure rclone for Pure Storage FlashBlade:</p>+<p>First run:</p>+<pre><code>rclone config</code></pre>+<p>This will guide you through an interactive setup process:</p>+<pre><code>No remotes found, make a new one?+n) New remote+s) Set configuration password+q) Quit config+n/s/q> n++Enter name for new remote.+name> flashblade++Option Storage.+Type of storage to configure.+Choose a number from below, or type in your own value.+[snip]+ 4 / Amazon S3 Compliant Storage Providers including AWS, Alibaba, ArvanCloud, Ceph, ChinaMobile, Cloudflare, DigitalOcean, Dreamhost, FlashBlade, GCS, HuaweiOBS, IBMCOS, IDrive, IONOS, LyveCloud, Leviia, Liara, Linode, Magalu, Minio, Netease, Outscale, Petabox, RackCorp, Rclone, Scaleway, SeaweedFS, Selectel, StackPath, Storj, Synology, TencentCOS, Wasabi, Qiniu and others+ \ (s3)+[snip]+Storage> s3++Option provider.+Choose your S3 provider.+Choose a number from below, or type in your own value.+Press Enter to leave empty.+[snip]+ 9 / Pure Storage FlashBlade Object Storage+ \ (FlashBlade)+[snip]+provider> FlashBlade++Option env_auth.+Get AWS credentials from runtime (environment variables or EC2/ECS meta data if no env vars).+Only applies if access_key_id and secret_access_key is blank.+Choose a number from below, or type in your own boolean value (true or false).+Press Enter for the default (false).+ 1 / Enter AWS credentials in the next step.+ \ (false)+ 2 / Get AWS credentials from the environment (env vars or IAM).+ \ (true)+env_auth> 1++Option access_key_id.+AWS Access Key ID.+Leave blank for anonymous access or runtime credentials.+Enter a value. Press Enter to leave empty.+access_key_id> ACCESS_KEY_ID++Option secret_access_key.+AWS Secret Access Key (password).+Leave blank for anonymous access or runtime credentials.+Enter a value. Press Enter to leave empty.+secret_access_key> SECRET_ACCESS_KEY++Option endpoint.+Endpoint for S3 API.+Required when using an S3 clone.+Enter a value. Press Enter to leave empty.+endpoint> https://s3.flashblade.example.com++Edit advanced config?+y) Yes+n) No (default)+y/n> n++Configuration complete.+Options:+- type: s3+- provider: FlashBlade+- access_key_id: ACCESS_KEY_ID+- secret_access_key: SECRET_ACCESS_KEY+- endpoint: https://s3.flashblade.example.com+Keep this "flashblade" remote?+y) Yes this is OK (default)+e) Edit this remote+d) Delete this remote+y/e/d> y</code></pre>+<p>This results in the following configuration being stored in <code>~/.config/rclone/rclone.conf</code>:</p>+<pre><code>[flashblade]+type = s3+provider = FlashBlade+access_key_id = ACCESS_KEY_ID+secret_access_key = SECRET_ACCESS_KEY+endpoint = https://s3.flashblade.example.com</code></pre>+<p>Note: The FlashBlade endpoint should be the S3 data VIP. For virtual-hosted style requests, ensure proper DNS configuration: subdomains of the endpoint hostname should resolve to a FlashBlade data VIP. For example, if your endpoint is <code>https://s3.flashblade.example.com</code>, then <code>bucket-name.s3.flashblade.example.com</code> should also resolve to the data VIP.</p><h3 id="storj">Storj</h3><p>Storj is a decentralized cloud storage which can be used through its native protocol or an S3 compatible gateway.</p><p>The S3 compatible gateway is configured using <code>rclone config</code> with a type of <code>s3</code> and with a provider name of <code>Storj</code>. Here is an example run of the configurator.</p>@@ -19152,7 +20495,7 @@ y/n> n</code></pre><p>Due to <a href="https://github.com/storj/gateway-mt/issues/39">issue #39</a> uploading multipart files via the S3 gateway causes them to lose their metadata. For rclone's purpose this means that the modification time is not stored, nor is any MD5SUM (if one is available from the source).</p><p>This has the following consequences:</p><ul>-<li>Using <code>rclone rcat</code> will fail as the medatada doesn't match after upload</li>+<li>Using <code>rclone rcat</code> will fail as the metadata doesn't match after upload</li><li>Uploading files with <code>rclone mount</code> will fail for the same reason<ul><li>This can worked around by using <code>--vfs-cache-mode writes</code> or <code>--vfs-cache-mode full</code> or setting <code>--s3-upload-cutoff</code> large</li>@@ -19795,7 +21138,7 @@ e) Edit this remoted) Delete this remotey/e/d> y</code></pre><p>See the <a href="https://rclone.org/remote_setup/">remote setup docs</a> for how to set it up on a machine with no Internet browser available.</p>-<p>Note that rclone runs a webserver on your local machine to collect the token as returned from Box. This only runs from the moment it opens your browser to the moment you get back the verification code. This is on <code>http://127.0.0.1:53682/</code> and this it may require you to unblock it temporarily if you are running a host firewall.</p>+<p>Note that rclone runs a webserver on your local machine to collect the token as returned from Box. This only runs from the moment it opens your browser to the moment you get back the verification code. This is on <code>http://127.0.0.1:53682/</code> and this may require you to unblock it temporarily if you are running a host firewall.</p><p>Once configured you can then use <code>rclone</code> like this,</p><p>List directories in top level of your Box</p><pre><code>rclone lsd remote:</code></pre>@@ -21008,6 +22351,24 @@ y/e/d> y</code></pre><li>Type: Duration</li><li>Default: 0s</li></ul>+<h4 id="cloudinary-adjust-media-files-extensions">--cloudinary-adjust-media-files-extensions</h4>+<p>Cloudinary handles media formats as a file attribute and strips it from the name, which is unlike most other file systems</p>+<p>Properties:</p>+<ul>+<li>Config: adjust_media_files_extensions</li>+<li>Env Var: RCLONE_CLOUDINARY_ADJUST_MEDIA_FILES_EXTENSIONS</li>+<li>Type: bool</li>+<li>Default: true</li>+</ul>+<h4 id="cloudinary-media-extensions">--cloudinary-media-extensions</h4>+<p>Cloudinary supported media extensions</p>+<p>Properties:</p>+<ul>+<li>Config: media_extensions</li>+<li>Env Var: RCLONE_CLOUDINARY_MEDIA_EXTENSIONS</li>+<li>Type: stringArray</li>+<li>Default: [3ds 3g2 3gp ai arw avi avif bmp bw cr2 cr3 djvu dng eps3 fbx flif flv gif glb gltf hdp heic heif ico indd jp2 jpe jpeg jpg jxl jxr m2ts mov mp4 mpeg mts mxf obj ogv pdf ply png psd svg tga tif tiff ts u3ma usdz wdp webm webp wmv]</li>+</ul><h4 id="cloudinary-description">--cloudinary-description</h4><p>Description of the remote.</p><p>Properties:</p>@@ -21755,7 +23116,7 @@ rclone rc backend/command command=decode fs=crypt: encryptedfile1 [encryptedfile<li>8 bytes magic string <code>RCLONE\x00\x00</code></li><li>24 bytes Nonce (IV)</li></ul>-<p>The initial nonce is generated from the operating systems crypto strong random number generator. The nonce is incremented for each chunk read making sure each nonce is unique for each block written. The chance of a nonce being reused is minuscule. If you wrote an exabyte of data (10¹⁸ bytes) you would have a probability of approximately 2×10⁻³² of re-using a nonce.</p>+<p>The initial nonce is generated from the operating systems crypto strong random number generator. The nonce is incremented for each chunk read making sure each nonce is unique for each block written. The chance of a nonce being reused is minuscule. If you wrote an exabyte of data (10¹⁸ bytes) you would have a probability of approximately 2×10⁻³² of reusing a nonce.</p><h4 id="chunk">Chunk</h4><p>Each chunk will contain 64 KiB of data, except for the last one which may have less data. The data chunk is in standard NaCl SecretBox format. SecretBox uses XSalsa20 and Poly1305 to encrypt and authenticate messages.</p><p>Each chunk contains:</p>@@ -21765,7 +23126,7 @@ rclone rc backend/command command=decode fs=crypt: encryptedfile1 [encryptedfile</ul><p>64k chunk size was chosen as the best performing chunk size (the authenticator takes too much time below this and the performance drops off due to cache effects above this). Note that these chunks are buffered in memory so they can't be too big.</p><p>This uses a 32 byte (256 bit key) key derived from the user password.</p>-<h4 id="examples-1">Examples</h4>+<h4 id="examples-2">Examples</h4><p>1 byte file will encrypt to</p><ul><li>32 bytes header</li>@@ -21798,7 +23159,7 @@ rclone rc backend/command command=decode fs=crypt: encryptedfile1 [encryptedfile<h3 id="key-derivation">Key derivation</h3><p>Rclone uses <code>scrypt</code> with parameters <code>N=16384, r=8, p=1</code> with an optional user supplied salt (password2) to derive the 32+32+16 = 80 bytes of key material required. If the user doesn't supply a salt then rclone uses an internal one.</p><p><code>scrypt</code> makes it impractical to mount a dictionary attack on rclone encrypted data. For full protection against this you should always use a salt.</p>-<h2 id="see-also-90">SEE ALSO</h2>+<h2 id="see-also-91">SEE ALSO</h2><ul><li><a href="https://rclone.org/commands/rclone_cryptdecode/">rclone cryptdecode</a> - Show forward/reverse mapping of encrypted filenames</li></ul>@@ -22032,10 +23393,136 @@ upstreams = "My Drive=My Drive:" "Test Drive=Test Drive:"</c<h3 id="metadata-7">Metadata</h3><p>Any metadata supported by the underlying remote is read and written.</p><p>See the <a href="https://rclone.org/docs/#metadata">metadata</a> docs for more info.</p>+<h1 id="doi">DOI</h1>+<p>The DOI remote is a read only remote for reading files from digital object identifiers (DOI).</p>+<p>Currently, the DOI backend supports supports DOIs hosted with: - <a href="https://inveniosoftware.org/products/rdm/">InvenioRDM</a> - <a href="https://zenodo.org">Zenodo</a> - <a href="https://data.caltech.edu">CaltechDATA</a> - <a href="https://inveniosoftware.org/showcase/">Other InvenioRDM repositories</a> - <a href="https://dataverse.org">Dataverse</a> - <a href="https://dataverse.harvard.edu">Harvard Dataverse</a> - <a href="https://dataverse.org/installations">Other Dataverse repositories</a></p>+<p>Paths are specified as <code>remote:path</code></p>+<p>Paths may be as deep as required, e.g. <code>remote:directory/subdirectory</code>.</p>+<h2 id="configuration-12">Configuration</h2>+<p>Here is an example of how to make a remote called <code>remote</code>. First run:</p>+<pre><code> rclone config</code></pre>+<p>This will guide you through an interactive setup process:</p>+<pre><code>No remotes found, make a new one?+n) New remote+s) Set configuration password+q) Quit config+n/s/q> n+Enter name for new remote.+name> remote+Type of storage to configure.+Choose a number from below, or type in your own value+[snip]+XX / DOI datasets+ \ (doi)+[snip]+Storage> doi+Option doi.+The DOI or the doi.org URL.+Enter a value.+doi> 10.5281/zenodo.5876941+Edit advanced config?+y) Yes+n) No (default)+y/n> n+Configuration complete.+Options:+- type: doi+- doi: 10.5281/zenodo.5876941+Keep this "remote" remote?+y) Yes this is OK (default)+e) Edit this remote+d) Delete this remote+y/e/d> y</code></pre>+<h3 id="standard-options-12">Standard options</h3>+<p>Here are the Standard options specific to doi (DOI datasets).</p>+<h4 id="doi-doi">--doi-doi</h4>+<p>The DOI or the doi.org URL.</p>+<p>Properties:</p>+<ul>+<li>Config: doi</li>+<li>Env Var: RCLONE_DOI_DOI</li>+<li>Type: string</li>+<li>Required: true</li>+</ul>+<h3 id="advanced-options-12">Advanced options</h3>+<p>Here are the Advanced options specific to doi (DOI datasets).</p>+<h4 id="doi-provider">--doi-provider</h4>+<p>DOI provider.</p>+<p>The DOI provider can be set when rclone does not automatically recognize a supported DOI provider.</p>+<p>Properties:</p>+<ul>+<li>Config: provider</li>+<li>Env Var: RCLONE_DOI_PROVIDER</li>+<li>Type: string</li>+<li>Required: false</li>+<li>Examples:+<ul>+<li>"auto"+<ul>+<li>Auto-detect provider</li>+</ul></li>+<li>"zenodo"+<ul>+<li>Zenodo</li>+</ul></li>+<li>"dataverse"+<ul>+<li>Dataverse</li>+</ul></li>+<li>"invenio"+<ul>+<li>Invenio</li>+</ul></li>+</ul></li>+</ul>+<h4 id="doi-doi-resolver-api-url">--doi-doi-resolver-api-url</h4>+<p>The URL of the DOI resolver API to use.</p>+<p>The DOI resolver can be set for testing or for cases when the the canonical DOI resolver API cannot be used.</p>+<p>Defaults to "https://doi.org/api".</p>+<p>Properties:</p>+<ul>+<li>Config: doi_resolver_api_url</li>+<li>Env Var: RCLONE_DOI_DOI_RESOLVER_API_URL</li>+<li>Type: string</li>+<li>Required: false</li>+</ul>+<h4 id="doi-description">--doi-description</h4>+<p>Description of the remote.</p>+<p>Properties:</p>+<ul>+<li>Config: description</li>+<li>Env Var: RCLONE_DOI_DESCRIPTION</li>+<li>Type: string</li>+<li>Required: false</li>+</ul>+<h2 id="backend-commands-4">Backend commands</h2>+<p>Here are the commands specific to the doi backend.</p>+<p>Run them with</p>+<pre><code>rclone backend COMMAND remote:</code></pre>+<p>The help below will explain what arguments each command takes.</p>+<p>See the <a href="https://rclone.org/commands/rclone_backend/">backend</a> command for more info on how to pass options and arguments.</p>+<p>These can be run on a running backend using the rc command <a href="https://rclone.org/rc/#backend-command">backend/command</a>.</p>+<h3 id="metadata-8">metadata</h3>+<p>Show metadata about the DOI.</p>+<pre><code>rclone backend metadata remote: [options] [<arguments>+]</code></pre>+<p>This command returns a JSON object with some information about the DOI.</p>+<pre><code>rclone backend medatadata doi: </code></pre>+<p>It returns a JSON object representing metadata about the DOI.</p>+<h3 id="set-1">set</h3>+<p>Set command for updating the config parameters.</p>+<pre><code>rclone backend set remote: [options] [<arguments>+]</code></pre>+<p>This set command can be used to update the config parameters for a running doi backend.</p>+<p>Usage Examples:</p>+<pre><code>rclone backend set doi: [-o opt_name=opt_value] [-o opt_name2=opt_value2]+rclone rc backend/command command=set fs=doi: [-o opt_name=opt_value] [-o opt_name2=opt_value2]+rclone rc backend/command command=set fs=doi: -o doi=NEW_DOI</code></pre>+<p>The option keys are named as they are in the config file.</p>+<p>This rebuilds the connection to the doi backend when it is called with the new parameters. Only new parameters need be passed as the values will default to those currently in use.</p>+<p>It doesn't return anything.</p><h1 id="dropbox">Dropbox</h1><p>Paths are specified as <code>remote:path</code></p><p>Dropbox paths may be as deep as required, e.g. <code>remote:directory/subdirectory</code>.</p>-<h2 id="configuration-12">Configuration</h2>+<h2 id="configuration-13">Configuration</h2><p>The initial setup for dropbox involves getting a token from Dropbox which you need to do in your browser. <code>rclone config</code> walks you through it.</p><p>Here is an example of how to make a remote called <code>remote</code>. First run:</p><pre><code> rclone config</code></pre>@@ -22159,7 +23646,61 @@ y/e/d> y</code></pre><p>This provides the maximum possible upload speed especially with lots of small files, however rclone can't check the file got uploaded properly using this mode.</p><p>If you are using this mode then using "rclone check" after the transfer completes is recommended. Or you could do an initial transfer with <code>--dropbox-batch-mode async</code> then do a final transfer with <code>--dropbox-batch-mode sync</code> (the default).</p><p>Note that there may be a pause when quitting rclone while rclone finishes up the last batch using this mode.</p>-<h3 id="standard-options-12">Standard options</h3>+<h3 id="exporting-files">Exporting files</h3>+<p>Certain files in Dropbox are "exportable", such as Dropbox Paper documents. These files need to be converted to another format in order to be downloaded. Often multiple formats are available for conversion.</p>+<p>When rclone downloads a exportable file, it chooses the format to download based on the <code>--dropbox-export-formats</code> setting. By default, the export formats are <code>html,md</code>, which are sensible defaults for Dropbox Paper.</p>+<p>Rclone chooses the first format ID in the export formats list that Dropbox supports for a given file. If no format in the list is usable, rclone will choose the default format that Dropbox suggests.</p>+<p>Rclone will change the extension to correspond to the export format. Here are some examples of how extensions are mapped:</p>+<table>+<thead>+<tr class="header">+<th>File type</th>+<th>Filename in Dropbox</th>+<th>Filename in rclone</th>+</tr>+</thead>+<tbody>+<tr class="odd">+<td>Paper</td>+<td>mydoc.paper</td>+<td>mydoc.html</td>+</tr>+<tr class="even">+<td>Paper template</td>+<td>mydoc.papert</td>+<td>mydoc.papert.html</td>+</tr>+<tr class="odd">+<td>other</td>+<td>mydoc</td>+<td>mydoc.html</td>+</tr>+</tbody>+</table>+<p><em>Importing</em> exportable files is not yet supported by rclone.</p>+<p>Here are the supported export extensions known by rclone. Note that rclone does not currently support other formats not on this list, even if Dropbox supports them. Also, Dropbox could change the list of supported formats at any time.</p>+<table>+<thead>+<tr class="header">+<th>Format ID</th>+<th>Name</th>+<th>Description</th>+</tr>+</thead>+<tbody>+<tr class="odd">+<td>html</td>+<td>HTML</td>+<td>HTML document</td>+</tr>+<tr class="even">+<td>md</td>+<td>Markdown</td>+<td>Markdown text format</td>+</tr>+</tbody>+</table>+<h3 id="standard-options-13">Standard options</h3><p>Here are the Standard options specific to dropbox (Dropbox).</p><h4 id="dropbox-client-id">--dropbox-client-id</h4><p>OAuth Client Id.</p>@@ -22181,7 +23722,7 @@ y/e/d> y</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h3 id="advanced-options-12">Advanced options</h3>+<h3 id="advanced-options-13">Advanced options</h3><p>Here are the Advanced options specific to dropbox (Dropbox).</p><h4 id="dropbox-token">--dropbox-token</h4><p>OAuth Access Token as a JSON blob.</p>@@ -22295,6 +23836,39 @@ y/e/d> y</code></pre><li>Type: string</li><li>Required: false</li></ul>+<h4 id="dropbox-export-formats">--dropbox-export-formats</h4>+<p>Comma separated list of preferred formats for exporting files</p>+<p>Certain Dropbox files can only be accessed by exporting them to another format. These include Dropbox Paper documents.</p>+<p>For each such file, rclone will choose the first format on this list that Dropbox considers valid. If none is valid, it will choose Dropbox's default format.</p>+<p>Known formats include: "html", "md" (markdown)</p>+<p>Properties:</p>+<ul>+<li>Config: export_formats</li>+<li>Env Var: RCLONE_DROPBOX_EXPORT_FORMATS</li>+<li>Type: CommaSepList</li>+<li>Default: html,md</li>+</ul>+<h4 id="dropbox-skip-exports">--dropbox-skip-exports</h4>+<p>Skip exportable files in all listings.</p>+<p>If given, exportable files practically become invisible to rclone.</p>+<p>Properties:</p>+<ul>+<li>Config: skip_exports</li>+<li>Env Var: RCLONE_DROPBOX_SKIP_EXPORTS</li>+<li>Type: bool</li>+<li>Default: false</li>+</ul>+<h4 id="dropbox-show-all-exports">--dropbox-show-all-exports</h4>+<p>Show all exportable files in listings.</p>+<p>Adding this flag will allow all exportable files to be server side copied. Note that rclone doesn't add extensions to the exportable file names in this mode.</p>+<p>Do <strong>not</strong> use this flag when trying to download exportable files - rclone will fail to download them.</p>+<p>Properties:</p>+<ul>+<li>Config: show_all_exports</li>+<li>Env Var: RCLONE_DROPBOX_SHOW_ALL_EXPORTS</li>+<li>Type: bool</li>+<li>Default: false</li>+</ul><h4 id="dropbox-batch-mode">--dropbox-batch-mode</h4><p>Upload file batching sync|async|off.</p><p>This sets the batch mode used by rclone.</p>@@ -22348,7 +23922,7 @@ y/e/d> y</code></pre><li>Default: 0s</li></ul><h4 id="dropbox-batch-commit-timeout">--dropbox-batch-commit-timeout</h4>-<p>Max time to wait for a batch to finish committing</p>+<p>Max time to wait for a batch to finish committing. (no longer used)</p><p>Properties:</p><ul><li>Config: batch_commit_timeout</li>@@ -22371,6 +23945,7 @@ y/e/d> y</code></pre><p>Some errors may occur if you try to sync copyright-protected files because Dropbox has its own <a href="https://techcrunch.com/2014/03/30/how-dropbox-knows-when-youre-sharing-copyrighted-stuff-without-actually-looking-at-your-stuff/">copyright detector</a> that prevents this sort of file being downloaded. This will return the error <code>ERROR : /path/to/your/file: Failed to copy: failed to open source object: path/restricted_content/.</code></p><p>If you have more than 10,000 files in a directory then <code>rclone purge dropbox:dir</code> will return the error <code>Failed to purge: There are too many files involved in this operation</code>. As a work-around do an <code>rclone delete dropbox:dir</code> followed by an <code>rclone rmdir dropbox:dir</code>.</p><p>When using <code>rclone link</code> you'll need to set <code>--expire</code> if using a non-personal account otherwise the visibility may not be correct. (Note that <code>--expire</code> isn't supported on personal accounts). See the <a href="https://forum.rclone.org/t/rclone-link-dropbox-permissions/23211">forum discussion</a> and the <a href="https://github.com/dropbox/dropbox-sdk-go-unofficial/issues/75">dropbox SDK issue</a>.</p>+<p>Modification times for Dropbox Paper documents are not exact, and may not change for some period after the document is edited. To make sure you get recent changes in a sync, either wait an hour or so, or use <code>--ignore-times</code> to force a full sync.</p><h2 id="get-your-own-dropbox-app-id">Get your own Dropbox App ID</h2><p>When you use rclone with Dropbox in its default configuration you are using rclone's App ID. This is shared between all the rclone users.</p><p>Here is how to create your own Dropbox App ID for rclone:</p>@@ -22386,7 +23961,7 @@ y/e/d> y</code></pre></ol><h1 id="enterprise-file-fabric">Enterprise File Fabric</h1><p>This backend supports <a href="https://storagemadeeasy.com/about/">Storage Made Easy's Enterprise File Fabric™</a> which provides a software solution to integrate and unify File and Object Storage accessible through a global file system.</p>-<h2 id="configuration-13">Configuration</h2>+<h2 id="configuration-14">Configuration</h2><p>The initial setup for the Enterprise File Fabric backend involves getting a token from the Enterprise File Fabric which you need to do in your browser. <code>rclone config</code> walks you through it.</p><p>Here is an example of how to make a remote called <code>remote</code>. First run:</p><pre><code> rclone config</code></pre>@@ -22480,7 +24055,7 @@ y/e/d> y</code></pre>120673757,My contacts/120673761,S3 Storage/</code></pre><p>The ID for "S3 Storage" would be <code>120673761</code>.</p>-<h3 id="standard-options-13">Standard options</h3>+<h3 id="standard-options-14">Standard options</h3><p>Here are the Standard options specific to filefabric (Enterprise File Fabric).</p><h4 id="filefabric-url">--filefabric-url</h4><p>URL of the Enterprise File Fabric to connect to.</p>@@ -22529,7 +24104,7 @@ y/e/d> y</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h3 id="advanced-options-13">Advanced options</h3>+<h3 id="advanced-options-14">Advanced options</h3><p>Here are the Advanced options specific to filefabric (Enterprise File Fabric).</p><h4 id="filefabric-token">--filefabric-token</h4><p>Session Token.</p>@@ -22581,10 +24156,127 @@ y/e/d> y</code></pre><li>Type: string</li><li>Required: false</li></ul>+<h1 id="filelu">FileLu</h1>+<p><a href="https://filelu.com/">FileLu</a> is a reliable cloud storage provider offering features like secure file uploads, downloads, flexible storage options, and sharing capabilities. With support for high storage limits and seamless integration with rclone, FileLu makes managing files in the cloud easy. Its cross-platform file backup services let you upload and back up files from any internet-connected device.</p>+<h2 id="configuration-15">Configuration</h2>+<p>Here is an example of how to make a remote called <code>filelu</code>. First, run:</p>+<pre><code> rclone config</code></pre>+<p>This will guide you through an interactive setup process:</p>+<pre><code>No remotes found, make a new one?+n) New remote+s) Set configuration password+q) Quit config+n/s/q> n+name> filelu+Type of storage to configure.+Choose a number from below, or type in your own value+[snip]+xx / FileLu Cloud Storage+ \ "filelu"+[snip]+Storage> filelu+Enter your FileLu Rclone Key:+key> YOUR_FILELU_RCLONE_KEY RC_xxxxxxxxxxxxxxxxxxxxxxxx+Configuration complete.++Keep this "filelu" remote?+y) Yes this is OK+e) Edit this remote+d) Delete this remote+y/e/d> y</code></pre>+<h3 id="paths-1">Paths</h3>+<p>A path without an initial <code>/</code> will operate in the <code>Rclone</code> directory.</p>+<p>A path with an initial <code>/</code> will operate at the root where you can see the <code>Rclone</code> directory.</p>+<pre><code>$ rclone lsf TestFileLu:/+CCTV/+Camera/+Documents/+Music/+Photos/+Rclone/+Vault/+Videos/</code></pre>+<h3 id="example-commands">Example Commands</h3>+<p>Create a new folder named <code>foldername</code> in the <code>Rclone</code> directory:</p>+<pre><code>rclone mkdir filelu:foldername</code></pre>+<p>Delete a folder on FileLu:</p>+<pre><code>rclone rmdir filelu:/folder/path/</code></pre>+<p>Delete a file on FileLu:</p>+<pre><code>rclone delete filelu:/hello.txt</code></pre>+<p>List files from your FileLu account:</p>+<pre><code>rclone ls filelu:</code></pre>+<p>List all folders:</p>+<pre><code>rclone lsd filelu:</code></pre>+<p>Copy a specific file to the FileLu root:</p>+<pre><code>rclone copy D:\\hello.txt filelu:</code></pre>+<p>Copy files from a local directory to a FileLu directory:</p>+<pre><code>rclone copy D:/local-folder filelu:/remote-folder/path/</code></pre>+<p>Download a file from FileLu into a local directory:</p>+<pre><code>rclone copy filelu:/file-path/hello.txt D:/local-folder</code></pre>+<p>Move files from a local directory to a FileLu directory:</p>+<pre><code>rclone move D:\\local-folder filelu:/remote-path/</code></pre>+<p>Sync files from a local directory to a FileLu directory:</p>+<pre><code>rclone sync --interactive D:/local-folder filelu:/remote-path/</code></pre>+<p>Mount remote to local Linux:</p>+<pre><code>rclone mount filelu: /root/mnt --vfs-cache-mode full</code></pre>+<p>Mount remote to local Windows:</p>+<pre><code>rclone mount filelu: D:/local_mnt --vfs-cache-mode full</code></pre>+<p>Get storage info about the FileLu account:</p>+<pre><code>rclone about filelu:</code></pre>+<p>All the other rclone commands are supported by this backend.</p>+<h3 id="folderid-instead-of-folder-path">FolderID instead of folder path</h3>+<p>We use the FolderID instead of the folder name to prevent errors when users have identical folder names or paths. For example, if a user has two or three folders named "test_folders," the system may become confused and won't know which folder to move. In large storage systems, some clients have hundred of thousands of folders and a few millions of files, duplicate folder names or paths are quite common.</p>+<h3 id="modification-times-and-hashes-7">Modification Times and Hashes</h3>+<p>FileLu supports both modification times and MD5 hashes.</p>+<p>FileLu only supports filenames and folder names up to 255 characters in length, where a character is a Unicode character.</p>+<h3 id="duplicated-files-1">Duplicated Files</h3>+<p>When uploading and syncing via Rclone, FileLu does not allow uploading duplicate files within the same directory. However, you can upload duplicate files, provided they are in different directories (folders).</p>+<h3 id="failure-to-log-invalid-credentials-or-key">Failure to Log / Invalid Credentials or KEY</h3>+<p>Ensure that you have the correct Rclone key, which can be found in <a href="https://filelu.com/account/">My Account</a>. Every time you toggle Rclone OFF and ON in My Account, a new RC_xxxxxxxxxxxxxxxxxxxx key is generated. Be sure to update your Rclone configuration with the new key.</p>+<p>If you are connecting to your FileLu remote for the first time and encounter an error such as:</p>+<pre><code>Failed to create file system for "my-filelu-remote:": couldn't login: Invalid credentials</code></pre>+<p>Ensure your Rclone Key is correct.</p>+<h3 id="process-killed">Process <code>killed</code></h3>+<p>Accounts with large files or extensive metadata may experience significant memory usage during list/sync operations. Ensure the system running <code>rclone</code> has sufficient memory and CPU to handle these operations.</p>+<h3 id="standard-options-15">Standard options</h3>+<p>Here are the Standard options specific to filelu (FileLu Cloud Storage).</p>+<h4 id="filelu-key">--filelu-key</h4>+<p>Your FileLu Rclone key from My Account</p>+<p>Properties:</p>+<ul>+<li>Config: key</li>+<li>Env Var: RCLONE_FILELU_KEY</li>+<li>Type: string</li>+<li>Required: true</li>+</ul>+<h3 id="advanced-options-15">Advanced options</h3>+<p>Here are the Advanced options specific to filelu (FileLu Cloud Storage).</p>+<h4 id="filelu-encoding">--filelu-encoding</h4>+<p>The encoding for the backend.</p>+<p>See the <a href="https://rclone.org/overview/#encoding">encoding section in the overview</a> for more info.</p>+<p>Properties:</p>+<ul>+<li>Config: encoding</li>+<li>Env Var: RCLONE_FILELU_ENCODING</li>+<li>Type: Encoding</li>+<li>Default: Slash,LtGt,DoubleQuote,SingleQuote,BackQuote,Dollar,Colon,Question,Asterisk,Pipe,Hash,Percent,BackSlash,CrLf,Del,Ctl,LeftSpace,LeftPeriod,LeftTilde,LeftCrLfHtVt,RightSpace,RightPeriod,RightCrLfHtVt,InvalidUtf8,Dot,SquareBracket,Semicolon,Exclamation</li>+</ul>+<h4 id="filelu-description">--filelu-description</h4>+<p>Description of the remote.</p>+<p>Properties:</p>+<ul>+<li>Config: description</li>+<li>Env Var: RCLONE_FILELU_DESCRIPTION</li>+<li>Type: string</li>+<li>Required: false</li>+</ul>+<h2 id="limitations-11">Limitations</h2>+<p>This backend uses a custom library implementing the FileLu API. While it supports file transfers, some advanced features may not yet be available. Please report any issues to the <a href="https://forum.rclone.org/">rclone forum</a> for troubleshooting and updates.</p>+<p>For further information, visit <a href="https://filelu.com/">FileLu's website</a>.</p><h1 id="files.com">Files.com</h1><p><a href="https://www.files.com/">Files.com</a> is a cloud storage service that provides a secure and easy way to store and share files.</p><p>The initial setup for filescom involves authenticating with your Files.com account. You can do this by providing your site subdomain, username, and password. Alternatively, you can authenticate using an API Key from <a href="https://www.files.com/docs/sdk-and-apis/api-keys/">Files.com</a>. <code>rclone config</code> walks you through it.</p>-<h2 id="configuration-14">Configuration</h2>+<h2 id="configuration-16">Configuration</h2><p>Here is an example of how to make a remote called <code>remote</code>. First run:</p><pre><code>rclone config</code></pre><p>This will guide you through an interactive setup process:</p>@@ -22653,7 +24345,7 @@ y/e/d> y</code></pre><pre><code>rclone ls remote:</code></pre><p>Sync <code>/home/local/directory</code> to the remote directory, deleting any excess files in the directory.</p><pre><code>rclone sync --interactive /home/local/directory remote:dir</code></pre>-<h3 id="standard-options-14">Standard options</h3>+<h3 id="standard-options-16">Standard options</h3><p>Here are the Standard options specific to filescom (Files.com).</p><h4 id="filescom-site">--filescom-site</h4><p>Your site subdomain (e.g. mysite) or custom domain (e.g. myfiles.customdomain.com).</p>@@ -22683,7 +24375,7 @@ y/e/d> y</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h3 id="advanced-options-14">Advanced options</h3>+<h3 id="advanced-options-16">Advanced options</h3><p>Here are the Advanced options specific to filescom (Files.com).</p><h4 id="filescom-api-key">--filescom-api-key</h4><p>The API key used to authenticate with Files.com.</p>@@ -22717,7 +24409,7 @@ y/e/d> y</code></pre><p>FTP is the File Transfer Protocol. Rclone FTP support is provided using the <a href="https://godoc.org/github.com/jlaffaye/ftp">github.com/jlaffaye/ftp</a> package.</p><p><a href="#limitations">Limitations of Rclone's FTP backend</a></p><p>Paths are specified as <code>remote:path</code>. If the path does not begin with a <code>/</code> it is relative to the home directory of the user. An empty path <code>remote:</code> refers to the user's home directory.</p>-<h2 id="configuration-15">Configuration</h2>+<h2 id="configuration-17">Configuration</h2><p>To create an FTP configuration named <code>remote</code>, run</p><pre><code>rclone config</code></pre><p>Rclone config guides you through an interactive setup process. A minimal rclone FTP remote definition only requires host, username and password. For an anonymous FTP server, see <a href="#anonymous-ftp">below</a>.</p>@@ -22833,7 +24525,7 @@ rclone lsf :ftp,host=speedtest.tele2.net,user=anonymous,pass=IXs2wc8OJOz7SYLBk47</tbody></table><p>This backend's interactive configuration wizard provides a selection of sensible encoding settings for major FTP servers: ProFTPd, PureFTPd, VsFTPd. Just hit a selection number when prompted.</p>-<h3 id="standard-options-15">Standard options</h3>+<h3 id="standard-options-17">Standard options</h3><p>Here are the Standard options specific to ftp (FTP).</p><h4 id="ftp-host">--ftp-host</h4><p>FTP host to connect to.</p>@@ -22893,7 +24585,7 @@ rclone lsf :ftp,host=speedtest.tele2.net,user=anonymous,pass=IXs2wc8OJOz7SYLBk47<li>Type: bool</li><li>Default: false</li></ul>-<h3 id="advanced-options-15">Advanced options</h3>+<h3 id="advanced-options-17">Advanced options</h3><p>Here are the Advanced options specific to ftp (FTP).</p><h4 id="ftp-concurrency">--ftp-concurrency</h4><p>Maximum number of FTP simultaneous connections, 0 for unlimited.</p>@@ -23078,7 +24770,7 @@ rclone lsf :ftp,host=speedtest.tele2.net,user=anonymous,pass=IXs2wc8OJOz7SYLBk47<li>Type: string</li><li>Required: false</li></ul>-<h2 id="limitations-11">Limitations</h2>+<h2 id="limitations-12">Limitations</h2><p>FTP servers acting as rclone remotes must support <code>passive</code> mode. The mode cannot be configured as <code>passive</code> is the only supported one. Rclone's FTP implementation is not compatible with <code>active</code> mode as <a href="https://github.com/jlaffaye/ftp/issues/29">the library it uses doesn't support it</a>. This will likely never be supported due to security concerns.</p><p>Rclone's FTP backend does not support any checksums but can compare file sizes.</p><p><code>rclone about</code> is not supported by the FTP backend. Backends without this capability cannot determine free space for an rclone mount or use policy <code>mfs</code> (most free space) as a member of an rclone union remote.</p>@@ -23096,7 +24788,7 @@ rclone lsf :ftp,host=speedtest.tele2.net,user=anonymous,pass=IXs2wc8OJOz7SYLBk47<p><a href="https://gofile.io">Gofile</a> is a content storage and distribution platform. Its aim is to provide as much service as possible for free or at a very low price.</p><p>The initial setup for Gofile involves logging in to the web interface and going to the "My Profile" section. Copy the "Account API token" for use in the config file.</p><p>Note that if you wish to connect rclone to Gofile you will need a premium account.</p>-<h2 id="configuration-16">Configuration</h2>+<h2 id="configuration-18">Configuration</h2><p>Here is an example of how to make a remote called <code>remote</code>. First run:</p><pre><code> rclone config</code></pre><p>This will guide you through an interactive setup process:</p>@@ -23141,7 +24833,7 @@ y/e/d> y</code></pre><pre><code>rclone lsf remote:</code></pre><p>To copy a local directory to an Gofile directory called backup</p><pre><code>rclone copy /home/source remote:backup</code></pre>-<h3 id="modification-times-and-hashes-7">Modification times and hashes</h3>+<h3 id="modification-times-and-hashes-8">Modification times and hashes</h3><p>Gofile supports modification times with a resolution of 1 second.</p><p>Gofile supports MD5 hashes, so you can use the <code>--checksum</code> flag.</p><h3 id="restricted-filename-characters-8">Restricted filename characters</h3>@@ -23235,7 +24927,7 @@ d50e356c-29ca-4b27-a3a7-494d91026e04;Videos/</code></pre><p>The ID to use is the part before the <code>;</code> so you could set</p><pre><code>root_folder_id = d6341f53-ee65-4f29-9f59-d11e8070b2a0</code></pre><p>To restrict rclone to the <code>Files</code> directory.</p>-<h3 id="standard-options-16">Standard options</h3>+<h3 id="standard-options-18">Standard options</h3><p>Here are the Standard options specific to gofile (Gofile).</p><h4 id="gofile-access-token">--gofile-access-token</h4><p>API Access token</p>@@ -23247,7 +24939,7 @@ d50e356c-29ca-4b27-a3a7-494d91026e04;Videos/</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h3 id="advanced-options-16">Advanced options</h3>+<h3 id="advanced-options-18">Advanced options</h3><p>Here are the Advanced options specific to gofile (Gofile).</p><h4 id="gofile-root-folder-id">--gofile-root-folder-id</h4><p>ID of the root folder</p>@@ -23298,18 +24990,18 @@ d50e356c-29ca-4b27-a3a7-494d91026e04;Videos/</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h2 id="limitations-12">Limitations</h2>+<h2 id="limitations-13">Limitations</h2><p>Gofile only supports filenames up to 255 characters in length, where a character is a unicode character.</p><p>Directories should not be cached for more than 24h otherwise files in the directory may not be downloadable. In practice this means when using a VFS based rclone command such as <code>rclone mount</code> you should make sure <code>--dir-cache-time</code> is less than <code>24h</code>.</p><p>Note that Gofile is currently limited to a total of 100,000 items. If you attempt to upload more than that you will get <code>error-limit-100000</code>. This limit may be lifted in the future.</p>-<h3 id="duplicated-files-1">Duplicated files</h3>+<h3 id="duplicated-files-2">Duplicated files</h3><p>Gofile is capable of having files with duplicated file names. For instance two files called <code>hello.txt</code> in the same directory.</p><p>Rclone cannot sync that to a normal file system but it can be fixed with the <code>rclone dedupe</code> command.</p><p>Duplicated files cause problems with the syncing and you will see messages in the log about duplicates.</p><p>Use <code>rclone dedupe</code> to fix duplicated files.</p><h1 id="google-cloud-storage-1">Google Cloud Storage</h1><p>Paths are specified as <code>remote:bucket</code> (or <code>remote:</code> for the <code>lsd</code> command.) You may put subdirectories in too, e.g. <code>remote:bucket/path/to/dir</code>.</p>-<h2 id="configuration-17">Configuration</h2>+<h2 id="configuration-19">Configuration</h2><p>The initial setup for google cloud storage involves getting a token from Google Cloud Storage which you need to do in your browser. <code>rclone config</code> walks you through it.</p><p>Here is an example of how to make a remote called <code>remote</code>. First run:</p><pre><code> rclone config</code></pre>@@ -23540,7 +25232,7 @@ ya29.c.c0ASRK0GbAFEewXD [truncated]</code></pre></tbody></table><p>Invalid UTF-8 bytes will also be <a href="https://rclone.org/overview/#invalid-utf8">replaced</a>, as they can't be used in JSON strings.</p>-<h3 id="standard-options-17">Standard options</h3>+<h3 id="standard-options-19">Standard options</h3><p>Here are the Standard options specific to google cloud storage (Google Cloud Storage (this is not Google Drive)).</p><h4 id="gcs-client-id">--gcs-client-id</h4><p>OAuth Client Id.</p>@@ -23925,7 +25617,7 @@ ya29.c.c0ASRK0GbAFEewXD [truncated]</code></pre></ul></li></ul></li></ul>-<h3 id="advanced-options-17">Advanced options</h3>+<h3 id="advanced-options-19">Advanced options</h3><p>Here are the Advanced options specific to google cloud storage (Google Cloud Storage (this is not Google Drive)).</p><h4 id="gcs-token">--gcs-token</h4><p>OAuth Access Token as a JSON blob.</p>@@ -24036,13 +25728,13 @@ ya29.c.c0ASRK0GbAFEewXD [truncated]</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h2 id="limitations-13">Limitations</h2>+<h2 id="limitations-14">Limitations</h2><p><code>rclone about</code> is not supported by the Google Cloud Storage backend. Backends without this capability cannot determine free space for an rclone mount or use policy <code>mfs</code> (most free space) as a member of an rclone union remote.</p><p>See <a href="https://rclone.org/overview/#optional-features">List of backends that do not support rclone about</a> and <a href="https://rclone.org/commands/rclone_about/">rclone about</a></p><h1 id="google-drive">Google Drive</h1><p>Paths are specified as <code>drive:path</code></p><p>Drive paths may be as deep as required, e.g. <code>drive:directory/subdirectory</code>.</p>-<h2 id="configuration-18">Configuration</h2>+<h2 id="configuration-20">Configuration</h2><p>The initial setup for drive involves getting a token from Google drive which you need to do in your browser. <code>rclone config</code> walks you through it.</p><p>Here is an example of how to make a remote called <code>remote</code>. First run:</p><pre><code> rclone config</code></pre>@@ -24257,7 +25949,7 @@ trashed=false and 'c' in parents</code></pre><li>without <code>--fast-list</code>: 22:05 min</li><li>with <code>--fast-list</code>: 58s</li></ul>-<h3 id="modification-times-and-hashes-8">Modification times and hashes</h3>+<h3 id="modification-times-and-hashes-9">Modification times and hashes</h3><p>Google drive stores modification times accurate to 1 ms.</p><p>Hash algorithms MD5, SHA1 and SHA256 are supported. Note, however, that a small fraction of files uploaded may not have SHA1 or SHA256 hashes especially if they were uploaded before 2018.</p><h3 id="restricted-filename-characters-10">Restricted filename characters</h3>@@ -24551,7 +26243,7 @@ trashed=false and 'c' in parents</code></pre></tr></tbody></table>-<h3 id="standard-options-18">Standard options</h3>+<h3 id="standard-options-20">Standard options</h3><p>Here are the Standard options specific to drive (Google Drive).</p><h4 id="drive-client-id">--drive-client-id</h4><p>Google Application Client Id Setting your own is recommended. See https://rclone.org/drive/#making-your-own-client-id for how to create your own. If you leave this blank, it will use an internal key which is low performance.</p>@@ -24628,7 +26320,7 @@ trashed=false and 'c' in parents</code></pre><li>Type: bool</li><li>Default: false</li></ul>-<h3 id="advanced-options-18">Advanced options</h3>+<h3 id="advanced-options-20">Advanced options</h3><p>Here are the Advanced options specific to drive (Google Drive).</p><h4 id="drive-token">--drive-token</h4><p>OAuth Access Token as a JSON blob.</p>@@ -25191,7 +26883,7 @@ trashed=false and 'c' in parents</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h3 id="metadata-8">Metadata</h3>+<h3 id="metadata-9">Metadata</h3><p>User metadata is stored in the properties field of the drive object.</p><p>Metadata is supported on files and directories.</p><p>Here are the possible system metadata items for the drive backend.</p>@@ -25300,7 +26992,7 @@ trashed=false and 'c' in parents</code></pre></tbody></table><p>See the <a href="https://rclone.org/docs/#metadata">metadata</a> docs for more info.</p>-<h2 id="backend-commands-4">Backend commands</h2>+<h2 id="backend-commands-5">Backend commands</h2><p>Here are the commands specific to the drive backend.</p><p>Run them with</p><pre><code>rclone backend COMMAND remote:</code></pre>@@ -25319,7 +27011,7 @@ rclone rc backend/command command=get fs=drive: [-o service_account_file] [-o ch<li>"chunk_size": show the current upload chunk size</li><li>"service_account_file": show the current service account file</li></ul>-<h3 id="set-1">set</h3>+<h3 id="set-2">set</h3><p>Set command for updating the drive config parameters</p><pre><code>rclone backend set remote: [options] [<arguments>+]</code></pre><p>This is a set command which will be used to update the various drive config parameters</p>@@ -25401,6 +27093,17 @@ rclone backend copyid drive: ID1 path1 ID2 path2</code></pre><p>The path should end with a / to indicate copy the file as named to this directory. If it doesn't end with a / then the last path component will be used as the file name.</p><p>If the destination is a drive backend then server-side copying will be attempted if possible.</p><p>Use the --interactive/-i or --dry-run flag to see what would be copied before copying.</p>+<h3 id="moveid">moveid</h3>+<p>Move files by ID</p>+<pre><code>rclone backend moveid remote: [options] [<arguments>+]</code></pre>+<p>This command moves files by ID</p>+<p>Usage:</p>+<pre><code>rclone backend moveid drive: ID path+rclone backend moveid drive: ID1 path1 ID2 path2</code></pre>+<p>It moves the drive file with ID given to the path (an rclone path which will be passed internally to rclone moveto).</p>+<p>The path should end with a / to indicate move the file as named to this directory. If it doesn't end with a / then the last path component will be used as the file name.</p>+<p>If the destination is a drive backend then server-side moving will be attempted if possible.</p>+<p>Use the --interactive/-i or --dry-run flag to see what would be moved beforehand.</p><h3 id="exportformats">exportformats</h3><p>Dump the export formats for debug purposes</p><pre><code>rclone backend exportformats remote: [options] [<arguments>+]</code></pre>@@ -25452,7 +27155,7 @@ rclone backend copyid drive: ID1 path1 ID2 path2</code></pre><pre><code>rclone backend rescue drive: Orphans</code></pre><p>Third delete all orphaned files to the trash</p><pre><code>rclone backend rescue drive: -o delete</code></pre>-<h2 id="limitations-14">Limitations</h2>+<h2 id="limitations-15">Limitations</h2><p>Drive has quite a lot of rate limiting. This causes rclone to be limited to transferring about 2 files per second only. Individual files may be transferred much faster at 100s of MiB/s but lots of small files can take a long time.</p><p>Server side copies are also subject to a separate rate limit. If you see User rate limit exceeded errors, wait at least 24 hours and retry. You can disable server-side copies with <code>--disable copy</code> to download and upload the files if you prefer.</p><h3 id="limitations-of-google-docs">Limitations of Google Docs</h3>@@ -25460,7 +27163,7 @@ rclone backend copyid drive: ID1 path1 ID2 path2</code></pre><p>This is because rclone can't find out the size of the Google docs without downloading them.</p><p>Google docs will transfer correctly with <code>rclone sync</code>, <code>rclone copy</code> etc as rclone knows to ignore the size when doing the transfer.</p><p>However an unfortunate consequence of this is that you may not be able to download Google docs using <code>rclone mount</code>. If it doesn't work you will get a 0 sized file. If you try again the doc may gain its correct size and be downloadable. Whether it will work on not depends on the application accessing the mount and the OS you are running - experiment to find out if it does work for you!</p>-<h3 id="duplicated-files-2">Duplicated files</h3>+<h3 id="duplicated-files-3">Duplicated files</h3><p>Sometimes, for no reason I've been able to track down, drive will duplicate a file that rclone uploads. Drive unlike all the other remotes can have duplicated files.</p><p>Duplicated files cause problems with the syncing and you will see messages in the log about duplicates.</p><p>Use <code>rclone dedupe</code> to fix duplicated files.</p>@@ -25504,7 +27207,8 @@ rclone backend copyid drive: ID1 path1 ID2 path2</code></pre><h1 id="google-photos">Google Photos</h1><p>The rclone backend for <a href="https://www.google.com/photos/about/">Google Photos</a> is a specialized backend for transferring photos and videos to and from Google Photos.</p><p><strong>NB</strong> The Google Photos API which rclone uses has quite a few limitations, so please read the <a href="#limitations">limitations section</a> carefully to make sure it is suitable for your use.</p>-<h2 id="configuration-19">Configuration</h2>+<p><strong>NB</strong> From March 31, 2025 rclone can only download photos it uploaded. This limitation is due to policy changes at Google. You may need to run <code>rclone config reconnect remote:</code> to make rclone work again after upgrading to rclone v1.70.</p>+<h2 id="configuration-21">Configuration</h2><p>The initial setup for google cloud storage involves getting a token from Google Photos which you need to do in your browser. <code>rclone config</code> walks you through it.</p><p>Here is an example of how to make a remote called <code>remote</code>. First run:</p><pre><code> rclone config</code></pre>@@ -25659,7 +27363,7 @@ y/e/d> y</code></pre></ul><p>This means that you can use the <code>album</code> path pretty much like a normal filesystem and it is a good target for repeated syncing.</p><p>The <code>shared-album</code> directory shows albums shared with you or by you. This is similar to the Sharing tab in the Google Photos web interface.</p>-<h3 id="standard-options-19">Standard options</h3>+<h3 id="standard-options-21">Standard options</h3><p>Here are the Standard options specific to google photos (Google Photos).</p><h4 id="gphotos-client-id">--gphotos-client-id</h4><p>OAuth Client Id.</p>@@ -25691,7 +27395,7 @@ y/e/d> y</code></pre><li>Type: bool</li><li>Default: false</li></ul>-<h3 id="advanced-options-19">Advanced options</h3>+<h3 id="advanced-options-21">Advanced options</h3><p>Here are the Advanced options specific to google photos (Google Photos).</p><h4 id="gphotos-token">--gphotos-token</h4><p>OAuth Access Token as a JSON blob.</p>@@ -25767,7 +27471,7 @@ y/e/d> y</code></pre><h4 id="gphotos-proxy">--gphotos-proxy</h4><p>Use the gphotosdl proxy for downloading the full resolution images</p><p>The Google API will deliver images and video which aren't full resolution, and/or have EXIF data missing.</p>-<p>However if you ue the gphotosdl proxy tnen you can download original, unchanged images.</p>+<p>However if you use the gphotosdl proxy then you can download original, unchanged images.</p><p>This runs a headless browser in the background.</p><p>Download the software from <a href="https://github.com/rclone/gphotosdl">gphotosdl</a></p><p>First run with</p>@@ -25844,7 +27548,7 @@ y/e/d> y</code></pre><li>Default: 0s</li></ul><h4 id="gphotos-batch-commit-timeout">--gphotos-batch-commit-timeout</h4>-<p>Max time to wait for a batch to finish committing</p>+<p>Max time to wait for a batch to finish committing. (no longer used)</p><p>Properties:</p><ul><li>Config: batch_commit_timeout</li>@@ -25861,8 +27565,9 @@ y/e/d> y</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h2 id="limitations-15">Limitations</h2>+<h2 id="limitations-16">Limitations</h2><p>Only images and videos can be uploaded. If you attempt to upload non videos or images or formats that Google Photos doesn't understand, rclone will upload the file, then Google Photos will give an error when it is put turned into a media item.</p>+<p><strong>NB</strong> From March 31, 2025 rclone can only download photos it uploaded. This limitation is due to policy changes at Google. You may need to run <code>rclone config reconnect remote:</code> to make rclone work again after upgrading to rclone v1.70.</p><p>Note that all media items uploaded to Google Photos through the API are stored in full resolution at "original quality" and <strong>will</strong> count towards your storage quota in your Google Account. The API does <strong>not</strong> offer a way to upload in "high quality" mode..</p><p><code>rclone about</code> is not supported by the Google Photos backend. Backends without this capability cannot determine free space for an rclone mount or use policy <code>mfs</code> (most free space) as a member of an rclone union remote.</p><p>See <a href="https://rclone.org/overview/#optional-features">List of backends that do not support rclone about</a> See <a href="https://rclone.org/commands/rclone_about/">rclone about</a></p>@@ -25972,7 +27677,7 @@ rclone backend drop Hasher:</code></pre><pre><code>rclone backend stickyimport hasher:path/to/data sha1 remote:/path/to/sum.sha1</code></pre><p><code>stickyimport</code> is similar to <code>import</code> but works much faster because it does not need to stat existing files and skips initial tree walk. Instead of binding cache entries to file fingerprints it creates <em>sticky</em> entries bound to the file name alone ignoring size, modification time etc. Such hash entries can be replaced only by <code>purge</code>, <code>delete</code>, <code>backend drop</code> or by full re-read/re-write of the files.</p><h2 id="configuration-reference">Configuration reference</h2>-<h3 id="standard-options-20">Standard options</h3>+<h3 id="standard-options-22">Standard options</h3><p>Here are the Standard options specific to hasher (Better checksums for other remotes).</p><h4 id="hasher-remote">--hasher-remote</h4><p>Remote to cache checksums for (e.g. myRemote:path).</p>@@ -26001,7 +27706,7 @@ rclone backend drop Hasher:</code></pre><li>Type: Duration</li><li>Default: off</li></ul>-<h3 id="advanced-options-20">Advanced options</h3>+<h3 id="advanced-options-22">Advanced options</h3><p>Here are the Advanced options specific to hasher (Better checksums for other remotes).</p><h4 id="hasher-auto-size">--hasher-auto-size</h4><p>Auto-update checksum for files smaller than this size (disabled by default).</p>@@ -26021,10 +27726,10 @@ rclone backend drop Hasher:</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h3 id="metadata-9">Metadata</h3>+<h3 id="metadata-10">Metadata</h3><p>Any metadata supported by the underlying remote is read and written.</p><p>See the <a href="https://rclone.org/docs/#metadata">metadata</a> docs for more info.</p>-<h2 id="backend-commands-5">Backend commands</h2>+<h2 id="backend-commands-6">Backend commands</h2><p>Here are the commands specific to the hasher backend.</p><p>Run them with</p><pre><code>rclone backend COMMAND remote:</code></pre>@@ -26079,7 +27784,7 @@ rclone backend drop Hasher:</code></pre><h1 id="hdfs">HDFS</h1><p><a href="https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/HdfsDesign.html">HDFS</a> is a distributed file-system, part of the <a href="https://hadoop.apache.org/">Apache Hadoop</a> framework.</p><p>Paths are specified as <code>remote:</code> or <code>remote:path/to/dir</code>.</p>-<h2 id="configuration-20">Configuration</h2>+<h2 id="configuration-22">Configuration</h2><p>Here is an example of how to make a remote called <code>remote</code>. First run:</p><pre><code> rclone config</code></pre><p>This will guide you through an interactive setup process:</p>@@ -26187,7 +27892,7 @@ username = root</code></pre></tbody></table><p>Invalid UTF-8 bytes will also be <a href="https://rclone.org/overview/#invalid-utf8">replaced</a>.</p>-<h3 id="standard-options-21">Standard options</h3>+<h3 id="standard-options-23">Standard options</h3><p>Here are the Standard options specific to hdfs (Hadoop distributed file system).</p><h4 id="hdfs-namenode">--hdfs-namenode</h4><p>Hadoop name nodes and ports.</p>@@ -26215,7 +27920,7 @@ username = root</code></pre></ul></li></ul></li></ul>-<h3 id="advanced-options-21">Advanced options</h3>+<h3 id="advanced-options-23">Advanced options</h3><p>Here are the Advanced options specific to hdfs (Hadoop distributed file system).</p><h4 id="hdfs-service-principal-name">--hdfs-service-principal-name</h4><p>Kerberos service principal name for the namenode.</p>@@ -26263,7 +27968,7 @@ username = root</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h2 id="limitations-16">Limitations</h2>+<h2 id="limitations-17">Limitations</h2><ul><li>No server-side <code>Move</code> or <code>DirMove</code>.</li><li>Checksums not implemented.</li>@@ -26272,7 +27977,7 @@ username = root</code></pre><p>Paths are specified as <code>remote:path</code></p><p>Paths may be as deep as required, e.g. <code>remote:directory/subdirectory</code>.</p><p>The initial setup for hidrive involves getting a token from HiDrive which you need to do in your browser. <code>rclone config</code> walks you through it.</p>-<h2 id="configuration-21">Configuration</h2>+<h2 id="configuration-23">Configuration</h2><p>Here is an example of how to make a remote called <code>remote</code>. First run:</p><pre><code> rclone config</code></pre><p>This will guide you through an interactive setup process:</p>@@ -26340,7 +28045,7 @@ y/e/d> y</code></pre><p>Using</p><pre><code>rclone config reconnect remote:</code></pre><p>the process is very similar to the process of initial setup exemplified before.</p>-<h3 id="modification-times-and-hashes-9">Modification times and hashes</h3>+<h3 id="modification-times-and-hashes-10">Modification times and hashes</h3><p>HiDrive allows modification times to be set on objects accurate to 1 second.</p><p>HiDrive supports <a href="https://static.hidrive.com/dev/0001">its own hash type</a> which is used to verify the integrity of file contents after successful transfers.</p><h3 id="restricted-filename-characters-12">Restricted filename characters</h3>@@ -26370,7 +28075,7 @@ rclone lsd remote:/users/test/path</code></pre><p>By default, rclone will know the number of directory members contained in a directory. For example, <code>rclone lsd</code> uses this information.</p><p>The acquisition of this information will result in additional time costs for HiDrive's API. When dealing with large directory structures, it may be desirable to circumvent this time cost, especially when this information is not explicitly needed. For this, the <code>disable_fetching_member_count</code> option can be used.</p><p>See the below section about configuration options for more details.</p>-<h3 id="standard-options-22">Standard options</h3>+<h3 id="standard-options-24">Standard options</h3><p>Here are the Standard options specific to hidrive (HiDrive).</p><h4 id="hidrive-client-id">--hidrive-client-id</h4><p>OAuth Client Id.</p>@@ -26412,7 +28117,7 @@ rclone lsd remote:/users/test/path</code></pre></ul></li></ul></li></ul>-<h3 id="advanced-options-22">Advanced options</h3>+<h3 id="advanced-options-24">Advanced options</h3><p>Here are the Advanced options specific to hidrive (HiDrive).</p><h4 id="hidrive-token">--hidrive-token</h4><p>OAuth Access Token as a JSON blob.</p>@@ -26578,7 +28283,7 @@ rclone lsd remote:/users/test/path</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h2 id="limitations-17">Limitations</h2>+<h2 id="limitations-18">Limitations</h2><h3 id="symbolic-links">Symbolic links</h3><p>HiDrive is able to store symbolic links (<em>symlinks</em>) by design, for example, when unpacked from a zip archive.</p><p>There exists no direct mechanism to manage native symlinks in remotes. As such this implementation has chosen to ignore any native symlinks present in the remote. rclone will not be able to access or show any symlinks stored in the hidrive-remote. This means symlinks cannot be individually removed, copied, or moved, except when removing, copying, or moving the parent folder.</p>@@ -26592,7 +28297,7 @@ rclone lsd remote:/users/test/path</code></pre><p>The <code>remote:</code> represents the configured <a href="#http-url">url</a>, and any path following it will be resolved relative to this url, according to the URL standard. This means with remote url <code>https://beta.rclone.org/branch</code> and path <code>fix</code>, the resolved URL will be <code>https://beta.rclone.org/branch/fix</code>, while with path <code>/fix</code> the resolved URL will be <code>https://beta.rclone.org/fix</code> as the absolute path is resolved from the root of the domain.</p><p>If the path following the <code>remote:</code> ends with <code>/</code> it will be assumed to point to a directory. If the path does not end with <code>/</code>, then a HEAD request is sent and the response used to decide if it it is treated as a file or a directory (run with <code>-vv</code> to see details). When <a href="#http-no-head">--http-no-head</a> is specified, a path without ending <code>/</code> is always assumed to be a file. If rclone incorrectly assumes the path is a file, the solution is to specify the path with ending <code>/</code>. When you know the path is a directory, ending it with <code>/</code> is always better as it avoids the initial HEAD request.</p><p>To just download a single file it is easier to use <a href="https://rclone.org/commands/rclone_copyurl/">copyurl</a>.</p>-<h2 id="configuration-22">Configuration</h2>+<h2 id="configuration-24">Configuration</h2><p>Here is an example of how to make a remote called <code>remote</code>. First run:</p><pre><code> rclone config</code></pre><p>This will guide you through an interactive setup process:</p>@@ -26656,7 +28361,7 @@ e/n/d/r/c/s/q> q</code></pre><pre><code>rclone lsd --http-url https://beta.rclone.org :http:</code></pre><p>or:</p><pre><code>rclone lsd :http,url='https://beta.rclone.org':</code></pre>-<h3 id="standard-options-23">Standard options</h3>+<h3 id="standard-options-25">Standard options</h3><p>Here are the Standard options specific to http (HTTP).</p><h4 id="http-url">--http-url</h4><p>URL of HTTP host to connect to.</p>@@ -26677,7 +28382,7 @@ e/n/d/r/c/s/q> q</code></pre><li>Type: bool</li><li>Default: false</li></ul>-<h3 id="advanced-options-23">Advanced options</h3>+<h3 id="advanced-options-25">Advanced options</h3><p>Here are the Advanced options specific to http (HTTP).</p><h4 id="http-headers">--http-headers</h4><p>Set HTTP headers for all transactions.</p>@@ -26729,14 +28434,14 @@ e/n/d/r/c/s/q> q</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h2 id="backend-commands-6">Backend commands</h2>+<h2 id="backend-commands-7">Backend commands</h2><p>Here are the commands specific to the http backend.</p><p>Run them with</p><pre><code>rclone backend COMMAND remote:</code></pre><p>The help below will explain what arguments each command takes.</p><p>See the <a href="https://rclone.org/commands/rclone_backend/">backend</a> command for more info on how to pass options and arguments.</p><p>These can be run on a running backend using the rc command <a href="https://rclone.org/rc/#backend-command">backend/command</a>.</p>-<h3 id="set-2">set</h3>+<h3 id="set-3">set</h3><p>Set command for updating the config parameters.</p><pre><code>rclone backend set remote: [options] [<arguments>+]</code></pre><p>This set command can be used to update the config parameters for a running http backend.</p>@@ -26747,7 +28452,7 @@ rclone rc backend/command command=set fs=remote: -o url=https://example.com</cod<p>The option keys are named as they are in the config file.</p><p>This rebuilds the connection to the http backend when it is called with the new parameters. Only new parameters need be passed as the values will default to those currently in use.</p><p>It doesn't return anything.</p>-<h2 id="limitations-18">Limitations</h2>+<h2 id="limitations-19">Limitations</h2><p><code>rclone about</code> is not supported by the HTTP backend. Backends without this capability cannot determine free space for an rclone mount or use policy <code>mfs</code> (most free space) as a member of an rclone union remote.</p><p>See <a href="https://rclone.org/overview/#optional-features">List of backends that do not support rclone about</a> and <a href="https://rclone.org/commands/rclone_about/">rclone about</a></p><h1 id="imagekit">ImageKit</h1>@@ -26756,7 +28461,7 @@ rclone rc backend/command command=set fs=remote: -o url=https://example.com</cod<p><a href="https://imagekit.io/">ImageKit.io</a> provides real-time image and video optimizations, transformations, and CDN delivery. Over 1,000 businesses and 70,000 developers trust ImageKit with their images and videos on the web.</p><h4 id="accounts-pricing-1">Accounts & Pricing</h4><p>To use this backend, you need to <a href="https://imagekit.io/registration/">create an account</a> on ImageKit. Start with a free plan with generous usage limits. Then, as your requirements grow, upgrade to a plan that best fits your needs. See <a href="https://imagekit.io/plans">the pricing details</a>.</p>-<h2 id="configuration-23">Configuration</h2>+<h2 id="configuration-25">Configuration</h2><p>Here is an example of making an imagekit configuration.</p><p>Firstly create a <a href="https://imagekit.io/">ImageKit.io</a> account and choose a plan.</p><p>You will need to log in and get the <code>publicKey</code> and <code>privateKey</code> for your account from the developer section.</p>@@ -26823,7 +28528,7 @@ y/e/d> y</code></pre><p>ImageKit does not support modification times or hashes yet.</p><h3 id="checksums">Checksums</h3><p>No checksums are supported.</p>-<h3 id="standard-options-24">Standard options</h3>+<h3 id="standard-options-26">Standard options</h3><p>Here are the Standard options specific to imagekit (ImageKit.io).</p><h4 id="imagekit-endpoint">--imagekit-endpoint</h4><p>You can find your ImageKit.io URL endpoint in your <a href="https://imagekit.io/dashboard/developer/api-keys">dashboard</a></p>@@ -26852,7 +28557,7 @@ y/e/d> y</code></pre><li>Type: string</li><li>Required: true</li></ul>-<h3 id="advanced-options-24">Advanced options</h3>+<h3 id="advanced-options-26">Advanced options</h3><p>Here are the Advanced options specific to imagekit (ImageKit.io).</p><h4 id="imagekit-only-signed">--imagekit-only-signed</h4><p>If you have configured <code>Restrict unsigned image URLs</code> in your dashboard settings, set this to true.</p>@@ -26900,7 +28605,7 @@ y/e/d> y</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h3 id="metadata-10">Metadata</h3>+<h3 id="metadata-11">Metadata</h3><p>Any metadata supported by the underlying remote is read and written.</p><p>Here are the possible system metadata items for the imagekit backend.</p><table>@@ -27002,7 +28707,7 @@ y/e/d> y</code></pre></table><p>See the <a href="https://rclone.org/docs/#metadata">metadata</a> docs for more info.</p><h1 id="icloud-drive">iCloud Drive</h1>-<h2 id="configuration-24">Configuration</h2>+<h2 id="configuration-26">Configuration</h2><p>The initial setup for an iCloud Drive backend involves getting a trust token/session. This can be done by simply using the regular iCloud password, and accepting the code prompt on another iCloud connected device.</p><p><strong>IMPORTANT</strong>: At the moment an app specific password won't be accepted. Only use your regular password and 2FA.</p><p><code>rclone config</code> walks you through the token creation. The trust token is valid for 30 days. After which you will have to reauthenticate with <code>rclone reconnect</code> or <code>rclone config</code>.</p>@@ -27047,7 +28752,7 @@ Enter a value.config_2fa> 2FACODERemote config---------------------[koofr]+[iclouddrive]- type: iclouddrive- apple_id: APPLEID- password: *** ENCRYPTED ***@@ -27060,7 +28765,14 @@ d) Delete this remotey/e/d> y</code></pre><h2 id="advanced-data-protection">Advanced Data Protection</h2><p>ADP is currently unsupported and need to be disabled</p>-<h3 id="standard-options-25">Standard options</h3>+<p>On iPhone, Settings <code>></code> Apple Account <code>></code> iCloud <code>></code> 'Access iCloud Data on the Web' must be ON, and 'Advanced Data Protection' OFF.</p>+<h2 id="troubleshooting-2">Troubleshooting</h2>+<h3 id="missing-pcs-cookies-from-the-request">Missing PCS cookies from the request</h3>+<p>This means you have Advanced Data Protection (ADP) turned on. This is not supported at the moment. If you want to use rclone you will have to turn it off. See above for how to turn it off.</p>+<p>You will need to clear the <code>cookies</code> and the <code>trust_token</code> fields in the config. Or you can delete the remote config and start again.</p>+<p>You should then run <code>rclone reconnect remote:</code>.</p>+<p>Note that changing the ADP setting may not take effect immediately - you may need to wait a few hours or a day before you can get rclone to work - keep clearing the config entry and running <code>rclone reconnect remote:</code> until rclone functions properly.</p>+<h3 id="standard-options-27">Standard options</h3><p>Here are the Standard options specific to iclouddrive (iCloud Drive).</p><h4 id="iclouddrive-apple-id">--iclouddrive-apple-id</h4><p>Apple ID.</p>@@ -27099,7 +28811,7 @@ y/e/d> y</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h3 id="advanced-options-25">Advanced options</h3>+<h3 id="advanced-options-27">Advanced options</h3><p>Here are the Advanced options specific to iclouddrive (iCloud Drive).</p><h4 id="iclouddrive-client-id">--iclouddrive-client-id</h4><p>Client id</p>@@ -27156,7 +28868,7 @@ y/e/d> y</code></pre><p>These auto-created files can be excluded from the sync using <a href="https://rclone.org/filtering/#metadata">metadata filtering</a>.</p><pre><code>rclone sync ... --metadata-exclude "source=metadata" --metadata-exclude "format=Metadata"</code></pre><p>Which excludes from the sync any files which have the <code>source=metadata</code> or <code>format=Metadata</code> flags which are added to Internet Archive auto-created files.</p>-<h2 id="configuration-25">Configuration</h2>+<h2 id="configuration-27">Configuration</h2><p>Here is an example of making an internetarchive configuration. Most applies to the other providers as well, any differences are described <a href="#providers">below</a>.</p><p>First run</p><pre><code>rclone config</code></pre>@@ -27225,7 +28937,7 @@ y) Yes this is OK (default)e) Edit this remoted) Delete this remotey/e/d> y</code></pre>-<h3 id="standard-options-26">Standard options</h3>+<h3 id="standard-options-28">Standard options</h3><p>Here are the Standard options specific to internetarchive (Internet Archive).</p><h4 id="internetarchive-access-key-id">--internetarchive-access-key-id</h4><p>IAS3 Access Key.</p>@@ -27247,7 +28959,16 @@ y/e/d> y</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h3 id="advanced-options-26">Advanced options</h3>+<h4 id="internetarchive-item-derive">--internetarchive-item-derive</h4>+<p>Whether to trigger derive on the IA item or not. If set to false, the item will not be derived by IA upon upload. The derive process produces a number of secondary files from an upload to make an upload more usable on the web. Setting this to false is useful for uploading files that are already in a format that IA can display or reduce burden on IA's infrastructure.</p>+<p>Properties:</p>+<ul>+<li>Config: item_derive</li>+<li>Env Var: RCLONE_INTERNETARCHIVE_ITEM_DERIVE</li>+<li>Type: bool</li>+<li>Default: true</li>+</ul>+<h3 id="advanced-options-28">Advanced options</h3><p>Here are the Advanced options specific to internetarchive (Internet Archive).</p><h4 id="internetarchive-endpoint">--internetarchive-endpoint</h4><p>IAS3 Endpoint.</p>@@ -27269,6 +28990,15 @@ y/e/d> y</code></pre><li>Type: string</li><li>Default: "https://archive.org"</li></ul>+<h4 id="internetarchive-item-metadata">--internetarchive-item-metadata</h4>+<p>Metadata to be set on the IA item, this is different from file-level metadata that can be set using --metadata-set. Format is key=value and the 'x-archive-meta-' prefix is automatically added.</p>+<p>Properties:</p>+<ul>+<li>Config: item_metadata</li>+<li>Env Var: RCLONE_INTERNETARCHIVE_ITEM_METADATA</li>+<li>Type: stringArray</li>+<li>Default: []</li>+</ul><h4 id="internetarchive-disable-checksum">--internetarchive-disable-checksum</h4><p>Don't ask the server to test against MD5 checksum calculated by rclone. Normally rclone will calculate the MD5 checksum of the input before uploading it so it can ask the server to check the object against checksum. This is great for data integrity checking but can cause long delays for large files to start uploading.</p><p>Properties:</p>@@ -27306,7 +29036,7 @@ y/e/d> y</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h3 id="metadata-11">Metadata</h3>+<h3 id="metadata-12">Metadata</h3><p>Metadata fields provided by Internet Archive. If there are multiple values for a key, only the first one is returned. This is a limitation of Rclone, that supports one value per one key.</p><p>Owner is able to add custom keys. Metadata feature grabs all the keys including them.</p><p>Here are the possible system metadata items for the internetarchive backend.</p>@@ -27453,7 +29183,7 @@ Response: {"error":"invalid_grant","error_description&q<p>Onlime has sold access to Jottacloud proper, while providing localized support to Danish Customers, but have recently set up their own hosting, transferring their customers from Jottacloud servers to their own ones.</p><p>This, of course, necessitates using their servers for authentication, but otherwise functionality and architecture seems equivalent to Jottacloud.</p><p>To setup rclone to use Onlime Cloud Storage, choose Onlime Cloud authentication in the setup. The rest of the setup is identical to the default setup.</p>-<h2 id="configuration-26">Configuration</h2>+<h2 id="configuration-28">Configuration</h2><p>Here is an example of how to make a remote called <code>remote</code> with the default setup. First run:</p><pre><code>rclone config</code></pre><p>This will guide you through an interactive setup process:</p>@@ -27557,7 +29287,7 @@ y/e/d> y</code></pre><p>This backend supports <code>--fast-list</code> which allows you to use fewer transactions in exchange for more memory. See the <a href="https://rclone.org/docs/#fast-list">rclone docs</a> for more details.</p><p>Note that the implementation in Jottacloud always uses only a single API request to get the entire list, so for large folders this could lead to long wait time before the first results are shown.</p><p>Note also that with rclone version 1.58 and newer, information about <a href="https://rclone.org/overview/#mime-type">MIME types</a> and metadata item <a href="#metadata">utime</a> are not available when using <code>--fast-list</code>.</p>-<h3 id="modification-times-and-hashes-10">Modification times and hashes</h3>+<h3 id="modification-times-and-hashes-11">Modification times and hashes</h3><p>Jottacloud allows modification times to be set on objects accurate to 1 second. These will be used to detect whether objects need syncing or not.</p><p>Jottacloud supports MD5 type hashes, so you can use the <code>--checksum</code> flag.</p><p>Note that Jottacloud requires the MD5 hash before upload so if the source does not have an MD5 checksum then the file will be cached temporarily on disk (in location given by <a href="https://rclone.org/docs/#temp-dir-dir">--temp-dir</a>) before it is uploaded. Small files will be cached in memory - see the <a href="#jottacloud-md5-memory-limit">--jottacloud-md5-memory-limit</a> flag. When uploading from local disk the source checksum is always available, so this does not apply. Starting with rclone version 1.52 the same is true for encrypted remotes (in older versions the crypt backend would not calculate hashes for uploads from local disk, so the Jottacloud backend had to do it as described above).</p>@@ -27617,7 +29347,7 @@ y/e/d> y</code></pre><p>Versioning can be disabled by <code>--jottacloud-no-versions</code> option. This is achieved by deleting the remote file prior to uploading a new version. If the upload the fails no version of the file will be available in the remote.</p><h3 id="quota-information-1">Quota information</h3><p>To view your current quota you can use the <code>rclone about remote:</code> command which will display your usage limit (unless it is unlimited) and the current usage.</p>-<h3 id="standard-options-27">Standard options</h3>+<h3 id="standard-options-29">Standard options</h3><p>Here are the Standard options specific to jottacloud (Jottacloud).</p><h4 id="jottacloud-client-id">--jottacloud-client-id</h4><p>OAuth Client Id.</p>@@ -27639,7 +29369,7 @@ y/e/d> y</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h3 id="advanced-options-27">Advanced options</h3>+<h3 id="advanced-options-29">Advanced options</h3><p>Here are the Advanced options specific to jottacloud (Jottacloud).</p><h4 id="jottacloud-token">--jottacloud-token</h4><p>OAuth Access Token as a JSON blob.</p>@@ -27745,7 +29475,7 @@ y/e/d> y</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h3 id="metadata-12">Metadata</h3>+<h3 id="metadata-13">Metadata</h3><p>Jottacloud has limited support for metadata, currently an extended set of timestamps.</p><p>Here are the possible system metadata items for the jottacloud backend.</p><table>@@ -27797,16 +29527,16 @@ y/e/d> y</code></pre></tbody></table><p>See the <a href="https://rclone.org/docs/#metadata">metadata</a> docs for more info.</p>-<h2 id="limitations-19">Limitations</h2>+<h2 id="limitations-20">Limitations</h2><p>Note that Jottacloud is case insensitive so you can't have a file called "Hello.doc" and one called "hello.doc".</p><p>There are quite a few characters that can't be in Jottacloud file names. Rclone will map these names to and from an identical looking unicode equivalent. For example if a file has a ? in it will be mapped to ? instead.</p><p>Jottacloud only supports filenames up to 255 characters in length.</p>-<h2 id="troubleshooting-1">Troubleshooting</h2>+<h2 id="troubleshooting-3">Troubleshooting</h2><p>Jottacloud exhibits some inconsistent behaviours regarding deleted files and folders which may cause Copy, Move and DirMove operations to previously deleted paths to fail. Emptying the trash should help in such cases.</p><h1 id="koofr">Koofr</h1><p>Paths are specified as <code>remote:path</code></p><p>Paths may be as deep as required, e.g. <code>remote:directory/subdirectory</code>.</p>-<h2 id="configuration-27">Configuration</h2>+<h2 id="configuration-29">Configuration</h2><p>The initial setup for Koofr involves creating an application password for rclone. You can do that by opening the Koofr <a href="https://app.koofr.net/app/admin/preferences/password">web application</a>, giving the password a nice name like <code>rclone</code> and clicking on generate.</p><p>Here is an example of how to make a remote called <code>koofr</code>. First run:</p><pre><code> rclone config</code></pre>@@ -27893,7 +29623,7 @@ y/e/d> y</code></pre></tbody></table><p>Invalid UTF-8 bytes will also be <a href="https://rclone.org/overview/#invalid-utf8">replaced</a>, as they can't be used in XML strings.</p>-<h3 id="standard-options-28">Standard options</h3>+<h3 id="standard-options-30">Standard options</h3><p>Here are the Standard options specific to koofr (Koofr, Digi Storage and other Koofr-compatible storage providers).</p><h4 id="koofr-provider">--koofr-provider</h4><p>Choose your storage provider.</p>@@ -27949,7 +29679,7 @@ y/e/d> y</code></pre><li>Type: string</li><li>Required: true</li></ul>-<h3 id="advanced-options-28">Advanced options</h3>+<h3 id="advanced-options-30">Advanced options</h3><p>Here are the Advanced options specific to koofr (Koofr, Digi Storage and other Koofr-compatible storage providers).</p><h4 id="koofr-mountid">--koofr-mountid</h4><p>Mount ID of the mount to use.</p>@@ -27990,7 +29720,7 @@ y/e/d> y</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h2 id="limitations-20">Limitations</h2>+<h2 id="limitations-21">Limitations</h2><p>Note that Koofr is case insensitive so you can't have a file called "Hello.doc" and one called "hello.doc".</p><h2 id="providers-2">Providers</h2><h3 id="koofr-1">Koofr</h3>@@ -28120,7 +29850,7 @@ d) Delete this remotey/e/d> y</code></pre><h1 id="linkbox">Linkbox</h1><p>Linkbox is <a href="https://linkbox.to/">a private cloud drive</a>.</p>-<h2 id="configuration-28">Configuration</h2>+<h2 id="configuration-30">Configuration</h2><p>Here is an example of making a remote for Linkbox.</p><p>First run:</p><pre><code> rclone config</code></pre>@@ -28156,7 +29886,7 @@ e) Edit this remoted) Delete this remotey/e/d> y</code></pre>-<h3 id="standard-options-29">Standard options</h3>+<h3 id="standard-options-31">Standard options</h3><p>Here are the Standard options specific to linkbox (Linkbox).</p><h4 id="linkbox-token">--linkbox-token</h4><p>Token from https://www.linkbox.to/admin/account</p>@@ -28167,7 +29897,7 @@ y/e/d> y<li>Type: string</li><li>Required: true</li></ul>-<h3 id="advanced-options-29">Advanced options</h3>+<h3 id="advanced-options-31">Advanced options</h3><p>Here are the Advanced options specific to linkbox (Linkbox).</p><h4 id="linkbox-description">--linkbox-description</h4><p>Description of the remote.</p>@@ -28178,7 +29908,7 @@ y/e/d> y<li>Type: string</li><li>Required: false</li></ul>-<h2 id="limitations-21">Limitations</h2>+<h2 id="limitations-22">Limitations</h2><p>Invalid UTF-8 bytes will also be <a href="https://rclone.org/overview/#invalid-utf8">replaced</a>, as they can't be used in JSON strings.</p><h1 id="mail.ru-cloud">Mail.ru Cloud</h1><p><a href="https://cloud.mail.ru/">Mail.ru Cloud</a> is a cloud storage provided by a Russian internet company <a href="https://mail.ru">Mail.Ru Group</a>. The official desktop client is <a href="https://disk-o.cloud/en">Disk-O:</a>, available on Windows and Mac OS.</p>@@ -28193,7 +29923,7 @@ y/e/d> y<li>Storage keeps hash for all files and performs transparent deduplication, the hash algorithm is a modified SHA1</li><li>If a particular file is already present in storage, one can quickly submit file hash instead of long file upload (this optimization is supported by rclone)</li></ul>-<h2 id="configuration-29">Configuration</h2>+<h2 id="configuration-31">Configuration</h2><p>Here is an example of making a mailru configuration.</p><p>First create a Mail.ru Cloud account and choose a tariff.</p><p>You will need to log in and create an app password for rclone. Rclone <strong>will not work</strong> with your normal username and password - it will give an error like <code>oauth2: server response missing access_token</code>.</p>@@ -28202,6 +29932,7 @@ y/e/d> y<li>Go to Security / "Пароль и безопасность"</li><li>Click password for apps / "Пароли для внешних приложений"</li><li>Add the password - give it a name - eg "rclone"</li>+<li>Select the permissions level. For some reason just "Full access to Cloud" (WebDav) doesn't work for Rclone currently. You have to select "Full access to Mail, Cloud and Calendar" (all protocols). (<a href="https://forum.rclone.org/t/failed-to-create-file-system-for-mailru-failed-to-authorize-oauth2-invalid-username-or-password-username-or-password-is-incorrect/49298">thread on forum.rclone.org</a>)</li><li>Copy the password and use this password below - your normal login password won't work.</li></ul><p>Now run</p>@@ -28273,7 +30004,7 @@ y/e/d> y</code></pre><pre><code>rclone ls remote:directory</code></pre><p>Sync <code>/home/local/directory</code> to the remote path, deleting any excess files in the path.</p><pre><code>rclone sync --interactive /home/local/directory remote:directory</code></pre>-<h3 id="modification-times-and-hashes-11">Modification times and hashes</h3>+<h3 id="modification-times-and-hashes-12">Modification times and hashes</h3><p>Files support a modification time attribute with up to 1 second precision. Directories do not have a modification time, which is shown as "Jan 1 1970".</p><p>File hashes are supported, with a custom Mail.ru algorithm based on SHA1. If file size is less than or equal to the SHA1 block size (20 bytes), its hash is simply its data right-padded with zero bytes. Hashes of a larger file is computed as a SHA1 of the file data bytes concatenated with a decimal representation of the data length.</p><h3 id="emptying-trash-1">Emptying Trash</h3>@@ -28334,7 +30065,7 @@ y/e/d> y</code></pre></tbody></table><p>Invalid UTF-8 bytes will also be <a href="https://rclone.org/overview/#invalid-utf8">replaced</a>, as they can't be used in JSON strings.</p>-<h3 id="standard-options-30">Standard options</h3>+<h3 id="standard-options-32">Standard options</h3><p>Here are the Standard options specific to mailru (Mail.ru Cloud).</p><h4 id="mailru-client-id">--mailru-client-id</h4><p>OAuth Client Id.</p>@@ -28397,7 +30128,7 @@ y/e/d> y</code></pre></ul></li></ul></li></ul>-<h3 id="advanced-options-30">Advanced options</h3>+<h3 id="advanced-options-32">Advanced options</h3><p>Here are the Advanced options specific to mailru (Mail.ru Cloud).</p><h4 id="mailru-token">--mailru-token</h4><p>OAuth Access Token as a JSON blob.</p>@@ -28575,15 +30306,15 @@ y/e/d> y</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h2 id="limitations-22">Limitations</h2>+<h2 id="limitations-23">Limitations</h2><p>File size limits depend on your account. A single file size is limited by 2G for a free account and unlimited for paid tariffs. Please refer to the Mail.ru site for the total uploaded size limits.</p><p>Note that Mailru is case insensitive so you can't have a file called "Hello.doc" and one called "hello.doc".</p>-<h1 id="mega">Mega</h1>+<h1 id="mega-1">Mega</h1><p><a href="https://mega.nz/">Mega</a> is a cloud storage and file hosting service known for its security feature where all files are encrypted locally before they are uploaded. This prevents anyone (including employees of Mega) from accessing the files without knowledge of the key used for encryption.</p><p>This is an rclone backend for Mega which supports the file transfer features of Mega using the same client side encryption.</p><p>Paths are specified as <code>remote:path</code></p><p>Paths may be as deep as required, e.g. <code>remote:directory/subdirectory</code>.</p>-<h2 id="configuration-30">Configuration</h2>+<h2 id="configuration-32">Configuration</h2><p>Here is an example of how to make a remote called <code>remote</code>. First run:</p><pre><code> rclone config</code></pre><p>This will guide you through an interactive setup process:</p>@@ -28630,7 +30361,7 @@ y/e/d> y</code></pre><pre><code>rclone ls remote:</code></pre><p>To copy a local directory to an Mega directory called backup</p><pre><code>rclone copy /home/source remote:backup</code></pre>-<h3 id="modification-times-and-hashes-12">Modification times and hashes</h3>+<h3 id="modification-times-and-hashes-13">Modification times and hashes</h3><p>Mega does not support modification times or hashes yet.</p><h3 id="restricted-filename-characters-16">Restricted filename characters</h3><table>@@ -28655,7 +30386,7 @@ y/e/d> y</code></pre></tbody></table><p>Invalid UTF-8 bytes will also be <a href="https://rclone.org/overview/#invalid-utf8">replaced</a>, as they can't be used in JSON strings.</p>-<h3 id="duplicated-files-3">Duplicated files</h3>+<h3 id="duplicated-files-4">Duplicated files</h3><p>Mega can have two files with exactly the same name and path (unlike a normal file system).</p><p>Duplicated files cause problems with the syncing and you will see messages in the log about duplicates.</p><p>Use <code>rclone dedupe</code> to fix duplicated files.</p>@@ -28684,7 +30415,7 @@ [email protected]:/$ </code></pre><p>Note that once blocked, the use of other tools (such as megacmd) is not a sure workaround: following megacmd login times have been observed in succession for blocked remote: 7 minutes, 20 min, 30min, 30 min, 30min. Web access looks unaffected though.</p><p>Investigation is continuing in relation to workarounds based on timeouts, pacers, retrials and tpslimits - if you discover something relevant, please post on the forum.</p><p>So, if rclone was working nicely and suddenly you are unable to log-in and you are sure the user and the password are correct, likely you have got the remote blocked for a while.</p>-<h3 id="standard-options-31">Standard options</h3>+<h3 id="standard-options-33">Standard options</h3><p>Here are the Standard options specific to mega (Mega).</p><h4 id="mega-user">--mega-user</h4><p>User name.</p>@@ -28705,7 +30436,7 @@ [email protected]:/$ </code></pre><li>Type: string</li><li>Required: true</li></ul>-<h3 id="advanced-options-31">Advanced options</h3>+<h3 id="advanced-options-33">Advanced options</h3><p>Here are the Advanced options specific to mega (Mega).</p><h4 id="mega-debug">--mega-debug</h4><p>Output more debug from Mega.</p>@@ -28756,15 +30487,15 @@ [email protected]:/$ </code></pre><li>Type: string</li><li>Required: false</li></ul>-<h3 id="process-killed">Process <code>killed</code></h3>+<h3 id="process-killed-1">Process <code>killed</code></h3><p>On accounts with large files or something else, memory usage can significantly increase when executing list/sync instructions. When running on cloud providers (like AWS with EC2), check if the instance type has sufficient memory/CPU to execute the commands. Use the resource monitoring tools to inspect after sending the commands. Look <a href="https://forum.rclone.org/t/rclone-with-mega-appears-to-work-only-in-some-accounts/40233/4">at this issue</a>.</p>-<h2 id="limitations-23">Limitations</h2>+<h2 id="limitations-24">Limitations</h2><p>This backend uses the <a href="https://github.com/t3rm1n4l/go-mega">go-mega go library</a> which is an opensource go library implementing the Mega API. There doesn't appear to be any documentation for the mega protocol beyond the <a href="https://github.com/meganz/sdk">mega C++ SDK</a> source code so there are likely quite a few errors still remaining in this library.</p><p>Mega allows duplicate files which may confuse rclone.</p><h1 id="memory">Memory</h1><p>The memory backend is an in RAM backend. It does not persist its data - use the local backend for that.</p><p>The memory backend behaves like a bucket-based remote (e.g. like s3). Because it has no parameters you can just use it with the <code>:memory:</code> remote name.</p>-<h2 id="configuration-31">Configuration</h2>+<h2 id="configuration-33">Configuration</h2><p>You can configure it as a remote like this with <code>rclone config</code> too if you want to:</p><pre><code>No remotes found, make a new one?n) New remote@@ -28796,11 +30527,11 @@ y/e/d> y</code></pre><pre><code>rclone mount :memory: /mnt/tmprclone serve webdav :memory:rclone serve sftp :memory:</code></pre>-<h3 id="modification-times-and-hashes-13">Modification times and hashes</h3>+<h3 id="modification-times-and-hashes-14">Modification times and hashes</h3><p>The memory backend supports MD5 hashes and modification times accurate to 1 nS.</p><h3 id="restricted-filename-characters-17">Restricted filename characters</h3><p>The memory backend replaces the <a href="https://rclone.org/overview/#restricted-characters">default restricted characters set</a>.</p>-<h3 id="advanced-options-32">Advanced options</h3>+<h3 id="advanced-options-34">Advanced options</h3><p>Here are the Advanced options specific to memory (In memory object storage system.).</p><h4 id="memory-description">--memory-description</h4><p>Description of the remote.</p>@@ -28815,7 +30546,7 @@ rclone serve sftp :memory:</code></pre><p>Paths are specified as <code>remote:</code> You may put subdirectories in too, e.g. <code>remote:/path/to/dir</code>. If you have a CP code you can use that as the folder after the domain such as <domain>/<cpcode>/<internal directories within cpcode>.</p><p>For example, this is commonly configured with or without a CP code: * <strong>With a CP code</strong>. <code>[your-domain-prefix]-nsu.akamaihd.net/123456/subdirectory/</code> * <strong>Without a CP code</strong>. <code>[your-domain-prefix]-nsu.akamaihd.net</code></p><p>See all buckets rclone lsd remote: The initial setup for Netstorage involves getting an account and secret. Use <code>rclone config</code> to walk you through the setup process.</p>-<h2 id="configuration-32">Configuration</h2>+<h2 id="configuration-34">Configuration</h2><p>Here's an example of how to make a remote called <code>ns1</code>.</p><ol type="1"><li>To begin the interactive configuration process, enter this command:</li>@@ -28923,7 +30654,7 @@ y/e/d> y</code></pre><h3 id="purge-1">Purge</h3><p>NetStorage remote supports the purge feature by using the "quick-delete" NetStorage API action. The quick-delete action is disabled by default for security reasons and can be enabled for the account through the Akamai portal. Rclone will first try to use quick-delete action for the purge command and if this functionality is disabled then will fall back to a standard delete method.</p><p><strong>Note</strong>: Read the <a href="https://learn.akamai.com/en-us/webhelp/netstorage/netstorage-http-api-developer-guide/GUID-15836617-9F50-405A-833C-EA2556756A30.html">NetStorage Usage API</a> for considerations when using "quick-delete". In general, using quick-delete method will not delete the tree immediately and objects targeted for quick-delete may still be accessible.</p>-<h3 id="standard-options-32">Standard options</h3>+<h3 id="standard-options-34">Standard options</h3><p>Here are the Standard options specific to netstorage (Akamai NetStorage).</p><h4 id="netstorage-host">--netstorage-host</h4><p>Domain+path of NetStorage host to connect to.</p>@@ -28955,7 +30686,7 @@ y/e/d> y</code></pre><li>Type: string</li><li>Required: true</li></ul>-<h3 id="advanced-options-33">Advanced options</h3>+<h3 id="advanced-options-35">Advanced options</h3><p>Here are the Advanced options specific to netstorage (Akamai NetStorage).</p><h4 id="netstorage-protocol">--netstorage-protocol</h4><p>Select between HTTP or HTTPS protocol.</p>@@ -28987,7 +30718,7 @@ y/e/d> y</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h2 id="backend-commands-7">Backend commands</h2>+<h2 id="backend-commands-8">Backend commands</h2><p>Here are the commands specific to the netstorage backend.</p><p>Run them with</p><pre><code>rclone backend COMMAND remote:</code></pre>@@ -29004,7 +30735,7 @@ y/e/d> y</code></pre><p>The desired path location (including applicable sub-directories) ending in the object that will be the target of the symlink (for example, /links/mylink). Include the file extension for the object, if applicable. <code>rclone backend symlink <src> <path></code></p><h1 id="microsoft-azure-blob-storage">Microsoft Azure Blob Storage</h1><p>Paths are specified as <code>remote:container</code> (or <code>remote:</code> for the <code>lsd</code> command.) You may put subdirectories in too, e.g. <code>remote:container/path/to/dir</code>.</p>-<h2 id="configuration-33">Configuration</h2>+<h2 id="configuration-35">Configuration</h2><p>Here is an example of making a Microsoft Azure Blob Storage configuration. For a remote called <code>remote</code>. First run:</p><pre><code> rclone config</code></pre><p>This will guide you through an interactive setup process:</p>@@ -29049,7 +30780,7 @@ y/e/d> y</code></pre><pre><code>rclone sync --interactive /home/local/directory remote:container</code></pre><h3 id="fast-list-5">--fast-list</h3><p>This remote supports <code>--fast-list</code> which allows you to use fewer transactions in exchange for more memory. See the <a href="https://rclone.org/docs/#fast-list">rclone docs</a> for more details.</p>-<h3 id="modification-times-and-hashes-14">Modification times and hashes</h3>+<h3 id="modification-times-and-hashes-15">Modification times and hashes</h3><p>The modification time is stored as metadata on the object with the <code>mtime</code> key. It is stored using RFC3339 Format time with nanosecond precision. The metadata is supplied during directory listings so there is no performance overhead to using it.</p><p>If you wish to use the Azure standard <code>LastModified</code> time stored on the object as the modified time, then use the <code>--use-server-modtime</code> flag. Note that rclone can't set <code>LastModified</code>, so using the <code>--update</code> flag when syncing is recommended if using <code>--use-server-modtime</code>.</p><p>MD5 hashes are stored with blobs. However blobs that were uploaded in chunks only have an MD5 if the source remote was capable of MD5 hashes, e.g. the local disk.</p>@@ -29206,7 +30937,7 @@ container/</code></pre><h4 id="anonymous">Anonymous</h4><p>If you want to access resources with public anonymous access then set <code>account</code> only. You can do this without making an rclone config:</p><pre><code>rclone lsf :azureblob,account=ACCOUNT:CONTAINER</code></pre>-<h3 id="standard-options-33">Standard options</h3>+<h3 id="standard-options-35">Standard options</h3><p>Here are the Standard options specific to azureblob (Microsoft Azure Blob Storage).</p><h4 id="azureblob-account">--azureblob-account</h4><p>Azure Storage Account Name.</p>@@ -29302,7 +31033,7 @@ container/</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h3 id="advanced-options-34">Advanced options</h3>+<h3 id="advanced-options-36">Advanced options</h3><p>Here are the Advanced options specific to azureblob (Microsoft Azure Blob Storage).</p><h4 id="azureblob-client-send-certificate-chain">--azureblob-client-send-certificate-chain</h4><p>Send the certificate chain when using certificate auth.</p>@@ -29469,6 +31200,42 @@ container/</code></pre><li>Type: int</li><li>Default: 16</li></ul>+<h4 id="azureblob-copy-cutoff">--azureblob-copy-cutoff</h4>+<p>Cutoff for switching to multipart copy.</p>+<p>Any files larger than this that need to be server-side copied will be copied in chunks of chunk_size using the put block list API.</p>+<p>Files smaller than this limit will be copied with the Copy Blob API.</p>+<p>Properties:</p>+<ul>+<li>Config: copy_cutoff</li>+<li>Env Var: RCLONE_AZUREBLOB_COPY_CUTOFF</li>+<li>Type: SizeSuffix</li>+<li>Default: 8Mi</li>+</ul>+<h4 id="azureblob-copy-concurrency">--azureblob-copy-concurrency</h4>+<p>Concurrency for multipart copy.</p>+<p>This is the number of chunks of the same file that are copied concurrently.</p>+<p>These chunks are not buffered in memory and Microsoft recommends setting this value to greater than 1000 in the azcopy documentation.</p>+<p>https://learn.microsoft.com/en-us/azure/storage/common/storage-use-azcopy-optimize#increase-concurrency</p>+<p>In tests, copy speed increases almost linearly with copy concurrency.</p>+<p>Properties:</p>+<ul>+<li>Config: copy_concurrency</li>+<li>Env Var: RCLONE_AZUREBLOB_COPY_CONCURRENCY</li>+<li>Type: int</li>+<li>Default: 512</li>+</ul>+<h4 id="azureblob-use-copy-blob">--azureblob-use-copy-blob</h4>+<p>Whether to use the Copy Blob API when copying to the same storage account.</p>+<p>If true (the default) then rclone will use the Copy Blob API for copies to the same storage account even when the size is above the copy_cutoff.</p>+<p>Rclone assumes that the same storage account means the same config and does not check for the same storage account in different configs.</p>+<p>There should be no need to change this value.</p>+<p>Properties:</p>+<ul>+<li>Config: use_copy_blob</li>+<li>Env Var: RCLONE_AZUREBLOB_USE_COPY_BLOB</li>+<li>Type: bool</li>+<li>Default: true</li>+</ul><h4 id="azureblob-list-chunk">--azureblob-list-chunk</h4><p>Size of blob list.</p><p>This sets the number of blobs requested in each listing chunk. Default is the maximum, 5000. "List blobs" requests are permitted 2 minutes per megabyte to complete. If an operation is taking longer than 2 minutes per megabyte on average, it will time out ( <a href="https://docs.microsoft.com/en-us/rest/api/storageservices/setting-timeouts-for-blob-service-operations#exceptions-to-default-timeout-interval">source</a> ). This can be used to limit the number of blobs items to return, to avoid the time out.</p>@@ -29636,9 +31403,10 @@ container/</code></pre><li>Content-Encoding</li><li>Content-Language</li><li>Content-Type</li>+<li>X-MS-Tags</li></ul>-<p>Eg <code>--header-upload "Content-Type: text/potato"</code></p>-<h2 id="limitations-24">Limitations</h2>+<p>Eg <code>--header-upload "Content-Type: text/potato"</code> or <code>--header-upload "X-MS-Tags: foo=bar"</code></p>+<h2 id="limitations-25">Limitations</h2><p>MD5 sums are only uploaded with chunked files if the source has an MD5 sum. This will always be the case for a local to azure copy.</p><p><code>rclone about</code> is not supported by the Microsoft Azure Blob storage backend. Backends without this capability cannot determine free space for an rclone mount or use policy <code>mfs</code> (most free space) as a member of an rclone union remote.</p><p>See <a href="https://rclone.org/overview/#optional-features">List of backends that do not support rclone about</a> and <a href="https://rclone.org/commands/rclone_about/">rclone about</a></p>@@ -29648,7 +31416,7 @@ container/</code></pre><p>Also, if you want to access a storage emulator instance running on a different machine, you can override the <code>endpoint</code> parameter in the advanced settings, setting it to <code>http(s)://<host>:<port>/devstoreaccount1</code> (e.g. <code>http://10.254.2.5:10000/devstoreaccount1</code>).</p><h1 id="microsoft-azure-files-storage">Microsoft Azure Files Storage</h1><p>Paths are specified as <code>remote:</code> You may put subdirectories in too, e.g. <code>remote:path/to/dir</code>.</p>-<h2 id="configuration-34">Configuration</h2>+<h2 id="configuration-36">Configuration</h2><p>Here is an example of making a Microsoft Azure Files Storage configuration. For a remote called <code>remote</code>. First run:</p><pre><code> rclone config</code></pre><p>This will guide you through an interactive setup process:</p>@@ -29847,6 +31615,7 @@ y/e/d> </code></pre><h5 id="env-auth-2.-managed-service-identity-credentials-1">Env Auth: 2. Managed Service Identity Credentials</h5><p>When using Managed Service Identity if the VM(SS) on which this program is running has a system-assigned identity, it will be used by default. If the resource has no system-assigned but exactly one user-assigned identity, the user-assigned identity will be used by default.</p><p>If the resource has multiple user-assigned identities you will need to unset <code>env_auth</code> and set <code>use_msi</code> instead. See the <a href="#use_msi"><code>use_msi</code> section</a>.</p>+<p>If you are operating in disconnected clouds, or private clouds such as Azure Stack you may want to set <code>disable_instance_discovery = true</code>. This determines whether rclone requests Microsoft Entra instance metadata from <code>https://login.microsoft.com/</code> before authenticating. Setting this to <code>true</code> will skip this request, making you responsible for ensuring the configured authority is valid and trustworthy.</p><h5 id="env-auth-3.-azure-cli-credentials-as-used-by-the-az-tool-1">Env Auth: 3. Azure CLI credentials (as used by the az tool)</h5><p>Credentials created with the <code>az</code> tool can be picked up using <code>env_auth</code>.</p><p>For example if you were to login with a service principal like this:</p>@@ -29893,7 +31662,9 @@ y/e/d> </code></pre><p>If <code>use_msi</code> is set then managed service identity credentials are used. This authentication only works when running in an Azure service. <code>env_auth</code> needs to be unset to use this.</p><p>However if you have multiple user identities to choose from these must be explicitly specified using exactly one of the <code>msi_object_id</code>, <code>msi_client_id</code>, or <code>msi_mi_res_id</code> parameters.</p><p>If none of <code>msi_object_id</code>, <code>msi_client_id</code>, or <code>msi_mi_res_id</code> is set, this is is equivalent to using <code>env_auth</code>.</p>-<h3 id="standard-options-34">Standard options</h3>+<h4 id="use_az">Azure CLI tool <code>az</code></h4>+<p>Set to use the <a href="https://learn.microsoft.com/en-us/cli/azure/">Azure CLI tool <code>az</code></a> as the sole means of authentication. Setting this can be useful if you wish to use the <code>az</code> CLI on a host with a System Managed Identity that you do not want to use. Don't set <code>env_auth</code> at the same time.</p>+<h3 id="standard-options-36">Standard options</h3><p>Here are the Standard options specific to azurefiles (Microsoft Azure Files).</p><h4 id="azurefiles-account">--azurefiles-account</h4><p>Azure Storage Account Name.</p>@@ -30008,7 +31779,7 @@ y/e/d> </code></pre><li>Type: string</li><li>Required: false</li></ul>-<h3 id="advanced-options-35">Advanced options</h3>+<h3 id="advanced-options-37">Advanced options</h3><p>Here are the Advanced options specific to azurefiles (Microsoft Azure Files).</p><h4 id="azurefiles-client-send-certificate-chain">--azurefiles-client-send-certificate-chain</h4><p>Send the certificate chain when using certificate auth.</p>@@ -30100,6 +31871,24 @@ y/e/d> </code></pre><li>Type: string</li><li>Required: false</li></ul>+<h4 id="azurefiles-disable-instance-discovery">--azurefiles-disable-instance-discovery</h4>+<p>Skip requesting Microsoft Entra instance metadata This should be set true only by applications authenticating in disconnected clouds, or private clouds such as Azure Stack. It determines whether rclone requests Microsoft Entra instance metadata from <code>https://login.microsoft.com/</code> before authenticating. Setting this to true will skip this request, making you responsible for ensuring the configured authority is valid and trustworthy.</p>+<p>Properties:</p>+<ul>+<li>Config: disable_instance_discovery</li>+<li>Env Var: RCLONE_AZUREFILES_DISABLE_INSTANCE_DISCOVERY</li>+<li>Type: bool</li>+<li>Default: false</li>+</ul>+<h4 id="azurefiles-use-az">--azurefiles-use-az</h4>+<p>Use Azure CLI tool az for authentication Set to use the <a href="https://learn.microsoft.com/en-us/cli/azure/">Azure CLI tool az</a> as the sole means of authentication. Setting this can be useful if you wish to use the az CLI on a host with a System Managed Identity that you do not want to use. Don't set env_auth at the same time.</p>+<p>Properties:</p>+<ul>+<li>Config: use_az</li>+<li>Env Var: RCLONE_AZUREFILES_USE_AZ</li>+<li>Type: bool</li>+<li>Default: false</li>+</ul><h4 id="azurefiles-endpoint">--azurefiles-endpoint</h4><p>Endpoint for the service.</p><p>Leave blank normally.</p>@@ -30178,12 +31967,12 @@ y/e/d> </code></pre><li>Content-Type</li></ul><p>Eg <code>--header-upload "Content-Type: text/potato"</code></p>-<h2 id="limitations-25">Limitations</h2>+<h2 id="limitations-26">Limitations</h2><p>MD5 sums are only uploaded with chunked files if the source has an MD5 sum. This will always be the case for a local to azure copy.</p><h1 id="microsoft-onedrive">Microsoft OneDrive</h1><p>Paths are specified as <code>remote:path</code></p><p>Paths may be as deep as required, e.g. <code>remote:directory/subdirectory</code>.</p>-<h2 id="configuration-35">Configuration</h2>+<h2 id="configuration-37">Configuration</h2><p>The initial setup for OneDrive involves getting a token from Microsoft which you need to do in your browser. <code>rclone config</code> walks you through it.</p><p>Here is an example of how to make a remote called <code>remote</code>. First run:</p><pre><code> rclone config</code></pre>@@ -30306,7 +32095,7 @@ y/e/d> y</code></pre></ol><p>When it comes to choosing the type of the connection work with the client credentials flow. In particular the "onedrive" option does not work. You can use the "sharepoint" option or if that does not find the correct drive ID type it in manually with the "driveid" option.</p><p><strong>NOTE</strong> Assigning permissions directly to the application means that anyone with the <em>Client ID</em> and <em>Client Secret</em> can access your OneDrive files. Take care to safeguard these credentials.</p>-<h3 id="modification-times-and-hashes-15">Modification times and hashes</h3>+<h3 id="modification-times-and-hashes-16">Modification times and hashes</h3><p>OneDrive allows modification times to be set on objects accurate to 1 second. These will be used to detect whether objects need syncing or not.</p><p>OneDrive Personal, OneDrive for Business and Sharepoint Server support <a href="https://docs.microsoft.com/en-us/onedrive/developer/code-snippets/quickxorhash">QuickXorHash</a>.</p><p>Before rclone 1.62 the default hash for Onedrive Personal was <code>SHA1</code>. For rclone 1.62 and above the default for all Onedrive backends is <code>QuickXorHash</code>.</p>@@ -30419,7 +32208,7 @@ y/e/d> y</code></pre><p>Invalid UTF-8 bytes will also be <a href="https://rclone.org/overview/#invalid-utf8">replaced</a>, as they can't be used in JSON strings.</p><h3 id="deleting-files-4">Deleting files</h3><p>Any files you delete with rclone will end up in the trash. Microsoft doesn't provide an API to permanently delete files, nor to empty the trash, so you will have to do that with one of Microsoft's apps or via the OneDrive website.</p>-<h3 id="standard-options-35">Standard options</h3>+<h3 id="standard-options-37">Standard options</h3><p>Here are the Standard options specific to onedrive (Microsoft OneDrive).</p><h4 id="onedrive-client-id">--onedrive-client-id</h4><p>OAuth Client Id.</p>@@ -30461,7 +32250,7 @@ y/e/d> y</code></pre></ul></li><li>"de"<ul>-<li>Microsoft Cloud Germany</li>+<li>Microsoft Cloud Germany (deprecated - try global region first).</li></ul></li><li>"cn"<ul>@@ -30479,7 +32268,7 @@ y/e/d> y</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h3 id="advanced-options-36">Advanced options</h3>+<h3 id="advanced-options-38">Advanced options</h3><p>Here are the Advanced options specific to onedrive (Microsoft OneDrive).</p><h4 id="onedrive-token">--onedrive-token</h4><p>OAuth Access Token as a JSON blob.</p>@@ -30520,6 +32309,18 @@ y/e/d> y</code></pre><li>Type: bool</li><li>Default: false</li></ul>+<h4 id="onedrive-upload-cutoff">--onedrive-upload-cutoff</h4>+<p>Cutoff for switching to chunked upload.</p>+<p>Any files larger than this will be uploaded in chunks of chunk_size.</p>+<p>This is disabled by default as uploading using single part uploads causes rclone to use twice the storage on Onedrive business as when rclone sets the modification time after the upload Onedrive creates a new version.</p>+<p>See: https://github.com/rclone/rclone/issues/1716</p>+<p>Properties:</p>+<ul>+<li>Config: upload_cutoff</li>+<li>Env Var: RCLONE_ONEDRIVE_UPLOAD_CUTOFF</li>+<li>Type: SizeSuffix</li>+<li>Default: off</li>+</ul><h4 id="onedrive-chunk-size">--onedrive-chunk-size</h4><p>Chunk size to upload files with - must be multiple of 320k (327,680 bytes).</p><p>Above this size files will be chunked - must be multiple of 320k (327,680 bytes) and should not exceed 250M (262,144,000 bytes) else you may encounter "Microsoft.SharePoint.Client.InvalidClientQueryException: The request message is too big." Note that the chunks will be buffered into memory.</p>@@ -30829,80 +32630,80 @@ rclone rc vfs/refresh recursive=true</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h3 id="metadata-13">Metadata</h3>+<h3 id="metadata-14">Metadata</h3><p>OneDrive supports System Metadata (not User Metadata, as of this writing) for both files and directories. Much of the metadata is read-only, and there are some differences between OneDrive Personal and Business (see table below for details).</p><p>Permissions are also supported, if <code>--onedrive-metadata-permissions</code> is set. The accepted values for <code>--onedrive-metadata-permissions</code> are "<code>read</code>", "<code>write</code>", "<code>read,write</code>", and "<code>off</code>" (the default). "<code>write</code>" supports adding new permissions, updating the "role" of existing permissions, and removing permissions. Updating and removing require the Permission ID to be known, so it is recommended to use "<code>read,write</code>" instead of "<code>write</code>" if you wish to update/remove permissions.</p><p>Permissions are read/written in JSON format using the same schema as the <a href="https://learn.microsoft.com/en-us/onedrive/developer/rest-api/resources/permission?view=odsp-graph-online">OneDrive API</a>, which differs slightly between OneDrive Personal and Business.</p><p>Example for OneDrive Personal:</p>-<div class="sourceCode" id="cb1313"><pre class="sourceCode json"><code class="sourceCode json"><span id="cb1313-1"><a href="#cb1313-1" aria-hidden="true"></a><span class="ot">[</span></span>-<span id="cb1313-2"><a href="#cb1313-2" aria-hidden="true"></a> <span class="fu">{</span></span>-<span id="cb1313-3"><a href="#cb1313-3" aria-hidden="true"></a> <span class="dt">"id"</span><span class="fu">:</span> <span class="st">"1234567890ABC!123"</span><span class="fu">,</span></span>-<span id="cb1313-4"><a href="#cb1313-4" aria-hidden="true"></a> <span class="dt">"grantedTo"</span><span class="fu">:</span> <span class="fu">{</span></span>-<span id="cb1313-5"><a href="#cb1313-5" aria-hidden="true"></a> <span class="dt">"user"</span><span class="fu">:</span> <span class="fu">{</span></span>-<span id="cb1313-6"><a href="#cb1313-6" aria-hidden="true"></a> <span class="dt">"id"</span><span class="fu">:</span> <span class="st">"[email protected]"</span></span>-<span id="cb1313-7"><a href="#cb1313-7" aria-hidden="true"></a> <span class="fu">},</span></span>-<span id="cb1313-8"><a href="#cb1313-8" aria-hidden="true"></a> <span class="dt">"application"</span><span class="fu">:</span> <span class="fu">{},</span></span>-<span id="cb1313-9"><a href="#cb1313-9" aria-hidden="true"></a> <span class="dt">"device"</span><span class="fu">:</span> <span class="fu">{}</span></span>-<span id="cb1313-10"><a href="#cb1313-10" aria-hidden="true"></a> <span class="fu">},</span></span>-<span id="cb1313-11"><a href="#cb1313-11" aria-hidden="true"></a> <span class="dt">"invitation"</span><span class="fu">:</span> <span class="fu">{</span></span>-<span id="cb1313-12"><a href="#cb1313-12" aria-hidden="true"></a> <span class="dt">"email"</span><span class="fu">:</span> <span class="st">"[email protected]"</span></span>-<span id="cb1313-13"><a href="#cb1313-13" aria-hidden="true"></a> <span class="fu">},</span></span>-<span id="cb1313-14"><a href="#cb1313-14" aria-hidden="true"></a> <span class="dt">"link"</span><span class="fu">:</span> <span class="fu">{</span></span>-<span id="cb1313-15"><a href="#cb1313-15" aria-hidden="true"></a> <span class="dt">"webUrl"</span><span class="fu">:</span> <span class="st">"https://1drv.ms/t/s!1234567890ABC"</span></span>-<span id="cb1313-16"><a href="#cb1313-16" aria-hidden="true"></a> <span class="fu">},</span></span>-<span id="cb1313-17"><a href="#cb1313-17" aria-hidden="true"></a> <span class="dt">"roles"</span><span class="fu">:</span> <span class="ot">[</span></span>-<span id="cb1313-18"><a href="#cb1313-18" aria-hidden="true"></a> <span class="st">"read"</span></span>-<span id="cb1313-19"><a href="#cb1313-19" aria-hidden="true"></a> <span class="ot">]</span><span class="fu">,</span></span>-<span id="cb1313-20"><a href="#cb1313-20" aria-hidden="true"></a> <span class="dt">"shareId"</span><span class="fu">:</span> <span class="st">"s!1234567890ABC"</span></span>-<span id="cb1313-21"><a href="#cb1313-21" aria-hidden="true"></a> <span class="fu">}</span></span>-<span id="cb1313-22"><a href="#cb1313-22" aria-hidden="true"></a><span class="ot">]</span></span></code></pre></div>+<div class="sourceCode" id="cb1405"><pre class="sourceCode json"><code class="sourceCode json"><span id="cb1405-1"><a href="#cb1405-1" aria-hidden="true"></a><span class="ot">[</span></span>+<span id="cb1405-2"><a href="#cb1405-2" aria-hidden="true"></a> <span class="fu">{</span></span>+<span id="cb1405-3"><a href="#cb1405-3" aria-hidden="true"></a> <span class="dt">"id"</span><span class="fu">:</span> <span class="st">"1234567890ABC!123"</span><span class="fu">,</span></span>+<span id="cb1405-4"><a href="#cb1405-4" aria-hidden="true"></a> <span class="dt">"grantedTo"</span><span class="fu">:</span> <span class="fu">{</span></span>+<span id="cb1405-5"><a href="#cb1405-5" aria-hidden="true"></a> <span class="dt">"user"</span><span class="fu">:</span> <span class="fu">{</span></span>+<span id="cb1405-6"><a href="#cb1405-6" aria-hidden="true"></a> <span class="dt">"id"</span><span class="fu">:</span> <span class="st">"[email protected]"</span></span>+<span id="cb1405-7"><a href="#cb1405-7" aria-hidden="true"></a> <span class="fu">},</span></span>+<span id="cb1405-8"><a href="#cb1405-8" aria-hidden="true"></a> <span class="dt">"application"</span><span class="fu">:</span> <span class="fu">{},</span></span>+<span id="cb1405-9"><a href="#cb1405-9" aria-hidden="true"></a> <span class="dt">"device"</span><span class="fu">:</span> <span class="fu">{}</span></span>+<span id="cb1405-10"><a href="#cb1405-10" aria-hidden="true"></a> <span class="fu">},</span></span>+<span id="cb1405-11"><a href="#cb1405-11" aria-hidden="true"></a> <span class="dt">"invitation"</span><span class="fu">:</span> <span class="fu">{</span></span>+<span id="cb1405-12"><a href="#cb1405-12" aria-hidden="true"></a> <span class="dt">"email"</span><span class="fu">:</span> <span class="st">"[email protected]"</span></span>+<span id="cb1405-13"><a href="#cb1405-13" aria-hidden="true"></a> <span class="fu">},</span></span>+<span id="cb1405-14"><a href="#cb1405-14" aria-hidden="true"></a> <span class="dt">"link"</span><span class="fu">:</span> <span class="fu">{</span></span>+<span id="cb1405-15"><a href="#cb1405-15" aria-hidden="true"></a> <span class="dt">"webUrl"</span><span class="fu">:</span> <span class="st">"https://1drv.ms/t/s!1234567890ABC"</span></span>+<span id="cb1405-16"><a href="#cb1405-16" aria-hidden="true"></a> <span class="fu">},</span></span>+<span id="cb1405-17"><a href="#cb1405-17" aria-hidden="true"></a> <span class="dt">"roles"</span><span class="fu">:</span> <span class="ot">[</span></span>+<span id="cb1405-18"><a href="#cb1405-18" aria-hidden="true"></a> <span class="st">"read"</span></span>+<span id="cb1405-19"><a href="#cb1405-19" aria-hidden="true"></a> <span class="ot">]</span><span class="fu">,</span></span>+<span id="cb1405-20"><a href="#cb1405-20" aria-hidden="true"></a> <span class="dt">"shareId"</span><span class="fu">:</span> <span class="st">"s!1234567890ABC"</span></span>+<span id="cb1405-21"><a href="#cb1405-21" aria-hidden="true"></a> <span class="fu">}</span></span>+<span id="cb1405-22"><a href="#cb1405-22" aria-hidden="true"></a><span class="ot">]</span></span></code></pre></div><p>Example for OneDrive Business:</p>-<div class="sourceCode" id="cb1314"><pre class="sourceCode json"><code class="sourceCode json"><span id="cb1314-1"><a href="#cb1314-1" aria-hidden="true"></a><span class="ot">[</span></span>-<span id="cb1314-2"><a href="#cb1314-2" aria-hidden="true"></a> <span class="fu">{</span></span>-<span id="cb1314-3"><a href="#cb1314-3" aria-hidden="true"></a> <span class="dt">"id"</span><span class="fu">:</span> <span class="st">"48d31887-5fad-4d73-a9f5-3c356e68a038"</span><span class="fu">,</span></span>-<span id="cb1314-4"><a href="#cb1314-4" aria-hidden="true"></a> <span class="dt">"grantedToIdentities"</span><span class="fu">:</span> <span class="ot">[</span></span>-<span id="cb1314-5"><a href="#cb1314-5" aria-hidden="true"></a> <span class="fu">{</span></span>-<span id="cb1314-6"><a href="#cb1314-6" aria-hidden="true"></a> <span class="dt">"user"</span><span class="fu">:</span> <span class="fu">{</span></span>-<span id="cb1314-7"><a href="#cb1314-7" aria-hidden="true"></a> <span class="dt">"displayName"</span><span class="fu">:</span> <span class="st">"[email protected]"</span></span>-<span id="cb1314-8"><a href="#cb1314-8" aria-hidden="true"></a> <span class="fu">},</span></span>-<span id="cb1314-9"><a href="#cb1314-9" aria-hidden="true"></a> <span class="dt">"application"</span><span class="fu">:</span> <span class="fu">{},</span></span>-<span id="cb1314-10"><a href="#cb1314-10" aria-hidden="true"></a> <span class="dt">"device"</span><span class="fu">:</span> <span class="fu">{}</span></span>-<span id="cb1314-11"><a href="#cb1314-11" aria-hidden="true"></a> <span class="fu">}</span></span>-<span id="cb1314-12"><a href="#cb1314-12" aria-hidden="true"></a> <span class="ot">]</span><span class="fu">,</span></span>-<span id="cb1314-13"><a href="#cb1314-13" aria-hidden="true"></a> <span class="dt">"link"</span><span class="fu">:</span> <span class="fu">{</span></span>-<span id="cb1314-14"><a href="#cb1314-14" aria-hidden="true"></a> <span class="dt">"type"</span><span class="fu">:</span> <span class="st">"view"</span><span class="fu">,</span></span>-<span id="cb1314-15"><a href="#cb1314-15" aria-hidden="true"></a> <span class="dt">"scope"</span><span class="fu">:</span> <span class="st">"users"</span><span class="fu">,</span></span>-<span id="cb1314-16"><a href="#cb1314-16" aria-hidden="true"></a> <span class="dt">"webUrl"</span><span class="fu">:</span> <span class="st">"https://contoso.sharepoint.com/:w:/t/design/a577ghg9hgh737613bmbjf839026561fmzhsr85ng9f3hjck2t5s"</span></span>-<span id="cb1314-17"><a href="#cb1314-17" aria-hidden="true"></a> <span class="fu">},</span></span>-<span id="cb1314-18"><a href="#cb1314-18" aria-hidden="true"></a> <span class="dt">"roles"</span><span class="fu">:</span> <span class="ot">[</span></span>-<span id="cb1314-19"><a href="#cb1314-19" aria-hidden="true"></a> <span class="st">"read"</span></span>-<span id="cb1314-20"><a href="#cb1314-20" aria-hidden="true"></a> <span class="ot">]</span><span class="fu">,</span></span>-<span id="cb1314-21"><a href="#cb1314-21" aria-hidden="true"></a> <span class="dt">"shareId"</span><span class="fu">:</span> <span class="st">"u!LKj1lkdlals90j1nlkascl"</span></span>-<span id="cb1314-22"><a href="#cb1314-22" aria-hidden="true"></a> <span class="fu">}</span><span class="ot">,</span></span>-<span id="cb1314-23"><a href="#cb1314-23" aria-hidden="true"></a> <span class="fu">{</span></span>-<span id="cb1314-24"><a href="#cb1314-24" aria-hidden="true"></a> <span class="dt">"id"</span><span class="fu">:</span> <span class="st">"5D33DD65C6932946"</span><span class="fu">,</span></span>-<span id="cb1314-25"><a href="#cb1314-25" aria-hidden="true"></a> <span class="dt">"grantedTo"</span><span class="fu">:</span> <span class="fu">{</span></span>-<span id="cb1314-26"><a href="#cb1314-26" aria-hidden="true"></a> <span class="dt">"user"</span><span class="fu">:</span> <span class="fu">{</span></span>-<span id="cb1314-27"><a href="#cb1314-27" aria-hidden="true"></a> <span class="dt">"displayName"</span><span class="fu">:</span> <span class="st">"John Doe"</span><span class="fu">,</span></span>-<span id="cb1314-28"><a href="#cb1314-28" aria-hidden="true"></a> <span class="dt">"id"</span><span class="fu">:</span> <span class="st">"efee1b77-fb3b-4f65-99d6-274c11914d12"</span></span>-<span id="cb1314-29"><a href="#cb1314-29" aria-hidden="true"></a> <span class="fu">},</span></span>-<span id="cb1314-30"><a href="#cb1314-30" aria-hidden="true"></a> <span class="dt">"application"</span><span class="fu">:</span> <span class="fu">{},</span></span>-<span id="cb1314-31"><a href="#cb1314-31" aria-hidden="true"></a> <span class="dt">"device"</span><span class="fu">:</span> <span class="fu">{}</span></span>-<span id="cb1314-32"><a href="#cb1314-32" aria-hidden="true"></a> <span class="fu">},</span></span>-<span id="cb1314-33"><a href="#cb1314-33" aria-hidden="true"></a> <span class="dt">"roles"</span><span class="fu">:</span> <span class="ot">[</span></span>-<span id="cb1314-34"><a href="#cb1314-34" aria-hidden="true"></a> <span class="st">"owner"</span></span>-<span id="cb1314-35"><a href="#cb1314-35" aria-hidden="true"></a> <span class="ot">]</span><span class="fu">,</span></span>-<span id="cb1314-36"><a href="#cb1314-36" aria-hidden="true"></a> <span class="dt">"shareId"</span><span class="fu">:</span> <span class="st">"FWxc1lasfdbEAGM5fI7B67aB5ZMPDMmQ11U"</span></span>-<span id="cb1314-37"><a href="#cb1314-37" aria-hidden="true"></a> <span class="fu">}</span></span>-<span id="cb1314-38"><a href="#cb1314-38" aria-hidden="true"></a><span class="ot">]</span></span></code></pre></div>+<div class="sourceCode" id="cb1406"><pre class="sourceCode json"><code class="sourceCode json"><span id="cb1406-1"><a href="#cb1406-1" aria-hidden="true"></a><span class="ot">[</span></span>+<span id="cb1406-2"><a href="#cb1406-2" aria-hidden="true"></a> <span class="fu">{</span></span>+<span id="cb1406-3"><a href="#cb1406-3" aria-hidden="true"></a> <span class="dt">"id"</span><span class="fu">:</span> <span class="st">"48d31887-5fad-4d73-a9f5-3c356e68a038"</span><span class="fu">,</span></span>+<span id="cb1406-4"><a href="#cb1406-4" aria-hidden="true"></a> <span class="dt">"grantedToIdentities"</span><span class="fu">:</span> <span class="ot">[</span></span>+<span id="cb1406-5"><a href="#cb1406-5" aria-hidden="true"></a> <span class="fu">{</span></span>+<span id="cb1406-6"><a href="#cb1406-6" aria-hidden="true"></a> <span class="dt">"user"</span><span class="fu">:</span> <span class="fu">{</span></span>+<span id="cb1406-7"><a href="#cb1406-7" aria-hidden="true"></a> <span class="dt">"displayName"</span><span class="fu">:</span> <span class="st">"[email protected]"</span></span>+<span id="cb1406-8"><a href="#cb1406-8" aria-hidden="true"></a> <span class="fu">},</span></span>+<span id="cb1406-9"><a href="#cb1406-9" aria-hidden="true"></a> <span class="dt">"application"</span><span class="fu">:</span> <span class="fu">{},</span></span>+<span id="cb1406-10"><a href="#cb1406-10" aria-hidden="true"></a> <span class="dt">"device"</span><span class="fu">:</span> <span class="fu">{}</span></span>+<span id="cb1406-11"><a href="#cb1406-11" aria-hidden="true"></a> <span class="fu">}</span></span>+<span id="cb1406-12"><a href="#cb1406-12" aria-hidden="true"></a> <span class="ot">]</span><span class="fu">,</span></span>+<span id="cb1406-13"><a href="#cb1406-13" aria-hidden="true"></a> <span class="dt">"link"</span><span class="fu">:</span> <span class="fu">{</span></span>+<span id="cb1406-14"><a href="#cb1406-14" aria-hidden="true"></a> <span class="dt">"type"</span><span class="fu">:</span> <span class="st">"view"</span><span class="fu">,</span></span>+<span id="cb1406-15"><a href="#cb1406-15" aria-hidden="true"></a> <span class="dt">"scope"</span><span class="fu">:</span> <span class="st">"users"</span><span class="fu">,</span></span>+<span id="cb1406-16"><a href="#cb1406-16" aria-hidden="true"></a> <span class="dt">"webUrl"</span><span class="fu">:</span> <span class="st">"https://contoso.sharepoint.com/:w:/t/design/a577ghg9hgh737613bmbjf839026561fmzhsr85ng9f3hjck2t5s"</span></span>+<span id="cb1406-17"><a href="#cb1406-17" aria-hidden="true"></a> <span class="fu">},</span></span>+<span id="cb1406-18"><a href="#cb1406-18" aria-hidden="true"></a> <span class="dt">"roles"</span><span class="fu">:</span> <span class="ot">[</span></span>+<span id="cb1406-19"><a href="#cb1406-19" aria-hidden="true"></a> <span class="st">"read"</span></span>+<span id="cb1406-20"><a href="#cb1406-20" aria-hidden="true"></a> <span class="ot">]</span><span class="fu">,</span></span>+<span id="cb1406-21"><a href="#cb1406-21" aria-hidden="true"></a> <span class="dt">"shareId"</span><span class="fu">:</span> <span class="st">"u!LKj1lkdlals90j1nlkascl"</span></span>+<span id="cb1406-22"><a href="#cb1406-22" aria-hidden="true"></a> <span class="fu">}</span><span class="ot">,</span></span>+<span id="cb1406-23"><a href="#cb1406-23" aria-hidden="true"></a> <span class="fu">{</span></span>+<span id="cb1406-24"><a href="#cb1406-24" aria-hidden="true"></a> <span class="dt">"id"</span><span class="fu">:</span> <span class="st">"5D33DD65C6932946"</span><span class="fu">,</span></span>+<span id="cb1406-25"><a href="#cb1406-25" aria-hidden="true"></a> <span class="dt">"grantedTo"</span><span class="fu">:</span> <span class="fu">{</span></span>+<span id="cb1406-26"><a href="#cb1406-26" aria-hidden="true"></a> <span class="dt">"user"</span><span class="fu">:</span> <span class="fu">{</span></span>+<span id="cb1406-27"><a href="#cb1406-27" aria-hidden="true"></a> <span class="dt">"displayName"</span><span class="fu">:</span> <span class="st">"John Doe"</span><span class="fu">,</span></span>+<span id="cb1406-28"><a href="#cb1406-28" aria-hidden="true"></a> <span class="dt">"id"</span><span class="fu">:</span> <span class="st">"efee1b77-fb3b-4f65-99d6-274c11914d12"</span></span>+<span id="cb1406-29"><a href="#cb1406-29" aria-hidden="true"></a> <span class="fu">},</span></span>+<span id="cb1406-30"><a href="#cb1406-30" aria-hidden="true"></a> <span class="dt">"application"</span><span class="fu">:</span> <span class="fu">{},</span></span>+<span id="cb1406-31"><a href="#cb1406-31" aria-hidden="true"></a> <span class="dt">"device"</span><span class="fu">:</span> <span class="fu">{}</span></span>+<span id="cb1406-32"><a href="#cb1406-32" aria-hidden="true"></a> <span class="fu">},</span></span>+<span id="cb1406-33"><a href="#cb1406-33" aria-hidden="true"></a> <span class="dt">"roles"</span><span class="fu">:</span> <span class="ot">[</span></span>+<span id="cb1406-34"><a href="#cb1406-34" aria-hidden="true"></a> <span class="st">"owner"</span></span>+<span id="cb1406-35"><a href="#cb1406-35" aria-hidden="true"></a> <span class="ot">]</span><span class="fu">,</span></span>+<span id="cb1406-36"><a href="#cb1406-36" aria-hidden="true"></a> <span class="dt">"shareId"</span><span class="fu">:</span> <span class="st">"FWxc1lasfdbEAGM5fI7B67aB5ZMPDMmQ11U"</span></span>+<span id="cb1406-37"><a href="#cb1406-37" aria-hidden="true"></a> <span class="fu">}</span></span>+<span id="cb1406-38"><a href="#cb1406-38" aria-hidden="true"></a><span class="ot">]</span></span></code></pre></div><p>To write permissions, pass in a "permissions" metadata key using this same format. The <a href="https://rclone.org/docs/#metadata-mapper"><code>--metadata-mapper</code></a> tool can be very helpful for this.</p><p>When adding permissions, an email address can be provided in the <code>User.ID</code> or <code>DisplayName</code> properties of <code>grantedTo</code> or <code>grantedToIdentities</code>. Alternatively, an ObjectID can be provided in <code>User.ID</code>. At least one valid recipient must be provided in order to add a permission for a user. Creating a Public Link is also supported, if <code>Link.Scope</code> is set to <code>"anonymous"</code>.</p><p>Example request to add a "read" permission with <code>--metadata-mapper</code>:</p>-<div class="sourceCode" id="cb1315"><pre class="sourceCode json"><code class="sourceCode json"><span id="cb1315-1"><a href="#cb1315-1" aria-hidden="true"></a><span class="fu">{</span></span>-<span id="cb1315-2"><a href="#cb1315-2" aria-hidden="true"></a> <span class="dt">"Metadata"</span><span class="fu">:</span> <span class="fu">{</span></span>-<span id="cb1315-3"><a href="#cb1315-3" aria-hidden="true"></a> <span class="dt">"permissions"</span><span class="fu">:</span> <span class="st">"[{</span><span class="ch">\"</span><span class="st">grantedToIdentities</span><span class="ch">\"</span><span class="st">:[{</span><span class="ch">\"</span><span class="st">user</span><span class="ch">\"</span><span class="st">:{</span><span class="ch">\"</span><span class="st">id</span><span class="ch">\"</span><span class="st">:</span><span class="ch">\"</span><span class="st">[email protected]</span><span class="ch">\"</span><span class="st">}}],</span><span class="ch">\"</span><span class="st">roles</span><span class="ch">\"</span><span class="st">:[</span><span class="ch">\"</span><span class="st">read</span><span class="ch">\"</span><span class="st">]}]"</span></span>-<span id="cb1315-4"><a href="#cb1315-4" aria-hidden="true"></a> <span class="fu">}</span></span>-<span id="cb1315-5"><a href="#cb1315-5" aria-hidden="true"></a><span class="fu">}</span></span></code></pre></div>+<div class="sourceCode" id="cb1407"><pre class="sourceCode json"><code class="sourceCode json"><span id="cb1407-1"><a href="#cb1407-1" aria-hidden="true"></a><span class="fu">{</span></span>+<span id="cb1407-2"><a href="#cb1407-2" aria-hidden="true"></a> <span class="dt">"Metadata"</span><span class="fu">:</span> <span class="fu">{</span></span>+<span id="cb1407-3"><a href="#cb1407-3" aria-hidden="true"></a> <span class="dt">"permissions"</span><span class="fu">:</span> <span class="st">"[{</span><span class="ch">\"</span><span class="st">grantedToIdentities</span><span class="ch">\"</span><span class="st">:[{</span><span class="ch">\"</span><span class="st">user</span><span class="ch">\"</span><span class="st">:{</span><span class="ch">\"</span><span class="st">id</span><span class="ch">\"</span><span class="st">:</span><span class="ch">\"</span><span class="st">[email protected]</span><span class="ch">\"</span><span class="st">}}],</span><span class="ch">\"</span><span class="st">roles</span><span class="ch">\"</span><span class="st">:[</span><span class="ch">\"</span><span class="st">read</span><span class="ch">\"</span><span class="st">]}]"</span></span>+<span id="cb1407-4"><a href="#cb1407-4" aria-hidden="true"></a> <span class="fu">}</span></span>+<span id="cb1407-5"><a href="#cb1407-5" aria-hidden="true"></a><span class="fu">}</span></span></code></pre></div><p>Note that adding a permission can fail if a conflicting permission already exists for the file/folder.</p><p>To update an existing permission, include both the Permission ID and the new <code>roles</code> to be assigned. <code>roles</code> is the only property that can be changed.</p><p>To remove permissions, pass in a blob containing only the permissions you wish to keep (which can be empty, to remove all.) Note that the <code>owner</code> role will be ignored, as it cannot be removed.</p>@@ -31052,7 +32853,27 @@ rclone rc vfs/refresh recursive=true</code></pre></tbody></table><p>See the <a href="https://rclone.org/docs/#metadata">metadata</a> docs for more info.</p>-<h2 id="limitations-26">Limitations</h2>+<h3 id="impersonate-other-users-as-admin">Impersonate other users as Admin</h3>+<p>Unlike Google Drive and impersonating any domain user via service accounts, OneDrive requires you to authenticate as an admin account, and manually setup a remote per user you wish to impersonate.</p>+<ol type="1">+<li>In <a href="https://admin.microsoft.com">Microsoft 365 Admin Center</a>, open each user you need to "impersonate" and go to the OneDrive section. There is a heading called "Get access to files", you need to click to create the link, this creates the link of the format <code>https://{tenant}-my.sharepoint.com/personal/{user_name_domain_tld}/</code> but also changes the permissions so you your admin user has access.</li>+<li>Then in powershell run the following commands:</li>+</ol>+<pre class="console"><code>Install-Module Microsoft.Graph -Scope CurrentUser -Repository PSGallery -Force+Import-Module Microsoft.Graph.Files+Connect-MgGraph -Scopes "Files.ReadWrite.All"+# Follow the steps to allow access to your admin user+# Then run this for each user you want to impersonate to get the Drive ID+Get-MgUserDefaultDrive -UserId '{emailaddress}'+# This will give you output of the format:+# Name Id DriveType CreatedDateTime+# ---- -- --------- ---------------+# OneDrive b!XYZ123 business 14/10/2023 1:00:58 pm+</code></pre>+<ol start="3" type="1">+<li>Then in rclone add a onedrive remote type, and use the <code>Type in driveID</code> with the DriveID you got in the previous step. One remote per user. It will then confirm the drive ID, and hopefully give you a message of <code>Found drive "root" of type "business"</code> and then include the URL of the format <code>https://{tenant}-my.sharepoint.com/personal/{user_name_domain_tld}/Documents</code></li>+</ol>+<h2 id="limitations-27">Limitations</h2><p>If you don't use rclone for 90 days the refresh token will expire. This will result in authorization problems. This is easy to fix by running the <code>rclone config reconnect remote:</code> command to get a new token and refresh token.</p><h3 id="naming">Naming</h3><p>Note that OneDrive is case insensitive so you can't have a file called "Hello.doc" and one called "hello.doc".</p>@@ -31097,7 +32918,7 @@ rclone rc vfs/refresh recursive=true</code></pre><pre><code>rclone cleanup --interactive remote:path/subdir # interactively remove all old version for path/subdirrclone cleanup remote:path/subdir # unconditionally remove all old version for path/subdir</code></pre><p><strong>NB</strong> Onedrive personal can't currently delete versions</p>-<h2 id="troubleshooting-2">Troubleshooting</h2>+<h2 id="troubleshooting-4">Troubleshooting</h2><h3 id="excessive-throttling-or-blocked-on-sharepoint">Excessive throttling or blocked on SharePoint</h3><p>If you experience excessive throttling or is being blocked on SharePoint then it may help to set the user agent explicitly with a flag like this: <code>--user-agent "ISV|rclone.org|rclone/v1.55.1"</code></p><p>The specific details can be found in the Microsoft document: <a href="https://docs.microsoft.com/en-us/sharepoint/dev/general-development/how-to-avoid-getting-throttled-or-blocked-in-sharepoint-online#how-to-decorate-your-http-traffic-to-avoid-throttling">Avoid getting throttled or blocked in SharePoint Online</a></p>@@ -31147,7 +32968,7 @@ ERROR : 20230203_123826234_iOS.heic: vfs cache: failed to download: vfs reader:<h1 id="opendrive">OpenDrive</h1><p>Paths are specified as <code>remote:path</code></p><p>Paths may be as deep as required, e.g. <code>remote:directory/subdirectory</code>.</p>-<h2 id="configuration-36">Configuration</h2>+<h2 id="configuration-38">Configuration</h2><p>Here is an example of how to make a remote called <code>remote</code>. First run:</p><pre><code> rclone config</code></pre><p>This will guide you through an interactive setup process:</p>@@ -31189,7 +33010,7 @@ y/e/d> y</code></pre><pre><code>rclone ls remote:</code></pre><p>To copy a local directory to an OpenDrive directory called backup</p><pre><code>rclone copy /home/source remote:backup</code></pre>-<h3 id="modification-times-and-hashes-16">Modification times and hashes</h3>+<h3 id="modification-times-and-hashes-17">Modification times and hashes</h3><p>OpenDrive allows modification times to be set on objects accurate to 1 second. These will be used to detect whether objects need syncing or not.</p><p>The MD5 hash algorithm is supported.</p><h3 id="restricted-filename-characters-21">Restricted filename characters</h3>@@ -31292,7 +33113,7 @@ y/e/d> y</code></pre></tbody></table><p>Invalid UTF-8 bytes will also be <a href="https://rclone.org/overview/#invalid-utf8">replaced</a>, as they can't be used in JSON strings.</p>-<h3 id="standard-options-36">Standard options</h3>+<h3 id="standard-options-38">Standard options</h3><p>Here are the Standard options specific to opendrive (OpenDrive).</p><h4 id="opendrive-username">--opendrive-username</h4><p>Username.</p>@@ -31313,7 +33134,7 @@ y/e/d> y</code></pre><li>Type: string</li><li>Required: true</li></ul>-<h3 id="advanced-options-37">Advanced options</h3>+<h3 id="advanced-options-39">Advanced options</h3><p>Here are the Advanced options specific to opendrive (OpenDrive).</p><h4 id="opendrive-encoding">--opendrive-encoding</h4><p>The encoding for the backend.</p>@@ -31335,6 +33156,30 @@ y/e/d> y</code></pre><li>Type: SizeSuffix</li><li>Default: 10Mi</li></ul>+<h4 id="opendrive-access">--opendrive-access</h4>+<p>Files and folders will be uploaded with this access permission (default private)</p>+<p>Properties:</p>+<ul>+<li>Config: access</li>+<li>Env Var: RCLONE_OPENDRIVE_ACCESS</li>+<li>Type: string</li>+<li>Default: "private"</li>+<li>Examples:+<ul>+<li>"private"+<ul>+<li>The file or folder access can be granted in a way that will allow select users to view, read or write what is absolutely essential for them.</li>+</ul></li>+<li>"public"+<ul>+<li>The file or folder can be downloaded by anyone from a web browser. The link can be shared in any way,</li>+</ul></li>+<li>"hidden"+<ul>+<li>The file or folder can be accessed has the same restrictions as Public if the user knows the URL of the file or folder link in order to access the contents</li>+</ul></li>+</ul></li>+</ul><h4 id="opendrive-description">--opendrive-description</h4><p>Description of the remote.</p><p>Properties:</p>@@ -31344,7 +33189,7 @@ y/e/d> y</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h2 id="limitations-27">Limitations</h2>+<h2 id="limitations-28">Limitations</h2><p>Note that OpenDrive is case insensitive so you can't have a file called "Hello.doc" and one called "hello.doc".</p><p>There are quite a few characters that can't be in OpenDrive file names. These can't occur on Windows platforms, but on non-Windows platforms they are common. Rclone will map these names to and from an identical looking unicode equivalent. For example if a file has a <code>?</code> in it will be mapped to <code>?</code> instead.</p><p><code>rclone about</code> is not supported by the OpenDrive backend. Backends without this capability cannot determine free space for an rclone mount or use policy <code>mfs</code> (most free space) as a member of an rclone union remote.</p>@@ -31358,7 +33203,7 @@ y/e/d> y</code></pre><p>Paths are specified as <code>remote:bucket</code> (or <code>remote:</code> for the <code>lsd</code> command.) You may put subdirectories in too, e.g. <code>remote:bucket/path/to/dir</code>.</p><p>Sample command to transfer local artifacts to remote:bucket in oracle object storage:</p><p><code>rclone -vvv --progress --stats-one-line --max-stats-groups 10 --log-format date,time,UTC,longfile --fast-list --buffer-size 256Mi --oos-no-check-bucket --oos-upload-cutoff 10Mi --multi-thread-cutoff 16Mi --multi-thread-streams 3000 --transfers 3000 --checkers 64 --retries 2 --oos-chunk-size 10Mi --oos-upload-concurrency 10000 --oos-attempt-resume-upload --oos-leave-parts-on-error sync ./artifacts remote:bucket -vv</code></p>-<h2 id="configuration-37">Configuration</h2>+<h2 id="configuration-39">Configuration</h2><p>Here is an example of making an oracle object storage configuration. <code>rclone config</code> walks you through it.</p><p>Here is an example of how to make a remote called <code>remote</code>. First run:</p><pre><code> rclone config</code></pre>@@ -31536,7 +33381,7 @@ namespace = id<redacted>34compartment = ocid1.compartment.oc1..aa<redacted>baregion = us-ashburn-1provider = no_auth</code></pre>-<h3 id="modification-times-and-hashes-17">Modification times and hashes</h3>+<h3 id="modification-times-and-hashes-18">Modification times and hashes</h3><p>The modification time is stored as metadata on the object as <code>opc-meta-mtime</code> as floating point since the epoch, accurate to 1 ns.</p><p>If the modification time needs to be updated rclone will attempt to perform a server side copy to update the modification if the object can be copied in a single part. In the case the object is larger than 5Gb, the object will be uploaded rather than copied.</p><p>Note that reading this from the object takes an additional <code>HEAD</code> request as the metadata isn't returned in object listings.</p>@@ -31549,7 +33394,7 @@ provider = no_auth</code></pre><p>Multipart uploads will use <code>--transfers</code> * <code>--oos-upload-concurrency</code> * <code>--oos-chunk-size</code> extra memory. Single part uploads to not use extra memory.</p><p>Single part transfers can be faster than multipart transfers or slower depending on your latency from oos - the more latency, the more likely single part transfers will be faster.</p><p>Increasing <code>--oos-upload-concurrency</code> will increase throughput (8 would be a sensible value) and increasing <code>--oos-chunk-size</code> also increases throughput (16M would be sensible). Increasing either of these will use more memory. The default values are high enough to gain most of the possible performance without using too much memory.</p>-<h3 id="standard-options-37">Standard options</h3>+<h3 id="standard-options-39">Standard options</h3><p>Here are the Standard options specific to oracleobjectstorage (Oracle Cloud Infrastructure Object Storage).</p><h4 id="oos-provider">--oos-provider</h4><p>Choose your Auth Provider</p>@@ -31665,7 +33510,7 @@ provider = no_auth</code></pre></ul></li></ul></li></ul>-<h3 id="advanced-options-38">Advanced options</h3>+<h3 id="advanced-options-40">Advanced options</h3><p>Here are the Advanced options specific to oracleobjectstorage (Oracle Cloud Infrastructure Object Storage).</p><h4 id="oos-storage-tier">--oos-storage-tier</h4><p>The storage class to use when storing new objects in storage. https://docs.oracle.com/en-us/iaas/Content/Object/Concepts/understandingstoragetiers.htm</p>@@ -31906,7 +33751,7 @@ provider = no_auth</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h2 id="backend-commands-8">Backend commands</h2>+<h2 id="backend-commands-9">Backend commands</h2><p>Here are the commands specific to the oracleobjectstorage backend.</p><p>Run them with</p><pre><code>rclone backend COMMAND remote:</code></pre>@@ -31984,7 +33829,7 @@ if not.<h3 id="mounting-buckets"><a href="https://rclone.org/oracleobjectstorage/tutorial_mount/">Mounting Buckets</a></h3><h1 id="qingstor">QingStor</h1><p>Paths are specified as <code>remote:bucket</code> (or <code>remote:</code> for the <code>lsd</code> command.) You may put subdirectories in too, e.g. <code>remote:bucket/path/to/dir</code>.</p>-<h2 id="configuration-38">Configuration</h2>+<h2 id="configuration-40">Configuration</h2><p>Here is an example of making an QingStor configuration. First run</p><pre><code>rclone config</code></pre><p>This will guide you through an interactive setup process.</p>@@ -32080,7 +33925,7 @@ y/e/d> y</code></pre><h3 id="restricted-filename-characters-22">Restricted filename characters</h3><p>The control characters 0x00-0x1F and / are replaced as in the <a href="https://rclone.org/overview/#restricted-characters">default restricted characters set</a>. Note that 0x7F is not replaced.</p><p>Invalid UTF-8 bytes will also be <a href="https://rclone.org/overview/#invalid-utf8">replaced</a>, as they can't be used in JSON strings.</p>-<h3 id="standard-options-38">Standard options</h3>+<h3 id="standard-options-40">Standard options</h3><p>Here are the Standard options specific to qingstor (QingCloud Object Storage).</p><h4 id="qingstor-env-auth">--qingstor-env-auth</h4><p>Get QingStor credentials from runtime.</p>@@ -32161,7 +34006,7 @@ y/e/d> y</code></pre></ul></li></ul></li></ul>-<h3 id="advanced-options-39">Advanced options</h3>+<h3 id="advanced-options-41">Advanced options</h3><p>Here are the Advanced options specific to qingstor (QingCloud Object Storage).</p><h4 id="qingstor-connection-retries">--qingstor-connection-retries</h4><p>Number of connection retries.</p>@@ -32225,7 +34070,7 @@ y/e/d> y</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h2 id="limitations-28">Limitations</h2>+<h2 id="limitations-29">Limitations</h2><p><code>rclone about</code> is not supported by the qingstor backend. Backends without this capability cannot determine free space for an rclone mount or use policy <code>mfs</code> (most free space) as a member of an rclone union remote.</p><p>See <a href="https://rclone.org/overview/#optional-features">List of backends that do not support rclone about</a> and <a href="https://rclone.org/commands/rclone_about/">rclone about</a></p><h1 id="quatrix">Quatrix</h1>@@ -32234,7 +34079,7 @@ y/e/d> y</code></pre><p>Paths may be as deep as required, e.g., <code>remote:directory/subdirectory</code>.</p><p>The initial setup for Quatrix involves getting an API Key from Quatrix. You can get the API key in the user's profile at <code>https://<account>/profile/api-keys</code> or with the help of the API - https://docs.maytech.net/quatrix/quatrix-api/api-explorer#/API-Key/post_api_key_create.</p><p>See complete Swagger documentation for Quatrix - https://docs.maytech.net/quatrix/quatrix-api/api-explorer</p>-<h2 id="configuration-39">Configuration</h2>+<h2 id="configuration-41">Configuration</h2><p>Here is an example of how to make a remote called <code>remote</code>. First run:</p><pre><code> rclone config</code></pre><p>This will guide you through an interactive setup process:</p>@@ -32318,7 +34163,7 @@ y) Yes this is OKe) Edit this remoted) Delete this remotey/e/d> y</code></pre>-<h3 id="modification-times-and-hashes-18">Modification times and hashes</h3>+<h3 id="modification-times-and-hashes-19">Modification times and hashes</h3><p>Quatrix allows modification times to be set on objects accurate to 1 microsecond. These will be used to detect whether objects need syncing or not.</p><p>Quatrix does not support hashes, so you cannot use the <code>--checksum</code> flag.</p><h3 id="restricted-filename-characters-23">Restricted filename characters</h3>@@ -32327,7 +34172,7 @@ y/e/d> y</code></pre><p>For files above 50 MiB rclone will use a chunked transfer. Rclone will upload up to <code>--transfers</code> chunks at the same time (shared among all multipart uploads). Chunks are buffered in memory, and the minimal chunk size is 10_000_000 bytes by default, and it can be changed in the advanced configuration, so increasing <code>--transfers</code> will increase the memory use. The chunk size has a maximum size limit, which is set to 100_000_000 bytes by default and can be changed in the advanced configuration. The size of the uploaded chunk will dynamically change depending on the upload speed. The total memory use equals the number of transfers multiplied by the minimal chunk size. In case there's free memory allocated for the upload (which equals the difference of <code>maximal_summary_chunk_size</code> and <code>minimal_chunk_size</code> * <code>transfers</code>), the chunk size may increase in case of high upload speed. As well as it can decrease in case of upload speed problems. If no free memory is available, all chunks will equal <code>minimal_chunk_size</code>.</p><h3 id="deleting-files-5">Deleting files</h3><p>Files you delete with rclone will end up in Trash and be stored there for 30 days. Quatrix also provides an API to permanently delete files and an API to empty the Trash so that you can remove files permanently from your account.</p>-<h3 id="standard-options-39">Standard options</h3>+<h3 id="standard-options-41">Standard options</h3><p>Here are the Standard options specific to quatrix (Quatrix by Maytech).</p><h4 id="quatrix-api-key">--quatrix-api-key</h4><p>API key for accessing Quatrix account</p>@@ -32347,7 +34192,7 @@ y/e/d> y</code></pre><li>Type: string</li><li>Required: true</li></ul>-<h3 id="advanced-options-40">Advanced options</h3>+<h3 id="advanced-options-42">Advanced options</h3><p>Here are the Advanced options specific to quatrix (Quatrix by Maytech).</p><h4 id="quatrix-encoding">--quatrix-encoding</h4><p>The encoding for the backend.</p>@@ -32424,7 +34269,7 @@ y/e/d> y</code></pre><p>rclone interacts with Sia network by talking to the Sia daemon via <a href="https://sia.tech/docs/">HTTP API</a> which is usually available on port <em>9980</em>. By default you will run the daemon locally on the same computer so it's safe to leave the API password blank (the API URL will be <code>http://127.0.0.1:9980</code> making external access impossible).</p><p>However, if you want to access Sia daemon running on another node, for example due to memory constraints or because you want to share single daemon between several rclone and Sia-UI instances, you'll need to make a few more provisions: - Ensure you have <em>Sia daemon</em> installed directly or in a <a href="https://github.com/SiaFoundation/siad/pkgs/container/siad">docker container</a> because Sia-UI does not support this mode natively. - Run it on externally accessible port, for example provide <code>--api-addr :9980</code> and <code>--disable-api-security</code> arguments on the daemon command line. - Enforce API password for the <code>siad</code> daemon via environment variable <code>SIA_API_PASSWORD</code> or text file named <code>apipassword</code> in the daemon directory. - Set rclone backend option <code>api_password</code> taking it from above locations.</p><p>Notes: 1. If your wallet is locked, rclone cannot unlock it automatically. You should either unlock it in advance by using Sia-UI or via command line <code>siac wallet unlock</code>. Alternatively you can make <code>siad</code> unlock your wallet automatically upon startup by running it with environment variable <code>SIA_WALLET_PASSWORD</code>. 2. If <code>siad</code> cannot find the <code>SIA_API_PASSWORD</code> variable or the <code>apipassword</code> file in the <code>SIA_DIR</code> directory, it will generate a random password and store in the text file named <code>apipassword</code> under <code>YOUR_HOME/.sia/</code> directory on Unix or <code>C:\Users\YOUR_HOME\AppData\Local\Sia\apipassword</code> on Windows. Remember this when you configure password in rclone. 3. The only way to use <code>siad</code> without API password is to run it <strong>on localhost</strong> with command line argument <code>--authorize-api=false</code>, but this is insecure and <strong>strongly discouraged</strong>.</p>-<h2 id="configuration-40">Configuration</h2>+<h2 id="configuration-42">Configuration</h2><p>Here is an example of how to make a <code>sia</code> remote called <code>mySia</code>. First, run:</p><pre><code> rclone config</code></pre><p>This will guide you through an interactive setup process:</p>@@ -32484,7 +34329,7 @@ y/e/d> y</code></pre><li>Upload a local directory to the Sia directory called <em>backup</em></li></ul><pre><code>rclone copy /home/source mySia:backup</code></pre>-<h3 id="standard-options-40">Standard options</h3>+<h3 id="standard-options-42">Standard options</h3><p>Here are the Standard options specific to sia (Sia Decentralized Cloud).</p><h4 id="sia-api-url">--sia-api-url</h4><p>Sia daemon API URL, like http://sia.daemon.host:9980.</p>@@ -32507,7 +34352,7 @@ y/e/d> y</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h3 id="advanced-options-41">Advanced options</h3>+<h3 id="advanced-options-43">Advanced options</h3><p>Here are the Advanced options specific to sia (Sia Decentralized Cloud).</p><h4 id="sia-user-agent">--sia-user-agent</h4><p>Siad User Agent</p>@@ -32538,7 +34383,7 @@ y/e/d> y</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h2 id="limitations-29">Limitations</h2>+<h2 id="limitations-30">Limitations</h2><ul><li>Modification times not supported</li><li>Checksums not supported</li>@@ -32557,7 +34402,7 @@ y/e/d> y</code></pre><li><a href="https://console.bluemix.net/docs/infrastructure/objectstorage-swift/index.html">IBM Bluemix Cloud ObjectStorage Swift</a></li></ul><p>Paths are specified as <code>remote:container</code> (or <code>remote:</code> for the <code>lsd</code> command.) You may put subdirectories in too, e.g. <code>remote:container/path/to/dir</code>.</p>-<h2 id="configuration-41">Configuration</h2>+<h2 id="configuration-43">Configuration</h2><p>Here is an example of making a swift configuration. First run</p><pre><code>rclone config</code></pre><p>This will guide you through an interactive setup process.</p>@@ -32696,7 +34541,7 @@ rclone lsd myremote:</code></pre><h3 id="update-and---use-server-modtime">--update and --use-server-modtime</h3><p>As noted below, the modified time is stored on metadata on the object. It is used by default for all operations that require checking the time a file was last updated. It allows rclone to treat the remote more like a true filesystem, but it is inefficient because it requires an extra API call to retrieve the metadata.</p><p>For many operations, the time the object was last uploaded to the remote is sufficient to determine if it is "dirty". By using <code>--update</code> along with <code>--use-server-modtime</code>, you can avoid the extra API call and simply upload files whose local modtime is newer than the time it was last uploaded.</p>-<h3 id="modification-times-and-hashes-19">Modification times and hashes</h3>+<h3 id="modification-times-and-hashes-20">Modification times and hashes</h3><p>The modified time is stored as metadata on the object as <code>X-Object-Meta-Mtime</code> as floating point since the epoch accurate to 1 ns.</p><p>This is a de facto standard (used in the official python-swiftclient amongst others) for storing the modification time for an object.</p><p>The MD5 hash algorithm is supported.</p>@@ -32723,7 +34568,7 @@ rclone lsd myremote:</code></pre></tbody></table><p>Invalid UTF-8 bytes will also be <a href="https://rclone.org/overview/#invalid-utf8">replaced</a>, as they can't be used in JSON strings.</p>-<h3 id="standard-options-41">Standard options</h3>+<h3 id="standard-options-43">Standard options</h3><p>Here are the Standard options specific to swift (OpenStack Swift (Rackspace Cloud Files, Blomp Cloud Storage, Memset Memstore, OVH)).</p><h4 id="swift-env-auth">--swift-env-auth</h4><p>Get swift credentials from environment variables in standard OpenStack form.</p>@@ -32961,7 +34806,7 @@ rclone lsd myremote:</code></pre></ul></li></ul></li></ul>-<h3 id="advanced-options-42">Advanced options</h3>+<h3 id="advanced-options-44">Advanced options</h3><p>Here are the Advanced options specific to swift (OpenStack Swift (Rackspace Cloud Files, Blomp Cloud Storage, Memset Memstore, OVH)).</p><h4 id="swift-leave-parts-on-error">--swift-leave-parts-on-error</h4><p>If true avoid calling abort upload on a failure.</p>@@ -33065,9 +34910,9 @@ rclone lsd myremote:</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h2 id="limitations-30">Limitations</h2>+<h2 id="limitations-31">Limitations</h2><p>The Swift API doesn't return a correct MD5SUM for segmented files (Dynamic or Static Large Objects) so rclone won't check or use the MD5SUM for these.</p>-<h2 id="troubleshooting-3">Troubleshooting</h2>+<h2 id="troubleshooting-5">Troubleshooting</h2><h3 id="rclone-gives-failed-to-create-file-system-for-remote-bad-request">Rclone gives Failed to create file system for "remote:": Bad Request</h3><p>Due to an oddity of the underlying swift library, it gives a "Bad Request" error rather than a more sensible error when the authentication fails for Swift.</p><p>So this most likely means your username / password is wrong. You can investigate further with the <code>--dump-bodies</code> flag.</p>@@ -33085,7 +34930,7 @@ rclone lsd myremote:</code></pre><h1 id="pcloud">pCloud</h1><p>Paths are specified as <code>remote:path</code></p><p>Paths may be as deep as required, e.g. <code>remote:directory/subdirectory</code>.</p>-<h2 id="configuration-42">Configuration</h2>+<h2 id="configuration-44">Configuration</h2><p>The initial setup for pCloud involves getting a token from pCloud which you need to do in your browser. <code>rclone config</code> walks you through it.</p><p>Here is an example of how to make a remote called <code>remote</code>. First run:</p><pre><code> rclone config</code></pre>@@ -33144,7 +34989,7 @@ y/e/d> y</code></pre><pre><code>rclone ls remote:</code></pre><p>To copy a local directory to a pCloud directory called backup</p><pre><code>rclone copy /home/source remote:backup</code></pre>-<h3 id="modification-times-and-hashes-20">Modification times and hashes</h3>+<h3 id="modification-times-and-hashes-21">Modification times and hashes</h3><p>pCloud allows modification times to be set on objects accurate to 1 second. These will be used to detect whether objects need syncing or not. In order to set a Modification time pCloud requires the object be re-uploaded.</p><p>pCloud supports MD5 and SHA1 hashes in the US region, and SHA1 and SHA256 hashes in the EU region, so you can use the <code>--checksum</code> flag.</p><h3 id="restricted-filename-characters-25">Restricted filename characters</h3>@@ -33176,7 +35021,7 @@ y/e/d> y</code></pre><p>However you can set this to restrict rclone to a specific folder hierarchy.</p><p>In order to do this you will have to find the <code>Folder ID</code> of the directory you wish rclone to display. This will be the <code>folder</code> field of the URL when you open the relevant folder in the pCloud web interface.</p><p>So if the folder you want rclone to use has a URL which looks like <code>https://my.pcloud.com/#page=filemanager&folder=5xxxxxxxx8&tpl=foldergrid</code> in the browser, then you use <code>5xxxxxxxx8</code> as the <code>root_folder_id</code> in the config.</p>-<h3 id="standard-options-42">Standard options</h3>+<h3 id="standard-options-44">Standard options</h3><p>Here are the Standard options specific to pcloud (Pcloud).</p><h4 id="pcloud-client-id">--pcloud-client-id</h4><p>OAuth Client Id.</p>@@ -33198,7 +35043,7 @@ y/e/d> y</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h3 id="advanced-options-43">Advanced options</h3>+<h3 id="advanced-options-45">Advanced options</h3><p>Here are the Advanced options specific to pcloud (Pcloud).</p><h4 id="pcloud-token">--pcloud-token</h4><p>OAuth Access Token as a JSON blob.</p>@@ -33311,7 +35156,7 @@ y/e/d> y</code></pre><h1 id="pikpak">PikPak</h1><p>PikPak is <a href="https://mypikpak.com/">a private cloud drive</a>.</p><p>Paths are specified as <code>remote:path</code>, and may be as deep as required, e.g. <code>remote:directory/subdirectory</code>.</p>-<h2 id="configuration-43">Configuration</h2>+<h2 id="configuration-45">Configuration</h2><p>Here is an example of making a remote for PikPak.</p><p>First run:</p><pre><code> rclone config</code></pre>@@ -33364,10 +35209,10 @@ y) Yes this is OK (default)e) Edit this remoted) Delete this remotey/e/d> y</code></pre>-<h3 id="modification-times-and-hashes-21">Modification times and hashes</h3>+<h3 id="modification-times-and-hashes-22">Modification times and hashes</h3><p>PikPak keeps modification times on objects, and updates them when uploading objects, but it does not support changing only the modification time</p><p>The MD5 hash algorithm is supported.</p>-<h3 id="standard-options-43">Standard options</h3>+<h3 id="standard-options-45">Standard options</h3><p>Here are the Standard options specific to pikpak (PikPak).</p><h4 id="pikpak-user">--pikpak-user</h4><p>Pikpak username.</p>@@ -33388,7 +35233,7 @@ y/e/d> y</code></pre><li>Type: string</li><li>Required: true</li></ul>-<h3 id="advanced-options-44">Advanced options</h3>+<h3 id="advanced-options-46">Advanced options</h3><p>Here are the Advanced options specific to pikpak (PikPak).</p><h4 id="pikpak-device-id">--pikpak-device-id</h4><p>Device ID used for authorization.</p>@@ -33503,7 +35348,7 @@ y/e/d> y</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h2 id="backend-commands-9">Backend commands</h2>+<h2 id="backend-commands-10">Backend commands</h2><p>Here are the commands specific to the pikpak backend.</p><p>Run them with</p><pre><code>rclone backend COMMAND remote:</code></pre>@@ -33531,7 +35376,7 @@ rclone backend decompress pikpak:dirpath {filename} -o delete-src-file</code></p"SourceDeleted": 0,"Errors": 0}</code></pre>-<h2 id="limitations-31">Limitations</h2>+<h2 id="limitations-32">Limitations</h2><h3 id="hashes-may-be-empty">Hashes may be empty</h3><p>PikPak supports MD5 hash, but sometimes given empty especially for user-uploaded files.</p><h3 id="deleted-files-still-visible-with-trashed-only">Deleted files still visible with trashed-only</h3>@@ -33609,7 +35454,7 @@ e/n/d/r/c/s/q> q</code></pre><p><code>rclone lsf Pixeldrain: --dirs-only -Fpi</code></p><p>This will print directories in your <code>Pixeldrain</code> home directory and their public IDs.</p><p>Enter this directory ID in the rclone config and you will be able to access the directory.</p>-<h3 id="standard-options-44">Standard options</h3>+<h3 id="standard-options-46">Standard options</h3><p>Here are the Standard options specific to pixeldrain (Pixeldrain Filesystem).</p><h4 id="pixeldrain-api-key">--pixeldrain-api-key</h4><p>API key for your pixeldrain account. Found on https://pixeldrain.com/user/api_keys.</p>@@ -33630,7 +35475,7 @@ e/n/d/r/c/s/q> q</code></pre><li>Type: string</li><li>Default: "me"</li></ul>-<h3 id="advanced-options-45">Advanced options</h3>+<h3 id="advanced-options-47">Advanced options</h3><p>Here are the Advanced options specific to pixeldrain (Pixeldrain Filesystem).</p><h4 id="pixeldrain-api-url">--pixeldrain-api-url</h4><p>The API endpoint to connect to. In the vast majority of cases it's fine to leave this at default. It is only intended to be changed for testing purposes.</p>@@ -33650,7 +35495,7 @@ e/n/d/r/c/s/q> q</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h3 id="metadata-14">Metadata</h3>+<h3 id="metadata-15">Metadata</h3><p>Pixeldrain supports file modes and creation times.</p><p>Here are the possible system metadata items for the pixeldrain backend.</p><table>@@ -33698,7 +35543,7 @@ e/n/d/r/c/s/q> q</code></pre><h1 id="premiumize.me">premiumize.me</h1><p>Paths are specified as <code>remote:path</code></p><p>Paths may be as deep as required, e.g. <code>remote:directory/subdirectory</code>.</p>-<h2 id="configuration-44">Configuration</h2>+<h2 id="configuration-46">Configuration</h2><p>The initial setup for <a href="https://premiumize.me/">premiumize.me</a> involves getting a token from premiumize.me which you need to do in your browser. <code>rclone config</code> walks you through it.</p><p>Here is an example of how to make a remote called <code>remote</code>. First run:</p><pre><code> rclone config</code></pre>@@ -33749,7 +35594,7 @@ y/e/d> </code></pre><pre><code>rclone ls remote:</code></pre><p>To copy a local directory to an premiumize.me directory called backup</p><pre><code>rclone copy /home/source remote:backup</code></pre>-<h3 id="modification-times-and-hashes-22">Modification times and hashes</h3>+<h3 id="modification-times-and-hashes-23">Modification times and hashes</h3><p>premiumize.me does not support modification times or hashes, therefore syncing will default to <code>--size-only</code> checking. Note that using <code>--update</code> will work.</p><h3 id="restricted-filename-characters-26">Restricted filename characters</h3><p>In addition to the <a href="https://rclone.org/overview/#restricted-characters">default restricted characters set</a> the following characters are also replaced:</p>@@ -33775,7 +35620,7 @@ y/e/d> </code></pre></tbody></table><p>Invalid UTF-8 bytes will also be <a href="https://rclone.org/overview/#invalid-utf8">replaced</a>, as they can't be used in JSON strings.</p>-<h3 id="standard-options-45">Standard options</h3>+<h3 id="standard-options-47">Standard options</h3><p>Here are the Standard options specific to premiumizeme (premiumize.me).</p><h4 id="premiumizeme-client-id">--premiumizeme-client-id</h4><p>OAuth Client Id.</p>@@ -33807,7 +35652,7 @@ y/e/d> </code></pre><li>Type: string</li><li>Required: false</li></ul>-<h3 id="advanced-options-46">Advanced options</h3>+<h3 id="advanced-options-48">Advanced options</h3><p>Here are the Advanced options specific to premiumizeme (premiumize.me).</p><h4 id="premiumizeme-token">--premiumizeme-token</h4><p>OAuth Access Token as a JSON blob.</p>@@ -33867,7 +35712,7 @@ y/e/d> </code></pre><li>Type: string</li><li>Required: false</li></ul>-<h2 id="limitations-32">Limitations</h2>+<h2 id="limitations-33">Limitations</h2><p>Note that premiumize.me is case insensitive so you can't have a file called "Hello.doc" and one called "hello.doc".</p><p>premiumize.me file names can't have the <code>\</code> or <code>"</code> characters in. rclone maps these to and from an identical looking unicode equivalents <code>\</code> and <code>"</code></p><p>premiumize.me only supports filenames up to 255 characters in length.</p>@@ -33929,18 +35774,18 @@ y/e/d> y</code></pre><pre><code>rclone ls remote:</code></pre><p>To copy a local directory to an Proton Drive directory called backup</p><pre><code>rclone copy /home/source remote:backup</code></pre>-<h3 id="modification-times-and-hashes-23">Modification times and hashes</h3>+<h3 id="modification-times-and-hashes-24">Modification times and hashes</h3><p>Proton Drive Bridge does not support updating modification times yet.</p><p>The SHA1 hash algorithm is supported.</p><h3 id="restricted-filename-characters-27">Restricted filename characters</h3><p>Invalid UTF-8 bytes will be <a href="https://rclone.org/overview/#invalid-utf8">replaced</a>, also left and right spaces will be removed (<a href="https://github.com/ProtonMail/WebClients/blob/b4eba99d241af4fdae06ff7138bd651a40ef5d3c/applications/drive/src/app/store/_links/validation.ts#L51">code reference</a>)</p>-<h3 id="duplicated-files-4">Duplicated files</h3>+<h3 id="duplicated-files-5">Duplicated files</h3><p>Proton Drive can not have two files with exactly the same name and path. If the conflict occurs, depending on the advanced config, the file might or might not be overwritten.</p><h3 id="mailbox-password"><a href="https://proton.me/support/the-difference-between-the-mailbox-password-and-login-password">Mailbox password</a></h3><p>Please set your mailbox password in the advanced config section.</p><h3 id="caching">Caching</h3><p>The cache is currently built for the case when the rclone is the only instance performing operations to the mount point. The event system, which is the proton API system that provides visibility of what has changed on the drive, is yet to be implemented, so updates from other clients won’t be reflected in the cache. Thus, if there are concurrent clients accessing the same mount point, then we might have a problem with caching the stale data.</p>-<h3 id="standard-options-46">Standard options</h3>+<h3 id="standard-options-48">Standard options</h3><p>Here are the Standard options specific to protondrive (Proton Drive).</p><h4 id="protondrive-username">--protondrive-username</h4><p>The username of your proton account</p>@@ -33972,7 +35817,7 @@ y/e/d> y</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h3 id="advanced-options-47">Advanced options</h3>+<h3 id="advanced-options-49">Advanced options</h3><p>Here are the Advanced options specific to protondrive (Proton Drive).</p><h4 id="protondrive-mailbox-password">--protondrive-mailbox-password</h4><p>The mailbox password of your two-password proton account.</p>@@ -34084,7 +35929,7 @@ y/e/d> y</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h2 id="limitations-33">Limitations</h2>+<h2 id="limitations-34">Limitations</h2><p>This backend uses the <a href="https://github.com/henrybear327/Proton-API-Bridge">Proton-API-Bridge</a>, which is based on <a href="https://github.com/henrybear327/go-proton-api">go-proton-api</a>, a fork of the <a href="https://github.com/ProtonMail/go-proton-api">official repo</a>.</p><p>There is no official API documentation available from Proton Drive. But, thanks to Proton open sourcing <a href="https://github.com/ProtonMail/go-proton-api">proton-go-api</a> and the web, iOS, and Android client codebases, we don't need to completely reverse engineer the APIs by observing the web client traffic!</p><p><a href="https://github.com/ProtonMail/go-proton-api">proton-go-api</a> provides the basic building blocks of API calls and error handling, such as 429 exponential back-off, but it is pretty much just a barebone interface to the Proton API. For example, the encryption and decryption of the Proton Drive file are not provided in this library.</p>@@ -34092,7 +35937,7 @@ y/e/d> y</code></pre><h1 id="put.io">put.io</h1><p>Paths are specified as <code>remote:path</code></p><p>put.io paths may be as deep as required, e.g. <code>remote:directory/subdirectory</code>.</p>-<h2 id="configuration-45">Configuration</h2>+<h2 id="configuration-47">Configuration</h2><p>The initial setup for put.io involves getting a token from put.io which you need to do in your browser. <code>rclone config</code> walks you through it.</p><p>Here is an example of how to make a remote called <code>remote</code>. First run:</p><pre><code> rclone config</code></pre>@@ -34176,7 +36021,7 @@ e/n/d/r/c/s/q> q</code></pre></tbody></table><p>Invalid UTF-8 bytes will also be <a href="https://rclone.org/overview/#invalid-utf8">replaced</a>, as they can't be used in JSON strings.</p>-<h3 id="standard-options-47">Standard options</h3>+<h3 id="standard-options-49">Standard options</h3><p>Here are the Standard options specific to putio (Put.io).</p><h4 id="putio-client-id">--putio-client-id</h4><p>OAuth Client Id.</p>@@ -34198,7 +36043,7 @@ e/n/d/r/c/s/q> q</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h3 id="advanced-options-48">Advanced options</h3>+<h3 id="advanced-options-50">Advanced options</h3><p>Here are the Advanced options specific to putio (Put.io).</p><h4 id="putio-token">--putio-token</h4><p>OAuth Access Token as a JSON blob.</p>@@ -34258,7 +36103,7 @@ e/n/d/r/c/s/q> q</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h2 id="limitations-34">Limitations</h2>+<h2 id="limitations-35">Limitations</h2><p>put.io has rate limiting. When you hit a limit, rclone automatically retries after waiting the amount of time requested by the server.</p><p>If you want to avoid ever hitting these limits, you may use the <code>--tpslimit</code> flag with a low number. Note that the imposed limits may be different for different operations, and may change over time.</p><h1 id="proton-drive-1">Proton Drive</h1>@@ -34319,18 +36164,18 @@ y/e/d> y</code></pre><pre><code>rclone ls remote:</code></pre><p>To copy a local directory to an Proton Drive directory called backup</p><pre><code>rclone copy /home/source remote:backup</code></pre>-<h3 id="modification-times-and-hashes-24">Modification times and hashes</h3>+<h3 id="modification-times-and-hashes-25">Modification times and hashes</h3><p>Proton Drive Bridge does not support updating modification times yet.</p><p>The SHA1 hash algorithm is supported.</p><h3 id="restricted-filename-characters-29">Restricted filename characters</h3><p>Invalid UTF-8 bytes will be <a href="https://rclone.org/overview/#invalid-utf8">replaced</a>, also left and right spaces will be removed (<a href="https://github.com/ProtonMail/WebClients/blob/b4eba99d241af4fdae06ff7138bd651a40ef5d3c/applications/drive/src/app/store/_links/validation.ts#L51">code reference</a>)</p>-<h3 id="duplicated-files-5">Duplicated files</h3>+<h3 id="duplicated-files-6">Duplicated files</h3><p>Proton Drive can not have two files with exactly the same name and path. If the conflict occurs, depending on the advanced config, the file might or might not be overwritten.</p><h3 id="mailbox-password-1"><a href="https://proton.me/support/the-difference-between-the-mailbox-password-and-login-password">Mailbox password</a></h3><p>Please set your mailbox password in the advanced config section.</p><h3 id="caching-1">Caching</h3><p>The cache is currently built for the case when the rclone is the only instance performing operations to the mount point. The event system, which is the proton API system that provides visibility of what has changed on the drive, is yet to be implemented, so updates from other clients won’t be reflected in the cache. Thus, if there are concurrent clients accessing the same mount point, then we might have a problem with caching the stale data.</p>-<h3 id="standard-options-48">Standard options</h3>+<h3 id="standard-options-50">Standard options</h3><p>Here are the Standard options specific to protondrive (Proton Drive).</p><h4 id="protondrive-username-1">--protondrive-username</h4><p>The username of your proton account</p>@@ -34362,7 +36207,7 @@ y/e/d> y</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h3 id="advanced-options-49">Advanced options</h3>+<h3 id="advanced-options-51">Advanced options</h3><p>Here are the Advanced options specific to protondrive (Proton Drive).</p><h4 id="protondrive-mailbox-password-1">--protondrive-mailbox-password</h4><p>The mailbox password of your two-password proton account.</p>@@ -34474,14 +36319,14 @@ y/e/d> y</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h2 id="limitations-35">Limitations</h2>+<h2 id="limitations-36">Limitations</h2><p>This backend uses the <a href="https://github.com/henrybear327/Proton-API-Bridge">Proton-API-Bridge</a>, which is based on <a href="https://github.com/henrybear327/go-proton-api">go-proton-api</a>, a fork of the <a href="https://github.com/ProtonMail/go-proton-api">official repo</a>.</p><p>There is no official API documentation available from Proton Drive. But, thanks to Proton open sourcing <a href="https://github.com/ProtonMail/go-proton-api">proton-go-api</a> and the web, iOS, and Android client codebases, we don't need to completely reverse engineer the APIs by observing the web client traffic!</p><p><a href="https://github.com/ProtonMail/go-proton-api">proton-go-api</a> provides the basic building blocks of API calls and error handling, such as 429 exponential back-off, but it is pretty much just a barebone interface to the Proton API. For example, the encryption and decryption of the Proton Drive file are not provided in this library.</p><p>The Proton-API-Bridge, attempts to bridge the gap, so rclone can be built on top of this quickly. This codebase handles the intricate tasks before and after calling Proton APIs, particularly the complex encryption scheme, allowing developers to implement features for other software on top of this codebase. There are likely quite a few errors in this library, as there isn't official documentation available.</p><h1 id="seafile">Seafile</h1><p>This is a backend for the <a href="https://www.seafile.com/">Seafile</a> storage service: - It works with both the free community edition or the professional edition. - Seafile versions 6.x, 7.x, 8.x and 9.x are all supported. - Encrypted libraries are also supported. - It supports 2FA enabled users - Using a Library API Token is <strong>not</strong> supported</p>-<h2 id="configuration-46">Configuration</h2>+<h2 id="configuration-48">Configuration</h2><p>There are two distinct modes you can setup your remote: - you point your remote to the <strong>root of the server</strong>, meaning you don't specify a library during the configuration: Paths are specified as <code>remote:library</code>. You may put subdirectories in too, e.g. <code>remote:library/path/to/dir</code>. - you point your remote to a specific library during the configuration: Paths are specified as <code>remote:path/to/dir</code>. <strong>This is the recommended mode when using encrypted libraries</strong>. (<em>This mode is possibly slightly faster than the root mode</em>)</p><h3 id="configuration-in-root-mode">Configuration in root mode</h3><p>Here is an example of making a seafile configuration for a user with <strong>no</strong> two-factor authentication. First run</p>@@ -34682,7 +36527,7 @@ http://my.seafile.server/d/9ea2455f6f55478bbb0d/</code></pre><p>It has been actively developed using the <a href="https://github.com/haiwen/seafile-docker">seafile docker image</a> of these versions: - 6.3.4 community edition - 7.0.5 community edition - 7.1.3 community edition - 9.0.10 community edition</p><p>Versions below 6.0 are not supported. Versions between 6.0 and 6.3 haven't been tested and might not work properly.</p><p>Each new version of <code>rclone</code> is automatically tested against the <a href="https://hub.docker.com/r/seafileltd/seafile-mc/">latest docker image</a> of the seafile community server.</p>-<h3 id="standard-options-49">Standard options</h3>+<h3 id="standard-options-51">Standard options</h3><p>Here are the Standard options specific to seafile (seafile).</p><h4 id="seafile-url">--seafile-url</h4><p>URL of seafile host to connect to.</p>@@ -34758,7 +36603,7 @@ http://my.seafile.server/d/9ea2455f6f55478bbb0d/</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h3 id="advanced-options-50">Advanced options</h3>+<h3 id="advanced-options-52">Advanced options</h3><p>Here are the Advanced options specific to seafile (seafile).</p><h4 id="seafile-create-library">--seafile-create-library</h4><p>Should rclone create a library if it doesn't exist.</p>@@ -34799,7 +36644,7 @@ http://my.seafile.server/d/9ea2455f6f55478bbb0d/</code></pre><p>Paths are specified as <code>remote:path</code>. If the path does not begin with a <code>/</code> it is relative to the home directory of the user. An empty path <code>remote:</code> refers to the user's home directory. For example, <code>rclone lsd remote:</code> would list the home directory of the user configured in the rclone remote config (<code>i.e /home/sftpuser</code>). However, <code>rclone lsd remote:/</code> would list the root directory for remote machine (i.e. <code>/</code>)</p><p>Note that some SFTP servers will need the leading / - Synology is a good example of this. rsync.net and Hetzner, on the other hand, requires users to OMIT the leading /.</p><p>Note that by default rclone will try to execute shell commands on the server, see <a href="#shell-access-considerations">shell access considerations</a>.</p>-<h2 id="configuration-47">Configuration</h2>+<h2 id="configuration-49">Configuration</h2><p>Here is an example of making an SFTP configuration. First run</p><pre><code>rclone config</code></pre><p>This will guide you through an interactive setup process.</p>@@ -34936,14 +36781,14 @@ known_hosts_file = ~/.ssh/known_hosts</code></pre><p>The options <code>md5sum_command</code> and <code>sha1_command</code> can be used to customize the command to be executed for calculation of checksums. You can for example set a specific path to where md5sum and sha1sum executables are located, or use them to specify some other tools that print checksums in compatible format. The value can include command-line arguments, or even shell script blocks as with PowerShell. Rclone has subcommands <a href="https://rclone.org/commands/rclone_md5sum/">md5sum</a> and <a href="https://rclone.org/commands/rclone_sha1sum/">sha1sum</a> that use compatible format, which means if you have an rclone executable on the server it can be used. As mentioned above, they will be automatically picked up if found in PATH, but if not you can set something like <code>/path/to/rclone md5sum</code> as the value of option <code>md5sum_command</code> to make sure a specific executable is used.</p><p>Remote checksumming is recommended and enabled by default. First time rclone is using a SFTP remote, if options <code>md5sum_command</code> or <code>sha1_command</code> are not set, it will check if any of the default commands for each of them, as described above, can be used. The result will be saved in the remote configuration, so next time it will use the same. Value <code>none</code> will be set if none of the default commands could be used for a specific algorithm, and this algorithm will not be supported by the remote.</p><p>Disabling the checksumming may be required if you are connecting to SFTP servers which are not under your control, and to which the execution of remote shell commands is prohibited. Set the configuration option <code>disable_hashcheck</code> to <code>true</code> to disable checksumming entirely, or set <code>shell_type</code> to <code>none</code> to disable all functionality based on remote shell command execution.</p>-<h3 id="modification-times-and-hashes-25">Modification times and hashes</h3>+<h3 id="modification-times-and-hashes-26">Modification times and hashes</h3><p>Modified times are stored on the server to 1 second precision.</p><p>Modified times are used in syncing and are fully supported.</p><p>Some SFTP servers disable setting/modifying the file modification time after upload (for example, certain configurations of ProFTPd with mod_sftp). If you are using one of these servers, you can set the option <code>set_modtime = false</code> in your RClone backend configuration to disable this behaviour.</p><h3 id="about-command">About command</h3><p>The <code>about</code> command returns the total space, free space, and used space on the remote for the disk of the specified path on the remote or, if not set, the disk of the root on the remote.</p><p>SFTP usually supports the <a href="https://rclone.org/commands/rclone_about/">about</a> command, but it depends on the server. If the server implements the vendor-specific VFS statistics extension, which is normally the case with OpenSSH instances, it will be used. If not, but the same login has access to a Unix shell, where the <code>df</code> command is available (e.g. in the remote's PATH), then this will be used instead. If the server shell is PowerShell, probably with a Windows OpenSSH server, rclone will use a built-in shell command (see <a href="#shell-access">shell access</a>). If none of the above is applicable, <code>about</code> will fail.</p>-<h3 id="standard-options-50">Standard options</h3>+<h3 id="standard-options-52">Standard options</h3><p>Here are the Standard options specific to sftp (SSH/SFTP).</p><h4 id="sftp-host">--sftp-host</h4><p>SSH host to connect to.</p>@@ -35107,7 +36952,7 @@ known_hosts_file = ~/.ssh/known_hosts</code></pre><li>Type: SpaceSepList</li><li>Default:</li></ul>-<h3 id="advanced-options-51">Advanced options</h3>+<h3 id="advanced-options-53">Advanced options</h3><p>Here are the Advanced options specific to sftp (SSH/SFTP).</p><h4 id="sftp-known-hosts-file">--sftp-known-hosts-file</h4><p>Optional path to known_hosts file.</p>@@ -35408,6 +37253,16 @@ server_command = sudo /usr/libexec/openssh/sftp-server</code></pre><li>Type: string</li><li>Required: false</li></ul>+<h4 id="sftp-http-proxy">--sftp-http-proxy</h4>+<p>URL for HTTP CONNECT proxy</p>+<p>Set this to a URL for an HTTP proxy which supports the HTTP CONNECT verb.</p>+<p>Properties:</p>+<ul>+<li>Config: http_proxy</li>+<li>Env Var: RCLONE_SFTP_HTTP_PROXY</li>+<li>Type: string</li>+<li>Required: false</li>+</ul><h4 id="sftp-copy-is-hardlink">--sftp-copy-is-hardlink</h4><p>Set to enable server side copies using hardlinks.</p><p>The SFTP protocol does not define a copy command so normally server side copies are not allowed with the sftp backend.</p>@@ -35431,8 +37286,8 @@ server_command = sudo /usr/libexec/openssh/sftp-server</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h2 id="limitations-36">Limitations</h2>-<p>On some SFTP servers (e.g. Synology) the paths are different for SSH and SFTP so the hashes can't be calculated properly. For them using <code>disable_hashcheck</code> is a good idea.</p>+<h2 id="limitations-37">Limitations</h2>+<p>On some SFTP servers (e.g. Synology) the paths are different for SSH and SFTP so the hashes can't be calculated properly. You can either use <a href="#--sftp-path-override"><code>--sftp-path-override</code></a> or <a href="#--sftp-disable-hashcheck"><code>disable_hashcheck</code></a>.</p><p>The only ssh agent supported under Windows is Putty's pageant.</p><p>The Go SSH library disables the use of the aes128-cbc cipher by default, due to security concerns. This can be re-enabled on a per-connection basis by setting the <code>use_insecure_cipher</code> setting in the configuration file to <code>true</code>. Further details on the insecurity of this cipher can be found <a href="http://www.isg.rhul.ac.uk/~kp/SandPfinal.pdf">in this paper</a>.</p><p>SFTP isn't supported under plan9 until <a href="https://github.com/pkg/sftp/issues/156">this issue</a> is fixed.</p>@@ -35452,7 +37307,7 @@ server_command = sudo /usr/libexec/openssh/sftp-server</code></pre><p>The first path segment must be the name of the share, which you entered when you started to share on Windows. On smbd, it's the section title in <code>smb.conf</code> (usually in <code>/etc/samba/</code>) file. You can find shares by querying the root if you're unsure (e.g. <code>rclone lsd remote:</code>).</p><p>You can't access to the shared printers from rclone, obviously.</p><p>You can't use Anonymous access for logging in. You have to use the <code>guest</code> user with an empty password instead. The rclone client tries to avoid 8.3 names when uploading files by encoding trailing spaces and periods. Alternatively, <a href="https://rclone.org/local/#paths-on-windows">the local backend</a> on Windows can access SMB servers using UNC paths, by <code>\\server\share</code>. This doesn't apply to non-Windows OSes, such as Linux and macOS.</p>-<h2 id="configuration-48">Configuration</h2>+<h2 id="configuration-50">Configuration</h2><p>Here is an example of making a SMB configuration.</p><p>First run</p><pre><code>rclone config</code></pre>@@ -35527,7 +37382,7 @@ y) Yes this is OK (default)e) Edit this remoted) Delete this remotey/e/d> d</code></pre>-<h3 id="standard-options-51">Standard options</h3>+<h3 id="standard-options-53">Standard options</h3><p>Here are the Standard options specific to smb (SMB / CIFS).</p><h4 id="smb-host">--smb-host</h4><p>SMB server hostname to connect to.</p>@@ -35588,7 +37443,17 @@ y/e/d> d</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h3 id="advanced-options-52">Advanced options</h3>+<h4 id="smb-use-kerberos">--smb-use-kerberos</h4>+<p>Use Kerberos authentication.</p>+<p>If set, rclone will use Kerberos authentication instead of NTLM. This requires a valid Kerberos configuration and credentials cache to be available, either in the default locations or as specified by the KRB5_CONFIG and KRB5CCNAME environment variables.</p>+<p>Properties:</p>+<ul>+<li>Config: use_kerberos</li>+<li>Env Var: RCLONE_SMB_USE_KERBEROS</li>+<li>Type: bool</li>+<li>Default: false</li>+</ul>+<h3 id="advanced-options-54">Advanced options</h3><p>Here are the Advanced options specific to smb (SMB / CIFS).</p><h4 id="smb-idle-timeout">--smb-idle-timeout</h4><p>Max time before closing idle connections.</p>@@ -35699,7 +37564,7 @@ y/e/d> d</code></pre><li><em>S3 backend</em>: secret encryption key is shared with the gateway</li></ul></li></ul>-<h2 id="configuration-49">Configuration</h2>+<h2 id="configuration-51">Configuration</h2><p>To make a new Storj configuration you need one of the following: * Access Grant that someone else shared with you. * <a href="https://documentation.storj.io/getting-started/uploading-your-first-object/create-an-api-key">API Key</a> of a Storj project you are a member of.</p><p>Here is an example of how to make a remote called <code>remote</code>. First run:</p><pre><code> rclone config</code></pre>@@ -35796,7 +37661,7 @@ y) Yes this is OK (default)e) Edit this remoted) Delete this remotey/e/d> y</code></pre>-<h3 id="standard-options-52">Standard options</h3>+<h3 id="standard-options-54">Standard options</h3><p>Here are the Standard options specific to storj (Storj Decentralized Cloud Storage).</p><h4 id="storj-provider">--storj-provider</h4><p>Choose an authentication method.</p>@@ -35875,7 +37740,7 @@ y/e/d> y</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h3 id="advanced-options-53">Advanced options</h3>+<h3 id="advanced-options-55">Advanced options</h3><p>Here are the Advanced options specific to storj (Storj Decentralized Cloud Storage).</p><h4 id="storj-description">--storj-description</h4><p>Description of the remote.</p>@@ -35940,7 +37805,7 @@ y/e/d> y</code></pre><pre><code>rclone sync --interactive --progress remote-us:bucket/path/to/dir/ remote-europe:bucket/path/to/dir/</code></pre><p>Or even between another cloud storage and Storj.</p><pre><code>rclone sync --interactive --progress s3:bucket/path/to/dir/ storj:bucket/path/to/dir/</code></pre>-<h2 id="limitations-37">Limitations</h2>+<h2 id="limitations-38">Limitations</h2><p><code>rclone about</code> is not supported by the rclone Storj backend. Backends without this capability cannot determine free space for an rclone mount or use policy <code>mfs</code> (most free space) as a member of an rclone union remote.</p><p>See <a href="https://rclone.org/overview/#optional-features">List of backends that do not support rclone about</a> and <a href="https://rclone.org/commands/rclone_about/">rclone about</a></p><h2 id="known-issues-1">Known issues</h2>@@ -35948,7 +37813,7 @@ y/e/d> y</code></pre><p>To fix these, please raise your system limits. You can do this issuing a <code>ulimit -n 65536</code> just before you run rclone. To change the limits more permanently you can add this to your shell startup script, e.g. <code>$HOME/.bashrc</code>, or change the system-wide configuration, usually <code>/etc/sysctl.conf</code> and/or <code>/etc/security/limits.conf</code>, but please refer to your operating system manual.</p><h1 id="sugarsync">SugarSync</h1><p><a href="https://sugarsync.com">SugarSync</a> is a cloud service that enables active synchronization of files across computers and other devices for file backup, access, syncing, and sharing.</p>-<h2 id="configuration-50">Configuration</h2>+<h2 id="configuration-52">Configuration</h2><p>The initial setup for SugarSync involves getting a token from SugarSync which you can do with rclone. <code>rclone config</code> walks you through it.</p><p>Here is an example of how to make a remote called <code>remote</code>. First run:</p><pre><code> rclone config</code></pre>@@ -36013,7 +37878,7 @@ y/e/d> y</code></pre><p>Paths are specified as <code>remote:path</code></p><p>Paths may be as deep as required, e.g. <code>remote:directory/subdirectory</code>.</p><p><strong>NB</strong> you can't create files in the top level folder you have to create a folder, which rclone will create as a "Sync Folder" with SugarSync.</p>-<h3 id="modification-times-and-hashes-26">Modification times and hashes</h3>+<h3 id="modification-times-and-hashes-27">Modification times and hashes</h3><p>SugarSync does not support modification times or hashes, therefore syncing will default to <code>--size-only</code> checking. Note that using <code>--update</code> will work as rclone can read the time files were uploaded.</p><h3 id="restricted-filename-characters-31">Restricted filename characters</h3><p>SugarSync replaces the <a href="https://rclone.org/overview/#restricted-characters">default restricted characters set</a> except for DEL.</p>@@ -36021,7 +37886,7 @@ y/e/d> y</code></pre><h3 id="deleting-files-7">Deleting files</h3><p>Deleted files will be moved to the "Deleted items" folder by default.</p><p>However you can supply the flag <code>--sugarsync-hard-delete</code> or set the config parameter <code>hard_delete = true</code> if you would like files to be deleted straight away.</p>-<h3 id="standard-options-53">Standard options</h3>+<h3 id="standard-options-55">Standard options</h3><p>Here are the Standard options specific to sugarsync (Sugarsync).</p><h4 id="sugarsync-app-id">--sugarsync-app-id</h4><p>Sugarsync App ID.</p>@@ -36062,7 +37927,7 @@ y/e/d> y</code></pre><li>Type: bool</li><li>Default: false</li></ul>-<h3 id="advanced-options-54">Advanced options</h3>+<h3 id="advanced-options-56">Advanced options</h3><p>Here are the Advanced options specific to sugarsync (Sugarsync).</p><h4 id="sugarsync-refresh-token">--sugarsync-refresh-token</h4><p>Sugarsync refresh token.</p>@@ -36143,14 +38008,14 @@ y/e/d> y</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h2 id="limitations-38">Limitations</h2>+<h2 id="limitations-39">Limitations</h2><p><code>rclone about</code> is not supported by the SugarSync backend. Backends without this capability cannot determine free space for an rclone mount or use policy <code>mfs</code> (most free space) as a member of an rclone union remote.</p><p>See <a href="https://rclone.org/overview/#optional-features">List of backends that do not support rclone about</a> and <a href="https://rclone.org/commands/rclone_about/">rclone about</a></p><h1 id="uloz.to">Uloz.to</h1><p>Paths are specified as <code>remote:path</code></p><p>Paths may be as deep as required, e.g. <code>remote:directory/subdirectory</code>.</p><p>The initial setup for Uloz.to involves filling in the user credentials. <code>rclone config</code> walks you through it.</p>-<h2 id="configuration-51">Configuration</h2>+<h2 id="configuration-53">Configuration</h2><p>Here is an example of how to make a remote called <code>remote</code>. First run:</p><pre><code> rclone config</code></pre><p>This will guide you through an interactive setup process:</p>@@ -36210,7 +38075,7 @@ y/e/d> y</code></pre><pre><code>rclone copy /home/source remote:backup</code></pre><h3 id="user-credentials">User credentials</h3><p>The only reliable method is to authenticate the user using username and password. Uloz.to offers an API key as well, but it's reserved for the use of Uloz.to's in-house application and using it in different circumstances is unreliable.</p>-<h3 id="modification-times-and-hashes-27">Modification times and hashes</h3>+<h3 id="modification-times-and-hashes-28">Modification times and hashes</h3><p>Uloz.to doesn't allow the user to set a custom modification time, or retrieve the hashes after upload. As a result, the integration uses a free form field the API provides to encode client-provided timestamps and hashes. Timestamps are stored with microsecond precision.</p><p>A server calculated MD5 hash of the file is verified upon upload. Afterwards, the backend only serves the client-side calculated hashes. Hashes can also be retrieved upon creating a file download link, but it's impractical for <code>list</code>-like use cases.</p><h3 id="restricted-filename-characters-32">Restricted filename characters</h3>@@ -36243,7 +38108,7 @@ y/e/d> y</code></pre><p>In order to do this you will have to find the <code>Folder slug</code> of the folder you wish to use as root. This will be the last segment of the URL when you open the relevant folder in the Uloz.to web interface.</p><p>For example, for exploring a folder with URL <code>https://uloz.to/fm/my-files/foobar</code>, <code>foobar</code> should be used as the root slug.</p><p><code>root_folder_slug</code> can be used alongside a specific path in the remote path. For example, if your remote's <code>root_folder_slug</code> corresponds to <code>/foo/bar</code>, <code>remote:baz/qux</code> will refer to <code>ABSOLUTE_ULOZTO_ROOT/foo/bar/baz/qux</code>.</p>-<h3 id="standard-options-54">Standard options</h3>+<h3 id="standard-options-56">Standard options</h3><p>Here are the Standard options specific to ulozto (Uloz.to).</p><h4 id="ulozto-app-token">--ulozto-app-token</h4><p>The application token identifying the app. An app API key can be either found in the API doc https://uloz.to/upload-resumable-api-beta or obtained from customer service.</p>@@ -36273,7 +38138,7 @@ y/e/d> y</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h3 id="advanced-options-55">Advanced options</h3>+<h3 id="advanced-options-57">Advanced options</h3><p>Here are the Advanced options specific to ulozto (Uloz.to).</p><h4 id="ulozto-root-folder-slug">--ulozto-root-folder-slug</h4><p>If set, rclone will use this folder as the root folder for all operations. For example, if the slug identifies 'foo/bar/', 'ulozto:baz' is equivalent to 'ulozto:foo/bar/baz' without any root slug set.</p>@@ -36312,7 +38177,7 @@ y/e/d> y</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h2 id="limitations-39">Limitations</h2>+<h2 id="limitations-40">Limitations</h2><p>Uloz.to file names can't have the <code>\</code> character in. rclone maps this to and from an identical looking unicode equivalent <code>\</code> (U+FF3C Fullwidth Reverse Solidus).</p><p>Uloz.to only supports filenames up to 255 characters in length.</p><p>Uloz.to rate limits access to the API, but exact details are undisclosed. Practical testing reveals that hitting the rate limit during normal use is very rare, although not impossible with higher number of concurrently uploaded files.</p>@@ -36322,7 +38187,7 @@ y/e/d> y</code></pre><p>This is a Backend for Uptobox file storage service. Uptobox is closer to a one-click hoster than a traditional cloud storage provider and therefore not suitable for long term storage.</p><p>Paths are specified as <code>remote:path</code></p><p>Paths may be as deep as required, e.g. <code>remote:directory/subdirectory</code>.</p>-<h2 id="configuration-52">Configuration</h2>+<h2 id="configuration-54">Configuration</h2><p>To configure an Uptobox backend you'll need your personal api token. You'll find it in your <a href="https://uptobox.com/my_account">account settings</a></p><p>Here is an example of how to make a remote called <code>remote</code> with the default setup. First run:</p><pre><code>rclone config</code></pre>@@ -36376,7 +38241,7 @@ y/e/d> </code></pre><pre><code>rclone ls remote:</code></pre><p>To copy a local directory to an Uptobox directory called backup</p><pre><code>rclone copy /home/source remote:backup</code></pre>-<h3 id="modification-times-and-hashes-28">Modification times and hashes</h3>+<h3 id="modification-times-and-hashes-29">Modification times and hashes</h3><p>Uptobox supports neither modified times nor checksums. All timestamps will read as that set by <code>--default-time</code>.</p><h3 id="restricted-filename-characters-33">Restricted filename characters</h3><p>In addition to the <a href="https://rclone.org/overview/#restricted-characters">default restricted characters set</a> the following characters are also replaced:</p>@@ -36402,7 +38267,7 @@ y/e/d> </code></pre></tbody></table><p>Invalid UTF-8 bytes will also be <a href="https://rclone.org/overview/#invalid-utf8">replaced</a>, as they can't be used in XML strings.</p>-<h3 id="standard-options-55">Standard options</h3>+<h3 id="standard-options-57">Standard options</h3><p>Here are the Standard options specific to uptobox (Uptobox).</p><h4 id="uptobox-access-token">--uptobox-access-token</h4><p>Your access token.</p>@@ -36414,7 +38279,7 @@ y/e/d> </code></pre><li>Type: string</li><li>Required: false</li></ul>-<h3 id="advanced-options-56">Advanced options</h3>+<h3 id="advanced-options-58">Advanced options</h3><p>Here are the Advanced options specific to uptobox (Uptobox).</p><h4 id="uptobox-private">--uptobox-private</h4><p>Set to make uploaded files private</p>@@ -36444,7 +38309,7 @@ y/e/d> </code></pre><li>Type: string</li><li>Required: false</li></ul>-<h2 id="limitations-40">Limitations</h2>+<h2 id="limitations-41">Limitations</h2><p>Uptobox will delete inactive files that have not been accessed in 60 days.</p><p><code>rclone about</code> is not supported by this backend an overview of used space can however been seen in the uptobox web interface.</p><h1 id="union">Union</h1>@@ -36458,7 +38323,7 @@ y/e/d> </code></pre></ul><p>Subfolders can be used in upstream remotes. Assume a union remote named <code>backup</code> with the remotes <code>mydrive:private/backup</code>. Invoking <code>rclone mkdir backup:desktop</code> is exactly the same as invoking <code>rclone mkdir mydrive:private/backup/desktop</code>.</p><p>There is no special handling of paths containing <code>..</code> segments. Invoking <code>rclone mkdir backup:../desktop</code> is exactly the same as invoking <code>rclone mkdir mydrive:private/backup/../desktop</code>.</p>-<h2 id="configuration-53">Configuration</h2>+<h2 id="configuration-55">Configuration</h2><p>Here is an example of how to make a union called <code>remote</code> for local folders. First run:</p><pre><code> rclone config</code></pre><p>This will guide you through an interactive setup process:</p>@@ -36691,7 +38556,7 @@ upstreams = /local:writeback remote:dir</code></pre><p>When files are written, they will be written to both <code>remote:dir</code> and <code>/local</code>.</p><p>As many remotes as desired can be added to <code>upstreams</code> but there should only be one <code>:writeback</code> tag.</p><p>Rclone does not manage the <code>:writeback</code> remote in any way other than writing files back to it. So if you need to expire old files or manage the size then you will have to do this yourself.</p>-<h3 id="standard-options-56">Standard options</h3>+<h3 id="standard-options-58">Standard options</h3><p>Here are the Standard options specific to union (Union merges the contents of several upstream fs).</p><h4 id="union-upstreams">--union-upstreams</h4><p>List of space separated upstreams.</p>@@ -36740,7 +38605,7 @@ upstreams = /local:writeback remote:dir</code></pre><li>Type: int</li><li>Default: 120</li></ul>-<h3 id="advanced-options-57">Advanced options</h3>+<h3 id="advanced-options-59">Advanced options</h3><p>Here are the Advanced options specific to union (Union merges the contents of several upstream fs).</p><h4 id="union-min-free-space">--union-min-free-space</h4><p>Minimum viable free space for lfs/eplfs policies.</p>@@ -36761,13 +38626,13 @@ upstreams = /local:writeback remote:dir</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h3 id="metadata-15">Metadata</h3>+<h3 id="metadata-16">Metadata</h3><p>Any metadata supported by the underlying remote is read and written.</p><p>See the <a href="https://rclone.org/docs/#metadata">metadata</a> docs for more info.</p><h1 id="webdav">WebDAV</h1><p>Paths are specified as <code>remote:path</code></p><p>Paths may be as deep as required, e.g. <code>remote:directory/subdirectory</code>.</p>-<h2 id="configuration-54">Configuration</h2>+<h2 id="configuration-56">Configuration</h2><p>To configure the WebDAV remote you will need to have a URL for it, and a username and password. If you know what kind of system you are connecting to then rclone can enable extra features.</p><p>Here is an example of how to make a remote called <code>remote</code>. First run:</p><pre><code> rclone config</code></pre>@@ -36841,10 +38706,10 @@ y/e/d> y</code></pre><pre><code>rclone ls remote:</code></pre><p>To copy a local directory to an WebDAV directory called backup</p><pre><code>rclone copy /home/source remote:backup</code></pre>-<h3 id="modification-times-and-hashes-29">Modification times and hashes</h3>-<p>Plain WebDAV does not support modified times. However when used with Fastmail Files, Owncloud or Nextcloud rclone will support modified times.</p>-<p>Likewise plain WebDAV does not support hashes, however when used with Fastmail Files, Owncloud or Nextcloud rclone will support SHA1 and MD5 hashes. Depending on the exact version of Owncloud or Nextcloud hashes may appear on all objects, or only on objects which had a hash uploaded with them.</p>-<h3 id="standard-options-57">Standard options</h3>+<h3 id="modification-times-and-hashes-30">Modification times and hashes</h3>+<p>Plain WebDAV does not support modified times. However when used with Fastmail Files, ownCloud or Nextcloud rclone will support modified times.</p>+<p>Likewise plain WebDAV does not support hashes, however when used with Fastmail Files, ownCloud or Nextcloud rclone will support SHA1 and MD5 hashes. Depending on the exact version of ownCloud or Nextcloud hashes may appear on all objects, or only on objects which had a hash uploaded with them.</p>+<h3 id="standard-options-59">Standard options</h3><p>Here are the Standard options specific to webdav (WebDAV).</p><h4 id="webdav-url">--webdav-url</h4><p>URL of http host to connect to.</p>@@ -36876,7 +38741,11 @@ y/e/d> y</code></pre></ul></li><li>"owncloud"<ul>-<li>Owncloud</li>+<li>Owncloud 10 PHP based WebDAV server</li>+</ul></li>+<li>"infinitescale"+<ul>+<li>ownCloud Infinite Scale</li></ul></li><li>"sharepoint"<ul>@@ -36925,7 +38794,7 @@ y/e/d> y</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h3 id="advanced-options-58">Advanced options</h3>+<h3 id="advanced-options-60">Advanced options</h3><p>Here are the Advanced options specific to webdav (WebDAV).</p><h4 id="webdav-bearer-token-command">--webdav-bearer-token-command</h4><p>Command to run to get a bearer token.</p>@@ -37033,11 +38902,14 @@ y/e/d> y</code></pre><h3 id="fastmail-files">Fastmail Files</h3><p>Use <code>https://webdav.fastmail.com/</code> or a subdirectory as the URL, and your Fastmail email <code>[email protected]</code> as the username. Follow <a href="https://www.fastmail.help/hc/en-us/articles/360058752854-App-passwords">this documentation</a> to create an app password with access to <code>Files (WebDAV)</code> and use this as the password.</p><p>Fastmail supports modified times using the <code>X-OC-Mtime</code> header.</p>-<h3 id="owncloud">Owncloud</h3>+<h3 id="owncloud">ownCloud</h3><p>Click on the settings cog in the bottom right of the page and this will show the WebDAV URL that rclone needs in the config step. It will look something like <code>https://example.com/remote.php/webdav/</code>.</p>-<p>Owncloud supports modified times using the <code>X-OC-Mtime</code> header.</p>+<p>ownCloud supports modified times using the <code>X-OC-Mtime</code> header.</p><h3 id="nextcloud">Nextcloud</h3>-<p>This is configured in an identical way to Owncloud. Note that Nextcloud initially did not support streaming of files (<code>rcat</code>) whereas Owncloud did, but <a href="https://github.com/nextcloud/nextcloud-snap/issues/365">this</a> seems to be fixed as of 2020-11-27 (tested with rclone v1.53.1 and Nextcloud Server v19).</p>+<p>This is configured in an identical way to ownCloud. Note that Nextcloud initially did not support streaming of files (<code>rcat</code>) whereas ownCloud did, but <a href="https://github.com/nextcloud/nextcloud-snap/issues/365">this</a> seems to be fixed as of 2020-11-27 (tested with rclone v1.53.1 and Nextcloud Server v19).</p>+<h3 id="owncloud-infinite-scale">ownCloud Infinite Scale</h3>+<p>The WebDAV URL for Infinite Scale can be found in the details panel of any space in Infinite Scale, if the display was enabled in the personal settings of the user through a checkbox there.</p>+<p>Infinite Scale works with the chunking <a href="https://tus.io">tus</a> upload protocol. The chunk size is currently fixed 10 MB.</p><h3 id="sharepoint-online">Sharepoint Online</h3><p>Rclone can be used with Sharepoint provided by OneDrive for Business or Office365 Education Accounts. This feature is only needed for a few of these Accounts, mostly Office365 Education ones. These accounts are sometimes not verified by the domain owner <a href="https://github.com/rclone/rclone/issues/1975">github#1975</a></p><p>This means that these accounts can't be added using the official API (other Accounts should work with the "onedrive" option). However, it is possible to access them using webdav.</p>@@ -37106,7 +38978,7 @@ vendor = otherbearer_token_command = oidc-token XDC</code></pre><h1 id="yandex-disk">Yandex Disk</h1><p><a href="https://disk.yandex.com">Yandex Disk</a> is a cloud storage solution created by <a href="https://yandex.com">Yandex</a>.</p>-<h2 id="configuration-55">Configuration</h2>+<h2 id="configuration-57">Configuration</h2><p>Here is an example of making a yandex configuration. First run</p><pre><code>rclone config</code></pre><p>This will guide you through an interactive setup process:</p>@@ -37161,7 +39033,7 @@ y/e/d> y</code></pre><p>Sync <code>/home/local/directory</code> to the remote path, deleting any excess files in the path.</p><pre><code>rclone sync --interactive /home/local/directory remote:directory</code></pre><p>Yandex paths may be as deep as required, e.g. <code>remote:directory/subdirectory</code>.</p>-<h3 id="modification-times-and-hashes-30">Modification times and hashes</h3>+<h3 id="modification-times-and-hashes-31">Modification times and hashes</h3><p>Modified times are supported and are stored accurate to 1 ns in custom metadata called <code>rclone_modified</code> in RFC3339 with nanoseconds format.</p><p>The MD5 hash algorithm is natively supported by Yandex Disk.</p><h3 id="emptying-trash-2">Emptying Trash</h3>@@ -37171,7 +39043,7 @@ y/e/d> y</code></pre><h3 id="restricted-filename-characters-34">Restricted filename characters</h3><p>The <a href="https://rclone.org/overview/#restricted-characters">default restricted characters set</a> are replaced.</p><p>Invalid UTF-8 bytes will also be <a href="https://rclone.org/overview/#invalid-utf8">replaced</a>, as they can't be used in JSON strings.</p>-<h3 id="standard-options-58">Standard options</h3>+<h3 id="standard-options-60">Standard options</h3><p>Here are the Standard options specific to yandex (Yandex Disk).</p><h4 id="yandex-client-id">--yandex-client-id</h4><p>OAuth Client Id.</p>@@ -37193,7 +39065,7 @@ y/e/d> y</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h3 id="advanced-options-59">Advanced options</h3>+<h3 id="advanced-options-61">Advanced options</h3><p>Here are the Advanced options specific to yandex (Yandex Disk).</p><h4 id="yandex-token">--yandex-token</h4><p>OAuth Access Token as a JSON blob.</p>@@ -37271,13 +39143,13 @@ y/e/d> y</code></pre><li>Type: string</li><li>Required: false</li></ul>-<h2 id="limitations-41">Limitations</h2>+<h2 id="limitations-42">Limitations</h2><p>When uploading very large files (bigger than about 5 GiB) you will need to increase the <code>--timeout</code> parameter. This is because Yandex pauses (perhaps to calculate the MD5SUM for the entire file) before returning confirmation that the file has been uploaded. The default handling of timeouts in rclone is to assume a 5 minute pause is an error and close the connection - you'll see <code>net/http: timeout awaiting response headers</code> errors in the logs if this is happening. Setting the timeout to twice the max size of file in GiB should be enough, so if you want to upload a 30 GiB file set a timeout of <code>2 * 30 = 60m</code>, that is <code>--timeout 60m</code>.</p><p>Having a Yandex Mail account is mandatory to use the Yandex.Disk subscription. Token generation will work without a mail account, but Rclone won't be able to complete any actions.</p><pre><code>[403 - DiskUnsupportedUserAccountTypeError] User account type is not supported.</code></pre><h1 id="zoho-workdrive">Zoho Workdrive</h1><p><a href="https://www.zoho.com/workdrive/">Zoho WorkDrive</a> is a cloud storage solution created by <a href="https://zoho.com">Zoho</a>.</p>-<h2 id="configuration-56">Configuration</h2>+<h2 id="configuration-58">Configuration</h2><p>Here is an example of making a zoho configuration. First run</p><pre><code>rclone config</code></pre><p>This will guide you through an interactive setup process:</p>@@ -37350,14 +39222,14 @@ y/e/d> </code></pre><p>Sync <code>/home/local/directory</code> to the remote path, deleting any excess files in the path.</p><pre><code>rclone sync --interactive /home/local/directory remote:directory</code></pre><p>Zoho paths may be as deep as required, eg <code>remote:directory/subdirectory</code>.</p>-<h3 id="modification-times-and-hashes-31">Modification times and hashes</h3>+<h3 id="modification-times-and-hashes-32">Modification times and hashes</h3><p>Modified times are currently not supported for Zoho Workdrive</p><p>No hash algorithms are supported.</p><h3 id="usage-information-1">Usage information</h3><p>To view your current quota you can use the <code>rclone about remote:</code> command which will display your current usage.</p><h3 id="restricted-filename-characters-35">Restricted filename characters</h3><p>Only control characters and invalid UTF-8 are replaced. In addition most Unicode full-width characters are not supported at all and will be removed from filenames during upload.</p>-<h3 id="standard-options-59">Standard options</h3>+<h3 id="standard-options-61">Standard options</h3><p>Here are the Standard options specific to zoho (Zoho).</p><h4 id="zoho-client-id">--zoho-client-id</h4><p>OAuth Client Id.</p>@@ -37416,7 +39288,7 @@ y/e/d> </code></pre></ul></li></ul></li></ul>-<h3 id="advanced-options-60">Advanced options</h3>+<h3 id="advanced-options-62">Advanced options</h3><p>Here are the Advanced options specific to zoho (Zoho).</p><h4 id="zoho-token">--zoho-token</h4><p>OAuth Access Token as a JSON blob.</p>@@ -37497,7 +39369,7 @@ y/e/d> </code></pre><p>Local paths are specified as normal filesystem paths, e.g. <code>/path/to/wherever</code>, so</p><pre><code>rclone sync --interactive /home/source /tmp/destination</code></pre><p>Will sync <code>/home/source</code> to <code>/tmp/destination</code>.</p>-<h2 id="configuration-57">Configuration</h2>+<h2 id="configuration-59">Configuration</h2><p>For consistencies sake one can also configure a remote of type <code>local</code> in the config file, and access the local filesystem using rclone remote paths, e.g. <code>remote:path/to/wherever</code>, but it is probably easier not to.</p><h3 id="modification-times-9">Modification times</h3><p>Rclone reads and writes the modification times using an accuracy determined by the OS. Typically this is 1ns on Linux, 10 ns on Windows and 1 Second on OS X.</p>@@ -37874,7 +39746,7 @@ $ tree /tmp/c0 file2</code></pre><p><strong>NB</strong> Rclone (like most unix tools such as <code>du</code>, <code>rsync</code> and <code>tar</code>) treats a bind mount to the same device as being on the same filesystem.</p><p><strong>NB</strong> This flag is only available on Unix based systems. On systems where it isn't supported (e.g. Windows) it will be ignored.</p>-<h3 id="advanced-options-61">Advanced options</h3>+<h3 id="advanced-options-63">Advanced options</h3><p>Here are the Advanced options specific to local (Local Disk).</p><h4 id="local-nounc">--local-nounc</h4><p>Disable UNC (long path names) conversion on Windows.</p>@@ -38098,7 +39970,7 @@ $ tree /tmp/c<li>Type: string</li><li>Required: false</li></ul>-<h3 id="metadata-16">Metadata</h3>+<h3 id="metadata-17">Metadata</h3><p>Depending on which OS is in use the local backend may return only some of the system metadata. Setting system metadata is supported on all OSes but setting user metadata is only supported on linux, freebsd, netbsd, macOS and Solaris. It is <strong>not</strong> supported on Windows yet (<a href="https://github.com/pkg/xattr/issues/47">see pkg/attrs#47</a>).</p><p>User metadata is stored as extended attributes (which may not be supported by all file systems) under the "user.*" prefix.</p><p>Metadata is supported on files and directories.</p>@@ -38173,7 +40045,7 @@ $ tree /tmp/c</tbody></table><p>See the <a href="https://rclone.org/docs/#metadata">metadata</a> docs for more info.</p>-<h2 id="backend-commands-10">Backend commands</h2>+<h2 id="backend-commands-11">Backend commands</h2><p>Here are the commands specific to the local backend.</p><p>Run them with</p><pre><code>rclone backend COMMAND remote:</code></pre>@@ -38190,6 +40062,292 @@ $ tree /tmp/c<li>"error": return an error based on option value</li></ul><h1 id="changelog-1">Changelog</h1>+<h2 id="v1.70.0---2025-06-17">v1.70.0 - 2025-06-17</h2>+<p><a href="https://github.com/rclone/rclone/compare/v1.69.0...v1.70.0">See commits</a></p>+<ul>+<li>New backends+<ul>+<li><a href="https://rclone.org/doi/">DOI</a> (Flora Thiebaut)</li>+<li><a href="https://rclone.org/filelu/">FileLu</a> (kingston125)</li>+<li>New S3 providers:+<ul>+<li><a href="https://rclone.org/s3/#mega">MEGA S4</a> (Nick Craig-Wood)</li>+<li><a href="https://rclone.org/s3/#pure-storage-flashblade">Pure Storage FlashBlade</a> (Jeremy Daer)</li>+</ul></li>+</ul></li>+<li>New commands+<ul>+<li><a href="https://rclone.org/commands/rclone_convmv/">convmv</a>: for moving and transforming files (nielash)</li>+</ul></li>+<li>New Features+<ul>+<li>Add <a href="https://rclone.org/docs/#max-connections-n"><code>--max-connections</code></a> to control maximum backend concurrency (Nick Craig-Wood)</li>+<li>Add <a href="https://rclone.org/docs/#max-buffer-memory"><code>--max-buffer-memory</code></a> to limit total buffer memory usage (Nick Craig-Wood)</li>+<li>Add transform library and <a href="https://rclone.org/docs/#name-transform-command-xxxx"><code>--name-transform</code></a> flag (nielash)</li>+<li>sync: Implement <a href="https://rclone.org/docs/#list-cutoff"><code>--list-cutoff</code></a> to allow on disk sorting for reduced memory use (Nick Craig-Wood)</li>+<li>accounting: Add listed stat for number of directory entries listed (Nick Craig-Wood)</li>+<li>backend: Skip hash calculation when the hashType is None (Oleksiy Stashok)</li>+<li>build+<ul>+<li>Update to go1.24 and make go1.22 the minimum required version (Nick Craig-Wood)</li>+<li>Disable docker builds on PRs & add missing dockerfile changes (Anagh Kumar Baranwal)</li>+<li>Modernize Go usage (Nick Craig-Wood)</li>+<li>Update all dependencies (Nick Craig-Wood)</li>+</ul></li>+<li>cmd/authorize: Show required arguments in help text (simwai)</li>+<li>cmd/config: add <code>--no-output</code> option (Jess)</li>+<li>cmd/gitannex+<ul>+<li>Tweak parsing of "rcloneremotename" config (Dan McArdle)</li>+<li>Permit remotes with options (Dan McArdle)</li>+<li>Reject unknown layout modes in INITREMOTE (Dan McArdle)</li>+</ul></li>+<li>docker image: Add label org.opencontainers.image.source for release notes in Renovate dependency updates (Robin Schneider)</li>+<li>doc fixes (albertony, Andrew Kreimer, Ben Boeckel, Christoph Berger, Danny Garside, Dimitri Papadopoulos, eccoisle, Ed Craig-Wood, Fernando Fernández, jack, Jeff Geerling, Jugal Kishore, kingston125, luzpaz, Markus Gerstel, Matt Ickstadt, Michael Kebe, Nick Craig-Wood, PrathameshLakawade, Ser-Bul, simonmcnair, Tim White, Zachary Vorhies)</li>+<li>filter:+<ul>+<li>Add <code>--hash-filter</code> to deterministically select a subset of files (Nick Craig-Wood)</li>+<li>Show <code>--min-size</code> and <code>--max-size</code> in <code>--dump</code> filters (Nick Craig-Wood)</li>+</ul></li>+<li>hash: Add SHA512 support for file hashes (Enduriel)</li>+<li>http servers: Add <code>--user-from-header</code> to use for authentication (Moises Lima)</li>+<li>lib/batcher: Deprecate unused option: batch_commit_timeout (Dan McArdle)</li>+<li>log:+<ul>+<li>Remove github.com/sirupsen/logrus and replace with log/slog (Nick Craig-Wood)</li>+<li>Add <code>--windows-event-log-level</code> to support Windows Event Log (Nick Craig-Wood)</li>+</ul></li>+<li>rc+<ul>+<li>Add add <code>short</code> parameter to <code>core/stats</code> to not return transferring and checking (Nick Craig-Wood)</li>+<li>In <code>options/info</code> make FieldName contain a "." if it should be nested (Nick Craig-Wood)</li>+<li>Add rc control for serve commands (Nick Craig-Wood)</li>+<li>rcserver: Improve content-type check (Jonathan Giannuzzi)</li>+</ul></li>+<li>serve nfs+<ul>+<li>Update docs to note Windows is not supported (Zachary Vorhies)</li>+<li>Change the format of <code>--nfs-cache-type symlink</code> file handles (Nick Craig-Wood)</li>+<li>Make metadata files have special file handles (Nick Craig-Wood)</li>+</ul></li>+<li>touch: Make touch obey <code>--transfers</code> (Nick Craig-Wood)</li>+<li>version: Add <code>--deps</code> flag to show dependencies and other build info (Nick Craig-Wood)</li>+</ul></li>+<li>Bug Fixes+<ul>+<li>serve s3:+<ul>+<li>Fix ListObjectsV2 response (fhuber)</li>+<li>Remove redundant handler initialization (Tho Neyugn)</li>+</ul></li>+<li>stats: Fix goroutine leak and improve stats accounting process (Nathanael Demacon)</li>+</ul></li>+<li>VFS+<ul>+<li>Add <code>--vfs-metadata-extension</code> to expose metadata sidecar files (Nick Craig-Wood)</li>+</ul></li>+<li>Azure Blob+<ul>+<li>Add support for <code>x-ms-tags</code> header (Trevor Starick)</li>+<li>Cleanup uncommitted blocks on upload errors (Nick Craig-Wood)</li>+<li>Speed up server side copies for small files (Nick Craig-Wood)</li>+<li>Implement multipart server side copy (Nick Craig-Wood)</li>+<li>Remove uncommitted blocks on InvalidBlobOrBlock error (Nick Craig-Wood)</li>+<li>Fix handling of objects with // in (Nick Craig-Wood)</li>+<li>Handle retry error codes more carefully (Nick Craig-Wood)</li>+<li>Fix errors not being retried when doing single part copy (Nick Craig-Wood)</li>+<li>Fix multipart server side copies of 0 sized files (Nick Craig-Wood)</li>+</ul></li>+<li>Azurefiles+<ul>+<li>Add <code>--azurefiles-use-az</code> and <code>--azurefiles-disable-instance-discovery</code> (b-wimmer)</li>+</ul></li>+<li>B2+<ul>+<li>Add SkipDestructive handling to backend commands (Pat Patterson)</li>+<li>Use file id from listing when not presented in headers (ahxxm)</li>+</ul></li>+<li>Cloudinary+<ul>+<li>Automatically add/remove known media files extensions (yuval-cloudinary)</li>+<li>Var naming convention (yuval-cloudinary)</li>+</ul></li>+<li>Drive+<ul>+<li>Added <code>backend moveid</code> command (Spencer McCullough)</li>+</ul></li>+<li>Dropbox+<ul>+<li>Support Dropbox Paper (Dave Vasilevsky)</li>+</ul></li>+<li>FTP+<ul>+<li>Add <code>--ftp-http-proxy</code> to connect via HTTP CONNECT proxy</li>+</ul></li>+<li>Gofile+<ul>+<li>Update to use new direct upload endpoint (wbulot)</li>+</ul></li>+<li>Googlephotos+<ul>+<li>Update read only and read write scopes to meet Google's requirements. (Germán Casares)</li>+</ul></li>+<li>Iclouddrive+<ul>+<li>Fix panic and files potentially downloaded twice (Clément Wehrung)</li>+</ul></li>+<li>Internetarchive+<ul>+<li>Add <code>--internetarchive-metadata="key=value"</code> for setting item metadata (Corentin Barreau)</li>+</ul></li>+<li>Onedrive+<ul>+<li>Fix "The upload session was not found" errors (Nick Craig-Wood)</li>+<li>Re-add <code>--onedrive-upload-cutoff</code> flag (Nick Craig-Wood)</li>+<li>Fix crash if no metadata was updated (Nick Craig-Wood)</li>+</ul></li>+<li>Opendrive+<ul>+<li>Added <code>--opendrive-access</code> flag to handle permissions (Joel K Biju)</li>+</ul></li>+<li>Pcloud+<ul>+<li>Fix "Access denied. You do not have permissions to perform this operation" on large uploads (Nick Craig-Wood)</li>+</ul></li>+<li>S3+<ul>+<li>Fix handling of objects with // in (Nick Craig-Wood)</li>+<li>Add IBM IAM signer (Alexander Minbaev)</li>+<li>Split the GCS quirks into <code>--s3-use-x-id</code> and <code>--s3-sign-accept-encoding</code> (Nick Craig-Wood)</li>+<li>Implement paged listing interface ListP (Nick Craig-Wood)</li>+<li>Add Pure Storage FlashBlade provider support (Jeremy Daer)</li>+<li>Require custom endpoint for Lyve Cloud v2 support (PrathameshLakawade)</li>+<li>MEGA S4 support (Nick Craig-Wood)</li>+</ul></li>+<li>SFTP+<ul>+<li>Add <code>--sftp-http-proxy</code> to connect via HTTP CONNECT proxy (Nick Craig-Wood)</li>+</ul></li>+<li>Smb+<ul>+<li>Add support for kerberos authentication (Jonathan Giannuzzi)</li>+<li>Improve connection pooling efficiency (Jonathan Giannuzzi)</li>+</ul></li>+<li>WebDAV+<ul>+<li>Retry propfind on 425 status (Jörn Friedrich Dreyer)</li>+<li>Add an ownCloud Infinite Scale vendor that enables tus chunked upload support (Klaas Freitag)</li>+</ul></li>+</ul>+<h2 id="v1.69.3---2025-05-21">v1.69.3 - 2025-05-21</h2>+<p><a href="https://github.com/rclone/rclone/compare/v1.69.2...v1.69.3">See commits</a></p>+<ul>+<li>Bug Fixes+<ul>+<li>build: Reapply update github.com/golang-jwt/jwt/v5 from 5.2.1 to 5.2.2 to fix CVE-2025-30204 (dependabot[bot])</li>+<li>build: Update github.com/ebitengine/purego to work around bug in go1.24.3 (Nick Craig-Wood)</li>+</ul></li>+</ul>+<h2 id="v1.69.2---2025-05-01">v1.69.2 - 2025-05-01</h2>+<p><a href="https://github.com/rclone/rclone/compare/v1.69.1...v1.69.2">See commits</a></p>+<ul>+<li>Bug fixes+<ul>+<li>accounting: Fix percentDiff calculation -- (Anagh Kumar Baranwal)</li>+<li>build+<ul>+<li>Update github.com/golang-jwt/jwt/v4 from 4.5.1 to 4.5.2 to fix CVE-2025-30204 (dependabot[bot])</li>+<li>Update github.com/golang-jwt/jwt/v5 from 5.2.1 to 5.2.2 to fix CVE-2025-30204 (dependabot[bot])</li>+<li>Update golang.org/x/crypto to v0.35.0 to fix CVE-2025-22869 (Nick Craig-Wood)</li>+<li>Update golang.org/x/net from 0.36.0 to 0.38.0 to fix CVE-2025-22870 (dependabot[bot])</li>+<li>Update golang.org/x/net to 0.36.0. to fix CVE-2025-22869 (dependabot[bot])</li>+<li>Stop building with go < go1.23 as security updates forbade it (Nick Craig-Wood)</li>+<li>Fix docker plugin build (Anagh Kumar Baranwal)</li>+</ul></li>+<li>cmd: Fix crash if rclone is invoked without any arguments (Janne Hellsten)</li>+<li>config: Read configuration passwords from stdin even when terminated with EOF (Samantha Bowen)</li>+<li>doc fixes (Andrew Kreimer, Danny Garside, eccoisle, Ed Craig-Wood, emyarod, jack, Jugal Kishore, Markus Gerstel, Michael Kebe, Nick Craig-Wood, simonmcnair, simwai, Zachary Vorhies)</li>+<li>fs: Fix corruption of SizeSuffix with "B" suffix in config (eg --min-size) (Nick Craig-Wood)</li>+<li>lib/http: Fix race between Serve() and Shutdown() (Nick Craig-Wood)</li>+<li>object: Fix memory object out of bounds Seek (Nick Craig-Wood)</li>+<li>operations: Fix call fmt.Errorf with wrong err (alingse)</li>+<li>rc+<ul>+<li>Disable the metrics server when running <code>rclone rc</code> (hiddenmarten)</li>+<li>Fix debug/* commands not being available over unix sockets (Nick Craig-Wood)</li>+</ul></li>+<li>serve nfs: Fix unlikely crash (Nick Craig-Wood)</li>+<li>stats: Fix the speed not getting updated after a pause in the processing (Anagh Kumar Baranwal)</li>+<li>sync+<ul>+<li>Fix cpu spinning when empty directory finding with leading slashes (Nick Craig-Wood)</li>+<li>Copy dir modtimes even when copyEmptySrcDirs is false (ll3006)</li>+</ul></li>+</ul></li>+<li>VFS+<ul>+<li>Fix directory cache serving stale data (Lorenz Brun)</li>+<li>Fix inefficient directory caching when directory reads are slow (huanghaojun)</li>+<li>Fix integration test failures (Nick Craig-Wood)</li>+</ul></li>+<li>Drive+<ul>+<li>Metadata: fix error when setting copy-requires-writer-permission on a folder (Nick Craig-Wood)</li>+</ul></li>+<li>Dropbox+<ul>+<li>Retry link without expiry (Dave Vasilevsky)</li>+</ul></li>+<li>HTTP+<ul>+<li>Correct root if definitely pointing to a file (nielash)</li>+</ul></li>+<li>Iclouddrive+<ul>+<li>Fix so created files are writable (Ben Alex)</li>+</ul></li>+<li>Onedrive+<ul>+<li>Fix metadata ordering in permissions (Nick Craig-Wood)</li>+</ul></li>+</ul>+<h2 id="v1.69.1---2025-02-14">v1.69.1 - 2025-02-14</h2>+<p><a href="https://github.com/rclone/rclone/compare/v1.69.0...v1.69.1">See commits</a></p>+<ul>+<li>Bug Fixes+<ul>+<li>lib/oauthutil: Fix redirect URL mismatch errors (Nick Craig-Wood)</li>+<li>bisync: Fix listings missing concurrent modifications (nielash)</li>+<li>serve s3: Fix list objects encoding-type (Nick Craig-Wood)</li>+<li>fs: Fix confusing "didn't find section in config file" error (Nick Craig-Wood)</li>+<li>doc fixes (Christoph Berger, Dimitri Papadopoulos, Matt Ickstadt, Nick Craig-Wood, Tim White, Zachary Vorhies)</li>+<li>build: Added parallel docker builds and caching for go build in the container (Anagh Kumar Baranwal)</li>+</ul></li>+<li>VFS+<ul>+<li>Fix the cache failing to upload symlinks when <code>--links</code> was specified (Nick Craig-Wood)</li>+<li>Fix race detected by race detector (Nick Craig-Wood)</li>+<li>Close the change notify channel on Shutdown (izouxv)</li>+</ul></li>+<li>B2+<ul>+<li>Fix "fatal error: concurrent map writes" (Nick Craig-Wood)</li>+</ul></li>+<li>Iclouddrive+<ul>+<li>Add notes on ADP and Missing PCS cookies (Nick Craig-Wood)</li>+</ul></li>+<li>Onedrive+<ul>+<li>Mark German (de) region as deprecated (Nick Craig-Wood)</li>+</ul></li>+<li>S3+<ul>+<li>Added new storage class to magalu provider (Bruno Fernandes)</li>+<li>Add DigitalOcean regions SFO2, LON1, TOR1, BLR1 (jkpe)</li>+<li>Add latest Linode Object Storage endpoints (jbagwell-akamai)</li>+</ul></li>+</ul><h2 id="v1.69.0---2025-01-12">v1.69.0 - 2025-01-12</h2><p><a href="https://github.com/rclone/rclone/compare/v1.68.0...v1.69.0">See commits</a></p><ul>@@ -38232,7 +40390,7 @@ $ tree /tmp/c<li>http servers: Disable automatic authentication skipping for unix sockets in http servers (Moises Lima)<ul><li>This was making it impossible to use unix sockets with an proxy</li>-<li>This might now cause rclone to need authenticaton where it didn't before</li>+<li>This might now cause rclone to need authentication where it didn't before</li></ul></li><li>oauthutil: add support for OAuth client credential flow (Martin Hassack, Nick Craig-Wood)</li><li>operations: make log messages consistent for mkdir/rmdir at INFO level (Nick Craig-Wood)</li>@@ -39272,7 +41430,7 @@ $ tree /tmp/c<li>Refactor version info and icon resource handling on windows (albertony)</li></ul></li><li>doc updates (albertony, alfish2000, asdffdsazqqq, Dimitri Papadopoulos, Herby Gillot, Joda Stößer, Manoj Ghosh, Nick Craig-Wood)</li>-<li>Implement <code>--metadata-mapper</code> to transform metatadata with a user supplied program (Nick Craig-Wood)</li>+<li>Implement <code>--metadata-mapper</code> to transform metadata with a user supplied program (Nick Craig-Wood)</li><li>Add <code>ChunkWriterDoesntSeek</code> feature flag and set it for b2 (Nick Craig-Wood)</li><li>lib/http: Export basic go string functions for use in <code>--template</code> (Gabriel Espinoza)</li><li>makefile: Use POSIX compatible install arguments (Mina Galić)</li>@@ -39447,7 +41605,7 @@ $ tree /tmp/c<li>B2<ul><li>Fix multipart upload: corrupted on transfer: sizes differ XXX vs 0 (Nick Craig-Wood)</li>-<li>Fix locking window when getting mutipart upload URL (Nick Craig-Wood)</li>+<li>Fix locking window when getting multipart upload URL (Nick Craig-Wood)</li><li>Fix server side copies greater than 4GB (Nick Craig-Wood)</li><li>Fix chunked streaming uploads (Nick Craig-Wood)</li><li>Reduce default <code>--b2-upload-concurrency</code> to 4 to reduce memory usage (Nick Craig-Wood)</li>@@ -46522,7 +48680,7 @@ $ tree /tmp/c<li>Project started</li></ul><h1 id="bugs-and-limitations">Bugs and Limitations</h1>-<h2 id="limitations-42">Limitations</h2>+<h2 id="limitations-43">Limitations</h2><h3 id="directory-timestamps-arent-preserved-on-some-backends">Directory timestamps aren't preserved on some backends</h3><p>As of <code>v1.66</code>, rclone supports syncing directory modtimes, if the backend supports it. Some backends do not support it -- see <a href="https://rclone.org/overview/">overview</a> for a complete list. Additionally, note that empty directories are not synced by default (this can be enabled with <code>--create-empty-src-dirs</code>.)</p><h3 id="rclone-struggles-with-millions-of-files-in-a-directorybucket">Rclone struggles with millions of files in a directory/bucket</h3>@@ -46545,6 +48703,11 @@ $ tree /tmp/c<p>See the <a href="https://rclone.org/remote_setup/">remote setup docs</a> for more info.</p><h3 id="how-do-i-configure-rclone-on-a-remote-headless-box-with-no-browser">How do I configure rclone on a remote / headless box with no browser?</h3><p>This has now been documented in its own <a href="https://rclone.org/remote_setup/">remote setup page</a>.</p>+<h3 id="how-can-i-get-rid-of-the-config-file-not-found-notice">How can I get rid of the "Config file not found" notice?</h3>+<p>If you see a notice like 'NOTICE: Config file "rclone.conf" not found', this means you have not configured any remotes.</p>+<p>If you need to configure a remote, see the <a href="https://rclone.org/docs/#configure">config help docs</a>.</p>+<p>If you are using rclone entirely with <a href="https://rclone.org/docs/#backend-path-to-dir">on the fly remotes</a>, you can create an empty config file to get rid of this notice, for example:</p>+<pre><code>rclone config touch</code></pre><h3 id="can-rclone-sync-directly-from-drive-to-s3">Can rclone sync directly from drive to s3</h3><p>Rclone can sync between two remote cloud storage systems just fine.</p><p>Note that it effectively downloads the file and uploads it again, so the node running rclone would need to have lots of bandwidth.</p>@@ -46623,7 +48786,10 @@ yyyy/mm/dd hh:mm:ss Fatal error: config failed to refresh token: failed to start<h3 id="rclone-is-using-too-much-memory-or-appears-to-have-a-memory-leak">Rclone is using too much memory or appears to have a memory leak</h3><p>Rclone is written in Go which uses a garbage collector. The default settings for the garbage collector mean that it runs when the heap size has doubled.</p><p>However it is possible to tune the garbage collector to use less memory by <a href="https://dave.cheney.net/tag/gogc">setting GOGC</a> to a lower value, say <code>export GOGC=20</code>. This will make the garbage collector work harder, reducing memory size at the expense of CPU usage.</p>-<p>The most common cause of rclone using lots of memory is a single directory with millions of files in. Rclone has to load this entirely into memory as rclone objects. Each rclone object takes 0.5k-1k of memory. There is <a href="https://github.com/rclone/rclone/wiki/Big-syncs-with-millions-of-files">a workaround for this</a> which involves a bit of scripting.</p>+<p>The most common cause of rclone using lots of memory is a single directory with millions of files in.</p>+<p>Before rclone v1.70 has to load this entirely into memory as rclone objects. Each rclone object takes 0.5k-1k of memory. There is <a href="https://github.com/rclone/rclone/wiki/Big-syncs-with-millions-of-files">a workaround for this</a> which involves a bit of scripting.</p>+<p>However with rclone v1.70 and later rclone will automatically save directory entries to disk when a directory with more than <a href="https://rclone.org/docs/#list-cutoff"><code>--list-cutoff</code></a> (1,000,000 by default) entries is detected.</p>+<p>From v1.70 rclone also has the <a href="https://rclone.org/docs/#max-buffer-memory">--max-buffer-memory</a> flag which helps particularly when multi-thread transfers are using too much memory.</p><h3 id="rclone-changes-fullwidth-unicode-punctuation-marks-in-file-names">Rclone changes fullwidth Unicode punctuation marks in file names</h3><p>For example: On a Windows system, you have a file with name <code>Test:1.jpg</code>, where <code>:</code> is the Unicode fullwidth colon symbol. When using rclone to copy this to your Google Drive, you will notice that the file gets renamed to <code>Test:1.jpg</code>, where <code>:</code> is the regular (halfwidth) colon.</p><p>The reason for such renames is the way rclone handles different <a href="https://rclone.org/overview/#restricted-filenames">restricted filenames</a> on different cloud storage systems. It tries to avoid ambiguous file names as much and allow moving files between many cloud storage systems transparently, by replacing invalid characters with similar looking Unicode characters when transferring to one storage system, and replacing back again when transferring to a different storage system where the original characters are supported. When the same Unicode characters are intentionally used in file names, this replacement strategy leads to unwanted renames. Read more <a href="https://rclone.org/overview/#restricted-filenames-caveats">here</a>.</p>@@ -47448,7 +49614,6 @@ THE SOFTWARE.</code></pre><li>ben-ba <a href="mailto:[email protected]" class="email">[email protected]</a></li><li>Eli Orzitzer <a href="mailto:[email protected]" class="email">[email protected]</a></li><li>Anthony Metzidis <a href="mailto:[email protected]" class="email">[email protected]</a></li>-<li>emyarod <a href="mailto:[email protected]" class="email">[email protected]</a></li><li>keongalvin <a href="mailto:[email protected]" class="email">[email protected]</a></li><li>rarspace01 <a href="mailto:[email protected]" class="email">[email protected]</a></li><li>Paul Stern <a href="mailto:[email protected]" class="email">[email protected]</a></li>@@ -47564,6 +49729,64 @@ THE SOFTWARE.</code></pre><li>ToM <a href="mailto:[email protected]" class="email">[email protected]</a></li><li>TAKEI Yuya <a href="mailto:[email protected]" class="email">[email protected]</a></li><li>Francesco Frassinelli <a href="mailto:[email protected]" class="email">[email protected]</a> <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>Matt Ickstadt <a href="mailto:[email protected]" class="email">[email protected]</a> <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>Spencer McCullough <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>Jonathan Giannuzzi <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>Christoph Berger <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>Tim White <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>Robin Schneider <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>izouxv <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>Moises Lima <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>Bruno Fernandes <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>Corentin Barreau <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>hiddenmarten <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>Trevor Starick <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>b-wimmer <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>Jess <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>Zachary Vorhies <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>Alexander Minbaev <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>Joel K Biju <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>ll3006 <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>jbagwell-akamai <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>Michael Kebe <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>Lorenz Brun <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>Dave Vasilevsky <a href="mailto:[email protected]" class="email">[email protected]</a> <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>luzpaz <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>jack <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>Jörn Friedrich Dreyer <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>alingse <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>Fernando Fernández <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>eccoisle <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>Klaas Freitag <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>Danny Garside <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>Samantha Bowen <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>simonmcnair <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>huanghaojun <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>Enduriel <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>Markus Gerstel <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>simwai <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>Ben Alex <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>Klaas Freitag <a href="mailto:[email protected]" class="email">[email protected]</a> <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>Andrew Kreimer <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>Ed Craig-Wood <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>Christian Richter <a href="mailto:[email protected]" class="email">[email protected]</a> <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>Ralf Haferkamp <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>Jugal Kishore <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>Tho Neyugn <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>Ben Boeckel <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>Clément Wehrung <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>Jeff Geerling <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>Germán Casares <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>fhuber <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>wbulot <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>Jeremy Daer <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>Oleksiy Stashok <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>PrathameshLakawade <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>Nathanael Demacon <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>ahxxm <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>Flora Thiebaut <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>kingston125 <a href="mailto:[email protected]" class="email">[email protected]</a></li>+<li>Ser-Bul <a href="mailto:[email protected]" class="email">[email protected]</a></li></ul><h1 id="contact-the-rclone-project">Contact the rclone project</h1><h2 id="forum">Forum</h2>diff --git a/MANUAL.md b/MANUAL.mdindex 8d2f405fe..ed3de7dfb 100644--- a/MANUAL.md+++ b/MANUAL.md@@ -1,7 +1,79 @@% rclone(1) User Manual% Nick Craig-Wood-% Jan 12, 2025+% Jun 17, 2025+# NAME++rclone - manage files on cloud storage++# SYNOPSIS++```+Usage:+ rclone [flags]+ rclone [command]++Available commands:+ about Get quota information from the remote.+ authorize Remote authorization.+ backend Run a backend-specific command.+ bisync Perform bidirectional synchronization between two paths.+ cat Concatenates any files and sends them to stdout.+ check Checks the files in the source and destination match.+ checksum Checks the files in the destination against a SUM file.+ cleanup Clean up the remote if possible.+ completion Output completion script for a given shell.+ config Enter an interactive configuration session.+ convmv Convert file and directory names in place.+ copy Copy files from source to dest, skipping identical files.+ copyto Copy files from source to dest, skipping identical files.+ copyurl Copy the contents of the URL supplied content to dest:path.+ cryptcheck Cryptcheck checks the integrity of an encrypted remote.+ cryptdecode Cryptdecode returns unencrypted file names.+ dedupe Interactively find duplicate filenames and delete/rename them.+ delete Remove the files in path.+ deletefile Remove a single file from remote.+ gendocs Output markdown docs for rclone to the directory supplied.+ gitannex Speaks with git-annex over stdin/stdout.+ hashsum Produces a hashsum file for all the objects in the path.+ help Show help for rclone commands, flags and backends.+ link Generate public link to file/folder.+ listremotes List all the remotes in the config file and defined in environment variables.+ ls List the objects in the path with size and path.+ lsd List all directories/containers/buckets in the path.+ lsf List directories and objects in remote:path formatted for parsing.+ lsjson List directories and objects in the path in JSON format.+ lsl List the objects in path with modification time, size and path.+ md5sum Produces an md5sum file for all the objects in the path.+ mkdir Make the path if it doesn't already exist.+ mount Mount the remote as file system on a mountpoint.+ move Move files from source to dest.+ moveto Move file or directory from source to dest.+ ncdu Explore a remote with a text based user interface.+ nfsmount Mount the remote as file system on a mountpoint.+ obscure Obscure password for use in the rclone config file.+ purge Remove the path and all of its contents.+ rc Run a command against a running rclone.+ rcat Copies standard input to file on remote.+ rcd Run rclone listening to remote control commands only.+ rmdir Remove the empty directory at path.+ rmdirs Remove empty directories under the path.+ selfupdate Update the rclone binary.+ serve Serve a remote over a protocol.+ settier Changes storage class/tier of objects in remote.+ sha1sum Produces an sha1sum file for all the objects in the path.+ size Prints the total size and number of objects in remote:path.+ sync Make source and dest identical, modifying destination only.+ test Run a test command+ touch Create new file or change file modification time.+ tree List the contents of the remote in a tree like fashion.+ version Show the version number.++Use "rclone [command] --help" for more information about a command.+Use "rclone help flags" for to see the global flags.+Use "rclone help backends" for a list of supported services.++```# Rclone syncs your files to cloud storage<img width="50%" src="https://rclone.org/img/logo_on_light__horizontal_color.svg" alt="rclone logo" style="float:right; padding: 5px;" >@@ -121,6 +193,8 @@ WebDAV or S3, that work out of the box.)- Enterprise File Fabric- Fastmail Files- Files.com+- FileLu Cloud Storage+- FlashBlade- FTP- Gofile- Google Cloud Storage@@ -145,7 +219,8 @@ WebDAV or S3, that work out of the box.)- Magalu- Mail.ru Cloud- Memset Memstore-- Mega+- MEGA+- MEGA S4- Memory- Microsoft Azure Blob Storage- Microsoft Azure Files Storage@@ -545,7 +620,7 @@ Note that this is controlled by [community maintainer](https://github.com/bouken## Source installation {#source}Make sure you have git and [Go](https://golang.org/) installed.-Go version 1.18 or newer is required, the latest release is recommended.+Go version 1.22 or newer is required, the latest release is recommended.You can get it from your package manager, or download it from[golang.org/dl](https://golang.org/dl/). Then you can run the following:@@ -885,6 +960,7 @@ See the following for detailed instructions for* [Digi Storage](https://rclone.org/koofr/#digi-storage)* [Dropbox](https://rclone.org/dropbox/)* [Enterprise File Fabric](https://rclone.org/filefabric/)+ * [FileLu Cloud Storage](https://rclone.org/filelu/)* [Files.com](https://rclone.org/filescom/)* [FTP](https://rclone.org/ftp/)* [Gofile](https://rclone.org/gofile/)@@ -1133,6 +1209,7 @@ Flags for anything which can copy a file--multi-thread-cutoff SizeSuffix Use multi-thread downloads for files above this size (default 256Mi)--multi-thread-streams int Number of streams to use for multi-thread downloads (default 4)--multi-thread-write-buffer-size SizeSuffix In memory buffer size for writing when in multi-thread mode (default 128Ki)+ --name-transform stringArray Transform paths during the copy process--no-check-dest Don't check the destination, copy regardless--no-traverse Don't traverse destination file system on copy--no-update-dir-modtime Don't update directory modification times@@ -1169,6 +1246,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -1342,6 +1420,7 @@ Flags for anything which can copy a file--multi-thread-cutoff SizeSuffix Use multi-thread downloads for files above this size (default 256Mi)--multi-thread-streams int Number of streams to use for multi-thread downloads (default 4)--multi-thread-write-buffer-size SizeSuffix In memory buffer size for writing when in multi-thread mode (default 128Ki)+ --name-transform stringArray Transform paths during the copy process--no-check-dest Don't check the destination, copy regardless--no-traverse Don't traverse destination file system on copy--no-update-dir-modtime Don't update directory modification times@@ -1366,6 +1445,7 @@ Flags used for sync commands--delete-during When synchronizing, delete files during transfer--fix-case Force rename of case insensitive dest to match source--ignore-errors Delete even if there are I/O errors+ --list-cutoff int To save memory, sort directory listings on disk above this threshold (default 1000000)--max-delete int When synchronizing, limit the number of deletes (default -1)--max-delete-size SizeSuffix When synchronizing, limit the total size of deletes (default off)--suffix string Suffix to add to changed files@@ -1397,6 +1477,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -1513,6 +1594,7 @@ Flags for anything which can copy a file--multi-thread-cutoff SizeSuffix Use multi-thread downloads for files above this size (default 256Mi)--multi-thread-streams int Number of streams to use for multi-thread downloads (default 4)--multi-thread-write-buffer-size SizeSuffix In memory buffer size for writing when in multi-thread mode (default 128Ki)+ --name-transform stringArray Transform paths during the copy process--no-check-dest Don't check the destination, copy regardless--no-traverse Don't traverse destination file system on copy--no-update-dir-modtime Don't update directory modification times@@ -1549,6 +1631,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -1649,6 +1732,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -1690,6 +1774,9 @@ include/exclude filters - everything will be removed. Use thedelete files. To delete empty directories only, use command[rmdir](https://rclone.org/commands/rclone_rmdir/) or [rmdirs](https://rclone.org/commands/rclone_rmdirs/).+The concurrency of this operation is controlled by the `--checkers` global flag. However, some backends will+implement this command directly, in which case `--checkers` will be ignored.+**Important**: Since this can cause data loss, test first with the`--dry-run` or the `--interactive`/`-i` flag.@@ -1886,6 +1973,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -1982,6 +2070,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -2089,6 +2178,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -2185,6 +2275,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -2268,6 +2359,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -2354,6 +2446,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -2435,6 +2528,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -2506,6 +2600,9 @@ Orbeta: 1.42.0.5 (released 2018-06-17)upgrade: https://beta.rclone.org/v1.42-005-g56e1e820+If you supply the --deps flag then rclone will print a list of all the+packages it depends on and their versions along with some other+information about the build.```@@ -2516,6 +2613,7 @@ rclone version [flags]```--check Check for new version+ --deps Show the Go dependencies-h, --help help for version```@@ -2784,13 +2882,18 @@ Remote authorization. Used to authorize a remote or headlessrclone from a machine with a browser - use as instructed byrclone config.+The command requires 1-3 arguments:+ - fs name (e.g., "drive", "s3", etc.)+ - Either a base64 encoded JSON blob obtained from a previous rclone config session+ - Or a client_id and client_secret pair obtained from the remote service+Use --auth-no-open-browser to prevent rclone to open authlink in default browser automatically.Use --template to generate HTML output via a custom Go template. If a blank string is provided as an argument to this flag, the default template is used.```-rclone authorize [flags]+rclone authorize <fs name> [base64_json_blob | client_id client_secret] [flags]```## Options@@ -2957,6 +3060,7 @@ Flags for anything which can copy a file--multi-thread-cutoff SizeSuffix Use multi-thread downloads for files above this size (default 256Mi)--multi-thread-streams int Number of streams to use for multi-thread downloads (default 4)--multi-thread-write-buffer-size SizeSuffix In memory buffer size for writing when in multi-thread mode (default 128Ki)+ --name-transform stringArray Transform paths during the copy process--no-check-dest Don't check the destination, copy regardless--no-traverse Don't traverse destination file system on copy--no-update-dir-modtime Don't update directory modification times@@ -2993,6 +3097,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -3083,6 +3188,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -3190,6 +3296,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -3529,6 +3636,7 @@ rclone config create name type [key value]* [flags]--continue Continue the configuration process with an answer-h, --help help for create--no-obscure Force any passwords not to be obscured+ --no-output Don't provide any output--non-interactive Don't interact with user and return questions--obscure Force any passwords to be obscured--result string Result - use with --continue@@ -3745,12 +3853,12 @@ password to re-encrypt the config.When `--password-command` is called to change the password then theenvironment variable `RCLONE_PASSWORD_CHANGE=1` will be set. So if-changing passwords programatically you can use the environment+changing passwords programmatically you can use the environmentvariable to distinguish which password you must supply.Alternatively you can remove the password first (with `rclone configencryption remove`), then set it again with this command which may be-easier if you don't mind the unecrypted config file being on the disk+easier if you don't mind the unencrypted config file being on the diskbriefly.@@ -4087,6 +4195,7 @@ rclone config update name [key value]+ [flags]--continue Continue the configuration process with an answer-h, --help help for update--no-obscure Force any passwords not to be obscured+ --no-output Don't provide any output--non-interactive Don't interact with user and return questions--obscure Force any passwords to be obscured--result string Result - use with --continue@@ -4126,6 +4235,400 @@ See the [global flags page](https://rclone.org/flags/) for global options not li* [rclone config](https://rclone.org/commands/rclone_config/) - Enter an interactive configuration session.+# rclone convmv++Convert file and directory names in place.++## Synopsis+++convmv supports advanced path name transformations for converting and renaming files and directories by applying prefixes, suffixes, and other alterations.++| Command | Description |+|------|------|+| `--name-transform prefix=XXXX` | Prepends XXXX to the file name. |+| `--name-transform suffix=XXXX` | Appends XXXX to the file name after the extension. |+| `--name-transform suffix_keep_extension=XXXX` | Appends XXXX to the file name while preserving the original file extension. |+| `--name-transform trimprefix=XXXX` | Removes XXXX if it appears at the start of the file name. |+| `--name-transform trimsuffix=XXXX` | Removes XXXX if it appears at the end of the file name. |+| `--name-transform regex=/pattern/replacement/` | Applies a regex-based transformation. |+| `--name-transform replace=old:new` | Replaces occurrences of old with new in the file name. |+| `--name-transform date={YYYYMMDD}` | Appends or prefixes the specified date format. |+| `--name-transform truncate=N` | Truncates the file name to a maximum of N characters. |+| `--name-transform base64encode` | Encodes the file name in Base64. |+| `--name-transform base64decode` | Decodes a Base64-encoded file name. |+| `--name-transform encoder=ENCODING` | Converts the file name to the specified encoding (e.g., ISO-8859-1, Windows-1252, Macintosh). |+| `--name-transform decoder=ENCODING` | Decodes the file name from the specified encoding. |+| `--name-transform charmap=MAP` | Applies a character mapping transformation. |+| `--name-transform lowercase` | Converts the file name to lowercase. |+| `--name-transform uppercase` | Converts the file name to UPPERCASE. |+| `--name-transform titlecase` | Converts the file name to Title Case. |+| `--name-transform ascii` | Strips non-ASCII characters. |+| `--name-transform url` | URL-encodes the file name. |+| `--name-transform nfc` | Converts the file name to NFC Unicode normalization form. |+| `--name-transform nfd` | Converts the file name to NFD Unicode normalization form. |+| `--name-transform nfkc` | Converts the file name to NFKC Unicode normalization form. |+| `--name-transform nfkd` | Converts the file name to NFKD Unicode normalization form. |+| `--name-transform command=/path/to/my/programfile names.` | Executes an external program to transform |+++Conversion modes:+```+none+nfc+nfd+nfkc+nfkd+replace+prefix+suffix+suffix_keep_extension+trimprefix+trimsuffix+index+date+truncate+base64encode+base64decode+encoder+decoder+ISO-8859-1+Windows-1252+Macintosh+charmap+lowercase+uppercase+titlecase+ascii+url+regex+command+```+Char maps:+```++IBM-Code-Page-037+IBM-Code-Page-437+IBM-Code-Page-850+IBM-Code-Page-852+IBM-Code-Page-855+Windows-Code-Page-858+IBM-Code-Page-860+IBM-Code-Page-862+IBM-Code-Page-863+IBM-Code-Page-865+IBM-Code-Page-866+IBM-Code-Page-1047+IBM-Code-Page-1140+ISO-8859-1+ISO-8859-2+ISO-8859-3+ISO-8859-4+ISO-8859-5+ISO-8859-6+ISO-8859-7+ISO-8859-8+ISO-8859-9+ISO-8859-10+ISO-8859-13+ISO-8859-14+ISO-8859-15+ISO-8859-16+KOI8-R+KOI8-U+Macintosh+Macintosh-Cyrillic+Windows-874+Windows-1250+Windows-1251+Windows-1252+Windows-1253+Windows-1254+Windows-1255+Windows-1256+Windows-1257+Windows-1258+X-User-Defined+```+Encoding masks:+```+Asterisk+ BackQuote+ BackSlash+ Colon+ CrLf+ Ctl+ Del+ Dollar+ Dot+ DoubleQuote+ Exclamation+ Hash+ InvalidUtf8+ LeftCrLfHtVt+ LeftPeriod+ LeftSpace+ LeftTilde+ LtGt+ None+ Percent+ Pipe+ Question+ Raw+ RightCrLfHtVt+ RightPeriod+ RightSpace+ Semicolon+ SingleQuote+ Slash+ SquareBracket+```+Examples:++```+rclone convmv "stories/The Quick Brown Fox!.txt" --name-transform "all,uppercase"+// Output: STORIES/THE QUICK BROWN FOX!.TXT+```++```+rclone convmv "stories/The Quick Brown Fox!.txt" --name-transform "all,replace=Fox:Turtle" --name-transform "all,replace=Quick:Slow"+// Output: stories/The Slow Brown Turtle!.txt+```++```+rclone convmv "stories/The Quick Brown Fox!.txt" --name-transform "all,base64encode"+// Output: c3Rvcmllcw==/VGhlIFF1aWNrIEJyb3duIEZveCEudHh0+```++```+rclone convmv "c3Rvcmllcw==/VGhlIFF1aWNrIEJyb3duIEZveCEudHh0" --name-transform "all,base64decode"+// Output: stories/The Quick Brown Fox!.txt+```++```+rclone convmv "stories/The Quick Brown 🦊 Fox Went to the Café!.txt" --name-transform "all,nfc"+// Output: stories/The Quick Brown 🦊 Fox Went to the Café!.txt+```++```+rclone convmv "stories/The Quick Brown 🦊 Fox Went to the Café!.txt" --name-transform "all,nfd"+// Output: stories/The Quick Brown 🦊 Fox Went to the Café!.txt+```++```+rclone convmv "stories/The Quick Brown 🦊 Fox!.txt" --name-transform "all,ascii"+// Output: stories/The Quick Brown Fox!.txt+```++```+rclone convmv "stories/The Quick Brown Fox!.txt" --name-transform "all,trimsuffix=.txt"+// Output: stories/The Quick Brown Fox!+```++```+rclone convmv "stories/The Quick Brown Fox!.txt" --name-transform "all,prefix=OLD_"+// Output: OLD_stories/OLD_The Quick Brown Fox!.txt+```++```+rclone convmv "stories/The Quick Brown 🦊 Fox Went to the Café!.txt" --name-transform "all,charmap=ISO-8859-7"+// Output: stories/The Quick Brown _ Fox Went to the Caf_!.txt+```++```+rclone convmv "stories/The Quick Brown Fox: A Memoir [draft].txt" --name-transform "all,encoder=Colon,SquareBracket"+// Output: stories/The Quick Brown Fox: A Memoir [draft].txt+```++```+rclone convmv "stories/The Quick Brown 🦊 Fox Went to the Café!.txt" --name-transform "all,truncate=21"+// Output: stories/The Quick Brown 🦊 Fox+```++```+rclone convmv "stories/The Quick Brown Fox!.txt" --name-transform "all,command=echo"+// Output: stories/The Quick Brown Fox!.txt+```++```+rclone convmv "stories/The Quick Brown Fox!" --name-transform "date=-{YYYYMMDD}"+// Output: stories/The Quick Brown Fox!-20250617+```++```+rclone convmv "stories/The Quick Brown Fox!" --name-transform "date=-{macfriendlytime}"+// Output: stories/The Quick Brown Fox!-2025-06-17 0551PM+```++```+rclone convmv "stories/The Quick Brown Fox!.txt" --name-transform "all,regex=[\\.\\w]/ab"+// Output: ababababababab/ababab ababababab ababababab ababab!abababab+```++++Multiple transformations can be used in sequence, applied in the order they are specified on the command line.++The `--name-transform` flag is also available in `sync`, `copy`, and `move`.++# Files vs Directories ##++By default `--name-transform` will only apply to file names. The means only the leaf file name will be transformed.+However some of the transforms would be better applied to the whole path or just directories.+To choose which which part of the file path is affected some tags can be added to the `--name-transform`++| Tag | Effect |+|------|------|+| `file` | Only transform the leaf name of files (DEFAULT) |+| `dir` | Only transform name of directories - these may appear anywhere in the path |+| `all` | Transform the entire path for files and directories |++This is used by adding the tag into the transform name like this: `--name-transform file,prefix=ABC` or `--name-transform dir,prefix=DEF`.++For some conversions using all is more likely to be useful, for example `--name-transform all,nfc`++Note that `--name-transform` may not add path separators `/` to the name. This will cause an error.++# Ordering and Conflicts ##++* Transformations will be applied in the order specified by the user.+ * If the `file` tag is in use (the default) then only the leaf name of files will be transformed.+ * If the `dir` tag is in use then directories anywhere in the path will be transformed+ * If the `all` tag is in use then directories and files anywhere in the path will be transformed+ * Each transformation will be run one path segment at a time.+ * If a transformation adds a `/` or ends up with an empty path segment then that will be an error.+* It is up to the user to put the transformations in a sensible order.+ * Conflicting transformations, such as `prefix` followed by `trimprefix` or `nfc` followed by `nfd`, are possible.+ * Instead of enforcing mutual exclusivity, transformations are applied in sequence as specified by the+user, allowing for intentional use cases (e.g., trimming one prefix before adding another).+ * Users should be aware that certain combinations may lead to unexpected results and should verify+transformations using `--dry-run` before execution.++# Race Conditions and Non-Deterministic Behavior ##++Some transformations, such as `replace=old:new`, may introduce conflicts where multiple source files map to the same destination name.+This can lead to race conditions when performing concurrent transfers. It is up to the user to anticipate these.+* If two files from the source are transformed into the same name at the destination, the final state may be non-deterministic.+* Running rclone check after a sync using such transformations may erroneously report missing or differing files due to overwritten results.++* To minimize risks, users should:+ * Carefully review transformations that may introduce conflicts.+ * Use `--dry-run` to inspect changes before executing a sync (but keep in mind that it won't show the effect of non-deterministic transformations).+ * Avoid transformations that cause multiple distinct source files to map to the same destination name.+ * Consider disabling concurrency with `--transfers=1` if necessary.+ * Certain transformations (e.g. `prefix`) will have a multiplying effect every time they are used. Avoid these when using `bisync`.++++```+rclone convmv dest:path --name-transform XXX [flags]+```++## Options++```+ --create-empty-src-dirs Create empty source dirs on destination after move+ --delete-empty-src-dirs Delete empty source dirs after move+ -h, --help help for convmv+```++Options shared with other commands are described next.+See the [global flags page](https://rclone.org/flags/) for global options not listed here.++### Copy Options++Flags for anything which can copy a file++```+ --check-first Do all the checks before starting transfers+ -c, --checksum Check for changes with size & checksum (if available, or fallback to size only)+ --compare-dest stringArray Include additional server-side paths during comparison+ --copy-dest stringArray Implies --compare-dest but also copies files from paths into destination+ --cutoff-mode HARD|SOFT|CAUTIOUS Mode to stop transfers when reaching the max transfer limit HARD|SOFT|CAUTIOUS (default HARD)+ --ignore-case-sync Ignore case when synchronizing+ --ignore-checksum Skip post copy check of checksums+ --ignore-existing Skip all files that exist on destination+ --ignore-size Ignore size when skipping use modtime or checksum+ -I, --ignore-times Don't skip items that match size and time - transfer all unconditionally+ --immutable Do not modify files, fail if existing files have been modified+ --inplace Download directly to destination file instead of atomic download to temp/rename+ -l, --links Translate symlinks to/from regular files with a '.rclonelink' extension+ --max-backlog int Maximum number of objects in sync or check backlog (default 10000)+ --max-duration Duration Maximum duration rclone will transfer data for (default 0s)+ --max-transfer SizeSuffix Maximum size of data to transfer (default off)+ -M, --metadata If set, preserve metadata when copying objects+ --modify-window Duration Max time diff to be considered the same (default 1ns)+ --multi-thread-chunk-size SizeSuffix Chunk size for multi-thread downloads / uploads, if not set by filesystem (default 64Mi)+ --multi-thread-cutoff SizeSuffix Use multi-thread downloads for files above this size (default 256Mi)+ --multi-thread-streams int Number of streams to use for multi-thread downloads (default 4)+ --multi-thread-write-buffer-size SizeSuffix In memory buffer size for writing when in multi-thread mode (default 128Ki)+ --name-transform stringArray Transform paths during the copy process+ --no-check-dest Don't check the destination, copy regardless+ --no-traverse Don't traverse destination file system on copy+ --no-update-dir-modtime Don't update directory modification times+ --no-update-modtime Don't update destination modtime if files identical+ --order-by string Instructions on how to order the transfers, e.g. 'size,descending'+ --partial-suffix string Add partial-suffix to temporary file name when --inplace is not used (default ".partial")+ --refresh-times Refresh the modtime of remote files+ --server-side-across-configs Allow server-side operations (e.g. copy) to work across different configs+ --size-only Skip based on size only, not modtime or checksum+ --streaming-upload-cutoff SizeSuffix Cutoff for switching to chunked upload if file size is unknown, upload starts after reaching cutoff or when file ends (default 100Ki)+ -u, --update Skip files that are newer on the destination+```++### Important Options++Important flags useful for most commands++```+ -n, --dry-run Do a trial run with no permanent changes+ -i, --interactive Enable interactive mode+ -v, --verbose count Print lots more stuff (repeat for more)+```++### Filter Options++Flags for filtering directory listings++```+ --delete-excluded Delete files on dest excluded from sync+ --exclude stringArray Exclude files matching pattern+ --exclude-from stringArray Read file exclude patterns from file (use - to read from stdin)+ --exclude-if-present stringArray Exclude directories if filename is present+ --files-from stringArray Read list of source-file names from file (use - to read from stdin)+ --files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)+ -f, --filter stringArray Add a file filtering rule+ --filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n+ --ignore-case Ignore case in filters (case insensitive)+ --include stringArray Include files matching pattern+ --include-from stringArray Read file include patterns from file (use - to read from stdin)+ --max-age Duration Only transfer files younger than this in s or suffix ms|s|m|h|d|w|M|y (default off)+ --max-depth int If set limits the recursion depth to this (default -1)+ --max-size SizeSuffix Only transfer files smaller than this in KiB or suffix B|K|M|G|T|P (default off)+ --metadata-exclude stringArray Exclude metadatas matching pattern+ --metadata-exclude-from stringArray Read metadata exclude patterns from file (use - to read from stdin)+ --metadata-filter stringArray Add a metadata filtering rule+ --metadata-filter-from stringArray Read metadata filtering patterns from a file (use - to read from stdin)+ --metadata-include stringArray Include metadatas matching pattern+ --metadata-include-from stringArray Read metadata include patterns from file (use - to read from stdin)+ --min-age Duration Only transfer files older than this in s or suffix ms|s|m|h|d|w|M|y (default off)+ --min-size SizeSuffix Only transfer files bigger than this in KiB or suffix B|K|M|G|T|P (default off)+```++### Listing Options++Flags for listing directories++```+ --default-time Time Time to show if modtime is unknown for files and directories (default 2000-01-01T00:00:00Z)+ --fast-list Use recursive list if available; uses more memory but fewer transactions+```++## See Also++* [rclone](https://rclone.org/commands/rclone/) - Show help for rclone commands, flags and backends.+# rclone copytoCopy files from source to dest, skipping identical files.@@ -4158,6 +4661,8 @@ This doesn't transfer files that are identical on src and dst, testingby size and modification time or MD5SUM. It doesn't delete files fromthe destination.+*If you are looking to copy just a byte range of a file, please see 'rclone cat --offset X --count Y'*+**Note**: Use the `-P`/`--progress` flag to view real-time transfer statistics@@ -4201,6 +4706,7 @@ Flags for anything which can copy a file--multi-thread-cutoff SizeSuffix Use multi-thread downloads for files above this size (default 256Mi)--multi-thread-streams int Number of streams to use for multi-thread downloads (default 4)--multi-thread-write-buffer-size SizeSuffix In memory buffer size for writing when in multi-thread mode (default 128Ki)+ --name-transform stringArray Transform paths during the copy process--no-check-dest Don't check the destination, copy regardless--no-traverse Don't traverse destination file system on copy--no-update-dir-modtime Don't update directory modification times@@ -4237,6 +4743,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -4279,7 +4786,7 @@ Setting `--auto-filename` will attempt to automatically determine thefilename from the URL (after any redirections) and used in thedestination path.-With `--auto-filename-header` in addition, if a specific filename is+With `--header-filename` in addition, if a specific filename isset in HTTP headers, it will be used instead of the name from the URL.With `--print-filename` in addition, the resulting file name will beprinted.@@ -4290,7 +4797,7 @@ destination if there is one with the same name.Setting `--stdout` or making the output file name `-`will cause the output to be written to standard output.-## Troublshooting+## TroubleshootingIf you can't get `rclone copyurl` to work then here are some things you can try:@@ -4429,6 +4936,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -4685,6 +5193,7 @@ Run without a hash to see the list of all supported hashes, e.g.* whirlpool* crc32* sha256+ * sha512Then@@ -4723,6 +5232,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -5016,6 +5526,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -5191,6 +5702,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -5787,11 +6299,11 @@ seconds. If rclone is quit or dies with files that haven't beenuploaded, these will be uploaded next time rclone is run with the sameflags.-If using `--vfs-cache-max-size` or `--vfs-cache-min-free-size` note+If using `--vfs-cache-max-size` or `--vfs-cache-min-free-space` notethat the cache may exceed these quotas for two reasons. Firstlybecause it is only checked every `--vfs-cache-poll-interval`. Secondlybecause open files cannot be evicted from the cache. When-`--vfs-cache-max-size` or `--vfs-cache-min-free-size` is exceeded,+`--vfs-cache-max-size` or `--vfs-cache-min-free-space` is exceeded,rclone will attempt to evict the least accessed files from the cachefirst. rclone will start with files that haven't been accessed for thelongest. This cache flushing strategy is efficient and more relevant@@ -6116,6 +6628,45 @@ _WARNING._ Contrary to `rclone size`, this flag ignores filters so that theresult is accurate. However, this is very inefficient and may cost lots of APIcalls resulting in extra charges. Use it as a last resort and only with caching.+## VFS Metadata++If you use the `--vfs-metadata-extension` flag you can get the VFS to+expose files which contain the [metadata](https://rclone.org/docs/#metadata) as a JSON+blob. These files will not appear in the directory listing, but can be+`stat`-ed and opened and once they have been they **will** appear in+directory listings until the directory cache expires.++Note that some backends won't create metadata unless you pass in the+`--metadata` flag.++For example, using `rclone mount` with `--metadata --vfs-metadata-extension .metadata`+we get++```+$ ls -l /mnt/+total 1048577+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++$ cat /mnt/1G.metadata+{+ "atime": "2025-03-04T17:34:22.317069787Z",+ "btime": "2025-03-03T16:03:37.708253808Z",+ "gid": "1000",+ "mode": "100664",+ "mtime": "2025-03-03T16:03:39.640238323Z",+ "uid": "1000"+}++$ ls -l /mnt/+total 1048578+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+-rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata+```++If the file has no metadata it will be returned as `{}` and if there+is an error reading the metadata the error will be returned as+`{"error":"error string"}`.+```@@ -6167,6 +6718,7 @@ rclone mount remote:path /path/to/mountpoint [flags]--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a '.rclonelink' extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached ('off' is unlimited) (default off)@@ -6196,6 +6748,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -6294,6 +6847,7 @@ Flags for anything which can copy a file--multi-thread-cutoff SizeSuffix Use multi-thread downloads for files above this size (default 256Mi)--multi-thread-streams int Number of streams to use for multi-thread downloads (default 4)--multi-thread-write-buffer-size SizeSuffix In memory buffer size for writing when in multi-thread mode (default 128Ki)+ --name-transform stringArray Transform paths during the copy process--no-check-dest Don't check the destination, copy regardless--no-traverse Don't traverse destination file system on copy--no-update-dir-modtime Don't update directory modification times@@ -6330,6 +6884,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -6453,6 +7008,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -7049,11 +7605,11 @@ seconds. If rclone is quit or dies with files that haven't beenuploaded, these will be uploaded next time rclone is run with the sameflags.-If using `--vfs-cache-max-size` or `--vfs-cache-min-free-size` note+If using `--vfs-cache-max-size` or `--vfs-cache-min-free-space` notethat the cache may exceed these quotas for two reasons. Firstlybecause it is only checked every `--vfs-cache-poll-interval`. Secondlybecause open files cannot be evicted from the cache. When-`--vfs-cache-max-size` or `--vfs-cache-min-free-size` is exceeded,+`--vfs-cache-max-size` or `--vfs-cache-min-free-space` is exceeded,rclone will attempt to evict the least accessed files from the cachefirst. rclone will start with files that haven't been accessed for thelongest. This cache flushing strategy is efficient and more relevant@@ -7378,6 +7934,45 @@ _WARNING._ Contrary to `rclone size`, this flag ignores filters so that theresult is accurate. However, this is very inefficient and may cost lots of APIcalls resulting in extra charges. Use it as a last resort and only with caching.+## VFS Metadata++If you use the `--vfs-metadata-extension` flag you can get the VFS to+expose files which contain the [metadata](https://rclone.org/docs/#metadata) as a JSON+blob. These files will not appear in the directory listing, but can be+`stat`-ed and opened and once they have been they **will** appear in+directory listings until the directory cache expires.++Note that some backends won't create metadata unless you pass in the+`--metadata` flag.++For example, using `rclone mount` with `--metadata --vfs-metadata-extension .metadata`+we get++```+$ ls -l /mnt/+total 1048577+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++$ cat /mnt/1G.metadata+{+ "atime": "2025-03-04T17:34:22.317069787Z",+ "btime": "2025-03-03T16:03:37.708253808Z",+ "gid": "1000",+ "mode": "100664",+ "mtime": "2025-03-03T16:03:39.640238323Z",+ "uid": "1000"+}++$ ls -l /mnt/+total 1048578+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+-rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata+```++If the file has no metadata it will be returned as `{}` and if there+is an error reading the metadata the error will be returned as+`{"error":"error string"}`.+```@@ -7434,6 +8029,7 @@ rclone nfsmount remote:path /path/to/mountpoint [flags]--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a '.rclonelink' extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached ('off' is unlimited) (default off)@@ -7463,6 +8059,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -7802,7 +8399,11 @@ By default this will serve files without needing a login.You can either use an htpasswd file which can take lots of users, orset a single username and password with the `--rc-user` and `--rc-pass` flags.-If no static users are configured by either of the above methods, and client+Alternatively, you can have the reverse proxy manage authentication and use the+username provided in the configured header with `--user-from-header` (e.g., `--rc---user-from-header=x-remote-user`).+Ensure the proxy is trusted and headers cannot be spoofed, as misconfiguration may lead to unauthorized access.++If either of the above authentication methods is not configured and clientcertificates are required by the `--client-ca` flag passed to the server, theclient certificate common name will be considered as the username.@@ -7866,6 +8467,7 @@ Flags to control the Remote Control API--rc-server-write-timeout Duration Timeout for server writing data (default 1h0m0s)--rc-template string User-specified template--rc-user string User name for authentication+ --rc-user-from-header string User name from a defined HTTP header--rc-web-fetch-url string URL to fetch the releases for webgui (default "https://api.github.com/repos/rclone/rclone-webui-react/releases/latest")--rc-web-gui Launch WebGUI on localhost--rc-web-gui-force-update Force update to latest version of web gui@@ -8177,11 +8779,11 @@ seconds. If rclone is quit or dies with files that haven't beenuploaded, these will be uploaded next time rclone is run with the sameflags.-If using `--vfs-cache-max-size` or `--vfs-cache-min-free-size` note+If using `--vfs-cache-max-size` or `--vfs-cache-min-free-space` notethat the cache may exceed these quotas for two reasons. Firstlybecause it is only checked every `--vfs-cache-poll-interval`. Secondlybecause open files cannot be evicted from the cache. When-`--vfs-cache-max-size` or `--vfs-cache-min-free-size` is exceeded,+`--vfs-cache-max-size` or `--vfs-cache-min-free-space` is exceeded,rclone will attempt to evict the least accessed files from the cachefirst. rclone will start with files that haven't been accessed for thelongest. This cache flushing strategy is efficient and more relevant@@ -8506,6 +9108,45 @@ _WARNING._ Contrary to `rclone size`, this flag ignores filters so that theresult is accurate. However, this is very inefficient and may cost lots of APIcalls resulting in extra charges. Use it as a last resort and only with caching.+## VFS Metadata++If you use the `--vfs-metadata-extension` flag you can get the VFS to+expose files which contain the [metadata](https://rclone.org/docs/#metadata) as a JSON+blob. These files will not appear in the directory listing, but can be+`stat`-ed and opened and once they have been they **will** appear in+directory listings until the directory cache expires.++Note that some backends won't create metadata unless you pass in the+`--metadata` flag.++For example, using `rclone mount` with `--metadata --vfs-metadata-extension .metadata`+we get++```+$ ls -l /mnt/+total 1048577+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++$ cat /mnt/1G.metadata+{+ "atime": "2025-03-04T17:34:22.317069787Z",+ "btime": "2025-03-03T16:03:37.708253808Z",+ "gid": "1000",+ "mode": "100664",+ "mtime": "2025-03-03T16:03:39.640238323Z",+ "uid": "1000"+}++$ ls -l /mnt/+total 1048578+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+-rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata+```++If the file has no metadata it will be returned as `{}` and if there+is an error reading the metadata the error will be returned as+`{"error":"error string"}`.+```@@ -8543,6 +9184,7 @@ rclone serve dlna remote:path [flags]--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a '.rclonelink' extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached ('off' is unlimited) (default off)@@ -8570,6 +9212,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -8732,11 +9375,11 @@ seconds. If rclone is quit or dies with files that haven't beenuploaded, these will be uploaded next time rclone is run with the sameflags.-If using `--vfs-cache-max-size` or `--vfs-cache-min-free-size` note+If using `--vfs-cache-max-size` or `--vfs-cache-min-free-space` notethat the cache may exceed these quotas for two reasons. Firstlybecause it is only checked every `--vfs-cache-poll-interval`. Secondlybecause open files cannot be evicted from the cache. When-`--vfs-cache-max-size` or `--vfs-cache-min-free-size` is exceeded,+`--vfs-cache-max-size` or `--vfs-cache-min-free-space` is exceeded,rclone will attempt to evict the least accessed files from the cachefirst. rclone will start with files that haven't been accessed for thelongest. This cache flushing strategy is efficient and more relevant@@ -9061,6 +9704,45 @@ _WARNING._ Contrary to `rclone size`, this flag ignores filters so that theresult is accurate. However, this is very inefficient and may cost lots of APIcalls resulting in extra charges. Use it as a last resort and only with caching.+## VFS Metadata++If you use the `--vfs-metadata-extension` flag you can get the VFS to+expose files which contain the [metadata](https://rclone.org/docs/#metadata) as a JSON+blob. These files will not appear in the directory listing, but can be+`stat`-ed and opened and once they have been they **will** appear in+directory listings until the directory cache expires.++Note that some backends won't create metadata unless you pass in the+`--metadata` flag.++For example, using `rclone mount` with `--metadata --vfs-metadata-extension .metadata`+we get++```+$ ls -l /mnt/+total 1048577+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++$ cat /mnt/1G.metadata+{+ "atime": "2025-03-04T17:34:22.317069787Z",+ "btime": "2025-03-03T16:03:37.708253808Z",+ "gid": "1000",+ "mode": "100664",+ "mtime": "2025-03-03T16:03:39.640238323Z",+ "uid": "1000"+}++$ ls -l /mnt/+total 1048578+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+-rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata+```++If the file has no metadata it will be returned as `{}` and if there+is an error reading the metadata the error will be returned as+`{"error":"error string"}`.+```@@ -9117,6 +9799,7 @@ rclone serve docker [flags]--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a '.rclonelink' extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached ('off' is unlimited) (default off)@@ -9146,6 +9829,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -9289,11 +9973,11 @@ seconds. If rclone is quit or dies with files that haven't beenuploaded, these will be uploaded next time rclone is run with the sameflags.-If using `--vfs-cache-max-size` or `--vfs-cache-min-free-size` note+If using `--vfs-cache-max-size` or `--vfs-cache-min-free-space` notethat the cache may exceed these quotas for two reasons. Firstlybecause it is only checked every `--vfs-cache-poll-interval`. Secondlybecause open files cannot be evicted from the cache. When-`--vfs-cache-max-size` or `--vfs-cache-min-free-size` is exceeded,+`--vfs-cache-max-size` or `--vfs-cache-min-free-space` is exceeded,rclone will attempt to evict the least accessed files from the cachefirst. rclone will start with files that haven't been accessed for thelongest. This cache flushing strategy is efficient and more relevant@@ -9618,6 +10302,45 @@ _WARNING._ Contrary to `rclone size`, this flag ignores filters so that theresult is accurate. However, this is very inefficient and may cost lots of APIcalls resulting in extra charges. Use it as a last resort and only with caching.+## VFS Metadata++If you use the `--vfs-metadata-extension` flag you can get the VFS to+expose files which contain the [metadata](https://rclone.org/docs/#metadata) as a JSON+blob. These files will not appear in the directory listing, but can be+`stat`-ed and opened and once they have been they **will** appear in+directory listings until the directory cache expires.++Note that some backends won't create metadata unless you pass in the+`--metadata` flag.++For example, using `rclone mount` with `--metadata --vfs-metadata-extension .metadata`+we get++```+$ ls -l /mnt/+total 1048577+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++$ cat /mnt/1G.metadata+{+ "atime": "2025-03-04T17:34:22.317069787Z",+ "btime": "2025-03-03T16:03:37.708253808Z",+ "gid": "1000",+ "mode": "100664",+ "mtime": "2025-03-03T16:03:39.640238323Z",+ "uid": "1000"+}++$ ls -l /mnt/+total 1048578+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+-rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata+```++If the file has no metadata it will be returned as `{}` and if there+is an error reading the metadata the error will be returned as+`{"error":"error string"}`.+## Auth ProxyIf you supply the parameter `--auth-proxy /path/to/program` then@@ -9739,6 +10462,7 @@ rclone serve ftp remote:path [flags]--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a '.rclonelink' extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached ('off' is unlimited) (default off)@@ -9766,6 +10490,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -9910,7 +10635,11 @@ By default this will serve files without needing a login.You can either use an htpasswd file which can take lots of users, orset a single username and password with the `--user` and `--pass` flags.-If no static users are configured by either of the above methods, and client+Alternatively, you can have the reverse proxy manage authentication and use the+username provided in the configured header with `--user-from-header` (e.g., `----user-from-header=x-remote-user`).+Ensure the proxy is trusted and headers cannot be spoofed, as misconfiguration may lead to unauthorized access.++If either of the above authentication methods is not configured and clientcertificates are required by the `--client-ca` flag passed to the server, theclient certificate common name will be considered as the username.@@ -10027,11 +10756,11 @@ seconds. If rclone is quit or dies with files that haven't beenuploaded, these will be uploaded next time rclone is run with the sameflags.-If using `--vfs-cache-max-size` or `--vfs-cache-min-free-size` note+If using `--vfs-cache-max-size` or `--vfs-cache-min-free-space` notethat the cache may exceed these quotas for two reasons. Firstlybecause it is only checked every `--vfs-cache-poll-interval`. Secondlybecause open files cannot be evicted from the cache. When-`--vfs-cache-max-size` or `--vfs-cache-min-free-size` is exceeded,+`--vfs-cache-max-size` or `--vfs-cache-min-free-space` is exceeded,rclone will attempt to evict the least accessed files from the cachefirst. rclone will start with files that haven't been accessed for thelongest. This cache flushing strategy is efficient and more relevant@@ -10356,6 +11085,45 @@ _WARNING._ Contrary to `rclone size`, this flag ignores filters so that theresult is accurate. However, this is very inefficient and may cost lots of APIcalls resulting in extra charges. Use it as a last resort and only with caching.+## VFS Metadata++If you use the `--vfs-metadata-extension` flag you can get the VFS to+expose files which contain the [metadata](https://rclone.org/docs/#metadata) as a JSON+blob. These files will not appear in the directory listing, but can be+`stat`-ed and opened and once they have been they **will** appear in+directory listings until the directory cache expires.++Note that some backends won't create metadata unless you pass in the+`--metadata` flag.++For example, using `rclone mount` with `--metadata --vfs-metadata-extension .metadata`+we get++```+$ ls -l /mnt/+total 1048577+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++$ cat /mnt/1G.metadata+{+ "atime": "2025-03-04T17:34:22.317069787Z",+ "btime": "2025-03-03T16:03:37.708253808Z",+ "gid": "1000",+ "mode": "100664",+ "mtime": "2025-03-03T16:03:39.640238323Z",+ "uid": "1000"+}++$ ls -l /mnt/+total 1048578+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+-rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata+```++If the file has no metadata it will be returned as `{}` and if there+is an error reading the metadata the error will be returned as+`{"error":"error string"}`.+## Auth ProxyIf you supply the parameter `--auth-proxy /path/to/program` then@@ -10446,19 +11214,19 @@ rclone serve http remote:path [flags]## Options```- --addr stringArray IPaddress:Port, :Port or [unix://]/path/to/socket to bind server to (default [127.0.0.1:8080])+ --addr stringArray IPaddress:Port or :Port to bind server to (default 127.0.0.1:8080)--allow-origin string Origin which cross-domain request (CORS) can be executed from--auth-proxy string A program to use to create the backend from the auth--baseurl string Prefix for URLs - leave blank for root- --cert string Path to TLS PEM public key certificate file (can also include intermediate/CA certificates)- --client-ca string Path to TLS PEM CA file with certificate authorities to verify clients with+ --cert string TLS PEM key (concatenation of certificate and CA certificate)+ --client-ca string Client certificate authority to verify clients with--dir-cache-time Duration Time to cache directory entries for (default 5m0s)--dir-perms FileMode Directory permissions (default 777)--file-perms FileMode File permissions (default 666)--gid uint32 Override the gid field set by the filesystem (not supported on Windows) (default 1000)-h, --help help for http--htpasswd string A htpasswd file - if not provided no authentication is done- --key string Path to TLS PEM private key file+ --key string TLS PEM Private key--link-perms FileMode Link permissions (default 666)--max-header-bytes int Maximum size of request header (default 4096)--min-tls-version string Minimum TLS version that is acceptable (default "tls1.0")@@ -10476,6 +11244,7 @@ rclone serve http remote:path [flags]--uid uint32 Override the uid field set by the filesystem (not supported on Windows) (default 1000)--umask FileMode Override the permission bits set by the filesystem (not supported on Windows) (default 002)--user string User name for authentication+ --user-from-header string User name from a defined HTTP header--vfs-block-norm-dupes If duplicate filenames exist in the same directory (after normalization), log an error and hide the duplicates (may have a performance cost)--vfs-cache-max-age Duration Max time since last access of objects in the cache (default 1h0m0s)--vfs-cache-max-size SizeSuffix Max total size of objects in the cache (default off)@@ -10486,6 +11255,7 @@ rclone serve http remote:path [flags]--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a '.rclonelink' extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached ('off' is unlimited) (default off)@@ -10513,6 +11283,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -10581,7 +11352,7 @@ that it uses an on disk cache, but the cache entries are held assymlinks. Rclone will use the handle of the underlying file as the NFShandle which improves performance. This sort of cache can't be backedup and restored as the underlying handles will change. This is Linux-only. It requres running rclone as root or with `CAP_DAC_READ_SEARCH`.+only. It requires running rclone as root or with `CAP_DAC_READ_SEARCH`.You can run rclone with this extra permission by doing this to therclone binary `sudo setcap cap_dac_read_search+ep /path/to/rclone`.@@ -10605,6 +11376,12 @@ Where `$PORT` is the same port number used in the `serve nfs` commandand `$HOSTNAME` is the network address of the machine that `serve nfs`was run on.+If `--vfs-metadata-extension` is in use then for the `--nfs-cache-type disk`+and `--nfs-cache-type cache` the metadata files will have the file+handle of their parent file suffixed with `0x00, 0x00, 0x00, 0x01`.+This means they can be looked up directly from the parent file handle+is desired.+This command is only available on Unix platforms.## VFS - Virtual File System@@ -10704,11 +11481,11 @@ seconds. If rclone is quit or dies with files that haven't beenuploaded, these will be uploaded next time rclone is run with the sameflags.-If using `--vfs-cache-max-size` or `--vfs-cache-min-free-size` note+If using `--vfs-cache-max-size` or `--vfs-cache-min-free-space` notethat the cache may exceed these quotas for two reasons. Firstlybecause it is only checked every `--vfs-cache-poll-interval`. Secondlybecause open files cannot be evicted from the cache. When-`--vfs-cache-max-size` or `--vfs-cache-min-free-size` is exceeded,+`--vfs-cache-max-size` or `--vfs-cache-min-free-space` is exceeded,rclone will attempt to evict the least accessed files from the cachefirst. rclone will start with files that haven't been accessed for thelongest. This cache flushing strategy is efficient and more relevant@@ -11033,6 +11810,45 @@ _WARNING._ Contrary to `rclone size`, this flag ignores filters so that theresult is accurate. However, this is very inefficient and may cost lots of APIcalls resulting in extra charges. Use it as a last resort and only with caching.+## VFS Metadata++If you use the `--vfs-metadata-extension` flag you can get the VFS to+expose files which contain the [metadata](https://rclone.org/docs/#metadata) as a JSON+blob. These files will not appear in the directory listing, but can be+`stat`-ed and opened and once they have been they **will** appear in+directory listings until the directory cache expires.++Note that some backends won't create metadata unless you pass in the+`--metadata` flag.++For example, using `rclone mount` with `--metadata --vfs-metadata-extension .metadata`+we get++```+$ ls -l /mnt/+total 1048577+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++$ cat /mnt/1G.metadata+{+ "atime": "2025-03-04T17:34:22.317069787Z",+ "btime": "2025-03-03T16:03:37.708253808Z",+ "gid": "1000",+ "mode": "100664",+ "mtime": "2025-03-03T16:03:39.640238323Z",+ "uid": "1000"+}++$ ls -l /mnt/+total 1048578+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+-rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata+```++If the file has no metadata it will be returned as `{}` and if there+is an error reading the metadata the error will be returned as+`{"error":"error string"}`.+```@@ -11069,6 +11885,7 @@ rclone serve nfs remote:path [flags]--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a '.rclonelink' extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached ('off' is unlimited) (default off)@@ -11096,6 +11913,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -11274,7 +12092,11 @@ By default this will serve files without needing a login.You can either use an htpasswd file which can take lots of users, orset a single username and password with the `--user` and `--pass` flags.-If no static users are configured by either of the above methods, and client+Alternatively, you can have the reverse proxy manage authentication and use the+username provided in the configured header with `--user-from-header` (e.g., `----user-from-header=x-remote-user`).+Ensure the proxy is trusted and headers cannot be spoofed, as misconfiguration may lead to unauthorized access.++If either of the above authentication methods is not configured and clientcertificates are required by the `--client-ca` flag passed to the server, theclient certificate common name will be considered as the username.@@ -11303,16 +12125,16 @@ rclone serve restic remote:path [flags]## Options```- --addr stringArray IPaddress:Port, :Port or [unix://]/path/to/socket to bind server to (default [127.0.0.1:8080])+ --addr stringArray IPaddress:Port or :Port to bind server to (default 127.0.0.1:8080)--allow-origin string Origin which cross-domain request (CORS) can be executed from--append-only Disallow deletion of repository data--baseurl string Prefix for URLs - leave blank for root--cache-objects Cache listed objects (default true)- --cert string Path to TLS PEM public key certificate file (can also include intermediate/CA certificates)- --client-ca string Path to TLS PEM CA file with certificate authorities to verify clients with+ --cert string TLS PEM key (concatenation of certificate and CA certificate)+ --client-ca string Client certificate authority to verify clients with-h, --help help for restic--htpasswd string A htpasswd file - if not provided no authentication is done- --key string Path to TLS PEM private key file+ --key string TLS PEM Private key--max-header-bytes int Maximum size of request header (default 4096)--min-tls-version string Minimum TLS version that is acceptable (default "tls1.0")--pass string Password for authentication@@ -11323,6 +12145,7 @@ rclone serve restic remote:path [flags]--server-write-timeout Duration Timeout for server writing data (default 1h0m0s)--stdio Run an HTTP2 server on stdin/stdout--user string User name for authentication+ --user-from-header string User name from a defined HTTP header```See the [global flags page](https://rclone.org/flags/) for global options not listed here.@@ -11353,7 +12176,7 @@ docs](https://docs.aws.amazon.com/general/latest/gr/signature-version-4.html)).access.Please note that some clients may require HTTPS endpoints. See [the-SSL docs](#ssl-tls) for more information.+SSL docs](#tls-ssl) for more information.This command uses the [VFS directory cache](#vfs-virtual-file-system).All the functionality will work with `--vfs-cache-mode off`. Using@@ -11408,7 +12231,7 @@ secret_access_key = SECRET_ACCESS_KEYuse_multipart_uploads = false```-Note that setting `disable_multipart_uploads = true` is to work around+Note that setting `use_multipart_uploads = false` is to work around[a bug](#bugs) which will be fixed in due course.## Bugs@@ -11480,7 +12303,11 @@ By default this will serve files without needing a login.You can either use an htpasswd file which can take lots of users, orset a single username and password with the `--user` and `--pass` flags.-If no static users are configured by either of the above methods, and client+Alternatively, you can have the reverse proxy manage authentication and use the+username provided in the configured header with `--user-from-header` (e.g., `----user-from-header=x-remote-user`).+Ensure the proxy is trusted and headers cannot be spoofed, as misconfiguration may lead to unauthorized access.++If either of the above authentication methods is not configured and clientcertificates are required by the `--client-ca` flag passed to the server, theclient certificate common name will be considered as the username.@@ -11660,11 +12487,11 @@ seconds. If rclone is quit or dies with files that haven't beenuploaded, these will be uploaded next time rclone is run with the sameflags.-If using `--vfs-cache-max-size` or `--vfs-cache-min-free-size` note+If using `--vfs-cache-max-size` or `--vfs-cache-min-free-space` notethat the cache may exceed these quotas for two reasons. Firstlybecause it is only checked every `--vfs-cache-poll-interval`. Secondlybecause open files cannot be evicted from the cache. When-`--vfs-cache-max-size` or `--vfs-cache-min-free-size` is exceeded,+`--vfs-cache-max-size` or `--vfs-cache-min-free-space` is exceeded,rclone will attempt to evict the least accessed files from the cachefirst. rclone will start with files that haven't been accessed for thelongest. This cache flushing strategy is efficient and more relevant@@ -11989,6 +12816,45 @@ _WARNING._ Contrary to `rclone size`, this flag ignores filters so that theresult is accurate. However, this is very inefficient and may cost lots of APIcalls resulting in extra charges. Use it as a last resort and only with caching.+## VFS Metadata++If you use the `--vfs-metadata-extension` flag you can get the VFS to+expose files which contain the [metadata](https://rclone.org/docs/#metadata) as a JSON+blob. These files will not appear in the directory listing, but can be+`stat`-ed and opened and once they have been they **will** appear in+directory listings until the directory cache expires.++Note that some backends won't create metadata unless you pass in the+`--metadata` flag.++For example, using `rclone mount` with `--metadata --vfs-metadata-extension .metadata`+we get++```+$ ls -l /mnt/+total 1048577+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++$ cat /mnt/1G.metadata+{+ "atime": "2025-03-04T17:34:22.317069787Z",+ "btime": "2025-03-03T16:03:37.708253808Z",+ "gid": "1000",+ "mode": "100664",+ "mtime": "2025-03-03T16:03:39.640238323Z",+ "uid": "1000"+}++$ ls -l /mnt/+total 1048578+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+-rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata+```++If the file has no metadata it will be returned as `{}` and if there+is an error reading the metadata the error will be returned as+`{"error":"error string"}`.+```@@ -11998,22 +12864,22 @@ rclone serve s3 remote:path [flags]## Options```- --addr stringArray IPaddress:Port, :Port or [unix://]/path/to/socket to bind server to (default [127.0.0.1:8080])+ --addr stringArray IPaddress:Port or :Port to bind server to (default 127.0.0.1:8080)--allow-origin string Origin which cross-domain request (CORS) can be executed from--auth-key stringArray Set key pair for v4 authorization: access_key_id,secret_access_key--auth-proxy string A program to use to create the backend from the auth--baseurl string Prefix for URLs - leave blank for root- --cert string Path to TLS PEM public key certificate file (can also include intermediate/CA certificates)- --client-ca string Path to TLS PEM CA file with certificate authorities to verify clients with+ --cert string TLS PEM key (concatenation of certificate and CA certificate)+ --client-ca string Client certificate authority to verify clients with--dir-cache-time Duration Time to cache directory entries for (default 5m0s)--dir-perms FileMode Directory permissions (default 777)--etag-hash string Which hash to use for the ETag, or auto or blank for off (default "MD5")--file-perms FileMode File permissions (default 666)- --force-path-style If true use path style access if false use virtual hosted style (default true) (default true)+ --force-path-style If true use path style access if false use virtual hosted style (default true)--gid uint32 Override the gid field set by the filesystem (not supported on Windows) (default 1000)-h, --help help for s3--htpasswd string A htpasswd file - if not provided no authentication is done- --key string Path to TLS PEM private key file+ --key string TLS PEM Private key--link-perms FileMode Link permissions (default 666)--max-header-bytes int Maximum size of request header (default 4096)--min-tls-version string Minimum TLS version that is acceptable (default "tls1.0")@@ -12031,6 +12897,7 @@ rclone serve s3 remote:path [flags]--uid uint32 Override the uid field set by the filesystem (not supported on Windows) (default 1000)--umask FileMode Override the permission bits set by the filesystem (not supported on Windows) (default 002)--user string User name for authentication+ --user-from-header string User name from a defined HTTP header--vfs-block-norm-dupes If duplicate filenames exist in the same directory (after normalization), log an error and hide the duplicates (may have a performance cost)--vfs-cache-max-age Duration Max time since last access of objects in the cache (default 1h0m0s)--vfs-cache-max-size SizeSuffix Max total size of objects in the cache (default off)@@ -12041,6 +12908,7 @@ rclone serve s3 remote:path [flags]--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a '.rclonelink' extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached ('off' is unlimited) (default off)@@ -12068,6 +12936,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -12254,11 +13123,11 @@ seconds. If rclone is quit or dies with files that haven't beenuploaded, these will be uploaded next time rclone is run with the sameflags.-If using `--vfs-cache-max-size` or `--vfs-cache-min-free-size` note+If using `--vfs-cache-max-size` or `--vfs-cache-min-free-space` notethat the cache may exceed these quotas for two reasons. Firstlybecause it is only checked every `--vfs-cache-poll-interval`. Secondlybecause open files cannot be evicted from the cache. When-`--vfs-cache-max-size` or `--vfs-cache-min-free-size` is exceeded,+`--vfs-cache-max-size` or `--vfs-cache-min-free-space` is exceeded,rclone will attempt to evict the least accessed files from the cachefirst. rclone will start with files that haven't been accessed for thelongest. This cache flushing strategy is efficient and more relevant@@ -12583,6 +13452,45 @@ _WARNING._ Contrary to `rclone size`, this flag ignores filters so that theresult is accurate. However, this is very inefficient and may cost lots of APIcalls resulting in extra charges. Use it as a last resort and only with caching.+## VFS Metadata++If you use the `--vfs-metadata-extension` flag you can get the VFS to+expose files which contain the [metadata](https://rclone.org/docs/#metadata) as a JSON+blob. These files will not appear in the directory listing, but can be+`stat`-ed and opened and once they have been they **will** appear in+directory listings until the directory cache expires.++Note that some backends won't create metadata unless you pass in the+`--metadata` flag.++For example, using `rclone mount` with `--metadata --vfs-metadata-extension .metadata`+we get++```+$ ls -l /mnt/+total 1048577+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++$ cat /mnt/1G.metadata+{+ "atime": "2025-03-04T17:34:22.317069787Z",+ "btime": "2025-03-03T16:03:37.708253808Z",+ "gid": "1000",+ "mode": "100664",+ "mtime": "2025-03-03T16:03:39.640238323Z",+ "uid": "1000"+}++$ ls -l /mnt/+total 1048578+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+-rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata+```++If the file has no metadata it will be returned as `{}` and if there+is an error reading the metadata the error will be returned as+`{"error":"error string"}`.+## Auth ProxyIf you supply the parameter `--auth-proxy /path/to/program` then@@ -12704,6 +13612,7 @@ rclone serve sftp remote:path [flags]--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a '.rclonelink' extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached ('off' is unlimited) (default off)@@ -12731,6 +13640,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -12918,7 +13828,11 @@ By default this will serve files without needing a login.You can either use an htpasswd file which can take lots of users, orset a single username and password with the `--user` and `--pass` flags.-If no static users are configured by either of the above methods, and client+Alternatively, you can have the reverse proxy manage authentication and use the+username provided in the configured header with `--user-from-header` (e.g., `----user-from-header=x-remote-user`).+Ensure the proxy is trusted and headers cannot be spoofed, as misconfiguration may lead to unauthorized access.++If either of the above authentication methods is not configured and clientcertificates are required by the `--client-ca` flag passed to the server, theclient certificate common name will be considered as the username.@@ -13035,11 +13949,11 @@ seconds. If rclone is quit or dies with files that haven't beenuploaded, these will be uploaded next time rclone is run with the sameflags.-If using `--vfs-cache-max-size` or `--vfs-cache-min-free-size` note+If using `--vfs-cache-max-size` or `--vfs-cache-min-free-space` notethat the cache may exceed these quotas for two reasons. Firstlybecause it is only checked every `--vfs-cache-poll-interval`. Secondlybecause open files cannot be evicted from the cache. When-`--vfs-cache-max-size` or `--vfs-cache-min-free-size` is exceeded,+`--vfs-cache-max-size` or `--vfs-cache-min-free-space` is exceeded,rclone will attempt to evict the least accessed files from the cachefirst. rclone will start with files that haven't been accessed for thelongest. This cache flushing strategy is efficient and more relevant@@ -13364,6 +14278,45 @@ _WARNING._ Contrary to `rclone size`, this flag ignores filters so that theresult is accurate. However, this is very inefficient and may cost lots of APIcalls resulting in extra charges. Use it as a last resort and only with caching.+## VFS Metadata++If you use the `--vfs-metadata-extension` flag you can get the VFS to+expose files which contain the [metadata](https://rclone.org/docs/#metadata) as a JSON+blob. These files will not appear in the directory listing, but can be+`stat`-ed and opened and once they have been they **will** appear in+directory listings until the directory cache expires.++Note that some backends won't create metadata unless you pass in the+`--metadata` flag.++For example, using `rclone mount` with `--metadata --vfs-metadata-extension .metadata`+we get++```+$ ls -l /mnt/+total 1048577+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++$ cat /mnt/1G.metadata+{+ "atime": "2025-03-04T17:34:22.317069787Z",+ "btime": "2025-03-03T16:03:37.708253808Z",+ "gid": "1000",+ "mode": "100664",+ "mtime": "2025-03-03T16:03:39.640238323Z",+ "uid": "1000"+}++$ ls -l /mnt/+total 1048578+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+-rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata+```++If the file has no metadata it will be returned as `{}` and if there+is an error reading the metadata the error will be returned as+`{"error":"error string"}`.+## Auth ProxyIf you supply the parameter `--auth-proxy /path/to/program` then@@ -13454,12 +14407,12 @@ rclone serve webdav remote:path [flags]## Options```- --addr stringArray IPaddress:Port, :Port or [unix://]/path/to/socket to bind server to (default [127.0.0.1:8080])+ --addr stringArray IPaddress:Port or :Port to bind server to (default 127.0.0.1:8080)--allow-origin string Origin which cross-domain request (CORS) can be executed from--auth-proxy string A program to use to create the backend from the auth--baseurl string Prefix for URLs - leave blank for root- --cert string Path to TLS PEM public key certificate file (can also include intermediate/CA certificates)- --client-ca string Path to TLS PEM CA file with certificate authorities to verify clients with+ --cert string TLS PEM key (concatenation of certificate and CA certificate)+ --client-ca string Client certificate authority to verify clients with--dir-cache-time Duration Time to cache directory entries for (default 5m0s)--dir-perms FileMode Directory permissions (default 777)--disable-dir-list Disable HTML directory list on GET request for a directory@@ -13468,7 +14421,7 @@ rclone serve webdav remote:path [flags]--gid uint32 Override the gid field set by the filesystem (not supported on Windows) (default 1000)-h, --help help for webdav--htpasswd string A htpasswd file - if not provided no authentication is done- --key string Path to TLS PEM private key file+ --key string TLS PEM Private key--link-perms FileMode Link permissions (default 666)--max-header-bytes int Maximum size of request header (default 4096)--min-tls-version string Minimum TLS version that is acceptable (default "tls1.0")@@ -13486,6 +14439,7 @@ rclone serve webdav remote:path [flags]--uid uint32 Override the uid field set by the filesystem (not supported on Windows) (default 1000)--umask FileMode Override the permission bits set by the filesystem (not supported on Windows) (default 002)--user string User name for authentication+ --user-from-header string User name from a defined HTTP header--vfs-block-norm-dupes If duplicate filenames exist in the same directory (after normalization), log an error and hide the duplicates (may have a performance cost)--vfs-cache-max-age Duration Max time since last access of objects in the cache (default 1h0m0s)--vfs-cache-max-size SizeSuffix Max total size of objects in the cache (default off)@@ -13496,6 +14450,7 @@ rclone serve webdav remote:path [flags]--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a '.rclonelink' extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached ('off' is unlimited) (default off)@@ -13523,6 +14478,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -13808,6 +14764,7 @@ unless `--no-create` or `--recursive` is provided.If `--recursive` is used then recursively sets the modificationtime on all existing files that is found under the path. Filters are supported,and you can test with the `--dry-run` or the `--interactive`/`-i` flag.+This will touch `--transfers` files concurrently.If `--timestamp` is used then sets the modification time to thattime instead of the current time. Times may be specified as one of:@@ -13860,6 +14817,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -13966,6 +14924,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -14444,6 +15403,11 @@ it to `false`. It is also possible to specify `--boolean=false` orparsed as `--boolean` and the `false` is parsed as an extra commandline argument for rclone.+Options documented to take a `stringArray` parameter accept multiple+values. To pass more than one value, repeat the option; for example:+`--include value1 --include value2`.++### Time or duration options {#time-option}TIME or DURATION options can be specified as a duration string or a@@ -14788,8 +15752,9 @@ on any OS, and the value is defined as following:- On Unix: `$HOME` if defined, else by looking up current user in OS-specific user database(e.g. passwd file), or else use the result from shell command `cd && pwd`.-If you run `rclone config file` you will see where the default-location is for you.+If you run `rclone config file` you will see where the default location is for+you. Running `rclone config touch` will ensure a configuration file exists,+creating an empty one in the default location if there is none.The fact that an existing file `rclone.conf` in the same directoryas the rclone executable is always preferred, means that it is easy@@ -14800,7 +15765,13 @@ same directory.If the location is set to empty string `""` or path to a filewith name `notfound`, or the os null device represented by value `NUL` onWindows and `/dev/null` on Unix systems, then rclone will keep the-config file in memory only.+configuration file in memory only.++You may see a log message "Config file not found - using defaults" if there is+no configuration file. This can be supressed, e.g. if you are using rclone+entirely with [on the fly remotes](https://rclone.org/docs/#backend-path-to-dir), by using+memory-only configuration file or by creating an empty configuration file, as+described above.The file format is basic [INI](https://en.wikipedia.org/wiki/INI_file#Format):Sections of text, led by a `[section]` header and followed by@@ -15268,6 +16239,19 @@ backends and the VFS. There are individual flags for just enabling itfor the VFS `--vfs-links` and the local backend `--local-links` ifrequired.+### --list-cutoff N {#list-cutoff}++When syncing rclone needs to sort directory entries before comparing+them. Below this threshold (1,000,000) by default, rclone will store+the directory entries in memory. 1,000,000 entries will take approx+1GB of RAM to store. Above this threshold rclone will store directory+entries on disk and sort them without using a lot of memory.++Doing this is slightly less efficient then sorting them in memory and+will only work well for the bucket based backends (eg s3, b2,+azureblob, swift) but these are the only backends likely to have+millions of entries in a directory.+### --log-file=FILE ###Log all of rclone's output to FILE. This is not active by default.@@ -15283,12 +16267,21 @@ have a signal to rotate logs.### --log-format LIST ###-Comma separated list of log format options. Accepted options are `date`,-`time`, `microseconds`, `pid`, `longfile`, `shortfile`, `UTC`. Any other-keywords will be silently ignored. `pid` will tag log messages with process-identifier which useful with `rclone mount --daemon`. Other accepted-options are explained in the [go documentation](https://pkg.go.dev/log#pkg-constants).-The default log format is "`date`,`time`".+Comma separated list of log format options. The accepted options are:++- `date` - Add a date in the format YYYY/MM/YY to the log.+- `time` - Add a time to the log in format HH:MM:SS.+- `microseconds` - Add microseconds to the time in format HH:MM:SS.SSSSSS.+- `UTC` - Make the logs in UTC not localtime.+- `longfile` - Adds the source file and line number of the log statement.+- `shortfile` - Adds the source file and line number of the log statement.+- `pid` - Add the process ID to the log - useful with `rclone mount --daemon`.+- `nolevel` - Don't add the level to the log.+- `json` - Equivalent to adding `--use-json-log`++They are added to the log line in the order above.++The default log format is `"date,time"`.### --log-level LEVEL ###@@ -15306,10 +16299,90 @@ warnings and significant events.`ERROR` is equivalent to `-q`. It only outputs error messages.+### --windows-event-log LEVEL ###++If this is configured (the default is `OFF`) then logs of this level+and above will be logged to the Windows event log in **addition** to+the normal logs. These will be logged in JSON format as described+below regardless of what format the main logs are configured for.++The Windows event log only has 3 levels of severity `Info`, `Warning`+and `Error`. If enabled we map rclone levels like this.++- `Error` ← `ERROR` (and above)+- `Warning` ← `WARNING` (note that this level is defined but not currently used).+- `Info` ← `NOTICE`, `INFO` and `DEBUG`.++Rclone will declare its log source as "rclone" if it is has enough+permissions to create the registry key needed. If not then logs will+appear as "Application". You can run `rclone version --windows-event-log DEBUG`+once as administrator to create the registry key in advance.++**Note** that the `--windows-event-log` level must be greater (more+severe) than or equal to the `--log-level`. For example to log DEBUG+to a log file but ERRORs to the event log you would use++ --log-file rclone.log --log-level DEBUG --windows-event-log ERROR++This option is only supported Windows platforms.+### --use-json-log ###-This switches the log format to JSON for rclone. The fields of json log-are level, msg, source, time.+This switches the log format to JSON for rclone. The fields of JSON+log are `level`, `msg`, `source`, `time`. The JSON logs will be+printed on a single line, but are shown expanded here for clarity.++```json+{+ "time": "2025-05-13T17:30:51.036237518+01:00",+ "level": "debug",+ "msg": "4 go routines active\n",+ "source": "cmd/cmd.go:298"+}+```++Completed data transfer logs will have extra `size` information. Logs+which are about a particular object will have `object` and+`objectType` fields also.++```json+{+ "time": "2025-05-13T17:38:05.540846352+01:00",+ "level": "info",+ "msg": "Copied (new) to: file2.txt",+ "size": 6,+ "object": "file.txt",+ "objectType": "*local.Object",+ "source": "operations/copy.go:368"+}+```++Stats logs will contain a `stats` field which is the same as+returned from the rc call [core/stats](https://rclone.org/rc/#core-stats).++```json+{+ "time": "2025-05-13T17:38:05.540912847+01:00",+ "level": "info",+ "msg": "...text version of the stats...",+ "stats": {+ "bytes": 6,+ "checks": 0,+ "deletedDirs": 0,+ "deletes": 0,+ "elapsedTime": 0.000904825,+ ...truncated for clarity...+ "totalBytes": 6,+ "totalChecks": 0,+ "totalTransfers": 1,+ "transferTime": 0.000882794,+ "transfers": 1+ },+ "source": "accounting/stats.go:569"+}+```++### --low-level-retries NUMBER ###@@ -15346,6 +16419,50 @@ of the remote which may be desirable.Setting this to a negative number will make the backlog as large aspossible.+### --max-buffer-memory=SIZE {#max-buffer-memory}++If set, don't allocate more than SIZE amount of memory as buffers. If+not set or set to `0` or `off` this will not limit the amount of memory+in use.++This includes memory used by buffers created by the `--buffer` flag+and buffers used by multi-thread transfers.++Most multi-thread transfers do not take additional memory, but some do+depending on the backend (eg the s3 backend for uploads). This means+there is a tension between total setting `--transfers` as high as+possible and memory use.++Setting `--max-buffer-memory` allows the buffer memory to be+controlled so that it doesn't overwhelm the machine and allows+`--transfers` to be set large.++### --max-connections=N ###++This sets the maximum number of concurrent calls to the backend API.+It may not map 1:1 to TCP or HTTP connections depending on the backend+in use and the use of HTTP1 vs HTTP2.++When downloading files, backends only limit the initial opening of the+stream. The bulk data download is not counted as a connection. This+means that the `--max--connections` flag won't limit the total number+of downloads.++Note that it is possible to cause deadlocks with this setting so it+should be used with care.++If you are doing a sync or copy then make sure `--max-connections` is+one more than the sum of `--transfers` and `--checkers`.++If you use `--check-first` then `--max-connections` just needs to be+one more than the maximum of `--checkers` and `--transfers`.++So for `--max-connections 3` you'd use `--checkers 2 --transfers 2+--check-first` or `--checkers 1 --transfers 1`.++Setting this flag can be useful for backends which do multipart+uploads to limit the number of simultaneous parts being transferred.+### --max-delete=N ###This tells rclone not to delete more than N files. If that limit is@@ -15605,6 +16722,14 @@ This will work with the `sync`/`copy`/`move` commands and friendsmount` and `rclone serve` if `--vfs-cache-mode` is set to `writes` orabove.+Most multi-thread transfers do not take additional memory, but some do+(for example uploading to s3). In the worst case memory usage can be+at maximum `--transfers` * `--multi-thread-chunk-size` *+`--multi-thread-streams` or specifically for the s3 backend+`--transfers` * `--s3-chunk-size` * `--s3-concurrency`. However you+can use the the [--max-buffer-memory](https://rclone.org/docs/#max-buffer-memory) flag+to control the maximum memory used here.+**NB** that this **only** works with supported backends as thedestination but will work with any backend as the source.@@ -15629,6 +16754,13 @@ If the backend has a `--backend-upload-concurrency` setting (egnumber of transfers instead if it is larger than the value of`--multi-thread-streams` or `--multi-thread-streams` isn't set.+### --name-transform COMMAND[=XXXX] ###+`--name-transform` introduces path name transformations for+`rclone copy`, `rclone sync`, and `rclone move`. These transformations+enable modifications to source and destination file names by applying+prefixes, suffixes, and other alterations during transfer operations.+For detailed docs and examples, see [`convmv`](https://rclone.org/commands/rclone_convmv/).+### --no-check-dest ###The `--no-check-dest` can be used with `move` or `copy` and it causes@@ -16628,6 +17760,7 @@ For the filtering options* `--max-size`* `--min-age`* `--max-age`+ * `--hash-filter`* `--dump filters`* `--metadata-include`* `--metadata-include-from`@@ -16755,7 +17888,7 @@ so they take exactly the same form.The options set by environment variables can be seen with the `-vv` flag, e.g. `rclone version -vv`.Options that can appear multiple times (type `stringArray`) are-treated slighly differently as environment variables can only be+treated slightly differently as environment variables can only bedefined once. In order to allow a simple mechanism for adding one ormany items, the input is treated as a [CSV encoded](https://godoc.org/encoding/csv)string. For example@@ -17679,6 +18812,98 @@ old or more.See [the time option docs](https://rclone.org/docs/#time-option) for valid formats.+### `--hash-filter` - Deterministically select a subset of files {#hash-filter}++The `--hash-filter` flag enables selecting a deterministic subset of files, useful for:++1. Running large sync operations across multiple machines.+2. Checking a subset of files for bitrot.+3. Any other operations where a sample of files is required.++#### Syntax++The flag takes two parameters expressed as a fraction:++```+--hash-filter K/N+```++- `N`: The total number of partitions (must be a positive integer).+- `K`: The specific partition to select (an integer from `0` to `N`).++For example:+- `--hash-filter 1/3`: Selects the first third of the files.+- `--hash-filter 2/3` and `--hash-filter 3/3`: Select the second and third partitions, respectively.++Each partition is non-overlapping, ensuring all files are covered without duplication.++#### Random Partition Selection++Use `@` as `K` to randomly select a partition:++```+--hash-filter @/M+```++For example, `--hash-filter @/3` will randomly select a number between 0 and 2. This will stay constant across retries.++#### How It Works++- Rclone takes each file's full path, normalizes it to lowercase, and applies Unicode normalization.+- It then hashes the normalized path into a 64 bit number.+- The hash result is reduced modulo `N` to assign the file to a partition.+- If the calculated partition does not match `K` the file is excluded.+- Other filters may apply if the file is not excluded.++**Important:** Rclone will traverse all directories to apply the filter.++#### Usage Notes++- Safe to use with `rclone sync`; source and destination selections will match.+- **Do not** use with `--delete-excluded`, as this could delete unselected files.+- Ignored if `--files-from` is used.++#### Examples++##### Dividing files into 4 partitions++Assuming the current directory contains `file1.jpg` through `file9.jpg`:++```+$ rclone lsf --hash-filter 0/4 .+file1.jpg+file5.jpg++$ rclone lsf --hash-filter 1/4 .+file3.jpg+file6.jpg+file9.jpg++$ rclone lsf --hash-filter 2/4 .+file2.jpg+file4.jpg++$ rclone lsf --hash-filter 3/4 .+file7.jpg+file8.jpg++$ rclone lsf --hash-filter 4/4 . # the same as --hash-filter 0/4+file1.jpg+file5.jpg+```++##### Syncing the first quarter of files++```+rclone sync --hash-filter 1/4 source:path destination:path+```++##### Checking a random 1% of files for integrity++```+rclone check --download --hash-filter @/100 source:path destination:path+```+## Other flags### `--delete-excluded` - Delete files on dest excluded from sync@@ -18187,9 +19412,16 @@ $ rclone rc job/listIf you wish to set config (the equivalent of the global flags) for theduration of an rc call only then pass in the `_config` parameter.-This should be in the same format as the `config` key returned by+This should be in the same format as the `main` key returned by[options/get](#options-get).+ rclone rc --loopback options/get blocks=main++You can see more help on these options with this command (see [the+options blocks section](#option-blocks) for more info).++ rclone rc --loopback options/info blocks=main+For example, if you wished to run a sync with the `--checksum`parameter, you would pass this parameter in your JSON blob.@@ -18220,6 +19452,13 @@ pass in the `_filter` parameter.This should be in the same format as the `filter` key returned by[options/get](#options-get).+ rclone rc --loopback options/get blocks=filter++You can see more help on these options with this command (see [the+options blocks section](#option-blocks) for more info).++ rclone rc --loopback options/info blocks=filter+For example, if you wished to run a sync with these flags--max-size 1M --max-age 42s --include "a" --include "b"@@ -18301,7 +19540,7 @@ format. Each block describes a single option.| Field | Type | Optional | Description ||-------|------|----------|-------------|| Name | string | N | name of the option in snake_case |-| FieldName | string | N | name of the field used in the rc - if blank use Name |+| FieldName | string | N | name of the field used in the rc - if blank use Name. May contain "." for nested fields. || Help | string | N | help, started with a single sentence on a single line || Groups | string | Y | groups this option belongs to - comma separated string for options classification || Provider | string | Y | set to filter on provider |@@ -18507,6 +19746,7 @@ This takes the following parameters:- opt - a dictionary of options to control the configuration- obscure - declare passwords are plain and need obscuring- noObscure - declare passwords are already obscured and don't need obscuring+ - noOutput - don't print anything to stdout- nonInteractive - don't interact with a user, return questions- continue - continue the config process with an answer- all - ask all the config questions not just the post config ones@@ -18621,6 +19861,7 @@ This takes the following parameters:- opt - a dictionary of options to control the configuration- obscure - declare passwords are plain and need obscuring- noObscure - declare passwords are already obscured and don't need obscuring+ - noOutput - don't print anything to stdout- nonInteractive - don't interact with a user, return questions- continue - continue the config process with an answer- all - ask all the config questions not just the post config ones@@ -18805,7 +20046,8 @@ returned.Parameters-- group - name of the stats group (string)+- group - name of the stats group (string, optional)+- short - if true will not return the transferring and checking arrays (boolean, optional)Returns the following values:@@ -18820,6 +20062,7 @@ Returns the following values:"fatalError": boolean whether there has been at least one fatal error,"lastError": last error string,"renames" : number of files renamed,+ "listed" : number of directory entries listed,"retryError": boolean showing whether there has been at least one non-NoRetryError,"serverSideCopies": number of server side copies done,"serverSideCopyBytes": number bytes server side copied,@@ -19786,6 +21029,141 @@ check that parameter passing is working properly.**Authentication is required for this call.**+### serve/list: Show running servers {#serve-list}++Show running servers with IDs.++This takes no parameters and returns++- list: list of running serve commands++Each list element will have++- id: ID of the server+- addr: address the server is running on+- params: parameters used to start the server++Eg++ rclone rc serve/list++Returns++```json+{+ "list": [+ {+ "addr": "[::]:4321",+ "id": "nfs-ffc2a4e5",+ "params": {+ "fs": "remote:",+ "opt": {+ "ListenAddr": ":4321"+ },+ "type": "nfs",+ "vfsOpt": {+ "CacheMode": "full"+ }+ }+ }+ ]+}+```++**Authentication is required for this call.**++### serve/start: Create a new server {#serve-start}++Create a new server with the specified parameters.++This takes the following parameters:++- `type` - type of server: `http`, `webdav`, `ftp`, `sftp`, `nfs`, etc.+- `fs` - remote storage path to serve+- `addr` - the ip:port to run the server on, eg ":1234" or "localhost:1234"++Other parameters are as described in the documentation for the+relevant [rclone serve](https://rclone.org/commands/rclone_serve/) command line options.+To translate a command line option to an rc parameter, remove the+leading `--` and replace `-` with `_`, so `--vfs-cache-mode` becomes+`vfs_cache_mode`. Note that global parameters must be set with+`_config` and `_filter` as described above.++Examples:++ rclone rc serve/start type=nfs fs=remote: addr=:4321 vfs_cache_mode=full+ rclone rc serve/start --json '{"type":"nfs","fs":"remote:","addr":":1234","vfs_cache_mode":"full"}'++This will give the reply++```json+{+ "addr": "[::]:4321", // Address the server was started on+ "id": "nfs-ecfc6852" // Unique identifier for the server instance+}+```++Or an error if it failed to start.++Stop the server with `serve/stop` and list the running servers with `serve/list`.++**Authentication is required for this call.**++### serve/stop: Unserve selected active serve {#serve-stop}++Stops a running `serve` instance by ID.++This takes the following parameters:++- id: as returned by serve/start++This will give an empty response if successful or an error if not.++Example:++ rclone rc serve/stop id=12345++**Authentication is required for this call.**++### serve/stopall: Stop all active servers {#serve-stopall}++Stop all active servers.++This will stop all active servers.++ rclone rc serve/stopall++**Authentication is required for this call.**++### serve/types: Show all possible serve types {#serve-types}++This shows all possible serve types and returns them as a list.++This takes no parameters and returns++- types: list of serve types, eg "nfs", "sftp", etc++The serve types are strings like "serve", "serve2", "cserve" and can+be passed to serve/start as the serveType parameter.++Eg++ rclone rc serve/types++Returns++```json+{+ "types": [+ "http",+ "sftp",+ "nfs"+ ]+}+```++**Authentication is required for this call.**+### sync/bisync: Perform bidirectional synchronization between two paths. {#sync-bisync}This takes the following parameters@@ -19937,7 +21315,7 @@ the `--vfs-cache-mode` is off, it will return an empty result.],}-The `expiry` time is the time until the file is elegible for being+The `expiry` time is the time until the file is eligible for beinguploaded in floating point seconds. This may go negative. As rcloneonly transfers `--transfers` files at once, only the lowest`--transfers` expiry times will have `uploading` as `true`. So there@@ -20285,6 +21663,7 @@ Here is an overview of the major features of each cloud storage system.| Cloudinary | MD5 | R | No | Yes | - | - || Dropbox | DBHASH ¹ | R | Yes | No | - | - || Enterprise File Fabric | - | R/W | Yes | No | R/W | - |+| FileLu Cloud Storage | MD5 | R/W | No | Yes | R | - || Files.com | MD5, CRC32 | DR/W | Yes | No | R | - || FTP | - | R/W ¹⁰ | No | No | - | - || Gofile | MD5 | DR/W | No | Yes | R | - |@@ -20939,6 +22318,7 @@ Flags for anything which can copy a file.--multi-thread-cutoff SizeSuffix Use multi-thread downloads for files above this size (default 256Mi)--multi-thread-streams int Number of streams to use for multi-thread downloads (default 4)--multi-thread-write-buffer-size SizeSuffix In memory buffer size for writing when in multi-thread mode (default 128Ki)+ --name-transform stringArray Transform paths during the copy process--no-check-dest Don't check the destination, copy regardless--no-traverse Don't traverse destination file system on copy--no-update-dir-modtime Don't update directory modification times@@ -20964,6 +22344,7 @@ Flags used for sync commands.--delete-during When synchronizing, delete files during transfer--fix-case Force rename of case insensitive dest to match source--ignore-errors Delete even if there are I/O errors+ --list-cutoff int To save memory, sort directory listings on disk above this threshold (default 1000000)--max-delete int When synchronizing, limit the number of deletes (default -1)--max-delete-size SizeSuffix When synchronizing, limit the total size of deletes (default off)--suffix string Suffix to add to changed files@@ -21012,13 +22393,14 @@ Flags for general networking and HTTP stuff.--header stringArray Set HTTP header for all transactions--header-download stringArray Set HTTP header for download transactions--header-upload stringArray Set HTTP header for upload transactions+ --max-connections int Maximum number of simultaneous backend API connections, 0 for unlimited--no-check-certificate Do not verify the server SSL certificate (insecure)--no-gzip-encoding Don't set Accept-Encoding: gzip--timeout Duration IO idle timeout (default 5m0s)--tpslimit float Limit HTTP transactions per second to this--tpslimit-burst int Max burst of transactions for --tpslimit (default 1)--use-cookies Enable session cookiejar- --user-agent string Set the user-agent to a specified string (default "rclone/v1.69.0")+ --user-agent string Set the user-agent to a specified string (default "rclone/v1.70.0")```@@ -21053,6 +22435,7 @@ Flags for general configuration of rclone.-i, --interactive Enable interactive mode--kv-lock-time Duration Maximum time to keep key-value database locked by process (default 1s)--low-level-retries int Number of low level retries to do (default 10)+ --max-buffer-memory SizeSuffix If set, don't allocate more than this amount of memory as buffers (default off)--no-console Hide console window (supported on Windows only)--no-unicode-normalization Don't normalize unicode characters in filenames--password-command SpaceSepList Command for supplying password for encrypted configuration@@ -21090,6 +22473,7 @@ Flags for filtering directory listings.--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -21123,7 +22507,7 @@ Flags for logging and statistics.```--log-file string Log everything to this file- --log-format string Comma separated list of log format options (default "date,time")+ --log-format Bits Comma separated list of log format options (default date,time)--log-level LogLevel Log level DEBUG|INFO|NOTICE|ERROR (default NOTICE)--log-systemd Activate systemd integration for the logger--max-stats-groups int Maximum number of stats groups to keep in memory, on max oldest is discarded (default 1000)@@ -21190,6 +22574,7 @@ Flags to control the Remote Control API.--rc-server-write-timeout Duration Timeout for server writing data (default 1h0m0s)--rc-template string User-specified template--rc-user string User name for authentication+ --rc-user-from-header string User name from a defined HTTP header--rc-web-fetch-url string URL to fetch the releases for webgui (default "https://api.github.com/repos/rclone/rclone-webui-react/releases/latest")--rc-web-gui Launch WebGUI on localhost--rc-web-gui-force-update Force update to latest version of web gui@@ -21219,6 +22604,7 @@ Flags to control the Metrics HTTP endpoint..--metrics-server-write-timeout Duration Timeout for server writing data (default 1h0m0s)--metrics-template string User-specified template--metrics-user string User name for authentication+ --metrics-user-from-header string User name from a defined HTTP header--rc-enable-metrics Enable the Prometheus metrics path at the remote control server```@@ -21239,6 +22625,8 @@ Backend-only flags (these can be set in the config file also).--azureblob-client-id string The ID of the client in use--azureblob-client-secret string One of the service principal's client secrets--azureblob-client-send-certificate-chain Send the certificate chain when using certificate auth+ --azureblob-copy-concurrency int Concurrency for multipart copy (default 512)+ --azureblob-copy-cutoff SizeSuffix Cutoff for switching to multipart copy (default 8Mi)--azureblob-delete-snapshots string Set to specify how to deal with snapshots on blob deletion--azureblob-description string Description of the remote--azureblob-directory-markers Upload an empty object with a trailing slash when a new directory is created@@ -21262,6 +22650,7 @@ Backend-only flags (these can be set in the config file also).--azureblob-upload-concurrency int Concurrency for multipart uploads (default 16)--azureblob-upload-cutoff string Cutoff for switching to chunked upload (<= 256 MiB) (deprecated)--azureblob-use-az Use Azure CLI tool az for authentication+ --azureblob-use-copy-blob Whether to use the Copy Blob API when copying to the same storage account (default true)--azureblob-use-emulator Uses local storage emulator if provided as 'true'--azureblob-use-msi Use a managed service identity to authenticate (only works in Azure)--azureblob-username string User name (usually an email address)@@ -21274,6 +22663,7 @@ Backend-only flags (these can be set in the config file also).--azurefiles-client-send-certificate-chain Send the certificate chain when using certificate auth--azurefiles-connection-string string Azure Files Connection String--azurefiles-description string Description of the remote+ --azurefiles-disable-instance-discovery Skip requesting Microsoft Entra instance metadata--azurefiles-encoding Encoding The encoding for the backend (default Slash,LtGt,DoubleQuote,Colon,Question,Asterisk,Pipe,BackSlash,Del,Ctl,RightPeriod,InvalidUtf8,Dot)--azurefiles-endpoint string Endpoint for the service--azurefiles-env-auth Read credentials from runtime (environment variables, CLI or MSI)@@ -21288,6 +22678,7 @@ Backend-only flags (these can be set in the config file also).--azurefiles-share-name string Azure Files Share Name--azurefiles-tenant string ID of the service principal's tenant. Also called its directory ID--azurefiles-upload-concurrency int Concurrency for multipart uploads (default 16)+ --azurefiles-use-az Use Azure CLI tool az for authentication--azurefiles-use-msi Use a managed service identity to authenticate (only works in Azure)--azurefiles-username string User name (usually an email address)--b2-account string Account ID or Application Key ID@@ -21350,12 +22741,14 @@ Backend-only flags (these can be set in the config file also).--chunker-fail-hard Choose how chunker should handle files with missing or invalid chunks--chunker-hash-type string Choose how chunker handles hash sums (default "md5")--chunker-remote string Remote to chunk/unchunk+ --cloudinary-adjust-media-files-extensions Cloudinary handles media formats as a file attribute and strips it from the name, which is unlike most other file systems (default true)--cloudinary-api-key string Cloudinary API Key--cloudinary-api-secret string Cloudinary API Secret--cloudinary-cloud-name string Cloudinary Environment Name--cloudinary-description string Description of the remote--cloudinary-encoding Encoding The encoding for the backend (default Slash,LtGt,DoubleQuote,Question,Asterisk,Pipe,Hash,Percent,BackSlash,Del,Ctl,RightSpace,InvalidUtf8,Dot)--cloudinary-eventually-consistent-delay Duration Wait N seconds for eventual consistency of the databases that support the backend operation (default 0s)+ --cloudinary-media-extensions stringArray Cloudinary supported media extensions (default 3ds,3g2,3gp,ai,arw,avi,avif,bmp,bw,cr2,cr3,djvu,dng,eps3,fbx,flif,flv,gif,glb,gltf,hdp,heic,heif,ico,indd,jp2,jpe,jpeg,jpg,jxl,jxr,m2ts,mov,mp4,mpeg,mts,mxf,obj,ogv,pdf,ply,png,psd,svg,tga,tif,tiff,ts,u3ma,usdz,wdp,webm,webp,wmv)--cloudinary-upload-prefix string Specify the API endpoint for environments out of the US--cloudinary-upload-preset string Upload Preset to select asset manipulation on upload--combine-description string Description of the remote@@ -21379,6 +22772,10 @@ Backend-only flags (these can be set in the config file also).--crypt-show-mapping For all files listed show how the names encrypt--crypt-strict-names If set, this will raise an error when crypt comes across a filename that can't be decrypted--crypt-suffix string If this is set it will override the default suffix of ".bin" (default ".bin")+ --doi-description string Description of the remote+ --doi-doi string The DOI or the doi.org URL+ --doi-doi-resolver-api-url string The URL of the DOI resolver API to use+ --doi-provider string DOI provider--drive-acknowledge-abuse Set to allow files which return cannotDownloadAbusiveFile to be downloaded--drive-allow-import-name-change Allow the filetype to change when uploading Google docs--drive-auth-owner-only Only consider files owned by the authenticated user@@ -21430,7 +22827,6 @@ Backend-only flags (these can be set in the config file also).--drive-use-trash Send files to the trash instead of deleting permanently (default true)--drive-v2-download-min-size SizeSuffix If Object's are greater, use drive v2 API to download (default off)--dropbox-auth-url string Auth server URL- --dropbox-batch-commit-timeout Duration Max time to wait for a batch to finish committing (default 10m0s)--dropbox-batch-mode string Upload file batching sync|async|off (default "sync")--dropbox-batch-size int Max number of files in upload batch--dropbox-batch-timeout Duration Max time to allow an idle upload batch before uploading (default 0s)@@ -21440,11 +22836,14 @@ Backend-only flags (these can be set in the config file also).--dropbox-client-secret string OAuth Client Secret--dropbox-description string Description of the remote--dropbox-encoding Encoding The encoding for the backend (default Slash,BackSlash,Del,RightSpace,InvalidUtf8,Dot)+ --dropbox-export-formats CommaSepList Comma separated list of preferred formats for exporting files (default html,md)--dropbox-impersonate string Impersonate this user when using a business account--dropbox-pacer-min-sleep Duration Minimum time to sleep between API calls (default 10ms)--dropbox-root-namespace string Specify a different Dropbox namespace ID to use as the root for all paths--dropbox-shared-files Instructs rclone to work on individual shared files--dropbox-shared-folders Instructs rclone to work on shared folders+ --dropbox-show-all-exports Show all exportable files in listings+ --dropbox-skip-exports Skip exportable files in all listings--dropbox-token string OAuth Access Token as a JSON blob--dropbox-token-url string Token server url--fichier-api-key string Your API Key, get it from https://1fichier.com/console/params.pl@@ -21462,6 +22861,9 @@ Backend-only flags (these can be set in the config file also).--filefabric-token-expiry string Token expiry time--filefabric-url string URL of the Enterprise File Fabric to connect to--filefabric-version string Version read from the file fabric+ --filelu-description string Description of the remote+ --filelu-encoding Encoding The encoding for the backend (default Slash,LtGt,DoubleQuote,SingleQuote,BackQuote,Dollar,Colon,Question,Asterisk,Pipe,Hash,Percent,BackSlash,CrLf,Del,Ctl,LeftSpace,LeftPeriod,LeftTilde,LeftCrLfHtVt,RightSpace,RightPeriod,RightCrLfHtVt,InvalidUtf8,Dot,SquareBracket,Semicolon,Exclamation)+ --filelu-key string Your FileLu Rclone key from My Account--filescom-api-key string The API key used to authenticate with Files.com--filescom-description string Description of the remote--filescom-encoding Encoding The encoding for the backend (default Slash,BackSlash,Del,Ctl,RightSpace,RightCrLfHtVt,InvalidUtf8,Dot)@@ -21521,7 +22923,6 @@ Backend-only flags (these can be set in the config file also).--gofile-list-chunk int Number of items to list in each call (default 1000)--gofile-root-folder-id string ID of the root folder--gphotos-auth-url string Auth server URL- --gphotos-batch-commit-timeout Duration Max time to wait for a batch to finish committing (default 10m0s)--gphotos-batch-mode string Upload file batching sync|async|off (default "sync")--gphotos-batch-size int Max number of files in upload batch--gphotos-batch-timeout Duration Max time to allow an idle upload batch before uploading (default 0s)@@ -21589,6 +22990,8 @@ Backend-only flags (these can be set in the config file also).--internetarchive-encoding Encoding The encoding for the backend (default Slash,LtGt,CrLf,Del,Ctl,InvalidUtf8,Dot)--internetarchive-endpoint string IAS3 Endpoint (default "https://s3.us.archive.org")--internetarchive-front-endpoint string Host of InternetArchive Frontend (default "https://archive.org")+ --internetarchive-item-derive Whether to trigger derive on the IA item or not. If set to false, the item will not be derived by IA upon upload (default true)+ --internetarchive-item-metadata stringArray Metadata to be set on the IA item, this is different from file-level metadata that can be set using --metadata-set--internetarchive-secret-access-key string IAS3 Secret Key (password)--internetarchive-wait-archive Duration Timeout for waiting the server's processing tasks (specifically archive and book_op) to finish (default 0s)--jottacloud-auth-url string Auth server URL@@ -21684,6 +23087,7 @@ Backend-only flags (these can be set in the config file also).--onedrive-tenant string ID of the service principal's tenant. Also called its directory ID--onedrive-token string OAuth Access Token as a JSON blob--onedrive-token-url string Token server url+ --onedrive-upload-cutoff SizeSuffix Cutoff for switching to chunked upload (default off)--oos-attempt-resume-upload If true attempt to resume previously started multipart upload for the object--oos-chunk-size SizeSuffix Chunk size to use for uploading (default 5Mi)--oos-compartment string Specify compartment OCID, if you need to list buckets@@ -21709,6 +23113,7 @@ Backend-only flags (these can be set in the config file also).--oos-storage-tier string The storage class to use when storing new objects in storage. https://docs.oracle.com/en-us/iaas/Content/Object/Concepts/understandingstoragetiers.htm (default "Standard")--oos-upload-concurrency int Concurrency for multipart uploads (default 10)--oos-upload-cutoff SizeSuffix Cutoff for switching to chunked upload (default 200Mi)+ --opendrive-access string Files and folders will be uploaded with this access permission (default private) (default "private")--opendrive-chunk-size SizeSuffix Files will be uploaded in chunks this size (default 10Mi)--opendrive-description string Description of the remote--opendrive-encoding Encoding The encoding for the backend (default Slash,LtGt,DoubleQuote,Colon,Question,Asterisk,Pipe,BackSlash,LeftSpace,LeftCrLfHtVt,RightSpace,RightCrLfHtVt,InvalidUtf8,Dot)@@ -21805,6 +23210,8 @@ Backend-only flags (these can be set in the config file also).--s3-endpoint string Endpoint for S3 API--s3-env-auth Get AWS credentials from runtime (environment variables or EC2/ECS meta data if no env vars)--s3-force-path-style If true use path style access if false use virtual hosted style (default true)+ --s3-ibm-api-key string IBM API Key to be used to obtain IAM token+ --s3-ibm-resource-instance-id string IBM service instance id--s3-leave-parts-on-error If true avoid calling abort upload on a failure, leaving all successfully uploaded parts on S3 for manual recovery--s3-list-chunk int Size of listing chunk (response list for each ListObject S3 request) (default 1000)--s3-list-url-encode Tristate Whether to url encode listings: true/false/unset (default unset)@@ -21825,6 +23232,7 @@ Backend-only flags (these can be set in the config file also).--s3-server-side-encryption string The server-side encryption algorithm used when storing this object in S3--s3-session-token string An AWS session token--s3-shared-credentials-file string Path to the shared credentials file+ --s3-sign-accept-encoding Tristate Set if rclone should include Accept-Encoding as part of the signature (default unset)--s3-sse-customer-algorithm string If using SSE-C, the server-side encryption algorithm used when storing this object in S3--s3-sse-customer-key string To use SSE-C you may provide the secret encryption key used to encrypt/decrypt your data--s3-sse-customer-key-base64 string If using SSE-C you must provide the secret encryption key encoded in base64 format to encrypt/decrypt your data@@ -21841,6 +23249,7 @@ Backend-only flags (these can be set in the config file also).--s3-use-multipart-uploads Tristate Set if rclone should use multipart uploads (default unset)--s3-use-presigned-request Whether to use a presigned request or PutObject for single part uploads--s3-use-unsigned-payload Tristate Whether to use an unsigned payload in PutObject (default unset)+ --s3-use-x-id Tristate Set if rclone should add x-id URL parameters (default unset)--s3-v2-auth If true use v2 authentication--s3-version-at Time Show file versions as they were at the specified time (default off)--s3-version-deleted Show deleted file markers when using versions@@ -21866,6 +23275,7 @@ Backend-only flags (these can be set in the config file also).--sftp-disable-hashcheck Disable the execution of SSH commands to determine if remote file hashing is available--sftp-host string SSH host to connect to--sftp-host-key-algorithms SpaceSepList Space separated list of host key algorithms, ordered by preference+ --sftp-http-proxy string URL for HTTP CONNECT proxy--sftp-idle-timeout Duration Max time before closing idle connections (default 1m0s)--sftp-key-exchange SpaceSepList Space separated list of key exchange algorithms, ordered by preference--sftp-key-file string Path to PEM-encoded private key file@@ -21920,6 +23330,7 @@ Backend-only flags (these can be set in the config file also).--smb-pass string SMB password (obscured)--smb-port int SMB port number (default 445)--smb-spn string Service principal name+ --smb-use-kerberos Use Kerberos authentication--smb-user string SMB username (default "$USER")--storj-access-grant string Access grant--storj-api-key string API key@@ -22062,7 +23473,7 @@ on the host.The _FUSE_ driver is a prerequisite for rclone mounting and should beinstalled on host:```-sudo apt-get -y install fuse+sudo apt-get -y install fuse3```Create two directories required by rclone docker plugin:@@ -23066,7 +24477,7 @@ See the [bisync filters](#filtering) section and generic[--filter-from](https://rclone.org/filtering/#filter-from-read-filtering-patterns-from-a-file)documentation.An [example filters file](#example-filters-file) contains filters for-non-allowed files for synching with Dropbox.+non-allowed files for syncing with Dropbox.If you make changes to your filters file then bisync requires a runwith `--resync`. This is a safety feature, which prevents existing files@@ -23243,7 +24654,7 @@ Using `--check-sync=false` will disable it and may significantly reduce thesync run times for very large numbers of files.The check may be run manually with `--check-sync=only`. It runs only the-integrity check and terminates without actually synching.+integrity check and terminates without actually syncing.Note that currently, `--check-sync` **only checks listing snapshots and NOT theactual files on the remotes.** Note also that the listing snapshots will not@@ -23720,7 +25131,7 @@ The `--include*`, `--exclude*`, and `--filter` flags are also supported.### How to filter directories-Filtering portions of the directory tree is a critical feature for synching.+Filtering portions of the directory tree is a critical feature for syncing.Examples of directory trees (always beneath the Path1/Path2 root level)you may want to exclude from your sync:@@ -23829,7 +25240,7 @@ quashed by adding `--quiet` to the bisync command line.## Example exclude-style filters files for use with Dropbox {#exclude-filters}-- Dropbox disallows synching the listed temporary and configuration/data files.+- Dropbox disallows syncing the listed temporary and configuration/data files.The `- <filename>` filters exclude these files where ever they may occurin the sync tree. Consider adding similar exclusions for file typesyou don't need to sync, such as core dump and software build files.@@ -24163,7 +25574,7 @@ test command flags can be equally prefixed by a single `-` or double dash.- `go test . -case basic -remote local -remote2 local`runs the `test_basic` test case using only the local filesystem,- synching one local directory with another local directory.+ syncing one local directory with another local directory.Test script output is to the console, while commands within scenario.txthave their output sent to the `.../workdir/test.log` file,which is finally compared to the golden copy.@@ -24394,6 +25805,9 @@ about _Unison_ and synchronization in general.## Changelog+### `v1.69.1`+* Fixed an issue causing listings to not capture concurrent modifications under certain conditions+### `v1.68`* Fixed an issue affecting backends that round modtimes to a lower precision.@@ -24956,9 +26370,11 @@ The S3 backend can be used with a number of different providers:- Liara Object Storage- Linode Object Storage- Magalu Object Storage+- MEGA S4 Object Storage- Minio- Outscale- Petabox+- Pure Storage FlashBlade- Qiniu Cloud Object Storage (Kodo)- RackCorp Object Storage- Rclone Serve S3@@ -25680,7 +27096,7 @@ Notes on above:that `USER_NAME` has been created.2. The Resource entry must include both resource ARNs, as one impliesthe bucket and the other implies the bucket's objects.-3. When using [s3-no-check-bucket](#s3-no-check-bucket) and the bucket already exsits, the `"arn:aws:s3:::BUCKET_NAME"` doesn't have to be included.+3. When using [s3-no-check-bucket](#s3-no-check-bucket) and the bucket already exists, the `"arn:aws:s3:::BUCKET_NAME"` doesn't have to be included.For reference, [here's an Ansible script](https://gist.github.com/ebridges/ebfc9042dd7c756cd101cfa807b7ae2b)that will generate one or more buckets that will work with `rclone sync`.@@ -25701,7 +27117,8 @@ tries to access data from the glacier storage class you will see an error like b2017/09/11 19:07:43 Failed to sync: failed to open source object: Object in GLACIER, restore first: path/to/fileIn this case you need to [restore](http://docs.aws.amazon.com/AmazonS3/latest/user-guide/restore-archived-objects.html)-the object(s) in question before using rclone.+the object(s) in question before accessing object contents.+The [restore](#restore) section below shows how to do this with rclone.Note that rclone only speaks the S3 API it does not speak the GlacierVault API, so rclone cannot directly access Glacier Vaults.@@ -25719,7 +27136,7 @@ A simple solution is to set the `--s3-upload-cutoff 0` and force all the files t### Standard options-Here are the Standard options specific to s3 (Amazon S3 Compliant Storage Providers including AWS, Alibaba, ArvanCloud, Ceph, ChinaMobile, Cloudflare, DigitalOcean, Dreamhost, GCS, HuaweiOBS, IBMCOS, IDrive, IONOS, LyveCloud, Leviia, Liara, Linode, Magalu, Minio, Netease, Outscale, Petabox, RackCorp, Rclone, Scaleway, SeaweedFS, Selectel, StackPath, Storj, Synology, TencentCOS, Wasabi, Qiniu and others).+Here are the Standard options specific to s3 (Amazon S3 Compliant Storage Providers including AWS, Alibaba, ArvanCloud, Ceph, ChinaMobile, Cloudflare, DigitalOcean, Dreamhost, Exaba, FlashBlade, GCS, HuaweiOBS, IBMCOS, IDrive, IONOS, LyveCloud, Leviia, Liara, Linode, Magalu, Mega, Minio, Netease, Outscale, Petabox, RackCorp, Rclone, Scaleway, SeaweedFS, Selectel, StackPath, Storj, Synology, TencentCOS, Wasabi, Qiniu and others).#### --s3-provider@@ -25748,6 +27165,10 @@ Properties:- DigitalOcean Spaces- "Dreamhost"- Dreamhost DreamObjects+ - "Exaba"+ - Exaba Object Storage+ - "FlashBlade"+ - Pure Storage FlashBlade Object Storage- "GCS"- Google Cloud Storage- "HuaweiOBS"@@ -25768,6 +27189,8 @@ Properties:- Linode Object Storage- "Magalu"- Magalu Object Storage+ - "Mega"+ - MEGA S4 Object Storage- "Minio"- Minio Object Storage- "Netease"@@ -26037,7 +27460,7 @@ Properties:- Config: acl- Env Var: RCLONE_S3_ACL-- Provider: !Storj,Selectel,Synology,Cloudflare+- Provider: !Storj,Selectel,Synology,Cloudflare,FlashBlade,Mega- Type: string- Required: false- Examples:@@ -26149,9 +27572,33 @@ Properties:- "GLACIER_IR"- Glacier Instant Retrieval storage class+#### --s3-ibm-api-key++IBM API Key to be used to obtain IAM token++Properties:++- Config: ibm_api_key+- Env Var: RCLONE_S3_IBM_API_KEY+- Provider: IBMCOS+- Type: string+- Required: false++#### --s3-ibm-resource-instance-id++IBM service instance id++Properties:++- Config: ibm_resource_instance_id+- Env Var: RCLONE_S3_IBM_RESOURCE_INSTANCE_ID+- Provider: IBMCOS+- Type: string+- Required: false+### Advanced options-Here are the Advanced options specific to s3 (Amazon S3 Compliant Storage Providers including AWS, Alibaba, ArvanCloud, Ceph, ChinaMobile, Cloudflare, DigitalOcean, Dreamhost, GCS, HuaweiOBS, IBMCOS, IDrive, IONOS, LyveCloud, Leviia, Liara, Linode, Magalu, Minio, Netease, Outscale, Petabox, RackCorp, Rclone, Scaleway, SeaweedFS, Selectel, StackPath, Storj, Synology, TencentCOS, Wasabi, Qiniu and others).+Here are the Advanced options specific to s3 (Amazon S3 Compliant Storage Providers including AWS, Alibaba, ArvanCloud, Ceph, ChinaMobile, Cloudflare, DigitalOcean, Dreamhost, Exaba, FlashBlade, GCS, HuaweiOBS, IBMCOS, IDrive, IONOS, LyveCloud, Leviia, Liara, Linode, Magalu, Mega, Minio, Netease, Outscale, Petabox, RackCorp, Rclone, Scaleway, SeaweedFS, Selectel, StackPath, Storj, Synology, TencentCOS, Wasabi, Qiniu and others).#### --s3-bucket-acl@@ -26170,6 +27617,7 @@ Properties:- Config: bucket_acl- Env Var: RCLONE_S3_BUCKET_ACL+- Provider: !Storj,Selectel,Synology,Cloudflare,FlashBlade- Type: string- Required: false- Examples:@@ -26985,6 +28433,46 @@ Properties:- Type: Tristate- Default: unset+#### --s3-use-x-id++Set if rclone should add x-id URL parameters.++You can change this if you want to disable the AWS SDK from+adding x-id URL parameters.++This shouldn't be necessary in normal operation.++This should be automatically set correctly for all providers rclone+knows about - please make a bug report if not.+++Properties:++- Config: use_x_id+- Env Var: RCLONE_S3_USE_X_ID+- Type: Tristate+- Default: unset++#### --s3-sign-accept-encoding++Set if rclone should include Accept-Encoding as part of the signature.++You can change this if you want to stop rclone including+Accept-Encoding as part of the signature.++This shouldn't be necessary in normal operation.++This should be automatically set correctly for all providers rclone+knows about - please make a bug report if not.+++Properties:++- Config: sign_accept_encoding+- Env Var: RCLONE_S3_SIGN_ACCEPT_ENCODING+- Type: Tristate+- Default: unset+#### --s3-directory-bucketSet to use AWS Directory Buckets@@ -27104,7 +28592,7 @@ or from INTELLIGENT-TIERING Archive Access / Deep Archive Access tier to the FreUsage Examples:- rclone backend restore s3:bucket/path/to/object -o priority=PRIORITY -o lifetime=DAYS+ rclone backend restore s3:bucket/path/to/ --include /object -o priority=PRIORITY -o lifetime=DAYSrclone backend restore s3:bucket/path/to/directory -o priority=PRIORITY -o lifetime=DAYSrclone backend restore s3:bucket -o priority=PRIORITY -o lifetime=DAYSrclone backend restore s3:bucket/path/to/directory -o priority=PRIORITY@@ -27888,7 +29376,7 @@ Choose a number from below, or type in your own valuelocation_constraint>1```-9. Specify a canned ACL. IBM Cloud (Storage) supports "public-read" and "private". IBM Cloud(Infra) supports all the canned ACLs. On-Premise COS supports all the canned ACLs.+8. Specify a canned ACL. IBM Cloud (Storage) supports "public-read" and "private". IBM Cloud(Infra) supports all the canned ACLs. On-Premise COS supports all the canned ACLs.```Canned ACL used when creating buckets and/or storing objects in S3.For more info visit https://docs.aws.amazon.com/AmazonS3/latest/dev/acl-overview.html#canned-acl@@ -27904,8 +29392,7 @@ Choose a number from below, or type in your own valueacl> 1```--12. Review the displayed configuration and accept to save the "remote" then quit. The config file should look like this+9. Review the displayed configuration and accept to save the "remote" then quit. The config file should look like this```[xxx]type = s3@@ -27917,7 +29404,7 @@ acl> 1acl = private```-13. Execute rclone commands+10. Execute rclone commands```1) Create a bucket.rclone mkdir IBM-COS-XREGION:newbucket@@ -27936,6 +29423,35 @@ acl> 1rclone delete IBM-COS-XREGION:newbucket/file.txt```+#### IBM IAM authentication+If using IBM IAM authentication with IBM API KEY you need to fill in these additional parameters+1. Select false for env_auth+2. Leave `access_key_id` and `secret_access_key` blank+3. Paste your `ibm_api_key`+```+Option ibm_api_key.+IBM API Key to be used to obtain IAM token+Enter a value of type string. Press Enter for the default (1).+ibm_api_key>+```+4. Paste your `ibm_resource_instance_id`+```+Option ibm_resource_instance_id.+IBM service instance id+Enter a value of type string. Press Enter for the default (2).+ibm_resource_instance_id>+```+5. In advanced settings type true for `v2_auth`+```+Option v2_auth.+If true use v2 authentication.+If this is false (the default) then rclone will use v4 authentication.+If it is set then rclone will use v2 authentication.+Use this only if v4 signatures don't work, e.g. pre Jewel/v10 CEPH.+Enter a boolean value (true or false). Press Enter for the default (true).+v2_auth>+```+### IDrive e2 {#idrive-e2}Here is an example of making an [IDrive e2](https://www.idrive.com/e2/)@@ -28658,7 +30174,7 @@ location_constraint = au-nsw### Rclone Serve S3 {#rclone}Rclone can serve any remote over the S3 protocol. For details see the-[rclone serve s3](https://rclone.org/commands/rclone_serve_http/) documentation.+[rclone serve s3](https://rclone.org/commands/rclone_serve_s3/) documentation.For example, to serve `remote:path` over s3, run the server like this:@@ -28678,8 +30194,8 @@ secret_access_key = SECRET_ACCESS_KEYuse_multipart_uploads = false```-Note that setting `disable_multipart_uploads = true` is to work around-[a bug](https://rclone.org/commands/rclone_serve_http/#bugs) which will be fixed in due course.+Note that setting `use_multipart_uploads = false` is to work around+[a bug](https://rclone.org/commands/rclone_serve_s3/#bugs) which will be fixed in due course.### Scaleway@@ -28795,20 +30311,17 @@ Press Enter to leave empty.region>```-Choose an endpoint from the list+Enter your Lyve Cloud endpoint. This field cannot be kept empty.```-Endpoint for S3 API.+Endpoint for Lyve Cloud S3 API.Required when using an S3 clone.-Choose a number from below, or type in your own value.-Press Enter to leave empty.- 1 / Seagate Lyve Cloud US East 1 (Virginia)- \ (s3.us-east-1.lyvecloud.seagate.com)- 2 / Seagate Lyve Cloud US West 1 (California)- \ (s3.us-west-1.lyvecloud.seagate.com)- 3 / Seagate Lyve Cloud AP Southeast 1 (Singapore)- \ (s3.ap-southeast-1.lyvecloud.seagate.com)-endpoint> 1+Please type in your LyveCloud endpoint.+Examples:+- s3.us-west-1.{account_name}.lyve.seagate.com (US West 1 - California)+- s3.eu-west-1.{account_name}.lyve.seagate.com (US West 1 - Ireland)+Enter a value.+endpoint> s3.us-west-1.global.lyve.seagate.com```Leave location constraint blank@@ -29775,27 +31288,49 @@ Option endpoint.Endpoint for Linode Object Storage API.Choose a number from below, or type in your own value.Press Enter to leave empty.- 1 / Atlanta, GA (USA), us-southeast-1+ 1 / Amsterdam (Netherlands), nl-ams-1+ \ (nl-ams-1.linodeobjects.com)+ 2 / Atlanta, GA (USA), us-southeast-1\ (us-southeast-1.linodeobjects.com)- 2 / Chicago, IL (USA), us-ord-1+ 3 / Chennai (India), in-maa-1+ \ (in-maa-1.linodeobjects.com)+ 4 / Chicago, IL (USA), us-ord-1\ (us-ord-1.linodeobjects.com)- 3 / Frankfurt (Germany), eu-central-1+ 5 / Frankfurt (Germany), eu-central-1\ (eu-central-1.linodeobjects.com)- 4 / Milan (Italy), it-mil-1+ 6 / Jakarta (Indonesia), id-cgk-1+ \ (id-cgk-1.linodeobjects.com)+ 7 / London 2 (Great Britain), gb-lon-1+ \ (gb-lon-1.linodeobjects.com)+ 8 / Los Angeles, CA (USA), us-lax-1+ \ (us-lax-1.linodeobjects.com)+ 9 / Madrid (Spain), es-mad-1+ \ (es-mad-1.linodeobjects.com)+10 / Melbourne (Australia), au-mel-1+ \ (au-mel-1.linodeobjects.com)+11 / Miami, FL (USA), us-mia-1+ \ (us-mia-1.linodeobjects.com)+12 / Milan (Italy), it-mil-1\ (it-mil-1.linodeobjects.com)- 5 / Newark, NJ (USA), us-east-1+13 / Newark, NJ (USA), us-east-1\ (us-east-1.linodeobjects.com)- 6 / Paris (France), fr-par-1+14 / Osaka (Japan), jp-osa-1+ \ (jp-osa-1.linodeobjects.com)+15 / Paris (France), fr-par-1\ (fr-par-1.linodeobjects.com)- 7 / Seattle, WA (USA), us-sea-1+16 / São Paulo (Brazil), br-gru-1+ \ (br-gru-1.linodeobjects.com)+17 / Seattle, WA (USA), us-sea-1\ (us-sea-1.linodeobjects.com)- 8 / Singapore ap-south-1+18 / Singapore, ap-south-1\ (ap-south-1.linodeobjects.com)- 9 / Stockholm (Sweden), se-sto-1+19 / Singapore 2, sg-sin-1+ \ (sg-sin-1.linodeobjects.com)+20 / Stockholm (Sweden), se-sto-1\ (se-sto-1.linodeobjects.com)-10 / Washington, DC, (USA), us-iad-1+21 / Washington, DC, (USA), us-iad-1\ (us-iad-1.linodeobjects.com)-endpoint> 3+endpoint> 5Option acl.Canned ACL used when creating buckets and storing or copying objects.@@ -29960,6 +31495,116 @@ secret_access_key = SECRET_ACCESS_KEYendpoint = br-ne1.magaluobjects.com```+### MEGA S4 {#mega}++[MEGA S4 Object Storage](https://mega.io/objectstorage) is an S3+compatible object storage system. It has a single pricing tier with no+additional charges for data transfers or API requests and it is+included in existing Pro plans.++Here is an example of making a configuration. First run:++ rclone config++This will guide you through an interactive setup process.++```+No remotes found, make a new one?+n) New remote+s) Set configuration password+q) Quit config+n/s/q> n++Enter name for new remote.+name> megas4++Option Storage.+Type of storage to configure.+Choose a number from below, or type in your own value.+[snip]+XX / Amazon S3 Compliant Storage Providers including AWS,... Mega, ...+ \ (s3)+[snip]+Storage> s3++Option provider.+Choose your S3 provider.+Choose a number from below, or type in your own value.+Press Enter to leave empty.+[snip]+XX / MEGA S4 Object Storage+ \ (Mega)+[snip]+provider> Mega++Option env_auth.+Get AWS credentials from runtime (environment variables or EC2/ECS meta data if no env vars).+Only applies if access_key_id and secret_access_key is blank.+Choose a number from below, or type in your own boolean value (true or false).+Press Enter for the default (false).+ 1 / Enter AWS credentials in the next step.+ \ (false)+ 2 / Get AWS credentials from the environment (env vars or IAM).+ \ (true)+env_auth>++Option access_key_id.+AWS Access Key ID.+Leave blank for anonymous access or runtime credentials.+Enter a value. Press Enter to leave empty.+access_key_id> XXX++Option secret_access_key.+AWS Secret Access Key (password).+Leave blank for anonymous access or runtime credentials.+Enter a value. Press Enter to leave empty.+secret_access_key> XXX++Option endpoint.+Endpoint for S3 API.+Required when using an S3 clone.+Choose a number from below, or type in your own value.+Press Enter to leave empty.+ 1 / Mega S4 eu-central-1 (Amsterdam)+ \ (s3.eu-central-1.s4.mega.io)+ 2 / Mega S4 eu-central-2 (Bettembourg)+ \ (s3.eu-central-2.s4.mega.io)+ 3 / Mega S4 ca-central-1 (Montreal)+ \ (s3.ca-central-1.s4.mega.io)+ 4 / Mega S4 ca-west-1 (Vancouver)+ \ (s3.ca-west-1.s4.mega.io)+endpoint> 1++Edit advanced config?+y) Yes+n) No (default)+y/n> n++Configuration complete.+Options:+- type: s3+- provider: Mega+- access_key_id: XXX+- secret_access_key: XXX+- endpoint: s3.eu-central-1.s4.mega.io+Keep this "megas4" remote?+y) Yes this is OK (default)+e) Edit this remote+d) Delete this remote+y/e/d> y+```++This will leave the config file looking like this.++```+[megas4]+type = s3+provider = Mega+access_key_id = XXX+secret_access_key = XXX+endpoint = s3.eu-central-1.s4.mega.io+```+### ArvanCloud {#arvan-cloud}[ArvanCloud](https://www.arvancloud.com/en/products/cloud-storage) ArvanCloud Object Storage goes beyond the limited traditional file storage.@@ -30361,6 +32006,119 @@ region = us-east-1endpoint = s3.petabox.io```+### Pure Storage FlashBlade++[Pure Storage FlashBlade](https://www.purestorage.com/products/unstructured-data-storage.html) is a high performance S3-compatible object store.++FlashBlade supports most modern S3 features including:++- ListObjectsV2+- Multipart uploads with AWS-compatible ETags+- Advanced checksum algorithms (SHA256, CRC32, CRC32C) with trailer support (Purity//FB 4.4.2+)+- Object versioning and lifecycle management+- Virtual hosted-style requests (requires DNS configuration)++To configure rclone for Pure Storage FlashBlade:++First run:++ rclone config++This will guide you through an interactive setup process:++```+No remotes found, make a new one?+n) New remote+s) Set configuration password+q) Quit config+n/s/q> n++Enter name for new remote.+name> flashblade++Option Storage.+Type of storage to configure.+Choose a number from below, or type in your own value.+[snip]+ 4 / Amazon S3 Compliant Storage Providers including AWS, Alibaba, ArvanCloud, Ceph, ChinaMobile, Cloudflare, DigitalOcean, Dreamhost, FlashBlade, GCS, HuaweiOBS, IBMCOS, IDrive, IONOS, LyveCloud, Leviia, Liara, Linode, Magalu, Minio, Netease, Outscale, Petabox, RackCorp, Rclone, Scaleway, SeaweedFS, Selectel, StackPath, Storj, Synology, TencentCOS, Wasabi, Qiniu and others+ \ (s3)+[snip]+Storage> s3++Option provider.+Choose your S3 provider.+Choose a number from below, or type in your own value.+Press Enter to leave empty.+[snip]+ 9 / Pure Storage FlashBlade Object Storage+ \ (FlashBlade)+[snip]+provider> FlashBlade++Option env_auth.+Get AWS credentials from runtime (environment variables or EC2/ECS meta data if no env vars).+Only applies if access_key_id and secret_access_key is blank.+Choose a number from below, or type in your own boolean value (true or false).+Press Enter for the default (false).+ 1 / Enter AWS credentials in the next step.+ \ (false)+ 2 / Get AWS credentials from the environment (env vars or IAM).+ \ (true)+env_auth> 1++Option access_key_id.+AWS Access Key ID.+Leave blank for anonymous access or runtime credentials.+Enter a value. Press Enter to leave empty.+access_key_id> ACCESS_KEY_ID++Option secret_access_key.+AWS Secret Access Key (password).+Leave blank for anonymous access or runtime credentials.+Enter a value. Press Enter to leave empty.+secret_access_key> SECRET_ACCESS_KEY++Option endpoint.+Endpoint for S3 API.+Required when using an S3 clone.+Enter a value. Press Enter to leave empty.+endpoint> https://s3.flashblade.example.com++Edit advanced config?+y) Yes+n) No (default)+y/n> n++Configuration complete.+Options:+- type: s3+- provider: FlashBlade+- access_key_id: ACCESS_KEY_ID+- secret_access_key: SECRET_ACCESS_KEY+- endpoint: https://s3.flashblade.example.com+Keep this "flashblade" remote?+y) Yes this is OK (default)+e) Edit this remote+d) Delete this remote+y/e/d> y+```++This results in the following configuration being stored in `~/.config/rclone/rclone.conf`:++```+[flashblade]+type = s3+provider = FlashBlade+access_key_id = ACCESS_KEY_ID+secret_access_key = SECRET_ACCESS_KEY+endpoint = https://s3.flashblade.example.com+```++Note: The FlashBlade endpoint should be the S3 data VIP. For virtual-hosted style requests,+ensure proper DNS configuration: subdomains of the endpoint hostname should resolve to a+FlashBlade data VIP. For example, if your endpoint is `https://s3.flashblade.example.com`,+then `bucket-name.s3.flashblade.example.com` should also resolve to the data VIP.+### StorjStorj is a decentralized cloud storage which can be used through its@@ -30430,7 +32188,7 @@ source).This has the following consequences:-- Using `rclone rcat` will fail as the medatada doesn't match after upload+- Using `rclone rcat` will fail as the metadata doesn't match after upload- Uploading files with `rclone mount` will fail for the same reason- This can worked around by using `--vfs-cache-mode writes` or `--vfs-cache-mode full` or setting `--s3-upload-cutoff` large- Files uploaded via a multipart upload won't have their modtimes@@ -31488,7 +33246,7 @@ machine with no Internet browser available.Note that rclone runs a webserver on your local machine to collect thetoken as returned from Box. This only runs from the moment it opensyour browser to the moment you get back the verification code. This-is on `http://127.0.0.1:53682/` and this it may require you to unblock+is on `http://127.0.0.1:53682/` and this may require you to unblockit temporarily if you are running a host firewall.Once configured you can then use `rclone` like this,@@ -33327,6 +35085,28 @@ Properties:- Type: Duration- Default: 0s+#### --cloudinary-adjust-media-files-extensions++Cloudinary handles media formats as a file attribute and strips it from the name, which is unlike most other file systems++Properties:++- Config: adjust_media_files_extensions+- Env Var: RCLONE_CLOUDINARY_ADJUST_MEDIA_FILES_EXTENSIONS+- Type: bool+- Default: true++#### --cloudinary-media-extensions++Cloudinary supported media extensions++Properties:++- Config: media_extensions+- Env Var: RCLONE_CLOUDINARY_MEDIA_EXTENSIONS+- Type: stringArray+- Default: [3ds 3g2 3gp ai arw avi avif bmp bw cr2 cr3 djvu dng eps3 fbx flif flv gif glb gltf hdp heic heif ico indd jp2 jpe jpeg jpg jxl jxr m2ts mov mp4 mpeg mts mxf obj ogv pdf ply png psd svg tga tif tiff ts u3ma usdz wdp webm webp wmv]+#### --cloudinary-descriptionDescription of the remote.@@ -34415,7 +36195,7 @@ strong random number generator. The nonce is incremented for eachchunk read making sure each nonce is unique for each block written.The chance of a nonce being reused is minuscule. If you wrote anexabyte of data (10¹⁸ bytes) you would have a probability of-approximately 2×10⁻³² of re-using a nonce.+approximately 2×10⁻³² of reusing a nonce.#### Chunk@@ -34847,6 +36627,188 @@ See the [metadata](https://rclone.org/docs/#metadata) docs for more info.+# DOI++The DOI remote is a read only remote for reading files from digital object identifiers (DOI).++Currently, the DOI backend supports supports DOIs hosted with:+- [InvenioRDM](https://inveniosoftware.org/products/rdm/)+ - [Zenodo](https://zenodo.org)+ - [CaltechDATA](https://data.caltech.edu)+ - [Other InvenioRDM repositories](https://inveniosoftware.org/showcase/)+- [Dataverse](https://dataverse.org)+ - [Harvard Dataverse](https://dataverse.harvard.edu)+ - [Other Dataverse repositories](https://dataverse.org/installations)++Paths are specified as `remote:path`++Paths may be as deep as required, e.g. `remote:directory/subdirectory`.++## Configuration++Here is an example of how to make a remote called `remote`. First run:++ rclone config++This will guide you through an interactive setup process:++```+No remotes found, make a new one?+n) New remote+s) Set configuration password+q) Quit config+n/s/q> n+Enter name for new remote.+name> remote+Type of storage to configure.+Choose a number from below, or type in your own value+[snip]+XX / DOI datasets+ \ (doi)+[snip]+Storage> doi+Option doi.+The DOI or the doi.org URL.+Enter a value.+doi> 10.5281/zenodo.5876941+Edit advanced config?+y) Yes+n) No (default)+y/n> n+Configuration complete.+Options:+- type: doi+- doi: 10.5281/zenodo.5876941+Keep this "remote" remote?+y) Yes this is OK (default)+e) Edit this remote+d) Delete this remote+y/e/d> y+```+++### Standard options++Here are the Standard options specific to doi (DOI datasets).++#### --doi-doi++The DOI or the doi.org URL.++Properties:++- Config: doi+- Env Var: RCLONE_DOI_DOI+- Type: string+- Required: true++### Advanced options++Here are the Advanced options specific to doi (DOI datasets).++#### --doi-provider++DOI provider.++The DOI provider can be set when rclone does not automatically recognize a supported DOI provider.++Properties:++- Config: provider+- Env Var: RCLONE_DOI_PROVIDER+- Type: string+- Required: false+- Examples:+ - "auto"+ - Auto-detect provider+ - "zenodo"+ - Zenodo+ - "dataverse"+ - Dataverse+ - "invenio"+ - Invenio++#### --doi-doi-resolver-api-url++The URL of the DOI resolver API to use.++The DOI resolver can be set for testing or for cases when the the canonical DOI resolver API cannot be used.++Defaults to "https://doi.org/api".++Properties:++- Config: doi_resolver_api_url+- Env Var: RCLONE_DOI_DOI_RESOLVER_API_URL+- Type: string+- Required: false++#### --doi-description++Description of the remote.++Properties:++- Config: description+- Env Var: RCLONE_DOI_DESCRIPTION+- Type: string+- Required: false++## Backend commands++Here are the commands specific to the doi backend.++Run them with++ rclone backend COMMAND remote:++The help below will explain what arguments each command takes.++See the [backend](https://rclone.org/commands/rclone_backend/) command for more+info on how to pass options and arguments.++These can be run on a running backend using the rc command+[backend/command](https://rclone.org/rc/#backend-command).++### metadata++Show metadata about the DOI.++ rclone backend metadata remote: [options] [<arguments>+]++This command returns a JSON object with some information about the DOI.++ rclone backend medatadata doi:++It returns a JSON object representing metadata about the DOI.+++### set++Set command for updating the config parameters.++ rclone backend set remote: [options] [<arguments>+]++This set command can be used to update the config parameters+for a running doi backend.++Usage Examples:++ rclone backend set doi: [-o opt_name=opt_value] [-o opt_name2=opt_value2]+ rclone rc backend/command command=set fs=doi: [-o opt_name=opt_value] [-o opt_name2=opt_value2]+ rclone rc backend/command command=set fs=doi: -o doi=NEW_DOI++The option keys are named as they are in the config file.++This rebuilds the connection to the doi backend when it is called with+the new parameters. Only new parameters need be passed as the values+will default to those currently in use.++It doesn't return anything.++++# DropboxPaths are specified as `remote:path`@@ -35033,6 +36995,42 @@ with `--dropbox-batch-mode async` then do a final transfer withNote that there may be a pause when quitting rclone while rclonefinishes up the last batch using this mode.+### Exporting files++Certain files in Dropbox are "exportable", such as Dropbox Paper+documents. These files need to be converted to another format in+order to be downloaded. Often multiple formats are available for+conversion.++When rclone downloads a exportable file, it chooses the format to+download based on the `--dropbox-export-formats` setting. By+default, the export formats are `html,md`, which are sensible+defaults for Dropbox Paper.++Rclone chooses the first format ID in the export formats list that+Dropbox supports for a given file. If no format in the list is+usable, rclone will choose the default format that Dropbox suggests.++Rclone will change the extension to correspond to the export format.+Here are some examples of how extensions are mapped:++| File type | Filename in Dropbox | Filename in rclone |+|----------------|---------------------|--------------------|+| Paper | mydoc.paper | mydoc.html |+| Paper template | mydoc.papert | mydoc.papert.html |+| other | mydoc | mydoc.html |++_Importing_ exportable files is not yet supported by rclone.++Here are the supported export extensions known by rclone. Note that+rclone does not currently support other formats not on this list,+even if Dropbox supports them. Also, Dropbox could change the list+of supported formats at any time.++| Format ID | Name | Description |+|-----------|----------|----------------------|+| html | HTML | HTML document |+| md | Markdown | Markdown text format |### Standard options@@ -35238,6 +37236,56 @@ Properties:- Type: string- Required: false+#### --dropbox-export-formats++Comma separated list of preferred formats for exporting files++Certain Dropbox files can only be accessed by exporting them to another format.+These include Dropbox Paper documents.++For each such file, rclone will choose the first format on this list that Dropbox+considers valid. If none is valid, it will choose Dropbox's default format.++Known formats include: "html", "md" (markdown)++Properties:++- Config: export_formats+- Env Var: RCLONE_DROPBOX_EXPORT_FORMATS+- Type: CommaSepList+- Default: html,md++#### --dropbox-skip-exports++Skip exportable files in all listings.++If given, exportable files practically become invisible to rclone.++Properties:++- Config: skip_exports+- Env Var: RCLONE_DROPBOX_SKIP_EXPORTS+- Type: bool+- Default: false++#### --dropbox-show-all-exports++Show all exportable files in listings.++Adding this flag will allow all exportable files to be server side copied.+Note that rclone doesn't add extensions to the exportable file names in this mode.++Do **not** use this flag when trying to download exportable files - rclone+will fail to download them.+++Properties:++- Config: show_all_exports+- Env Var: RCLONE_DROPBOX_SHOW_ALL_EXPORTS+- Type: bool+- Default: false+#### --dropbox-batch-modeUpload file batching sync|async|off.@@ -35315,7 +37363,7 @@ Properties:#### --dropbox-batch-commit-timeout-Max time to wait for a batch to finish committing+Max time to wait for a batch to finish committing. (no longer used)Properties:@@ -35365,6 +37413,11 @@ non-personal account otherwise the visibility may not be correct.[forum discussion](https://forum.rclone.org/t/rclone-link-dropbox-permissions/23211) and the[dropbox SDK issue](https://github.com/dropbox/dropbox-sdk-go-unofficial/issues/75).+Modification times for Dropbox Paper documents are not exact, and+may not change for some period after the document is edited.+To make sure you get recent changes in a sync, either wait an hour+or so, or use `--ignore-times` to force a full sync.+## Get your own Dropbox App IDWhen you use rclone with Dropbox in its default configuration you are using rclone's App ID. This is shared between all the rclone users.@@ -35671,6 +37724,225 @@ Properties:+# FileLu++[FileLu](https://filelu.com/) is a reliable cloud storage provider+offering features like secure file uploads, downloads, flexible+storage options, and sharing capabilities. With support for high+storage limits and seamless integration with rclone, FileLu makes+managing files in the cloud easy. Its cross-platform file backup+services let you upload and back up files from any internet-connected+device.++## Configuration++Here is an example of how to make a remote called `filelu`. First, run:++ rclone config++This will guide you through an interactive setup process:++```+No remotes found, make a new one?+n) New remote+s) Set configuration password+q) Quit config+n/s/q> n+name> filelu+Type of storage to configure.+Choose a number from below, or type in your own value+[snip]+xx / FileLu Cloud Storage+ \ "filelu"+[snip]+Storage> filelu+Enter your FileLu Rclone Key:+key> YOUR_FILELU_RCLONE_KEY RC_xxxxxxxxxxxxxxxxxxxxxxxx+Configuration complete.++Keep this "filelu" remote?+y) Yes this is OK+e) Edit this remote+d) Delete this remote+y/e/d> y+```++### Paths++A path without an initial `/` will operate in the `Rclone` directory.++A path with an initial `/` will operate at the root where you can see+the `Rclone` directory.++```+$ rclone lsf TestFileLu:/+CCTV/+Camera/+Documents/+Music/+Photos/+Rclone/+Vault/+Videos/+```++### Example Commands++Create a new folder named `foldername` in the `Rclone` directory:++ rclone mkdir filelu:foldername++Delete a folder on FileLu:++ rclone rmdir filelu:/folder/path/++Delete a file on FileLu:++ rclone delete filelu:/hello.txt++List files from your FileLu account:++ rclone ls filelu:++List all folders:++ rclone lsd filelu:++Copy a specific file to the FileLu root:++ rclone copy D:\\hello.txt filelu:++Copy files from a local directory to a FileLu directory:++ rclone copy D:/local-folder filelu:/remote-folder/path/++Download a file from FileLu into a local directory:++ rclone copy filelu:/file-path/hello.txt D:/local-folder++Move files from a local directory to a FileLu directory:++ rclone move D:\\local-folder filelu:/remote-path/++Sync files from a local directory to a FileLu directory:++ rclone sync --interactive D:/local-folder filelu:/remote-path/++Mount remote to local Linux:++ rclone mount filelu: /root/mnt --vfs-cache-mode full++Mount remote to local Windows:++ rclone mount filelu: D:/local_mnt --vfs-cache-mode full++Get storage info about the FileLu account:++ rclone about filelu:++All the other rclone commands are supported by this backend.++### FolderID instead of folder path++We use the FolderID instead of the folder name to prevent errors when+users have identical folder names or paths. For example, if a user has+two or three folders named "test_folders," the system may become+confused and won't know which folder to move. In large storage+systems, some clients have hundred of thousands of folders and a few+millions of files, duplicate folder names or paths are quite common.++### Modification Times and Hashes++FileLu supports both modification times and MD5 hashes.++FileLu only supports filenames and folder names up to 255 characters in length, where a+character is a Unicode character.++### Duplicated Files++When uploading and syncing via Rclone, FileLu does not allow uploading+duplicate files within the same directory. However, you can upload+duplicate files, provided they are in different directories (folders).++### Failure to Log / Invalid Credentials or KEY++Ensure that you have the correct Rclone key, which can be found in [My+Account](https://filelu.com/account/). Every time you toggle Rclone+OFF and ON in My Account, a new RC_xxxxxxxxxxxxxxxxxxxx key is+generated. Be sure to update your Rclone configuration with the new+key.++If you are connecting to your FileLu remote for the first time and+encounter an error such as:++```+Failed to create file system for "my-filelu-remote:": couldn't login: Invalid credentials+```++Ensure your Rclone Key is correct.++### Process `killed`++Accounts with large files or extensive metadata may experience+significant memory usage during list/sync operations. Ensure the+system running `rclone` has sufficient memory and CPU to handle these+operations.+++### Standard options++Here are the Standard options specific to filelu (FileLu Cloud Storage).++#### --filelu-key++Your FileLu Rclone key from My Account++Properties:++- Config: key+- Env Var: RCLONE_FILELU_KEY+- Type: string+- Required: true++### Advanced options++Here are the Advanced options specific to filelu (FileLu Cloud Storage).++#### --filelu-encoding++The encoding for the backend.++See the [encoding section in the overview](https://rclone.org/overview/#encoding) for more info.++Properties:++- Config: encoding+- Env Var: RCLONE_FILELU_ENCODING+- Type: Encoding+- Default: Slash,LtGt,DoubleQuote,SingleQuote,BackQuote,Dollar,Colon,Question,Asterisk,Pipe,Hash,Percent,BackSlash,CrLf,Del,Ctl,LeftSpace,LeftPeriod,LeftTilde,LeftCrLfHtVt,RightSpace,RightPeriod,RightCrLfHtVt,InvalidUtf8,Dot,SquareBracket,Semicolon,Exclamation++#### --filelu-description++Description of the remote.++Properties:++- Config: description+- Env Var: RCLONE_FILELU_DESCRIPTION+- Type: string+- Required: false++++## Limitations++This backend uses a custom library implementing the FileLu API. While+it supports file transfers, some advanced features may not yet be+available. Please report any issues to the [rclone forum](https://forum.rclone.org/)+for troubleshooting and updates.++For further information, visit [FileLu's website](https://filelu.com/).+# Files.com[Files.com](https://www.files.com/) is a cloud storage service that provides a@@ -39074,6 +41346,32 @@ attempted if possible.Use the --interactive/-i or --dry-run flag to see what would be copied before copying.+### moveid++Move files by ID++ rclone backend moveid remote: [options] [<arguments>+]++This command moves files by ID++Usage:++ rclone backend moveid drive: ID path+ rclone backend moveid drive: ID1 path1 ID2 path2++It moves the drive file with ID given to the path (an rclone path which+will be passed internally to rclone moveto).++The path should end with a / to indicate move the file as named to+this directory. If it doesn't end with a / then the last path+component will be used as the file name.++If the destination is a drive backend then server-side moving will be+attempted if possible.++Use the --interactive/-i or --dry-run flag to see what would be moved beforehand.++### exportformatsDump the export formats for debug purposes@@ -39331,6 +41629,11 @@ Google Photos.limitations, so please read the [limitations section](#limitations)carefully to make sure it is suitable for your use.+**NB** From March 31, 2025 rclone can only download photos it+uploaded. This limitation is due to policy changes at Google. You may+need to run `rclone config reconnect remote:` to make rclone work+again after upgrading to rclone v1.70.+## ConfigurationThe initial setup for google cloud storage involves getting a token from Google Photos@@ -39701,7 +42004,7 @@ Use the gphotosdl proxy for downloading the full resolution imagesThe Google API will deliver images and video which aren't fullresolution, and/or have EXIF data missing.-However if you ue the gphotosdl proxy tnen you can download original,+However if you use the gphotosdl proxy then you can download original,unchanged images.This runs a headless browser in the background.@@ -39816,7 +42119,7 @@ Properties:#### --gphotos-batch-commit-timeout-Max time to wait for a batch to finish committing+Max time to wait for a batch to finish committing. (no longer used)Properties:@@ -39845,6 +42148,11 @@ videos or images or formats that Google Photos doesn't understand,rclone will upload the file, then Google Photos will give an errorwhen it is put turned into a media item.+**NB** From March 31, 2025 rclone can only download photos it+uploaded. This limitation is due to policy changes at Google. You may+need to run `rclone config reconnect remote:` to make rclone work+again after upgrading to rclone v1.70.+Note that all media items uploaded to Google Photos through the APIare stored in full resolution at "original quality" and **will** counttowards your storage quota in your Google Account. The API does@@ -41561,7 +43869,7 @@ Enter a value.config_2fa> 2FACODERemote config---------------------[koofr]+[iclouddrive]- type: iclouddrive- apple_id: APPLEID- password: *** ENCRYPTED ***@@ -41578,6 +43886,20 @@ y/e/d> yADP is currently unsupported and need to be disabled+On iPhone, Settings `>` Apple Account `>` iCloud `>` 'Access iCloud Data on the Web' must be ON, and 'Advanced Data Protection' OFF.++## Troubleshooting++### Missing PCS cookies from the request++This means you have Advanced Data Protection (ADP) turned on. This is not supported at the moment. If you want to use rclone you will have to turn it off. See above for how to turn it off.++You will need to clear the `cookies` and the `trust_token` fields in the config. Or you can delete the remote config and start again.++You should then run `rclone reconnect remote:`.++Note that changing the ADP setting may not take effect immediately - you may need to wait a few hours or a day before you can get rclone to work - keep clearing the config entry and running `rclone reconnect remote:` until rclone functions properly.+### Standard options@@ -41858,6 +44180,19 @@ Properties:- Type: string- Required: false+#### --internetarchive-item-derive++Whether to trigger derive on the IA item or not. If set to false, the item will not be derived by IA upon upload.+The derive process produces a number of secondary files from an upload to make an upload more usable on the web.+Setting this to false is useful for uploading files that are already in a format that IA can display or reduce burden on IA's infrastructure.++Properties:++- Config: item_derive+- Env Var: RCLONE_INTERNETARCHIVE_ITEM_DERIVE+- Type: bool+- Default: true+### Advanced optionsHere are the Advanced options specific to internetarchive (Internet Archive).@@ -41888,6 +44223,18 @@ Properties:- Type: string- Default: "https://archive.org"+#### --internetarchive-item-metadata++Metadata to be set on the IA item, this is different from file-level metadata that can be set using --metadata-set.+Format is key=value and the 'x-archive-meta-' prefix is automatically added.++Properties:++- Config: item_metadata+- Env Var: RCLONE_INTERNETARCHIVE_ITEM_METADATA+- Type: stringArray+- Default: []+#### --internetarchive-disable-checksumDon't ask the server to test against MD5 checksum calculated by rclone.@@ -42961,6 +45308,7 @@ give an error like `oauth2: server response missing access_token`.- Go to Security / "Пароль и безопасность"- Click password for apps / "Пароли для внешних приложений"- Add the password - give it a name - eg "rclone"+- Select the permissions level. For some reason just "Full access to Cloud" (WebDav) doesn't work for Rclone currently. You have to select "Full access to Mail, Cloud and Calendar" (all protocols). ([thread on forum.rclone.org](https://forum.rclone.org/t/failed-to-create-file-system-for-mailru-failed-to-authorize-oauth2-invalid-username-or-password-username-or-password-is-incorrect/49298))- Copy the password and use this password below - your normal login password won't work.Now run@@ -44756,6 +47104,65 @@ Properties:- Type: int- Default: 16+#### --azureblob-copy-cutoff++Cutoff for switching to multipart copy.++Any files larger than this that need to be server-side copied will be+copied in chunks of chunk_size using the put block list API.++Files smaller than this limit will be copied with the Copy Blob API.++Properties:++- Config: copy_cutoff+- Env Var: RCLONE_AZUREBLOB_COPY_CUTOFF+- Type: SizeSuffix+- Default: 8Mi++#### --azureblob-copy-concurrency++Concurrency for multipart copy.++This is the number of chunks of the same file that are copied+concurrently.++These chunks are not buffered in memory and Microsoft recommends+setting this value to greater than 1000 in the azcopy documentation.++https://learn.microsoft.com/en-us/azure/storage/common/storage-use-azcopy-optimize#increase-concurrency++In tests, copy speed increases almost linearly with copy+concurrency.++Properties:++- Config: copy_concurrency+- Env Var: RCLONE_AZUREBLOB_COPY_CONCURRENCY+- Type: int+- Default: 512++#### --azureblob-use-copy-blob++Whether to use the Copy Blob API when copying to the same storage account.++If true (the default) then rclone will use the Copy Blob API for+copies to the same storage account even when the size is above the+copy_cutoff.++Rclone assumes that the same storage account means the same config+and does not check for the same storage account in different configs.++There should be no need to change this value.+++Properties:++- Config: use_copy_blob+- Env Var: RCLONE_AZUREBLOB_USE_COPY_BLOB+- Type: bool+- Default: true+#### --azureblob-list-chunkSize of blob list.@@ -44975,8 +47382,9 @@ You can set custom upload headers with the `--header-upload` flag.- Content-Encoding- Content-Language- Content-Type+- X-MS-Tags-Eg `--header-upload "Content-Type: text/potato"`+Eg `--header-upload "Content-Type: text/potato"` or `--header-upload "X-MS-Tags: foo=bar"`## Limitations@@ -45209,6 +47617,13 @@ If the resource has multiple user-assigned identities you will need tounset `env_auth` and set `use_msi` instead. See the [`use_msi`section](#use_msi).+If you are operating in disconnected clouds, or private clouds such as+Azure Stack you may want to set `disable_instance_discovery = true`.+This determines whether rclone requests Microsoft Entra instance+metadata from `https://login.microsoft.com/` before authenticating.+Setting this to `true` will skip this request, making you responsible+for ensuring the configured authority is valid and trustworthy.+##### Env Auth: 3. Azure CLI credentials (as used by the az tool)Credentials created with the `az` tool can be picked up using `env_auth`.@@ -45291,6 +47706,13 @@ be explicitly specified using exactly one of the `msi_object_id`,If none of `msi_object_id`, `msi_client_id`, or `msi_mi_res_id` isset, this is is equivalent to using `env_auth`.++#### Azure CLI tool `az` {#use_az}+Set to use the [Azure CLI tool `az`](https://learn.microsoft.com/en-us/cli/azure/)+as the sole means of authentication.+Setting this can be useful if you wish to use the `az` CLI on a host with+a System Managed Identity that you do not want to use.+Don't set `env_auth` at the same time.### Standard options@@ -45604,6 +48026,42 @@ Properties:- Type: string- Required: false+#### --azurefiles-disable-instance-discovery++Skip requesting Microsoft Entra instance metadata+This should be set true only by applications authenticating in+disconnected clouds, or private clouds such as Azure Stack.+It determines whether rclone requests Microsoft Entra instance+metadata from `https://login.microsoft.com/` before+authenticating.+Setting this to true will skip this request, making you responsible+for ensuring the configured authority is valid and trustworthy.+++Properties:++- Config: disable_instance_discovery+- Env Var: RCLONE_AZUREFILES_DISABLE_INSTANCE_DISCOVERY+- Type: bool+- Default: false++#### --azurefiles-use-az++Use Azure CLI tool az for authentication+Set to use the [Azure CLI tool az](https://learn.microsoft.com/en-us/cli/azure/)+as the sole means of authentication.+Setting this can be useful if you wish to use the az CLI on a host with+a System Managed Identity that you do not want to use.+Don't set env_auth at the same time.+++Properties:++- Config: use_az+- Env Var: RCLONE_AZUREFILES_USE_AZ+- Type: bool+- Default: false+#### --azurefiles-endpointEndpoint for the service.@@ -46035,7 +48493,7 @@ Properties:- "us"- Microsoft Cloud for US Government- "de"- - Microsoft Cloud Germany+ - Microsoft Cloud Germany (deprecated - try global region first).- "cn"- Azure and Office 365 operated by Vnet Group in China@@ -46108,6 +48566,27 @@ Properties:- Type: bool- Default: false+#### --onedrive-upload-cutoff++Cutoff for switching to chunked upload.++Any files larger than this will be uploaded in chunks of chunk_size.++This is disabled by default as uploading using single part uploads+causes rclone to use twice the storage on Onedrive business as when+rclone sets the modification time after the upload Onedrive creates a+new version.++See: https://github.com/rclone/rclone/issues/1716+++Properties:++- Config: upload_cutoff+- Env Var: RCLONE_ONEDRIVE_UPLOAD_CUTOFF+- Type: SizeSuffix+- Default: off+#### --onedrive-chunk-sizeChunk size to upload files with - must be multiple of 320k (327,680 bytes).@@ -46652,6 +49131,28 @@ See the [metadata](https://rclone.org/docs/#metadata) docs for more info.+### Impersonate other users as Admin++Unlike Google Drive and impersonating any domain user via service accounts, OneDrive requires you to authenticate as an admin account, and manually setup a remote per user you wish to impersonate.++1. In [Microsoft 365 Admin Center](https://admin.microsoft.com), open each user you need to "impersonate" and go to the OneDrive section. There is a heading called "Get access to files", you need to click to create the link, this creates the link of the format `https://{tenant}-my.sharepoint.com/personal/{user_name_domain_tld}/` but also changes the permissions so you your admin user has access.+2. Then in powershell run the following commands:+```console+Install-Module Microsoft.Graph -Scope CurrentUser -Repository PSGallery -Force+Import-Module Microsoft.Graph.Files+Connect-MgGraph -Scopes "Files.ReadWrite.All"+# Follow the steps to allow access to your admin user+# Then run this for each user you want to impersonate to get the Drive ID+Get-MgUserDefaultDrive -UserId '{emailaddress}'+# This will give you output of the format:+# Name Id DriveType CreatedDateTime+# ---- -- --------- ---------------+# OneDrive b!XYZ123 business 14/10/2023 1:00:58 pm++```+3. Then in rclone add a onedrive remote type, and use the `Type in driveID` with the DriveID you got in the previous step. One remote per user. It will then confirm the drive ID, and hopefully give you a message of `Found drive "root" of type "business"` and then include the URL of the format `https://{tenant}-my.sharepoint.com/personal/{user_name_domain_tld}/Documents`++## LimitationsIf you don't use rclone for 90 days the refresh token will@@ -47040,6 +49541,24 @@ Properties:- Type: SizeSuffix- Default: 10Mi+#### --opendrive-access++Files and folders will be uploaded with this access permission (default private)++Properties:++- Config: access+- Env Var: RCLONE_OPENDRIVE_ACCESS+- Type: string+- Default: "private"+- Examples:+ - "private"+ - The file or folder access can be granted in a way that will allow select users to view, read or write what is absolutely essential for them.+ - "public"+ - The file or folder can be downloaded by anyone from a web browser. The link can be shared in any way,+ - "hidden"+ - The file or folder can be accessed has the same restrictions as Public if the user knows the URL of the file or folder link in order to access the contents+#### --opendrive-descriptionDescription of the remote.@@ -52930,6 +55449,20 @@ Properties:- Type: string- Required: false+#### --sftp-http-proxy++URL for HTTP CONNECT proxy++Set this to a URL for an HTTP proxy which supports the HTTP CONNECT verb.+++Properties:++- Config: http_proxy+- Env Var: RCLONE_SFTP_HTTP_PROXY+- Type: string+- Required: false+#### --sftp-copy-is-hardlinkSet to enable server side copies using hardlinks.@@ -52973,7 +55506,8 @@ Properties:On some SFTP servers (e.g. Synology) the paths are differentfor SSH and SFTP so the hashes can't be calculated properly.-For them using `disable_hashcheck` is a good idea.+You can either use [`--sftp-path-override`](#--sftp-path-override)+or [`disable_hashcheck`](#--sftp-disable-hashcheck).The only ssh agent supported under Windows is Putty's pageant.@@ -53190,6 +55724,23 @@ Properties:- Type: string- Required: false+#### --smb-use-kerberos++Use Kerberos authentication.++If set, rclone will use Kerberos authentication instead of NTLM. This+requires a valid Kerberos configuration and credentials cache to be+available, either in the default locations or as specified by the+KRB5_CONFIG and KRB5CCNAME environment variables.+++Properties:++- Config: use_kerberos+- Env Var: RCLONE_SMB_USE_KERBEROS+- Type: bool+- Default: false+### Advanced optionsHere are the Advanced options specific to smb (SMB / CIFS).@@ -54823,11 +57374,11 @@ To copy a local directory to an WebDAV directory called backup### Modification times and hashesPlain WebDAV does not support modified times. However when used with-Fastmail Files, Owncloud or Nextcloud rclone will support modified times.+Fastmail Files, ownCloud or Nextcloud rclone will support modified times.Likewise plain WebDAV does not support hashes, however when used with-Fastmail Files, Owncloud or Nextcloud rclone will support SHA1 and MD5 hashes.-Depending on the exact version of Owncloud or Nextcloud hashes may+Fastmail Files, ownCloud or Nextcloud rclone will support SHA1 and MD5 hashes.+Depending on the exact version of ownCloud or Nextcloud hashes mayappear on all objects, or only on objects which had a hash uploadedwith them.@@ -54865,7 +57416,9 @@ Properties:- "nextcloud"- Nextcloud- "owncloud"- - Owncloud+ - Owncloud 10 PHP based WebDAV server+ - "infinitescale"+ - ownCloud Infinite Scale- "sharepoint"- Sharepoint Online, authenticated by Microsoft account- "sharepoint-ntlm"@@ -55074,19 +57627,28 @@ this as the password.Fastmail supports modified times using the `X-OC-Mtime` header.-### Owncloud+### ownCloudClick on the settings cog in the bottom right of the page and thiswill show the WebDAV URL that rclone needs in the config step. Itwill look something like `https://example.com/remote.php/webdav/`.-Owncloud supports modified times using the `X-OC-Mtime` header.+ownCloud supports modified times using the `X-OC-Mtime` header.### Nextcloud-This is configured in an identical way to Owncloud. Note that+This is configured in an identical way to ownCloud. Note thatNextcloud initially did not support streaming of files (`rcat`) whereas-Owncloud did, but [this](https://github.com/nextcloud/nextcloud-snap/issues/365) seems to be fixed as of 2020-11-27 (tested with rclone v1.53.1 and Nextcloud Server v19).+ownCloud did, but [this](https://github.com/nextcloud/nextcloud-snap/issues/365) seems to be fixed as of 2020-11-27 (tested with rclone v1.53.1 and Nextcloud Server v19).++### ownCloud Infinite Scale++The WebDAV URL for Infinite Scale can be found in the details panel of+any space in Infinite Scale, if the display was enabled in the personal+settings of the user through a checkbox there.++Infinite Scale works with the chunking [tus](https://tus.io) upload protocol.+The chunk size is currently fixed 10 MB.### Sharepoint Online@@ -56509,6 +59071,200 @@ Options:# Changelog+## v1.70.0 - 2025-06-17++[See commits](https://github.com/rclone/rclone/compare/v1.69.0...v1.70.0)++* New backends+ * [DOI](https://rclone.org/doi/) (Flora Thiebaut)+ * [FileLu](https://rclone.org/filelu/) (kingston125)+ * New S3 providers:+ * [MEGA S4](https://rclone.org/s3/#mega) (Nick Craig-Wood)+ * [Pure Storage FlashBlade](https://rclone.org/s3/#pure-storage-flashblade) (Jeremy Daer)+* New commands+ * [convmv](https://rclone.org/commands/rclone_convmv/): for moving and transforming files (nielash)+* New Features+ * Add [`--max-connections`](https://rclone.org/docs/#max-connections-n) to control maximum backend concurrency (Nick Craig-Wood)+ * Add [`--max-buffer-memory`](https://rclone.org/docs/#max-buffer-memory) to limit total buffer memory usage (Nick Craig-Wood)+ * Add transform library and [`--name-transform`](https://rclone.org/docs/#name-transform-command-xxxx) flag (nielash)+ * sync: Implement [`--list-cutoff`](https://rclone.org/docs/#list-cutoff) to allow on disk sorting for reduced memory use (Nick Craig-Wood)+ * accounting: Add listed stat for number of directory entries listed (Nick Craig-Wood)+ * backend: Skip hash calculation when the hashType is None (Oleksiy Stashok)+ * build+ * Update to go1.24 and make go1.22 the minimum required version (Nick Craig-Wood)+ * Disable docker builds on PRs & add missing dockerfile changes (Anagh Kumar Baranwal)+ * Modernize Go usage (Nick Craig-Wood)+ * Update all dependencies (Nick Craig-Wood)+ * cmd/authorize: Show required arguments in help text (simwai)+ * cmd/config: add `--no-output` option (Jess)+ * cmd/gitannex+ * Tweak parsing of "rcloneremotename" config (Dan McArdle)+ * Permit remotes with options (Dan McArdle)+ * Reject unknown layout modes in INITREMOTE (Dan McArdle)+ * docker image: Add label org.opencontainers.image.source for release notes in Renovate dependency updates (Robin Schneider)+ * doc fixes (albertony, Andrew Kreimer, Ben Boeckel, Christoph Berger, Danny Garside, Dimitri Papadopoulos, eccoisle, Ed Craig-Wood, Fernando Fernández, jack, Jeff Geerling, Jugal Kishore, kingston125, luzpaz, Markus Gerstel, Matt Ickstadt, Michael Kebe, Nick Craig-Wood, PrathameshLakawade, Ser-Bul, simonmcnair, Tim White, Zachary Vorhies)+ * filter:+ * Add `--hash-filter` to deterministically select a subset of files (Nick Craig-Wood)+ * Show `--min-size` and `--max-size` in `--dump` filters (Nick Craig-Wood)+ * hash: Add SHA512 support for file hashes (Enduriel)+ * http servers: Add `--user-from-header` to use for authentication (Moises Lima)+ * lib/batcher: Deprecate unused option: batch_commit_timeout (Dan McArdle)+ * log:+ * Remove github.com/sirupsen/logrus and replace with log/slog (Nick Craig-Wood)+ * Add `--windows-event-log-level` to support Windows Event Log (Nick Craig-Wood)+ * rc+ * Add add `short` parameter to `core/stats` to not return transferring and checking (Nick Craig-Wood)+ * In `options/info` make FieldName contain a "." if it should be nested (Nick Craig-Wood)+ * Add rc control for serve commands (Nick Craig-Wood)+ * rcserver: Improve content-type check (Jonathan Giannuzzi)+ * serve nfs+ * Update docs to note Windows is not supported (Zachary Vorhies)+ * Change the format of `--nfs-cache-type symlink` file handles (Nick Craig-Wood)+ * Make metadata files have special file handles (Nick Craig-Wood)+ * touch: Make touch obey `--transfers` (Nick Craig-Wood)+ * version: Add `--deps` flag to show dependencies and other build info (Nick Craig-Wood)+* Bug Fixes+ * serve s3:+ * Fix ListObjectsV2 response (fhuber)+ * Remove redundant handler initialization (Tho Neyugn)+ * stats: Fix goroutine leak and improve stats accounting process (Nathanael Demacon)+* VFS+ * Add `--vfs-metadata-extension` to expose metadata sidecar files (Nick Craig-Wood)+* Azure Blob+ * Add support for `x-ms-tags` header (Trevor Starick)+ * Cleanup uncommitted blocks on upload errors (Nick Craig-Wood)+ * Speed up server side copies for small files (Nick Craig-Wood)+ * Implement multipart server side copy (Nick Craig-Wood)+ * Remove uncommitted blocks on InvalidBlobOrBlock error (Nick Craig-Wood)+ * Fix handling of objects with // in (Nick Craig-Wood)+ * Handle retry error codes more carefully (Nick Craig-Wood)+ * Fix errors not being retried when doing single part copy (Nick Craig-Wood)+ * Fix multipart server side copies of 0 sized files (Nick Craig-Wood)+* Azurefiles+ * Add `--azurefiles-use-az` and `--azurefiles-disable-instance-discovery` (b-wimmer)+* B2+ * Add SkipDestructive handling to backend commands (Pat Patterson)+ * Use file id from listing when not presented in headers (ahxxm)+* Cloudinary+ * Automatically add/remove known media files extensions (yuval-cloudinary)+ * Var naming convention (yuval-cloudinary)+* Drive+ * Added `backend moveid` command (Spencer McCullough)+* Dropbox+ * Support Dropbox Paper (Dave Vasilevsky)+* FTP+ * Add `--ftp-http-proxy` to connect via HTTP CONNECT proxy+* Gofile+ * Update to use new direct upload endpoint (wbulot)+* Googlephotos+ * Update read only and read write scopes to meet Google's requirements. (Germán Casares)+* Iclouddrive+ * Fix panic and files potentially downloaded twice (Clément Wehrung)+* Internetarchive+ * Add `--internetarchive-metadata="key=value"` for setting item metadata (Corentin Barreau)+* Onedrive+ * Fix "The upload session was not found" errors (Nick Craig-Wood)+ * Re-add `--onedrive-upload-cutoff` flag (Nick Craig-Wood)+ * Fix crash if no metadata was updated (Nick Craig-Wood)+* Opendrive+ * Added `--opendrive-access` flag to handle permissions (Joel K Biju)+* Pcloud+ * Fix "Access denied. You do not have permissions to perform this operation" on large uploads (Nick Craig-Wood)+* S3+ * Fix handling of objects with // in (Nick Craig-Wood)+ * Add IBM IAM signer (Alexander Minbaev)+ * Split the GCS quirks into `--s3-use-x-id` and `--s3-sign-accept-encoding` (Nick Craig-Wood)+ * Implement paged listing interface ListP (Nick Craig-Wood)+ * Add Pure Storage FlashBlade provider support (Jeremy Daer)+ * Require custom endpoint for Lyve Cloud v2 support (PrathameshLakawade)+ * MEGA S4 support (Nick Craig-Wood)+* SFTP+ * Add `--sftp-http-proxy` to connect via HTTP CONNECT proxy (Nick Craig-Wood)+* Smb+ * Add support for kerberos authentication (Jonathan Giannuzzi)+ * Improve connection pooling efficiency (Jonathan Giannuzzi)+* WebDAV+ * Retry propfind on 425 status (Jörn Friedrich Dreyer)+ * Add an ownCloud Infinite Scale vendor that enables tus chunked upload support (Klaas Freitag)++## v1.69.3 - 2025-05-21++[See commits](https://github.com/rclone/rclone/compare/v1.69.2...v1.69.3)++* Bug Fixes+ * build: Reapply update github.com/golang-jwt/jwt/v5 from 5.2.1 to 5.2.2 to fix CVE-2025-30204 (dependabot[bot])+ * build: Update github.com/ebitengine/purego to work around bug in go1.24.3 (Nick Craig-Wood)++## v1.69.2 - 2025-05-01++[See commits](https://github.com/rclone/rclone/compare/v1.69.1...v1.69.2)++* Bug fixes+ * accounting: Fix percentDiff calculation -- (Anagh Kumar Baranwal)+ * build+ * Update github.com/golang-jwt/jwt/v4 from 4.5.1 to 4.5.2 to fix CVE-2025-30204 (dependabot[bot])+ * Update github.com/golang-jwt/jwt/v5 from 5.2.1 to 5.2.2 to fix CVE-2025-30204 (dependabot[bot])+ * Update golang.org/x/crypto to v0.35.0 to fix CVE-2025-22869 (Nick Craig-Wood)+ * Update golang.org/x/net from 0.36.0 to 0.38.0 to fix CVE-2025-22870 (dependabot[bot])+ * Update golang.org/x/net to 0.36.0. to fix CVE-2025-22869 (dependabot[bot])+ * Stop building with go < go1.23 as security updates forbade it (Nick Craig-Wood)+ * Fix docker plugin build (Anagh Kumar Baranwal)+ * cmd: Fix crash if rclone is invoked without any arguments (Janne Hellsten)+ * config: Read configuration passwords from stdin even when terminated with EOF (Samantha Bowen)+ * doc fixes (Andrew Kreimer, Danny Garside, eccoisle, Ed Craig-Wood, emyarod, jack, Jugal Kishore, Markus Gerstel, Michael Kebe, Nick Craig-Wood, simonmcnair, simwai, Zachary Vorhies)+ * fs: Fix corruption of SizeSuffix with "B" suffix in config (eg --min-size) (Nick Craig-Wood)+ * lib/http: Fix race between Serve() and Shutdown() (Nick Craig-Wood)+ * object: Fix memory object out of bounds Seek (Nick Craig-Wood)+ * operations: Fix call fmt.Errorf with wrong err (alingse)+ * rc+ * Disable the metrics server when running `rclone rc` (hiddenmarten)+ * Fix debug/* commands not being available over unix sockets (Nick Craig-Wood)+ * serve nfs: Fix unlikely crash (Nick Craig-Wood)+ * stats: Fix the speed not getting updated after a pause in the processing (Anagh Kumar Baranwal)+ * sync+ * Fix cpu spinning when empty directory finding with leading slashes (Nick Craig-Wood)+ * Copy dir modtimes even when copyEmptySrcDirs is false (ll3006)+* VFS+ * Fix directory cache serving stale data (Lorenz Brun)+ * Fix inefficient directory caching when directory reads are slow (huanghaojun)+ * Fix integration test failures (Nick Craig-Wood)+* Drive+ * Metadata: fix error when setting copy-requires-writer-permission on a folder (Nick Craig-Wood)+* Dropbox+ * Retry link without expiry (Dave Vasilevsky)+* HTTP+ * Correct root if definitely pointing to a file (nielash)+* Iclouddrive+ * Fix so created files are writable (Ben Alex)+* Onedrive+ * Fix metadata ordering in permissions (Nick Craig-Wood)++## v1.69.1 - 2025-02-14++[See commits](https://github.com/rclone/rclone/compare/v1.69.0...v1.69.1)++* Bug Fixes+ * lib/oauthutil: Fix redirect URL mismatch errors (Nick Craig-Wood)+ * bisync: Fix listings missing concurrent modifications (nielash)+ * serve s3: Fix list objects encoding-type (Nick Craig-Wood)+ * fs: Fix confusing "didn't find section in config file" error (Nick Craig-Wood)+ * doc fixes (Christoph Berger, Dimitri Papadopoulos, Matt Ickstadt, Nick Craig-Wood, Tim White, Zachary Vorhies)+ * build: Added parallel docker builds and caching for go build in the container (Anagh Kumar Baranwal)+* VFS+ * Fix the cache failing to upload symlinks when `--links` was specified (Nick Craig-Wood)+ * Fix race detected by race detector (Nick Craig-Wood)+ * Close the change notify channel on Shutdown (izouxv)+* B2+ * Fix "fatal error: concurrent map writes" (Nick Craig-Wood)+* Iclouddrive+ * Add notes on ADP and Missing PCS cookies (Nick Craig-Wood)+* Onedrive+ * Mark German (de) region as deprecated (Nick Craig-Wood)+* S3+ * Added new storage class to magalu provider (Bruno Fernandes)+ * Add DigitalOcean regions SFO2, LON1, TOR1, BLR1 (jkpe)+ * Add latest Linode Object Storage endpoints (jbagwell-akamai)+## v1.69.0 - 2025-01-12[See commits](https://github.com/rclone/rclone/compare/v1.68.0...v1.69.0)@@ -56538,7 +59294,7 @@ Options:* fs: Make `--links` flag global and add new `--local-links` and `--vfs-links` flags (Nick Craig-Wood)* http servers: Disable automatic authentication skipping for unix sockets in http servers (Moises Lima)* This was making it impossible to use unix sockets with an proxy- * This might now cause rclone to need authenticaton where it didn't before+ * This might now cause rclone to need authentication where it didn't before* oauthutil: add support for OAuth client credential flow (Martin Hassack, Nick Craig-Wood)* operations: make log messages consistent for mkdir/rmdir at INFO level (Nick Craig-Wood)* rc: Add `relative` to [vfs/queue-set-expiry](https://rclone.org/rc/#vfs-queue-set-expiry) (Nick Craig-Wood)@@ -57216,7 +59972,7 @@ instead of of `--size-only`, when `check` is not available.* Update all dependencies (Nick Craig-Wood)* Refactor version info and icon resource handling on windows (albertony)* doc updates (albertony, alfish2000, asdffdsazqqq, Dimitri Papadopoulos, Herby Gillot, Joda Stößer, Manoj Ghosh, Nick Craig-Wood)- * Implement `--metadata-mapper` to transform metatadata with a user supplied program (Nick Craig-Wood)+ * Implement `--metadata-mapper` to transform metadata with a user supplied program (Nick Craig-Wood)* Add `ChunkWriterDoesntSeek` feature flag and set it for b2 (Nick Craig-Wood)* lib/http: Export basic go string functions for use in `--template` (Gabriel Espinoza)* makefile: Use POSIX compatible install arguments (Mina Galić)@@ -57331,7 +60087,7 @@ instead of of `--size-only`, when `check` is not available.* Fix "fatal error: concurrent map writes" (Nick Craig-Wood)* B2* Fix multipart upload: corrupted on transfer: sizes differ XXX vs 0 (Nick Craig-Wood)- * Fix locking window when getting mutipart upload URL (Nick Craig-Wood)+ * Fix locking window when getting multipart upload URL (Nick Craig-Wood)* Fix server side copies greater than 4GB (Nick Craig-Wood)* Fix chunked streaming uploads (Nick Craig-Wood)* Reduce default `--b2-upload-concurrency` to 4 to reduce memory usage (Nick Craig-Wood)@@ -62170,6 +64926,20 @@ See the [remote setup docs](https://rclone.org/remote_setup/) for more info.This has now been documented in its own [remote setup page](https://rclone.org/remote_setup/).+### How can I get rid of the "Config file not found" notice?++If you see a notice like 'NOTICE: Config file "rclone.conf" not found', this+means you have not configured any remotes.++If you need to configure a remote, see the [config help docs](https://rclone.org/docs/#configure).++If you are using rclone entirely with [on the fly remotes](https://rclone.org/docs/#backend-path-to-dir),+you can create an empty config file to get rid of this notice, for example:++```+rclone config touch+```+### Can rclone sync directly from drive to s3 ###Rclone can sync between two remote cloud storage systems just fine.@@ -62381,12 +65151,22 @@ value, say `export GOGC=20`. This will make the garbage collectorwork harder, reducing memory size at the expense of CPU usage.The most common cause of rclone using lots of memory is a single-directory with millions of files in. Rclone has to load this entirely-into memory as rclone objects. Each rclone object takes 0.5k-1k of-memory. There is+directory with millions of files in.++Before rclone v1.70 has to load this entirely into memory as rclone+objects. Each rclone object takes 0.5k-1k of memory. There is[a workaround for this](https://github.com/rclone/rclone/wiki/Big-syncs-with-millions-of-files)which involves a bit of scripting.+However with rclone v1.70 and later rclone will automatically save+directory entries to disk when a directory with more than+[`--list-cutoff`](https://rclone.org/docs/#list-cutoff) (1,000,000 by default) entries+is detected.++From v1.70 rclone also has the [--max-buffer-memory](https://rclone.org/docs/#max-buffer-memory)+flag which helps particularly when multi-thread transfers are using+too much memory.+### Rclone changes fullwidth Unicode punctuation marks in file namesFor example: On a Windows system, you have a file with name `Test:1.jpg`,@@ -63238,7 +66018,6 @@ put them back in again.` >}}* ben-ba <[email protected]>* Eli Orzitzer <[email protected]>* Anthony Metzidis <[email protected]>- * emyarod <[email protected]>* keongalvin <[email protected]>* rarspace01 <[email protected]>* Paul Stern <[email protected]>@@ -63354,6 +66133,64 @@ put them back in again.` >}}* ToM <[email protected]>* TAKEI Yuya <[email protected]>* Francesco Frassinelli <[email protected]> <[email protected]>+ * Matt Ickstadt <[email protected]> <[email protected]>+ * Spencer McCullough <[email protected]>+ * Jonathan Giannuzzi <[email protected]>+ * Christoph Berger <[email protected]>+ * Tim White <[email protected]>+ * Robin Schneider <[email protected]>+ * izouxv <[email protected]>+ * Moises Lima <[email protected]>+ * Bruno Fernandes <[email protected]>+ * Corentin Barreau <[email protected]>+ * hiddenmarten <[email protected]>+ * Trevor Starick <[email protected]>+ * b-wimmer <[email protected]>+ * Jess <[email protected]>+ * Zachary Vorhies <[email protected]>+ * Alexander Minbaev <[email protected]>+ * Joel K Biju <[email protected]>+ * ll3006 <[email protected]>+ * jbagwell-akamai <[email protected]>+ * Michael Kebe <[email protected]>+ * Lorenz Brun <[email protected]>+ * Dave Vasilevsky <[email protected]> <[email protected]>+ * luzpaz <[email protected]>+ * jack <[email protected]>+ * Jörn Friedrich Dreyer <[email protected]>+ * alingse <[email protected]>+ * Fernando Fernández <[email protected]>+ * eccoisle <[email protected]>+ * Klaas Freitag <[email protected]>+ * Danny Garside <[email protected]>+ * Samantha Bowen <[email protected]>+ * simonmcnair <[email protected]>+ * huanghaojun <[email protected]>+ * Enduriel <[email protected]>+ * Markus Gerstel <[email protected]>+ * simwai <[email protected]>+ * Ben Alex <[email protected]>+ * Klaas Freitag <[email protected]> <[email protected]>+ * Andrew Kreimer <[email protected]>+ * Ed Craig-Wood <[email protected]>+ * Christian Richter <[email protected]> <[email protected]>+ * Ralf Haferkamp <[email protected]>+ * Jugal Kishore <[email protected]>+ * Tho Neyugn <[email protected]>+ * Ben Boeckel <[email protected]>+ * Clément Wehrung <[email protected]>+ * Jeff Geerling <[email protected]>+ * Germán Casares <[email protected]>+ * fhuber <[email protected]>+ * wbulot <[email protected]>+ * Jeremy Daer <[email protected]>+ * Oleksiy Stashok <[email protected]>+ * PrathameshLakawade <[email protected]>+ * Nathanael Demacon <[email protected]>+ * ahxxm <[email protected]>+ * Flora Thiebaut <[email protected]>+ * kingston125 <[email protected]>+ * Ser-Bul <[email protected]># Contact the rclone projectdiff --git a/MANUAL.txt b/MANUAL.txtindex 9247df8dc..f302efda6 100644--- a/MANUAL.txt+++ b/MANUAL.txt@@ -1,6 +1,76 @@rclone(1) User ManualNick Craig-Wood-Jan 12, 2025+Jun 17, 2025++NAME++rclone - manage files on cloud storage++SYNOPSIS++ Usage:+ rclone [flags]+ rclone [command]++ Available commands:+ about Get quota information from the remote.+ authorize Remote authorization.+ backend Run a backend-specific command.+ bisync Perform bidirectional synchronization between two paths.+ cat Concatenates any files and sends them to stdout.+ check Checks the files in the source and destination match.+ checksum Checks the files in the destination against a SUM file.+ cleanup Clean up the remote if possible.+ completion Output completion script for a given shell.+ config Enter an interactive configuration session.+ convmv Convert file and directory names in place.+ copy Copy files from source to dest, skipping identical files.+ copyto Copy files from source to dest, skipping identical files.+ copyurl Copy the contents of the URL supplied content to dest:path.+ cryptcheck Cryptcheck checks the integrity of an encrypted remote.+ cryptdecode Cryptdecode returns unencrypted file names.+ dedupe Interactively find duplicate filenames and delete/rename them.+ delete Remove the files in path.+ deletefile Remove a single file from remote.+ gendocs Output markdown docs for rclone to the directory supplied.+ gitannex Speaks with git-annex over stdin/stdout.+ hashsum Produces a hashsum file for all the objects in the path.+ help Show help for rclone commands, flags and backends.+ link Generate public link to file/folder.+ listremotes List all the remotes in the config file and defined in environment variables.+ ls List the objects in the path with size and path.+ lsd List all directories/containers/buckets in the path.+ lsf List directories and objects in remote:path formatted for parsing.+ lsjson List directories and objects in the path in JSON format.+ lsl List the objects in path with modification time, size and path.+ md5sum Produces an md5sum file for all the objects in the path.+ mkdir Make the path if it doesn't already exist.+ mount Mount the remote as file system on a mountpoint.+ move Move files from source to dest.+ moveto Move file or directory from source to dest.+ ncdu Explore a remote with a text based user interface.+ nfsmount Mount the remote as file system on a mountpoint.+ obscure Obscure password for use in the rclone config file.+ purge Remove the path and all of its contents.+ rc Run a command against a running rclone.+ rcat Copies standard input to file on remote.+ rcd Run rclone listening to remote control commands only.+ rmdir Remove the empty directory at path.+ rmdirs Remove empty directories under the path.+ selfupdate Update the rclone binary.+ serve Serve a remote over a protocol.+ settier Changes storage class/tier of objects in remote.+ sha1sum Produces an sha1sum file for all the objects in the path.+ size Prints the total size and number of objects in remote:path.+ sync Make source and dest identical, modifying destination only.+ test Run a test command+ touch Create new file or change file modification time.+ tree List the contents of the remote in a tree like fashion.+ version Show the version number.++ Use "rclone [command] --help" for more information about a command.+ Use "rclone help flags" for to see the global flags.+ Use "rclone help backends" for a list of supported services.Rclone syncs your files to cloud storage@@ -110,6 +180,8 @@ S3, that work out of the box.)- Enterprise File Fabric- Fastmail Files- Files.com+- FileLu Cloud Storage+- FlashBlade- FTP- Gofile- Google Cloud Storage@@ -134,7 +206,8 @@ S3, that work out of the box.)- Magalu- Mail.ru Cloud- Memset Memstore-- Mega+- MEGA+- MEGA S4- Memory- Microsoft Azure Blob Storage- Microsoft Azure Files Storage@@ -528,7 +601,7 @@ developers so it may be out of date. Its current version is as below.Source installation-Make sure you have git and Go installed. Go version 1.18 or newer is+Make sure you have git and Go installed. Go version 1.22 or newer isrequired, the latest release is recommended. You can get it from yourpackage manager, or download it from golang.org/dl. Then you can run thefollowing:@@ -849,6 +922,7 @@ See the following for detailed instructions for- Digi Storage- Dropbox- Enterprise File Fabric+- FileLu Cloud Storage- Files.com- FTP- Gofile@@ -1088,6 +1162,7 @@ Flags for anything which can copy a file--multi-thread-cutoff SizeSuffix Use multi-thread downloads for files above this size (default 256Mi)--multi-thread-streams int Number of streams to use for multi-thread downloads (default 4)--multi-thread-write-buffer-size SizeSuffix In memory buffer size for writing when in multi-thread mode (default 128Ki)+ --name-transform stringArray Transform paths during the copy process--no-check-dest Don't check the destination, copy regardless--no-traverse Don't traverse destination file system on copy--no-update-dir-modtime Don't update directory modification times@@ -1120,6 +1195,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -1290,6 +1366,7 @@ Flags for anything which can copy a file--multi-thread-cutoff SizeSuffix Use multi-thread downloads for files above this size (default 256Mi)--multi-thread-streams int Number of streams to use for multi-thread downloads (default 4)--multi-thread-write-buffer-size SizeSuffix In memory buffer size for writing when in multi-thread mode (default 128Ki)+ --name-transform stringArray Transform paths during the copy process--no-check-dest Don't check the destination, copy regardless--no-traverse Don't traverse destination file system on copy--no-update-dir-modtime Don't update directory modification times@@ -1312,6 +1389,7 @@ Flags used for sync commands--delete-during When synchronizing, delete files during transfer--fix-case Force rename of case insensitive dest to match source--ignore-errors Delete even if there are I/O errors+ --list-cutoff int To save memory, sort directory listings on disk above this threshold (default 1000000)--max-delete int When synchronizing, limit the number of deletes (default -1)--max-delete-size SizeSuffix When synchronizing, limit the total size of deletes (default off)--suffix string Suffix to add to changed files@@ -1339,6 +1417,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -1442,6 +1521,7 @@ Flags for anything which can copy a file--multi-thread-cutoff SizeSuffix Use multi-thread downloads for files above this size (default 256Mi)--multi-thread-streams int Number of streams to use for multi-thread downloads (default 4)--multi-thread-write-buffer-size SizeSuffix In memory buffer size for writing when in multi-thread mode (default 128Ki)+ --name-transform stringArray Transform paths during the copy process--no-check-dest Don't check the destination, copy regardless--no-traverse Don't traverse destination file system on copy--no-update-dir-modtime Don't update directory modification times@@ -1474,6 +1554,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -1563,6 +1644,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -1600,6 +1682,10 @@ include/exclude filters - everything will be removed. Use the deletecommand if you want to selectively delete files. To delete emptydirectories only, use command rmdir or rmdirs.+The concurrency of this operation is controlled by the --checkers global+flag. However, some backends will implement this command directly, in+which case --checkers will be ignored.+Important: Since this can cause data loss, test first with the --dry-runor the --interactive/-i flag.@@ -1771,6 +1857,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -1858,6 +1945,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -1956,6 +2044,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -2044,6 +2133,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -2118,6 +2208,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -2195,6 +2286,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -2264,6 +2356,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -2332,11 +2425,16 @@ Orbeta: 1.42.0.5 (released 2018-06-17)upgrade: https://beta.rclone.org/v1.42-005-g56e1e820+If you supply the --deps flag then rclone will print a list of all the+packages it depends on and their versions along with some other+information about the build.+rclone version [flags]Options--check Check for new version+ --deps Show the Go dependencies-h, --help help for versionSee the global flags page for global options not listed here.@@ -2595,6 +2693,11 @@ SynopsisRemote authorization. Used to authorize a remote or headless rclone froma machine with a browser - use as instructed by rclone config.+The command requires 1-3 arguments: - fs name (e.g., "drive", "s3",+etc.) - Either a base64 encoded JSON blob obtained from a previous+rclone config session - Or a client_id and client_secret pair obtained+from the remote service+Use --auth-no-open-browser to prevent rclone to open auth link indefault browser automatically.@@ -2602,7 +2705,7 @@ Use --template to generate HTML output via a custom Go template. If ablank string is provided as an argument to this flag, the defaulttemplate is used.- rclone authorize [flags]+ rclone authorize <fs name> [base64_json_blob | client_id client_secret] [flags]Options@@ -2751,6 +2854,7 @@ Flags for anything which can copy a file--multi-thread-cutoff SizeSuffix Use multi-thread downloads for files above this size (default 256Mi)--multi-thread-streams int Number of streams to use for multi-thread downloads (default 4)--multi-thread-write-buffer-size SizeSuffix In memory buffer size for writing when in multi-thread mode (default 128Ki)+ --name-transform stringArray Transform paths during the copy process--no-check-dest Don't check the destination, copy regardless--no-traverse Don't traverse destination file system on copy--no-update-dir-modtime Don't update directory modification times@@ -2783,6 +2887,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -2866,6 +2971,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -2970,6 +3076,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -3278,6 +3385,7 @@ Options--continue Continue the configuration process with an answer-h, --help help for create--no-obscure Force any passwords not to be obscured+ --no-output Don't provide any output--non-interactive Don't interact with user and return questions--obscure Force any passwords to be obscured--result string Result - use with --continue@@ -3467,12 +3575,12 @@ re-encrypt the config.When --password-command is called to change the password then theenvironment variable RCLONE_PASSWORD_CHANGE=1 will be set. So if-changing passwords programatically you can use the environment variable+changing passwords programmatically you can use the environment variableto distinguish which password you must supply.Alternatively you can remove the password first (withrclone config encryption remove), then set it again with this command-which may be easier if you don't mind the unecrypted config file being+which may be easier if you don't mind the unencrypted config file beingon the disk briefly.rclone config encryption set [flags]@@ -3766,6 +3874,7 @@ Options--continue Continue the configuration process with an answer-h, --help help for update--no-obscure Force any passwords not to be obscured+ --no-output Don't provide any output--non-interactive Don't interact with user and return questions--obscure Force any passwords to be obscured--result string Result - use with --continue@@ -3799,6 +3908,429 @@ See Also- rclone config - Enter an interactive configuration session.+rclone convmv++Convert file and directory names in place.++Synopsis++convmv supports advanced path name transformations for converting and+renaming files and directories by applying prefixes, suffixes, and other+alterations.++ ---------------------------------------------------------------------------------------------+ Command Description+ --------------------------------------------------------- -----------------------------------+ --name-transform prefix=XXXX Prepends XXXX to the file name.++ --name-transform suffix=XXXX Appends XXXX to the file name after+ the extension.++ --name-transform suffix_keep_extension=XXXX Appends XXXX to the file name while+ preserving the original file+ extension.++ --name-transform trimprefix=XXXX Removes XXXX if it appears at the+ start of the file name.++ --name-transform trimsuffix=XXXX Removes XXXX if it appears at the+ end of the file name.++ --name-transform regex=/pattern/replacement/ Applies a regex-based+ transformation.++ --name-transform replace=old:new Replaces occurrences of old with+ new in the file name.++ --name-transform date={YYYYMMDD} Appends or prefixes the specified+ date format.++ --name-transform truncate=N Truncates the file name to a+ maximum of N characters.++ --name-transform base64encode Encodes the file name in Base64.++ --name-transform base64decode Decodes a Base64-encoded file name.++ --name-transform encoder=ENCODING Converts the file name to the+ specified encoding (e.g.,+ ISO-8859-1, Windows-1252,+ Macintosh).++ --name-transform decoder=ENCODING Decodes the file name from the+ specified encoding.++ --name-transform charmap=MAP Applies a character mapping+ transformation.++ --name-transform lowercase Converts the file name to+ lowercase.++ --name-transform uppercase Converts the file name to+ UPPERCASE.++ --name-transform titlecase Converts the file name to Title+ Case.++ --name-transform ascii Strips non-ASCII characters.++ --name-transform url URL-encodes the file name.++ --name-transform nfc Converts the file name to NFC+ Unicode normalization form.++ --name-transform nfd Converts the file name to NFD+ Unicode normalization form.++ --name-transform nfkc Converts the file name to NFKC+ Unicode normalization form.++ --name-transform nfkd Converts the file name to NFKD+ Unicode normalization form.++ --name-transform command=/path/to/my/programfile names. Executes an external program to+ transform+ ---------------------------------------------------------------------------------------------++Conversion modes:++ none+ nfc+ nfd+ nfkc+ nfkd+ replace+ prefix+ suffix+ suffix_keep_extension+ trimprefix+ trimsuffix+ index+ date+ truncate+ base64encode+ base64decode+ encoder+ decoder+ ISO-8859-1+ Windows-1252+ Macintosh+ charmap+ lowercase+ uppercase+ titlecase+ ascii+ url+ regex+ command++Char maps:+++ IBM-Code-Page-037+ IBM-Code-Page-437+ IBM-Code-Page-850+ IBM-Code-Page-852+ IBM-Code-Page-855+ Windows-Code-Page-858+ IBM-Code-Page-860+ IBM-Code-Page-862+ IBM-Code-Page-863+ IBM-Code-Page-865+ IBM-Code-Page-866+ IBM-Code-Page-1047+ IBM-Code-Page-1140+ ISO-8859-1+ ISO-8859-2+ ISO-8859-3+ ISO-8859-4+ ISO-8859-5+ ISO-8859-6+ ISO-8859-7+ ISO-8859-8+ ISO-8859-9+ ISO-8859-10+ ISO-8859-13+ ISO-8859-14+ ISO-8859-15+ ISO-8859-16+ KOI8-R+ KOI8-U+ Macintosh+ Macintosh-Cyrillic+ Windows-874+ Windows-1250+ Windows-1251+ Windows-1252+ Windows-1253+ Windows-1254+ Windows-1255+ Windows-1256+ Windows-1257+ Windows-1258+ X-User-Defined++Encoding masks:++ Asterisk+ BackQuote+ BackSlash+ Colon+ CrLf+ Ctl+ Del+ Dollar+ Dot+ DoubleQuote+ Exclamation+ Hash+ InvalidUtf8+ LeftCrLfHtVt+ LeftPeriod+ LeftSpace+ LeftTilde+ LtGt+ None+ Percent+ Pipe+ Question+ Raw+ RightCrLfHtVt+ RightPeriod+ RightSpace+ Semicolon+ SingleQuote+ Slash+ SquareBracket++Examples:++ rclone convmv "stories/The Quick Brown Fox!.txt" --name-transform "all,uppercase"+ // Output: STORIES/THE QUICK BROWN FOX!.TXT++ rclone convmv "stories/The Quick Brown Fox!.txt" --name-transform "all,replace=Fox:Turtle" --name-transform "all,replace=Quick:Slow"+ // Output: stories/The Slow Brown Turtle!.txt++ rclone convmv "stories/The Quick Brown Fox!.txt" --name-transform "all,base64encode"+ // Output: c3Rvcmllcw==/VGhlIFF1aWNrIEJyb3duIEZveCEudHh0++ rclone convmv "c3Rvcmllcw==/VGhlIFF1aWNrIEJyb3duIEZveCEudHh0" --name-transform "all,base64decode"+ // Output: stories/The Quick Brown Fox!.txt++ rclone convmv "stories/The Quick Brown 🦊 Fox Went to the Café!.txt" --name-transform "all,nfc"+ // Output: stories/The Quick Brown 🦊 Fox Went to the Café!.txt++ rclone convmv "stories/The Quick Brown 🦊 Fox Went to the Café!.txt" --name-transform "all,nfd"+ // Output: stories/The Quick Brown 🦊 Fox Went to the Café!.txt++ rclone convmv "stories/The Quick Brown 🦊 Fox!.txt" --name-transform "all,ascii"+ // Output: stories/The Quick Brown Fox!.txt++ rclone convmv "stories/The Quick Brown Fox!.txt" --name-transform "all,trimsuffix=.txt"+ // Output: stories/The Quick Brown Fox!++ rclone convmv "stories/The Quick Brown Fox!.txt" --name-transform "all,prefix=OLD_"+ // Output: OLD_stories/OLD_The Quick Brown Fox!.txt++ rclone convmv "stories/The Quick Brown 🦊 Fox Went to the Café!.txt" --name-transform "all,charmap=ISO-8859-7"+ // Output: stories/The Quick Brown _ Fox Went to the Caf_!.txt++ rclone convmv "stories/The Quick Brown Fox: A Memoir [draft].txt" --name-transform "all,encoder=Colon,SquareBracket"+ // Output: stories/The Quick Brown Fox: A Memoir [draft].txt++ rclone convmv "stories/The Quick Brown 🦊 Fox Went to the Café!.txt" --name-transform "all,truncate=21"+ // Output: stories/The Quick Brown 🦊 Fox++ rclone convmv "stories/The Quick Brown Fox!.txt" --name-transform "all,command=echo"+ // Output: stories/The Quick Brown Fox!.txt++ rclone convmv "stories/The Quick Brown Fox!" --name-transform "date=-{YYYYMMDD}"+ // Output: stories/The Quick Brown Fox!-20250617++ rclone convmv "stories/The Quick Brown Fox!" --name-transform "date=-{macfriendlytime}"+ // Output: stories/The Quick Brown Fox!-2025-06-17 0551PM++ rclone convmv "stories/The Quick Brown Fox!.txt" --name-transform "all,regex=[\\.\\w]/ab"+ // Output: ababababababab/ababab ababababab ababababab ababab!abababab++Multiple transformations can be used in sequence, applied in the order+they are specified on the command line.++The --name-transform flag is also available in sync, copy, and move.++Files vs Directories++By default --name-transform will only apply to file names. The means+only the leaf file name will be transformed. However some of the+transforms would be better applied to the whole path or just+directories. To choose which which part of the file path is affected+some tags can be added to the --name-transform++ -----------------------------------------------------------------------+ Tag Effect+ ----------------------------------- -----------------------------------+ file Only transform the leaf name of+ files (DEFAULT)++ dir Only transform name of directories+ - these may appear anywhere in the+ path++ all Transform the entire path for files+ and directories+ -----------------------------------------------------------------------++This is used by adding the tag into the transform name like this:+--name-transform file,prefix=ABC or --name-transform dir,prefix=DEF.++For some conversions using all is more likely to be useful, for example+--name-transform all,nfc++Note that --name-transform may not add path separators / to the name.+This will cause an error.++Ordering and Conflicts++- Transformations will be applied in the order specified by the user.+ - If the file tag is in use (the default) then only the leaf name+ of files will be transformed.+ - If the dir tag is in use then directories anywhere in the path+ will be transformed+ - If the all tag is in use then directories and files anywhere in+ the path will be transformed+ - Each transformation will be run one path segment at a time.+ - If a transformation adds a / or ends up with an empty path+ segment then that will be an error.+- It is up to the user to put the transformations in a sensible order.+ - Conflicting transformations, such as prefix followed by+ trimprefix or nfc followed by nfd, are possible.+ - Instead of enforcing mutual exclusivity, transformations are+ applied in sequence as specified by the user, allowing for+ intentional use cases (e.g., trimming one prefix before adding+ another).+ - Users should be aware that certain combinations may lead to+ unexpected results and should verify transformations using+ --dry-run before execution.++Race Conditions and Non-Deterministic Behavior++Some transformations, such as replace=old:new, may introduce conflicts+where multiple source files map to the same destination name. This can+lead to race conditions when performing concurrent transfers. It is up+to the user to anticipate these. * If two files from the source are+transformed into the same name at the destination, the final state may+be non-deterministic. * Running rclone check after a sync using such+transformations may erroneously report missing or differing files due to+overwritten results.++- To minimize risks, users should:+ - Carefully review transformations that may introduce conflicts.+ - Use --dry-run to inspect changes before executing a sync (but+ keep in mind that it won't show the effect of non-deterministic+ transformations).+ - Avoid transformations that cause multiple distinct source files+ to map to the same destination name.+ - Consider disabling concurrency with --transfers=1 if necessary.+ - Certain transformations (e.g. prefix) will have a multiplying+ effect every time they are used. Avoid these when using bisync.++ rclone convmv dest:path --name-transform XXX [flags]++Options++ --create-empty-src-dirs Create empty source dirs on destination after move+ --delete-empty-src-dirs Delete empty source dirs after move+ -h, --help help for convmv++Options shared with other commands are described next. See the global+flags page for global options not listed here.++Copy Options++Flags for anything which can copy a file++ --check-first Do all the checks before starting transfers+ -c, --checksum Check for changes with size & checksum (if available, or fallback to size only)+ --compare-dest stringArray Include additional server-side paths during comparison+ --copy-dest stringArray Implies --compare-dest but also copies files from paths into destination+ --cutoff-mode HARD|SOFT|CAUTIOUS Mode to stop transfers when reaching the max transfer limit HARD|SOFT|CAUTIOUS (default HARD)+ --ignore-case-sync Ignore case when synchronizing+ --ignore-checksum Skip post copy check of checksums+ --ignore-existing Skip all files that exist on destination+ --ignore-size Ignore size when skipping use modtime or checksum+ -I, --ignore-times Don't skip items that match size and time - transfer all unconditionally+ --immutable Do not modify files, fail if existing files have been modified+ --inplace Download directly to destination file instead of atomic download to temp/rename+ -l, --links Translate symlinks to/from regular files with a '.rclonelink' extension+ --max-backlog int Maximum number of objects in sync or check backlog (default 10000)+ --max-duration Duration Maximum duration rclone will transfer data for (default 0s)+ --max-transfer SizeSuffix Maximum size of data to transfer (default off)+ -M, --metadata If set, preserve metadata when copying objects+ --modify-window Duration Max time diff to be considered the same (default 1ns)+ --multi-thread-chunk-size SizeSuffix Chunk size for multi-thread downloads / uploads, if not set by filesystem (default 64Mi)+ --multi-thread-cutoff SizeSuffix Use multi-thread downloads for files above this size (default 256Mi)+ --multi-thread-streams int Number of streams to use for multi-thread downloads (default 4)+ --multi-thread-write-buffer-size SizeSuffix In memory buffer size for writing when in multi-thread mode (default 128Ki)+ --name-transform stringArray Transform paths during the copy process+ --no-check-dest Don't check the destination, copy regardless+ --no-traverse Don't traverse destination file system on copy+ --no-update-dir-modtime Don't update directory modification times+ --no-update-modtime Don't update destination modtime if files identical+ --order-by string Instructions on how to order the transfers, e.g. 'size,descending'+ --partial-suffix string Add partial-suffix to temporary file name when --inplace is not used (default ".partial")+ --refresh-times Refresh the modtime of remote files+ --server-side-across-configs Allow server-side operations (e.g. copy) to work across different configs+ --size-only Skip based on size only, not modtime or checksum+ --streaming-upload-cutoff SizeSuffix Cutoff for switching to chunked upload if file size is unknown, upload starts after reaching cutoff or when file ends (default 100Ki)+ -u, --update Skip files that are newer on the destination++Important Options++Important flags useful for most commands++ -n, --dry-run Do a trial run with no permanent changes+ -i, --interactive Enable interactive mode+ -v, --verbose count Print lots more stuff (repeat for more)++Filter Options++Flags for filtering directory listings++ --delete-excluded Delete files on dest excluded from sync+ --exclude stringArray Exclude files matching pattern+ --exclude-from stringArray Read file exclude patterns from file (use - to read from stdin)+ --exclude-if-present stringArray Exclude directories if filename is present+ --files-from stringArray Read list of source-file names from file (use - to read from stdin)+ --files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)+ -f, --filter stringArray Add a file filtering rule+ --filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n+ --ignore-case Ignore case in filters (case insensitive)+ --include stringArray Include files matching pattern+ --include-from stringArray Read file include patterns from file (use - to read from stdin)+ --max-age Duration Only transfer files younger than this in s or suffix ms|s|m|h|d|w|M|y (default off)+ --max-depth int If set limits the recursion depth to this (default -1)+ --max-size SizeSuffix Only transfer files smaller than this in KiB or suffix B|K|M|G|T|P (default off)+ --metadata-exclude stringArray Exclude metadatas matching pattern+ --metadata-exclude-from stringArray Read metadata exclude patterns from file (use - to read from stdin)+ --metadata-filter stringArray Add a metadata filtering rule+ --metadata-filter-from stringArray Read metadata filtering patterns from a file (use - to read from stdin)+ --metadata-include stringArray Include metadatas matching pattern+ --metadata-include-from stringArray Read metadata include patterns from file (use - to read from stdin)+ --min-age Duration Only transfer files older than this in s or suffix ms|s|m|h|d|w|M|y (default off)+ --min-size SizeSuffix Only transfer files bigger than this in KiB or suffix B|K|M|G|T|P (default off)++Listing Options++Flags for listing directories++ --default-time Time Time to show if modtime is unknown for files and directories (default 2000-01-01T00:00:00Z)+ --fast-list Use recursive list if available; uses more memory but fewer transactions++See Also++- rclone - Show help for rclone commands, flags and backends.+rclone copytoCopy files from source to dest, skipping identical files.@@ -3831,6 +4363,9 @@ This doesn't transfer files that are identical on src and dst, testingby size and modification time or MD5SUM. It doesn't delete files fromthe destination.+If you are looking to copy just a byte range of a file, please see+'rclone cat --offset X --count Y'+Note: Use the -P/--progress flag to view real-time transfer statisticsrclone copyto source:path dest:path [flags]@@ -3868,6 +4403,7 @@ Flags for anything which can copy a file--multi-thread-cutoff SizeSuffix Use multi-thread downloads for files above this size (default 256Mi)--multi-thread-streams int Number of streams to use for multi-thread downloads (default 4)--multi-thread-write-buffer-size SizeSuffix In memory buffer size for writing when in multi-thread mode (default 128Ki)+ --name-transform stringArray Transform paths during the copy process--no-check-dest Don't check the destination, copy regardless--no-traverse Don't traverse destination file system on copy--no-update-dir-modtime Don't update directory modification times@@ -3900,6 +4436,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -3939,8 +4476,8 @@ Setting --auto-filename will attempt to automatically determine thefilename from the URL (after any redirections) and used in thedestination path.-With --auto-filename-header in addition, if a specific filename is set-in HTTP headers, it will be used instead of the name from the URL. With+With --header-filename in addition, if a specific filename is set in+HTTP headers, it will be used instead of the name from the URL. With--print-filename in addition, the resulting file name will be printed.Setting --no-clobber will prevent overwriting file on the destination if@@ -3949,7 +4486,7 @@ there is one with the same name.Setting --stdout or making the output file name - will cause the outputto be written to standard output.-Troublshooting+TroubleshootingIf you can't get rclone copyurl to work then here are some things youcan try:@@ -4080,6 +4617,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -4298,6 +4836,7 @@ Run without a hash to see the list of all supported hashes, e.g.* whirlpool* crc32* sha256+ * sha512Then@@ -4331,6 +4870,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -4604,6 +5144,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -4774,6 +5315,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -5368,11 +5910,11 @@ and if they haven't been accessed for --vfs-write-back seconds. Ifrclone is quit or dies with files that haven't been uploaded, these willbe uploaded next time rclone is run with the same flags.-If using --vfs-cache-max-size or --vfs-cache-min-free-size note that the-cache may exceed these quotas for two reasons. Firstly because it is+If using --vfs-cache-max-size or --vfs-cache-min-free-space note that+the cache may exceed these quotas for two reasons. Firstly because it isonly checked every --vfs-cache-poll-interval. Secondly because openfiles cannot be evicted from the cache. When --vfs-cache-max-size or---vfs-cache-min-free-size is exceeded, rclone will attempt to evict the+--vfs-cache-min-free-space is exceeded, rclone will attempt to evict theleast accessed files from the cache first. rclone will start with filesthat haven't been accessed for the longest. This cache flushing strategyis efficient and more relevant files are likely to remain cached.@@ -5698,6 +6240,43 @@ result is accurate. However, this is very inefficient and may cost lotsof API calls resulting in extra charges. Use it as a last resort andonly with caching.+VFS Metadata++If you use the --vfs-metadata-extension flag you can get the VFS to+expose files which contain the metadata as a JSON blob. These files will+not appear in the directory listing, but can be stat-ed and opened and+once they have been they will appear in directory listings until the+directory cache expires.++Note that some backends won't create metadata unless you pass in the+--metadata flag.++For example, using rclone mount with+--metadata --vfs-metadata-extension .metadata we get++ $ ls -l /mnt/+ total 1048577+ -rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++ $ cat /mnt/1G.metadata+ {+ "atime": "2025-03-04T17:34:22.317069787Z",+ "btime": "2025-03-03T16:03:37.708253808Z",+ "gid": "1000",+ "mode": "100664",+ "mtime": "2025-03-03T16:03:39.640238323Z",+ "uid": "1000"+ }++ $ ls -l /mnt/+ total 1048578+ -rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+ -rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata++If the file has no metadata it will be returned as {} and if there is an+error reading the metadata the error will be returned as+{"error":"error string"}.+rclone mount remote:path /path/to/mountpoint [flags]Options@@ -5744,6 +6323,7 @@ Options--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a '.rclonelink' extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached ('off' is unlimited) (default off)@@ -5771,6 +6351,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -5862,6 +6443,7 @@ Flags for anything which can copy a file--multi-thread-cutoff SizeSuffix Use multi-thread downloads for files above this size (default 256Mi)--multi-thread-streams int Number of streams to use for multi-thread downloads (default 4)--multi-thread-write-buffer-size SizeSuffix In memory buffer size for writing when in multi-thread mode (default 128Ki)+ --name-transform stringArray Transform paths during the copy process--no-check-dest Don't check the destination, copy regardless--no-traverse Don't traverse destination file system on copy--no-update-dir-modtime Don't update directory modification times@@ -5894,6 +6476,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -6006,6 +6589,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -6600,11 +7184,11 @@ and if they haven't been accessed for --vfs-write-back seconds. Ifrclone is quit or dies with files that haven't been uploaded, these willbe uploaded next time rclone is run with the same flags.-If using --vfs-cache-max-size or --vfs-cache-min-free-size note that the-cache may exceed these quotas for two reasons. Firstly because it is+If using --vfs-cache-max-size or --vfs-cache-min-free-space note that+the cache may exceed these quotas for two reasons. Firstly because it isonly checked every --vfs-cache-poll-interval. Secondly because openfiles cannot be evicted from the cache. When --vfs-cache-max-size or---vfs-cache-min-free-size is exceeded, rclone will attempt to evict the+--vfs-cache-min-free-space is exceeded, rclone will attempt to evict theleast accessed files from the cache first. rclone will start with filesthat haven't been accessed for the longest. This cache flushing strategyis efficient and more relevant files are likely to remain cached.@@ -6930,6 +7514,43 @@ result is accurate. However, this is very inefficient and may cost lotsof API calls resulting in extra charges. Use it as a last resort andonly with caching.+VFS Metadata++If you use the --vfs-metadata-extension flag you can get the VFS to+expose files which contain the metadata as a JSON blob. These files will+not appear in the directory listing, but can be stat-ed and opened and+once they have been they will appear in directory listings until the+directory cache expires.++Note that some backends won't create metadata unless you pass in the+--metadata flag.++For example, using rclone mount with+--metadata --vfs-metadata-extension .metadata we get++ $ ls -l /mnt/+ total 1048577+ -rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++ $ cat /mnt/1G.metadata+ {+ "atime": "2025-03-04T17:34:22.317069787Z",+ "btime": "2025-03-03T16:03:37.708253808Z",+ "gid": "1000",+ "mode": "100664",+ "mtime": "2025-03-03T16:03:39.640238323Z",+ "uid": "1000"+ }++ $ ls -l /mnt/+ total 1048578+ -rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+ -rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata++If the file has no metadata it will be returned as {} and if there is an+error reading the metadata the error will be returned as+{"error":"error string"}.+rclone nfsmount remote:path /path/to/mountpoint [flags]Options@@ -6981,6 +7602,7 @@ Options--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a '.rclonelink' extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached ('off' is unlimited) (default off)@@ -7008,6 +7630,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -7368,7 +7991,13 @@ By default this will serve files without needing a login.You can either use an htpasswd file which can take lots of users, or seta single username and password with the --rc-user and --rc-pass flags.-If no static users are configured by either of the above methods, and+Alternatively, you can have the reverse proxy manage authentication and+use the username provided in the configured header with+--user-from-header (e.g., --rc---user-from-header=x-remote-user). Ensure+the proxy is trusted and headers cannot be spoofed, as misconfiguration+may lead to unauthorized access.++If either of the above authentication methods is not configured andclient certificates are required by the --client-ca flag passed to theserver, the client certificate common name will be considered as theusername.@@ -7426,6 +8055,7 @@ Flags to control the Remote Control API--rc-server-write-timeout Duration Timeout for server writing data (default 1h0m0s)--rc-template string User-specified template--rc-user string User name for authentication+ --rc-user-from-header string User name from a defined HTTP header--rc-web-fetch-url string URL to fetch the releases for webgui (default "https://api.github.com/repos/rclone/rclone-webui-react/releases/latest")--rc-web-gui Launch WebGUI on localhost--rc-web-gui-force-update Force update to latest version of web gui@@ -7716,11 +8346,11 @@ and if they haven't been accessed for --vfs-write-back seconds. Ifrclone is quit or dies with files that haven't been uploaded, these willbe uploaded next time rclone is run with the same flags.-If using --vfs-cache-max-size or --vfs-cache-min-free-size note that the-cache may exceed these quotas for two reasons. Firstly because it is+If using --vfs-cache-max-size or --vfs-cache-min-free-space note that+the cache may exceed these quotas for two reasons. Firstly because it isonly checked every --vfs-cache-poll-interval. Secondly because openfiles cannot be evicted from the cache. When --vfs-cache-max-size or---vfs-cache-min-free-size is exceeded, rclone will attempt to evict the+--vfs-cache-min-free-space is exceeded, rclone will attempt to evict theleast accessed files from the cache first. rclone will start with filesthat haven't been accessed for the longest. This cache flushing strategyis efficient and more relevant files are likely to remain cached.@@ -8046,6 +8676,43 @@ result is accurate. However, this is very inefficient and may cost lotsof API calls resulting in extra charges. Use it as a last resort andonly with caching.+VFS Metadata++If you use the --vfs-metadata-extension flag you can get the VFS to+expose files which contain the metadata as a JSON blob. These files will+not appear in the directory listing, but can be stat-ed and opened and+once they have been they will appear in directory listings until the+directory cache expires.++Note that some backends won't create metadata unless you pass in the+--metadata flag.++For example, using rclone mount with+--metadata --vfs-metadata-extension .metadata we get++ $ ls -l /mnt/+ total 1048577+ -rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++ $ cat /mnt/1G.metadata+ {+ "atime": "2025-03-04T17:34:22.317069787Z",+ "btime": "2025-03-03T16:03:37.708253808Z",+ "gid": "1000",+ "mode": "100664",+ "mtime": "2025-03-03T16:03:39.640238323Z",+ "uid": "1000"+ }++ $ ls -l /mnt/+ total 1048578+ -rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+ -rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata++If the file has no metadata it will be returned as {} and if there is an+error reading the metadata the error will be returned as+{"error":"error string"}.+rclone serve dlna remote:path [flags]Options@@ -8078,6 +8745,7 @@ Options--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a '.rclonelink' extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached ('off' is unlimited) (default off)@@ -8103,6 +8771,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -8261,11 +8930,11 @@ and if they haven't been accessed for --vfs-write-back seconds. Ifrclone is quit or dies with files that haven't been uploaded, these willbe uploaded next time rclone is run with the same flags.-If using --vfs-cache-max-size or --vfs-cache-min-free-size note that the-cache may exceed these quotas for two reasons. Firstly because it is+If using --vfs-cache-max-size or --vfs-cache-min-free-space note that+the cache may exceed these quotas for two reasons. Firstly because it isonly checked every --vfs-cache-poll-interval. Secondly because openfiles cannot be evicted from the cache. When --vfs-cache-max-size or---vfs-cache-min-free-size is exceeded, rclone will attempt to evict the+--vfs-cache-min-free-space is exceeded, rclone will attempt to evict theleast accessed files from the cache first. rclone will start with filesthat haven't been accessed for the longest. This cache flushing strategyis efficient and more relevant files are likely to remain cached.@@ -8591,6 +9260,43 @@ result is accurate. However, this is very inefficient and may cost lotsof API calls resulting in extra charges. Use it as a last resort andonly with caching.+VFS Metadata++If you use the --vfs-metadata-extension flag you can get the VFS to+expose files which contain the metadata as a JSON blob. These files will+not appear in the directory listing, but can be stat-ed and opened and+once they have been they will appear in directory listings until the+directory cache expires.++Note that some backends won't create metadata unless you pass in the+--metadata flag.++For example, using rclone mount with+--metadata --vfs-metadata-extension .metadata we get++ $ ls -l /mnt/+ total 1048577+ -rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++ $ cat /mnt/1G.metadata+ {+ "atime": "2025-03-04T17:34:22.317069787Z",+ "btime": "2025-03-03T16:03:37.708253808Z",+ "gid": "1000",+ "mode": "100664",+ "mtime": "2025-03-03T16:03:39.640238323Z",+ "uid": "1000"+ }++ $ ls -l /mnt/+ total 1048578+ -rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+ -rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata++If the file has no metadata it will be returned as {} and if there is an+error reading the metadata the error will be returned as+{"error":"error string"}.+rclone serve docker [flags]Options@@ -8642,6 +9348,7 @@ Options--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a '.rclonelink' extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached ('off' is unlimited) (default off)@@ -8669,6 +9376,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -8810,11 +9518,11 @@ and if they haven't been accessed for --vfs-write-back seconds. Ifrclone is quit or dies with files that haven't been uploaded, these willbe uploaded next time rclone is run with the same flags.-If using --vfs-cache-max-size or --vfs-cache-min-free-size note that the-cache may exceed these quotas for two reasons. Firstly because it is+If using --vfs-cache-max-size or --vfs-cache-min-free-space note that+the cache may exceed these quotas for two reasons. Firstly because it isonly checked every --vfs-cache-poll-interval. Secondly because openfiles cannot be evicted from the cache. When --vfs-cache-max-size or---vfs-cache-min-free-size is exceeded, rclone will attempt to evict the+--vfs-cache-min-free-space is exceeded, rclone will attempt to evict theleast accessed files from the cache first. rclone will start with filesthat haven't been accessed for the longest. This cache flushing strategyis efficient and more relevant files are likely to remain cached.@@ -9140,6 +9848,43 @@ result is accurate. However, this is very inefficient and may cost lotsof API calls resulting in extra charges. Use it as a last resort andonly with caching.+VFS Metadata++If you use the --vfs-metadata-extension flag you can get the VFS to+expose files which contain the metadata as a JSON blob. These files will+not appear in the directory listing, but can be stat-ed and opened and+once they have been they will appear in directory listings until the+directory cache expires.++Note that some backends won't create metadata unless you pass in the+--metadata flag.++For example, using rclone mount with+--metadata --vfs-metadata-extension .metadata we get++ $ ls -l /mnt/+ total 1048577+ -rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++ $ cat /mnt/1G.metadata+ {+ "atime": "2025-03-04T17:34:22.317069787Z",+ "btime": "2025-03-03T16:03:37.708253808Z",+ "gid": "1000",+ "mode": "100664",+ "mtime": "2025-03-03T16:03:39.640238323Z",+ "uid": "1000"+ }++ $ ls -l /mnt/+ total 1048578+ -rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+ -rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata++If the file has no metadata it will be returned as {} and if there is an+error reading the metadata the error will be returned as+{"error":"error string"}.+Auth ProxyIf you supply the parameter --auth-proxy /path/to/program then rclone@@ -9246,6 +9991,7 @@ Options--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a '.rclonelink' extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached ('off' is unlimited) (default off)@@ -9271,6 +10017,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -9451,7 +10198,13 @@ By default this will serve files without needing a login.You can either use an htpasswd file which can take lots of users, or seta single username and password with the --user and --pass flags.-If no static users are configured by either of the above methods, and+Alternatively, you can have the reverse proxy manage authentication and+use the username provided in the configured header with+--user-from-header (e.g., ----user-from-header=x-remote-user). Ensure+the proxy is trusted and headers cannot be spoofed, as misconfiguration+may lead to unauthorized access.++If either of the above authentication methods is not configured andclient certificates are required by the --client-ca flag passed to theserver, the client certificate common name will be considered as theusername.@@ -9567,11 +10320,11 @@ and if they haven't been accessed for --vfs-write-back seconds. Ifrclone is quit or dies with files that haven't been uploaded, these willbe uploaded next time rclone is run with the same flags.-If using --vfs-cache-max-size or --vfs-cache-min-free-size note that the-cache may exceed these quotas for two reasons. Firstly because it is+If using --vfs-cache-max-size or --vfs-cache-min-free-space note that+the cache may exceed these quotas for two reasons. Firstly because it isonly checked every --vfs-cache-poll-interval. Secondly because openfiles cannot be evicted from the cache. When --vfs-cache-max-size or---vfs-cache-min-free-size is exceeded, rclone will attempt to evict the+--vfs-cache-min-free-space is exceeded, rclone will attempt to evict theleast accessed files from the cache first. rclone will start with filesthat haven't been accessed for the longest. This cache flushing strategyis efficient and more relevant files are likely to remain cached.@@ -9897,6 +10650,43 @@ result is accurate. However, this is very inefficient and may cost lotsof API calls resulting in extra charges. Use it as a last resort andonly with caching.+VFS Metadata++If you use the --vfs-metadata-extension flag you can get the VFS to+expose files which contain the metadata as a JSON blob. These files will+not appear in the directory listing, but can be stat-ed and opened and+once they have been they will appear in directory listings until the+directory cache expires.++Note that some backends won't create metadata unless you pass in the+--metadata flag.++For example, using rclone mount with+--metadata --vfs-metadata-extension .metadata we get++ $ ls -l /mnt/+ total 1048577+ -rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++ $ cat /mnt/1G.metadata+ {+ "atime": "2025-03-04T17:34:22.317069787Z",+ "btime": "2025-03-03T16:03:37.708253808Z",+ "gid": "1000",+ "mode": "100664",+ "mtime": "2025-03-03T16:03:39.640238323Z",+ "uid": "1000"+ }++ $ ls -l /mnt/+ total 1048578+ -rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+ -rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata++If the file has no metadata it will be returned as {} and if there is an+error reading the metadata the error will be returned as+{"error":"error string"}.+Auth ProxyIf you supply the parameter --auth-proxy /path/to/program then rclone@@ -9972,19 +10762,19 @@ that rclone supports.Options- --addr stringArray IPaddress:Port, :Port or [unix://]/path/to/socket to bind server to (default [127.0.0.1:8080])+ --addr stringArray IPaddress:Port or :Port to bind server to (default 127.0.0.1:8080)--allow-origin string Origin which cross-domain request (CORS) can be executed from--auth-proxy string A program to use to create the backend from the auth--baseurl string Prefix for URLs - leave blank for root- --cert string Path to TLS PEM public key certificate file (can also include intermediate/CA certificates)- --client-ca string Path to TLS PEM CA file with certificate authorities to verify clients with+ --cert string TLS PEM key (concatenation of certificate and CA certificate)+ --client-ca string Client certificate authority to verify clients with--dir-cache-time Duration Time to cache directory entries for (default 5m0s)--dir-perms FileMode Directory permissions (default 777)--file-perms FileMode File permissions (default 666)--gid uint32 Override the gid field set by the filesystem (not supported on Windows) (default 1000)-h, --help help for http--htpasswd string A htpasswd file - if not provided no authentication is done- --key string Path to TLS PEM private key file+ --key string TLS PEM Private key--link-perms FileMode Link permissions (default 666)--max-header-bytes int Maximum size of request header (default 4096)--min-tls-version string Minimum TLS version that is acceptable (default "tls1.0")@@ -10002,6 +10792,7 @@ Options--uid uint32 Override the uid field set by the filesystem (not supported on Windows) (default 1000)--umask FileMode Override the permission bits set by the filesystem (not supported on Windows) (default 002)--user string User name for authentication+ --user-from-header string User name from a defined HTTP header--vfs-block-norm-dupes If duplicate filenames exist in the same directory (after normalization), log an error and hide the duplicates (may have a performance cost)--vfs-cache-max-age Duration Max time since last access of objects in the cache (default 1h0m0s)--vfs-cache-max-size SizeSuffix Max total size of objects in the cache (default off)@@ -10012,6 +10803,7 @@ Options--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a '.rclonelink' extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached ('off' is unlimited) (default off)@@ -10037,6 +10829,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -10102,7 +10895,7 @@ uses an on disk cache, but the cache entries are held as symlinks.Rclone will use the handle of the underlying file as the NFS handlewhich improves performance. This sort of cache can't be backed up andrestored as the underlying handles will change. This is Linux only. It-requres running rclone as root or with CAP_DAC_READ_SEARCH. You can run+requires running rclone as root or with CAP_DAC_READ_SEARCH. You can runrclone with this extra permission by doing this to the rclone binarysudo setcap cap_dac_read_search+ep /path/to/rclone.@@ -10126,6 +10919,11 @@ Where $PORT is the same port number used in the serve nfs command and$HOSTNAME is the network address of the machine that serve nfs was runon.+If --vfs-metadata-extension is in use then for the --nfs-cache-type disk+and --nfs-cache-type cache the metadata files will have the file handle+of their parent file suffixed with 0x00, 0x00, 0x00, 0x01. This means+they can be looked up directly from the parent file handle is desired.+This command is only available on Unix platforms.VFS - Virtual File System@@ -10223,11 +11021,11 @@ and if they haven't been accessed for --vfs-write-back seconds. Ifrclone is quit or dies with files that haven't been uploaded, these willbe uploaded next time rclone is run with the same flags.-If using --vfs-cache-max-size or --vfs-cache-min-free-size note that the-cache may exceed these quotas for two reasons. Firstly because it is+If using --vfs-cache-max-size or --vfs-cache-min-free-space note that+the cache may exceed these quotas for two reasons. Firstly because it isonly checked every --vfs-cache-poll-interval. Secondly because openfiles cannot be evicted from the cache. When --vfs-cache-max-size or---vfs-cache-min-free-size is exceeded, rclone will attempt to evict the+--vfs-cache-min-free-space is exceeded, rclone will attempt to evict theleast accessed files from the cache first. rclone will start with filesthat haven't been accessed for the longest. This cache flushing strategyis efficient and more relevant files are likely to remain cached.@@ -10553,6 +11351,43 @@ result is accurate. However, this is very inefficient and may cost lotsof API calls resulting in extra charges. Use it as a last resort andonly with caching.+VFS Metadata++If you use the --vfs-metadata-extension flag you can get the VFS to+expose files which contain the metadata as a JSON blob. These files will+not appear in the directory listing, but can be stat-ed and opened and+once they have been they will appear in directory listings until the+directory cache expires.++Note that some backends won't create metadata unless you pass in the+--metadata flag.++For example, using rclone mount with+--metadata --vfs-metadata-extension .metadata we get++ $ ls -l /mnt/+ total 1048577+ -rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++ $ cat /mnt/1G.metadata+ {+ "atime": "2025-03-04T17:34:22.317069787Z",+ "btime": "2025-03-03T16:03:37.708253808Z",+ "gid": "1000",+ "mode": "100664",+ "mtime": "2025-03-03T16:03:39.640238323Z",+ "uid": "1000"+ }++ $ ls -l /mnt/+ total 1048578+ -rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+ -rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata++If the file has no metadata it will be returned as {} and if there is an+error reading the metadata the error will be returned as+{"error":"error string"}.+rclone serve nfs remote:path [flags]Options@@ -10584,6 +11419,7 @@ Options--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a '.rclonelink' extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached ('off' is unlimited) (default off)@@ -10609,6 +11445,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -10784,7 +11621,13 @@ By default this will serve files without needing a login.You can either use an htpasswd file which can take lots of users, or seta single username and password with the --user and --pass flags.-If no static users are configured by either of the above methods, and+Alternatively, you can have the reverse proxy manage authentication and+use the username provided in the configured header with+--user-from-header (e.g., ----user-from-header=x-remote-user). Ensure+the proxy is trusted and headers cannot be spoofed, as misconfiguration+may lead to unauthorized access.++If either of the above authentication methods is not configured andclient certificates are required by the --client-ca flag passed to theserver, the client certificate common name will be considered as theusername.@@ -10809,16 +11652,16 @@ Use --salt to change the password hashing salt from the default.Options- --addr stringArray IPaddress:Port, :Port or [unix://]/path/to/socket to bind server to (default [127.0.0.1:8080])+ --addr stringArray IPaddress:Port or :Port to bind server to (default 127.0.0.1:8080)--allow-origin string Origin which cross-domain request (CORS) can be executed from--append-only Disallow deletion of repository data--baseurl string Prefix for URLs - leave blank for root--cache-objects Cache listed objects (default true)- --cert string Path to TLS PEM public key certificate file (can also include intermediate/CA certificates)- --client-ca string Path to TLS PEM CA file with certificate authorities to verify clients with+ --cert string TLS PEM key (concatenation of certificate and CA certificate)+ --client-ca string Client certificate authority to verify clients with-h, --help help for restic--htpasswd string A htpasswd file - if not provided no authentication is done- --key string Path to TLS PEM private key file+ --key string TLS PEM Private key--max-header-bytes int Maximum size of request header (default 4096)--min-tls-version string Minimum TLS version that is acceptable (default "tls1.0")--pass string Password for authentication@@ -10829,6 +11672,7 @@ Options--server-write-timeout Duration Timeout for server writing data (default 1h0m0s)--stdio Run an HTTP2 server on stdin/stdout--user string User name for authentication+ --user-from-header string User name from a defined HTTP headerSee the global flags page for global options not listed here.@@ -10903,8 +11747,8 @@ which is defined like this:secret_access_key = SECRET_ACCESS_KEYuse_multipart_uploads = false-Note that setting disable_multipart_uploads = true is to work around a-bug which will be fixed in due course.+Note that setting use_multipart_uploads = false is to work around a bug+which will be fixed in due course.Bugs@@ -10971,7 +11815,13 @@ By default this will serve files without needing a login.You can either use an htpasswd file which can take lots of users, or seta single username and password with the --user and --pass flags.-If no static users are configured by either of the above methods, and+Alternatively, you can have the reverse proxy manage authentication and+use the username provided in the configured header with+--user-from-header (e.g., ----user-from-header=x-remote-user). Ensure+the proxy is trusted and headers cannot be spoofed, as misconfiguration+may lead to unauthorized access.++If either of the above authentication methods is not configured andclient certificates are required by the --client-ca flag passed to theserver, the client certificate common name will be considered as theusername.@@ -11151,11 +12001,11 @@ and if they haven't been accessed for --vfs-write-back seconds. Ifrclone is quit or dies with files that haven't been uploaded, these willbe uploaded next time rclone is run with the same flags.-If using --vfs-cache-max-size or --vfs-cache-min-free-size note that the-cache may exceed these quotas for two reasons. Firstly because it is+If using --vfs-cache-max-size or --vfs-cache-min-free-space note that+the cache may exceed these quotas for two reasons. Firstly because it isonly checked every --vfs-cache-poll-interval. Secondly because openfiles cannot be evicted from the cache. When --vfs-cache-max-size or---vfs-cache-min-free-size is exceeded, rclone will attempt to evict the+--vfs-cache-min-free-space is exceeded, rclone will attempt to evict theleast accessed files from the cache first. rclone will start with filesthat haven't been accessed for the longest. This cache flushing strategyis efficient and more relevant files are likely to remain cached.@@ -11481,26 +12331,63 @@ result is accurate. However, this is very inefficient and may cost lotsof API calls resulting in extra charges. Use it as a last resort andonly with caching.+VFS Metadata++If you use the --vfs-metadata-extension flag you can get the VFS to+expose files which contain the metadata as a JSON blob. These files will+not appear in the directory listing, but can be stat-ed and opened and+once they have been they will appear in directory listings until the+directory cache expires.++Note that some backends won't create metadata unless you pass in the+--metadata flag.++For example, using rclone mount with+--metadata --vfs-metadata-extension .metadata we get++ $ ls -l /mnt/+ total 1048577+ -rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++ $ cat /mnt/1G.metadata+ {+ "atime": "2025-03-04T17:34:22.317069787Z",+ "btime": "2025-03-03T16:03:37.708253808Z",+ "gid": "1000",+ "mode": "100664",+ "mtime": "2025-03-03T16:03:39.640238323Z",+ "uid": "1000"+ }++ $ ls -l /mnt/+ total 1048578+ -rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+ -rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata++If the file has no metadata it will be returned as {} and if there is an+error reading the metadata the error will be returned as+{"error":"error string"}.+rclone serve s3 remote:path [flags]Options- --addr stringArray IPaddress:Port, :Port or [unix://]/path/to/socket to bind server to (default [127.0.0.1:8080])+ --addr stringArray IPaddress:Port or :Port to bind server to (default 127.0.0.1:8080)--allow-origin string Origin which cross-domain request (CORS) can be executed from--auth-key stringArray Set key pair for v4 authorization: access_key_id,secret_access_key--auth-proxy string A program to use to create the backend from the auth--baseurl string Prefix for URLs - leave blank for root- --cert string Path to TLS PEM public key certificate file (can also include intermediate/CA certificates)- --client-ca string Path to TLS PEM CA file with certificate authorities to verify clients with+ --cert string TLS PEM key (concatenation of certificate and CA certificate)+ --client-ca string Client certificate authority to verify clients with--dir-cache-time Duration Time to cache directory entries for (default 5m0s)--dir-perms FileMode Directory permissions (default 777)--etag-hash string Which hash to use for the ETag, or auto or blank for off (default "MD5")--file-perms FileMode File permissions (default 666)- --force-path-style If true use path style access if false use virtual hosted style (default true) (default true)+ --force-path-style If true use path style access if false use virtual hosted style (default true)--gid uint32 Override the gid field set by the filesystem (not supported on Windows) (default 1000)-h, --help help for s3--htpasswd string A htpasswd file - if not provided no authentication is done- --key string Path to TLS PEM private key file+ --key string TLS PEM Private key--link-perms FileMode Link permissions (default 666)--max-header-bytes int Maximum size of request header (default 4096)--min-tls-version string Minimum TLS version that is acceptable (default "tls1.0")@@ -11518,6 +12405,7 @@ Options--uid uint32 Override the uid field set by the filesystem (not supported on Windows) (default 1000)--umask FileMode Override the permission bits set by the filesystem (not supported on Windows) (default 002)--user string User name for authentication+ --user-from-header string User name from a defined HTTP header--vfs-block-norm-dupes If duplicate filenames exist in the same directory (after normalization), log an error and hide the duplicates (may have a performance cost)--vfs-cache-max-age Duration Max time since last access of objects in the cache (default 1h0m0s)--vfs-cache-max-size SizeSuffix Max total size of objects in the cache (default off)@@ -11528,6 +12416,7 @@ Options--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a '.rclonelink' extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached ('off' is unlimited) (default off)@@ -11553,6 +12442,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -11738,11 +12628,11 @@ and if they haven't been accessed for --vfs-write-back seconds. Ifrclone is quit or dies with files that haven't been uploaded, these willbe uploaded next time rclone is run with the same flags.-If using --vfs-cache-max-size or --vfs-cache-min-free-size note that the-cache may exceed these quotas for two reasons. Firstly because it is+If using --vfs-cache-max-size or --vfs-cache-min-free-space note that+the cache may exceed these quotas for two reasons. Firstly because it isonly checked every --vfs-cache-poll-interval. Secondly because openfiles cannot be evicted from the cache. When --vfs-cache-max-size or---vfs-cache-min-free-size is exceeded, rclone will attempt to evict the+--vfs-cache-min-free-space is exceeded, rclone will attempt to evict theleast accessed files from the cache first. rclone will start with filesthat haven't been accessed for the longest. This cache flushing strategyis efficient and more relevant files are likely to remain cached.@@ -12068,6 +12958,43 @@ result is accurate. However, this is very inefficient and may cost lotsof API calls resulting in extra charges. Use it as a last resort andonly with caching.+VFS Metadata++If you use the --vfs-metadata-extension flag you can get the VFS to+expose files which contain the metadata as a JSON blob. These files will+not appear in the directory listing, but can be stat-ed and opened and+once they have been they will appear in directory listings until the+directory cache expires.++Note that some backends won't create metadata unless you pass in the+--metadata flag.++For example, using rclone mount with+--metadata --vfs-metadata-extension .metadata we get++ $ ls -l /mnt/+ total 1048577+ -rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++ $ cat /mnt/1G.metadata+ {+ "atime": "2025-03-04T17:34:22.317069787Z",+ "btime": "2025-03-03T16:03:37.708253808Z",+ "gid": "1000",+ "mode": "100664",+ "mtime": "2025-03-03T16:03:39.640238323Z",+ "uid": "1000"+ }++ $ ls -l /mnt/+ total 1048578+ -rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+ -rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata++If the file has no metadata it will be returned as {} and if there is an+error reading the metadata the error will be returned as+{"error":"error string"}.+Auth ProxyIf you supply the parameter --auth-proxy /path/to/program then rclone@@ -12174,6 +13101,7 @@ Options--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a '.rclonelink' extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached ('off' is unlimited) (default off)@@ -12199,6 +13127,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -12422,7 +13351,13 @@ By default this will serve files without needing a login.You can either use an htpasswd file which can take lots of users, or seta single username and password with the --user and --pass flags.-If no static users are configured by either of the above methods, and+Alternatively, you can have the reverse proxy manage authentication and+use the username provided in the configured header with+--user-from-header (e.g., ----user-from-header=x-remote-user). Ensure+the proxy is trusted and headers cannot be spoofed, as misconfiguration+may lead to unauthorized access.++If either of the above authentication methods is not configured andclient certificates are required by the --client-ca flag passed to theserver, the client certificate common name will be considered as theusername.@@ -12538,11 +13473,11 @@ and if they haven't been accessed for --vfs-write-back seconds. Ifrclone is quit or dies with files that haven't been uploaded, these willbe uploaded next time rclone is run with the same flags.-If using --vfs-cache-max-size or --vfs-cache-min-free-size note that the-cache may exceed these quotas for two reasons. Firstly because it is+If using --vfs-cache-max-size or --vfs-cache-min-free-space note that+the cache may exceed these quotas for two reasons. Firstly because it isonly checked every --vfs-cache-poll-interval. Secondly because openfiles cannot be evicted from the cache. When --vfs-cache-max-size or---vfs-cache-min-free-size is exceeded, rclone will attempt to evict the+--vfs-cache-min-free-space is exceeded, rclone will attempt to evict theleast accessed files from the cache first. rclone will start with filesthat haven't been accessed for the longest. This cache flushing strategyis efficient and more relevant files are likely to remain cached.@@ -12868,6 +13803,43 @@ result is accurate. However, this is very inefficient and may cost lotsof API calls resulting in extra charges. Use it as a last resort andonly with caching.+VFS Metadata++If you use the --vfs-metadata-extension flag you can get the VFS to+expose files which contain the metadata as a JSON blob. These files will+not appear in the directory listing, but can be stat-ed and opened and+once they have been they will appear in directory listings until the+directory cache expires.++Note that some backends won't create metadata unless you pass in the+--metadata flag.++For example, using rclone mount with+--metadata --vfs-metadata-extension .metadata we get++ $ ls -l /mnt/+ total 1048577+ -rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++ $ cat /mnt/1G.metadata+ {+ "atime": "2025-03-04T17:34:22.317069787Z",+ "btime": "2025-03-03T16:03:37.708253808Z",+ "gid": "1000",+ "mode": "100664",+ "mtime": "2025-03-03T16:03:39.640238323Z",+ "uid": "1000"+ }++ $ ls -l /mnt/+ total 1048578+ -rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+ -rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata++If the file has no metadata it will be returned as {} and if there is an+error reading the metadata the error will be returned as+{"error":"error string"}.+Auth ProxyIf you supply the parameter --auth-proxy /path/to/program then rclone@@ -12943,12 +13915,12 @@ that rclone supports.Options- --addr stringArray IPaddress:Port, :Port or [unix://]/path/to/socket to bind server to (default [127.0.0.1:8080])+ --addr stringArray IPaddress:Port or :Port to bind server to (default 127.0.0.1:8080)--allow-origin string Origin which cross-domain request (CORS) can be executed from--auth-proxy string A program to use to create the backend from the auth--baseurl string Prefix for URLs - leave blank for root- --cert string Path to TLS PEM public key certificate file (can also include intermediate/CA certificates)- --client-ca string Path to TLS PEM CA file with certificate authorities to verify clients with+ --cert string TLS PEM key (concatenation of certificate and CA certificate)+ --client-ca string Client certificate authority to verify clients with--dir-cache-time Duration Time to cache directory entries for (default 5m0s)--dir-perms FileMode Directory permissions (default 777)--disable-dir-list Disable HTML directory list on GET request for a directory@@ -12957,7 +13929,7 @@ Options--gid uint32 Override the gid field set by the filesystem (not supported on Windows) (default 1000)-h, --help help for webdav--htpasswd string A htpasswd file - if not provided no authentication is done- --key string Path to TLS PEM private key file+ --key string TLS PEM Private key--link-perms FileMode Link permissions (default 666)--max-header-bytes int Maximum size of request header (default 4096)--min-tls-version string Minimum TLS version that is acceptable (default "tls1.0")@@ -12975,6 +13947,7 @@ Options--uid uint32 Override the uid field set by the filesystem (not supported on Windows) (default 1000)--umask FileMode Override the permission bits set by the filesystem (not supported on Windows) (default 002)--user string User name for authentication+ --user-from-header string User name from a defined HTTP header--vfs-block-norm-dupes If duplicate filenames exist in the same directory (after normalization), log an error and hide the duplicates (may have a performance cost)--vfs-cache-max-age Duration Max time since last access of objects in the cache (default 1h0m0s)--vfs-cache-max-size SizeSuffix Max total size of objects in the cache (default off)@@ -12985,6 +13958,7 @@ Options--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a '.rclonelink' extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached ('off' is unlimited) (default off)@@ -13010,6 +13984,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -13264,7 +14239,8 @@ unless --no-create or --recursive is provided.If --recursive is used then recursively sets the modification time onall existing files that is found under the path. Filters are supported,-and you can test with the --dry-run or the --interactive/-i flag.+and you can test with the --dry-run or the --interactive/-i flag. This+will touch --transfers files concurrently.If --timestamp is used then sets the modification time to that timeinstead of the current time. Times may be specified as one of:@@ -13309,6 +14285,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -13406,6 +14383,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -13895,6 +14873,10 @@ also possible to specify --boolean=false or --boolean=true. Note that--boolean false is not valid - this is parsed as --boolean and the falseis parsed as an extra command line argument for rclone.+Options documented to take a stringArray parameter accept multiple+values. To pass more than one value, repeat the option; for example:+--include value1 --include value2.+Time or duration optionsTIME or DURATION options can be specified as a duration string or a time@@ -14244,7 +15226,8 @@ user on any OS, and the value is defined as following:from shell command cd && pwd.If you run rclone config file you will see where the default location is-for you.+for you. Running rclone config touch will ensure a configuration file+exists, creating an empty one in the default location if there is none.The fact that an existing file rclone.conf in the same directory as therclone executable is always preferred, means that it is easy to run in@@ -14253,8 +15236,14 @@ and then create an empty file rclone.conf in the same directory.If the location is set to empty string "" or path to a file with namenotfound, or the os null device represented by value NUL on Windows and-/dev/null on Unix systems, then rclone will keep the config file in-memory only.+/dev/null on Unix systems, then rclone will keep the configuration file+in memory only.++You may see a log message "Config file not found - using defaults" if+there is no configuration file. This can be supressed, e.g. if you are+using rclone entirely with on the fly remotes, by using memory-only+configuration file or by creating an empty configuration file, as+described above.The file format is basic INI: Sections of text, led by a [section]header and followed by key=value entries on separate lines. In rclone@@ -14712,6 +15701,19 @@ The --links / -l flag enables this feature for all supported backendsand the VFS. There are individual flags for just enabling it for the VFS--vfs-links and the local backend --local-links if required.+--list-cutoff N++When syncing rclone needs to sort directory entries before comparing+them. Below this threshold (1,000,000) by default, rclone will store the+directory entries in memory. 1,000,000 entries will take approx 1GB of+RAM to store. Above this threshold rclone will store directory entries+on disk and sort them without using a lot of memory.++Doing this is slightly less efficient then sorting them in memory and+will only work well for the bucket based backends (eg s3, b2, azureblob,+swift) but these are the only backends likely to have millions of+entries in a directory.+--log-file=FILELog all of rclone's output to FILE. This is not active by default. This@@ -14726,12 +15728,25 @@ a signal to rotate logs.--log-format LIST-Comma separated list of log format options. Accepted options are date,-time, microseconds, pid, longfile, shortfile, UTC. Any other keywords-will be silently ignored. pid will tag log messages with process-identifier which useful with rclone mount --daemon. Other accepted-options are explained in the go documentation. The default log format is-"date,time".+Comma separated list of log format options. The accepted options are:++- date - Add a date in the format YYYY/MM/YY to the log.+- time - Add a time to the log in format HH:MM:SS.+- microseconds - Add microseconds to the time in format+ HH:MM:SS.SSSSSS.+- UTC - Make the logs in UTC not localtime.+- longfile - Adds the source file and line number of the log+ statement.+- shortfile - Adds the source file and line number of the log+ statement.+- pid - Add the process ID to the log - useful with+ rclone mount --daemon.+- nolevel - Don't add the level to the log.+- json - Equivalent to adding --use-json-log++They are added to the log line in the order above.++The default log format is "date,time".--log-level LEVEL@@ -14749,10 +15764,84 @@ warnings and significant events.ERROR is equivalent to -q. It only outputs error messages.+--windows-event-log LEVEL++If this is configured (the default is OFF) then logs of this level and+above will be logged to the Windows event log in addition to the normal+logs. These will be logged in JSON format as described below regardless+of what format the main logs are configured for.++The Windows event log only has 3 levels of severity Info, Warning and+Error. If enabled we map rclone levels like this.++- Error ← ERROR (and above)+- Warning ← WARNING (note that this level is defined but not currently+ used).+- Info ← NOTICE, INFO and DEBUG.++Rclone will declare its log source as "rclone" if it is has enough+permissions to create the registry key needed. If not then logs will+appear as "Application". You can run+rclone version --windows-event-log DEBUG once as administrator to create+the registry key in advance.++Note that the --windows-event-log level must be greater (more severe)+than or equal to the --log-level. For example to log DEBUG to a log file+but ERRORs to the event log you would use++ --log-file rclone.log --log-level DEBUG --windows-event-log ERROR++This option is only supported Windows platforms.+--use-json-log-This switches the log format to JSON for rclone. The fields of json log-are level, msg, source, time.+This switches the log format to JSON for rclone. The fields of JSON log+are level, msg, source, time. The JSON logs will be printed on a single+line, but are shown expanded here for clarity.++ {+ "time": "2025-05-13T17:30:51.036237518+01:00",+ "level": "debug",+ "msg": "4 go routines active\n",+ "source": "cmd/cmd.go:298"+ }++Completed data transfer logs will have extra size information. Logs+which are about a particular object will have object and objectType+fields also.++ {+ "time": "2025-05-13T17:38:05.540846352+01:00",+ "level": "info",+ "msg": "Copied (new) to: file2.txt",+ "size": 6,+ "object": "file.txt",+ "objectType": "*local.Object",+ "source": "operations/copy.go:368"+ }++Stats logs will contain a stats field which is the same as returned from+the rc call core/stats.++ {+ "time": "2025-05-13T17:38:05.540912847+01:00",+ "level": "info",+ "msg": "...text version of the stats...",+ "stats": {+ "bytes": 6,+ "checks": 0,+ "deletedDirs": 0,+ "deletes": 0,+ "elapsedTime": 0.000904825,+ ...truncated for clarity...+ "totalBytes": 6,+ "totalChecks": 0,+ "totalTransfers": 1,+ "transferTime": 0.000882794,+ "transfers": 1+ },+ "source": "accounting/stats.go:569"+ }--low-level-retries NUMBER@@ -14788,6 +15877,50 @@ the remote which may be desirable.Setting this to a negative number will make the backlog as large aspossible.+--max-buffer-memory=SIZE++If set, don't allocate more than SIZE amount of memory as buffers. If+not set or set to 0 or off this will not limit the amount of memory in+use.++This includes memory used by buffers created by the --buffer flag and+buffers used by multi-thread transfers.++Most multi-thread transfers do not take additional memory, but some do+depending on the backend (eg the s3 backend for uploads). This means+there is a tension between total setting --transfers as high as possible+and memory use.++Setting --max-buffer-memory allows the buffer memory to be controlled so+that it doesn't overwhelm the machine and allows --transfers to be set+large.++--max-connections=N++This sets the maximum number of concurrent calls to the backend API. It+may not map 1:1 to TCP or HTTP connections depending on the backend in+use and the use of HTTP1 vs HTTP2.++When downloading files, backends only limit the initial opening of the+stream. The bulk data download is not counted as a connection. This+means that the --max--connections flag won't limit the total number of+downloads.++Note that it is possible to cause deadlocks with this setting so it+should be used with care.++If you are doing a sync or copy then make sure --max-connections is one+more than the sum of --transfers and --checkers.++If you use --check-first then --max-connections just needs to be one+more than the maximum of --checkers and --transfers.++So for --max-connections 3 you'd use+--checkers 2 --transfers 2 --check-first or --checkers 1 --transfers 1.++Setting this flag can be useful for backends which do multipart uploads+to limit the number of simultaneous parts being transferred.+--max-delete=NThis tells rclone not to delete more than N files. If that limit is@@ -15036,6 +16169,13 @@ This will work with the sync/copy/move commands and friendscopyto/moveto. Multi thread transfers will be used with rclone mount andrclone serve if --vfs-cache-mode is set to writes or above.+Most multi-thread transfers do not take additional memory, but some do+(for example uploading to s3). In the worst case memory usage can be at+maximum --transfers * --multi-thread-chunk-size --multi-thread-streams+or specifically for the s3 backend --transfers --s3-chunk-size *+--s3-concurrency. However you can use the the --max-buffer-memory flag+to control the maximum memory used here.+NB that this only works with supported backends as the destination butwill work with any backend as the source.@@ -15058,6 +16198,14 @@ If the backend has a --backend-upload-concurrency setting (egtransfers instead if it is larger than the value of--multi-thread-streams or --multi-thread-streams isn't set.+--name-transform COMMAND[=XXXX]++--name-transform introduces path name transformations for rclone copy,+rclone sync, and rclone move. These transformations enable modifications+to source and destination file names by applying prefixes, suffixes, and+other alterations during transfer operations. For detailed docs and+examples, see convmv.+--no-check-destThe --no-check-dest can be used with move or copy and it causes rclone@@ -16043,6 +17191,7 @@ For the filtering options- --max-size- --min-age- --max-age+- --hash-filter- --dump filters- --metadata-include- --metadata-include-from@@ -16177,7 +17326,7 @@ The options set by environment variables can be seen with the -vv flag,e.g. rclone version -vv.Options that can appear multiple times (type stringArray) are treated-slighly differently as environment variables can only be defined once.+slightly differently as environment variables can only be defined once.In order to allow a simple mechanism for adding one or many items, theinput is treated as a CSV encoded string. For example@@ -17106,6 +18255,95 @@ or more.See the time option docs for valid formats.+--hash-filter - Deterministically select a subset of files++The --hash-filter flag enables selecting a deterministic subset of+files, useful for:++1. Running large sync operations across multiple machines.+2. Checking a subset of files for bitrot.+3. Any other operations where a sample of files is required.++Syntax++The flag takes two parameters expressed as a fraction:++ --hash-filter K/N++- N: The total number of partitions (must be a positive integer).+- K: The specific partition to select (an integer from 0 to N).++For example: - --hash-filter 1/3: Selects the first third of the files.+- --hash-filter 2/3 and --hash-filter 3/3: Select the second and third+partitions, respectively.++Each partition is non-overlapping, ensuring all files are covered+without duplication.++Random Partition Selection++Use @ as K to randomly select a partition:++ --hash-filter @/M++For example, --hash-filter @/3 will randomly select a number between 0+and 2. This will stay constant across retries.++How It Works++- Rclone takes each file's full path, normalizes it to lowercase, and+ applies Unicode normalization.+- It then hashes the normalized path into a 64 bit number.+- The hash result is reduced modulo N to assign the file to a+ partition.+- If the calculated partition does not match K the file is excluded.+- Other filters may apply if the file is not excluded.++Important: Rclone will traverse all directories to apply the filter.++Usage Notes++- Safe to use with rclone sync; source and destination selections will+ match.+- Do not use with --delete-excluded, as this could delete unselected+ files.+- Ignored if --files-from is used.++Examples++Dividing files into 4 partitions++Assuming the current directory contains file1.jpg through file9.jpg:++ $ rclone lsf --hash-filter 0/4 .+ file1.jpg+ file5.jpg++ $ rclone lsf --hash-filter 1/4 .+ file3.jpg+ file6.jpg+ file9.jpg++ $ rclone lsf --hash-filter 2/4 .+ file2.jpg+ file4.jpg++ $ rclone lsf --hash-filter 3/4 .+ file7.jpg+ file8.jpg++ $ rclone lsf --hash-filter 4/4 . # the same as --hash-filter 0/4+ file1.jpg+ file5.jpg++Syncing the first quarter of files++ rclone sync --hash-filter 1/4 source:path destination:path++Checking a random 1% of files for integrity++ rclone check --download --hash-filter @/100 source:path destination:path+Other flags--delete-excluded - Delete files on dest excluded from sync@@ -17608,9 +18846,16 @@ Setting config flags with _configIf you wish to set config (the equivalent of the global flags) for theduration of an rc call only then pass in the _config parameter.-This should be in the same format as the config key returned by+This should be in the same format as the main key returned byoptions/get.+ rclone rc --loopback options/get blocks=main++You can see more help on these options with this command (see the+options blocks section for more info).++ rclone rc --loopback options/info blocks=main+For example, if you wished to run a sync with the --checksum parameter,you would pass this parameter in your JSON blob.@@ -17641,6 +18886,13 @@ in the _filter parameter.This should be in the same format as the filter key returned byoptions/get.+ rclone rc --loopback options/get blocks=filter++You can see more help on these options with this command (see the+options blocks section for more info).++ rclone rc --loopback options/info blocks=filter+For example, if you wished to run a sync with these flags--max-size 1M --max-age 42s --include "a" --include "b"@@ -17722,7 +18974,8 @@ format. Each block describes a single option.FieldName string N name of the field used inthe rc - if blank use- Name+ Name. May contain "." for+ nested fields.Help string N help, started with asingle sentence on a@@ -17957,6 +19210,7 @@ This takes the following parameters:- obscure - declare passwords are plain and need obscuring- noObscure - declare passwords are already obscured and don'tneed obscuring+ - noOutput - don't print anything to stdout- nonInteractive - don't interact with a user, return questions- continue - continue the config process with an answer- all - ask all the config questions not just the post config ones@@ -18065,6 +19319,7 @@ This takes the following parameters:- obscure - declare passwords are plain and need obscuring- noObscure - declare passwords are already obscured and don'tneed obscuring+ - noOutput - don't print anything to stdout- nonInteractive - don't interact with a user, return questions- continue - continue the config process with an answer- all - ask all the config questions not just the post config ones@@ -18245,7 +19500,9 @@ returned.Parameters-- group - name of the stats group (string)+- group - name of the stats group (string, optional)+- short - if true will not return the transferring and checking arrays+ (boolean, optional)Returns the following values:@@ -18259,6 +19516,7 @@ Returns the following values:"fatalError": boolean whether there has been at least one fatal error,"lastError": last error string,"renames" : number of files renamed,+ "listed" : number of directory entries listed,"retryError": boolean showing whether there has been at least one non-NoRetryError,"serverSideCopies": number of server side copies done,"serverSideCopyBytes": number bytes server side copied,@@ -19268,6 +20526,136 @@ check that parameter passing is working properly.Authentication is required for this call.+serve/list: Show running servers++Show running servers with IDs.++This takes no parameters and returns++- list: list of running serve commands++Each list element will have++- id: ID of the server+- addr: address the server is running on+- params: parameters used to start the server++Eg++ rclone rc serve/list++Returns++ {+ "list": [+ {+ "addr": "[::]:4321",+ "id": "nfs-ffc2a4e5",+ "params": {+ "fs": "remote:",+ "opt": {+ "ListenAddr": ":4321"+ },+ "type": "nfs",+ "vfsOpt": {+ "CacheMode": "full"+ }+ }+ }+ ]+ }++Authentication is required for this call.++serve/start: Create a new server++Create a new server with the specified parameters.++This takes the following parameters:++- type - type of server: http, webdav, ftp, sftp, nfs, etc.+- fs - remote storage path to serve+- addr - the ip:port to run the server on, eg ":1234" or+ "localhost:1234"++Other parameters are as described in the documentation for the relevant+rclone serve command line options. To translate a command line option to+an rc parameter, remove the leading -- and replace - with _, so+--vfs-cache-mode becomes vfs_cache_mode. Note that global parameters+must be set with _config and _filter as described above.++Examples:++ rclone rc serve/start type=nfs fs=remote: addr=:4321 vfs_cache_mode=full+ rclone rc serve/start --json '{"type":"nfs","fs":"remote:","addr":":1234","vfs_cache_mode":"full"}'++This will give the reply++ {+ "addr": "[::]:4321", // Address the server was started on+ "id": "nfs-ecfc6852" // Unique identifier for the server instance+ }++Or an error if it failed to start.++Stop the server with serve/stop and list the running servers with+serve/list.++Authentication is required for this call.++serve/stop: Unserve selected active serve++Stops a running serve instance by ID.++This takes the following parameters:++- id: as returned by serve/start++This will give an empty response if successful or an error if not.++Example:++ rclone rc serve/stop id=12345++Authentication is required for this call.++serve/stopall: Stop all active servers++Stop all active servers.++This will stop all active servers.++ rclone rc serve/stopall++Authentication is required for this call.++serve/types: Show all possible serve types++This shows all possible serve types and returns them as a list.++This takes no parameters and returns++- types: list of serve types, eg "nfs", "sftp", etc++The serve types are strings like "serve", "serve2", "cserve" and can be+passed to serve/start as the serveType parameter.++Eg++ rclone rc serve/types++Returns++ {+ "types": [+ "http",+ "sftp",+ "nfs"+ ]+ }++Authentication is required for this call.+sync/bisync: Perform bidirectional synchronization between two paths.This takes the following parameters@@ -19420,7 +20808,7 @@ This is only useful if --vfs-cache-mode > off. If you call it when the],}-The expiry time is the time until the file is elegible for being+The expiry time is the time until the file is eligible for beinguploaded in floating point seconds. This may go negative. As rclone onlytransfers --transfers files at once, only the lowest --transfers expirytimes will have uploading as true. So there may be files with negative@@ -19734,6 +21122,7 @@ Here is an overview of the major features of each cloud storage system.Cloudinary MD5 R No Yes - -Dropbox DBHASH ¹ R Yes No - -Enterprise File Fabric - R/W Yes No R/W -+ FileLu Cloud Storage MD5 R/W No Yes R -Files.com MD5, CRC32 DR/W Yes No R -FTP - R/W ¹⁰ No No - -Gofile MD5 DR/W No Yes R -@@ -20502,6 +21891,7 @@ Flags for anything which can copy a file.--multi-thread-cutoff SizeSuffix Use multi-thread downloads for files above this size (default 256Mi)--multi-thread-streams int Number of streams to use for multi-thread downloads (default 4)--multi-thread-write-buffer-size SizeSuffix In memory buffer size for writing when in multi-thread mode (default 128Ki)+ --name-transform stringArray Transform paths during the copy process--no-check-dest Don't check the destination, copy regardless--no-traverse Don't traverse destination file system on copy--no-update-dir-modtime Don't update directory modification times@@ -20524,6 +21914,7 @@ Flags used for sync commands.--delete-during When synchronizing, delete files during transfer--fix-case Force rename of case insensitive dest to match source--ignore-errors Delete even if there are I/O errors+ --list-cutoff int To save memory, sort directory listings on disk above this threshold (default 1000000)--max-delete int When synchronizing, limit the number of deletes (default -1)--max-delete-size SizeSuffix When synchronizing, limit the total size of deletes (default off)--suffix string Suffix to add to changed files@@ -20563,13 +21954,14 @@ Flags for general networking and HTTP stuff.--header stringArray Set HTTP header for all transactions--header-download stringArray Set HTTP header for download transactions--header-upload stringArray Set HTTP header for upload transactions+ --max-connections int Maximum number of simultaneous backend API connections, 0 for unlimited--no-check-certificate Do not verify the server SSL certificate (insecure)--no-gzip-encoding Don't set Accept-Encoding: gzip--timeout Duration IO idle timeout (default 5m0s)--tpslimit float Limit HTTP transactions per second to this--tpslimit-burst int Max burst of transactions for --tpslimit (default 1)--use-cookies Enable session cookiejar- --user-agent string Set the user-agent to a specified string (default "rclone/v1.69.0")+ --user-agent string Set the user-agent to a specified string (default "rclone/v1.70.0")Performance@@ -20598,6 +21990,7 @@ Flags for general configuration of rclone.-i, --interactive Enable interactive mode--kv-lock-time Duration Maximum time to keep key-value database locked by process (default 1s)--low-level-retries int Number of low level retries to do (default 10)+ --max-buffer-memory SizeSuffix If set, don't allocate more than this amount of memory as buffers (default off)--no-console Hide console window (supported on Windows only)--no-unicode-normalization Don't normalize unicode characters in filenames--password-command SpaceSepList Command for supplying password for encrypted configuration@@ -20629,6 +22022,7 @@ Flags for filtering directory listings.--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -20656,7 +22050,7 @@ LoggingFlags for logging and statistics.--log-file string Log everything to this file- --log-format string Comma separated list of log format options (default "date,time")+ --log-format Bits Comma separated list of log format options (default date,time)--log-level LogLevel Log level DEBUG|INFO|NOTICE|ERROR (default NOTICE)--log-systemd Activate systemd integration for the logger--max-stats-groups int Maximum number of stats groups to keep in memory, on max oldest is discarded (default 1000)@@ -20717,6 +22111,7 @@ Flags to control the Remote Control API.--rc-server-write-timeout Duration Timeout for server writing data (default 1h0m0s)--rc-template string User-specified template--rc-user string User name for authentication+ --rc-user-from-header string User name from a defined HTTP header--rc-web-fetch-url string URL to fetch the releases for webgui (default "https://api.github.com/repos/rclone/rclone-webui-react/releases/latest")--rc-web-gui Launch WebGUI on localhost--rc-web-gui-force-update Force update to latest version of web gui@@ -20743,6 +22138,7 @@ Flags to control the Metrics HTTP endpoint..--metrics-server-write-timeout Duration Timeout for server writing data (default 1h0m0s)--metrics-template string User-specified template--metrics-user string User name for authentication+ --metrics-user-from-header string User name from a defined HTTP header--rc-enable-metrics Enable the Prometheus metrics path at the remote control serverBackend@@ -20760,6 +22156,8 @@ Backend-only flags (these can be set in the config file also).--azureblob-client-id string The ID of the client in use--azureblob-client-secret string One of the service principal's client secrets--azureblob-client-send-certificate-chain Send the certificate chain when using certificate auth+ --azureblob-copy-concurrency int Concurrency for multipart copy (default 512)+ --azureblob-copy-cutoff SizeSuffix Cutoff for switching to multipart copy (default 8Mi)--azureblob-delete-snapshots string Set to specify how to deal with snapshots on blob deletion--azureblob-description string Description of the remote--azureblob-directory-markers Upload an empty object with a trailing slash when a new directory is created@@ -20783,6 +22181,7 @@ Backend-only flags (these can be set in the config file also).--azureblob-upload-concurrency int Concurrency for multipart uploads (default 16)--azureblob-upload-cutoff string Cutoff for switching to chunked upload (<= 256 MiB) (deprecated)--azureblob-use-az Use Azure CLI tool az for authentication+ --azureblob-use-copy-blob Whether to use the Copy Blob API when copying to the same storage account (default true)--azureblob-use-emulator Uses local storage emulator if provided as 'true'--azureblob-use-msi Use a managed service identity to authenticate (only works in Azure)--azureblob-username string User name (usually an email address)@@ -20795,6 +22194,7 @@ Backend-only flags (these can be set in the config file also).--azurefiles-client-send-certificate-chain Send the certificate chain when using certificate auth--azurefiles-connection-string string Azure Files Connection String--azurefiles-description string Description of the remote+ --azurefiles-disable-instance-discovery Skip requesting Microsoft Entra instance metadata--azurefiles-encoding Encoding The encoding for the backend (default Slash,LtGt,DoubleQuote,Colon,Question,Asterisk,Pipe,BackSlash,Del,Ctl,RightPeriod,InvalidUtf8,Dot)--azurefiles-endpoint string Endpoint for the service--azurefiles-env-auth Read credentials from runtime (environment variables, CLI or MSI)@@ -20809,6 +22209,7 @@ Backend-only flags (these can be set in the config file also).--azurefiles-share-name string Azure Files Share Name--azurefiles-tenant string ID of the service principal's tenant. Also called its directory ID--azurefiles-upload-concurrency int Concurrency for multipart uploads (default 16)+ --azurefiles-use-az Use Azure CLI tool az for authentication--azurefiles-use-msi Use a managed service identity to authenticate (only works in Azure)--azurefiles-username string User name (usually an email address)--b2-account string Account ID or Application Key ID@@ -20871,12 +22272,14 @@ Backend-only flags (these can be set in the config file also).--chunker-fail-hard Choose how chunker should handle files with missing or invalid chunks--chunker-hash-type string Choose how chunker handles hash sums (default "md5")--chunker-remote string Remote to chunk/unchunk+ --cloudinary-adjust-media-files-extensions Cloudinary handles media formats as a file attribute and strips it from the name, which is unlike most other file systems (default true)--cloudinary-api-key string Cloudinary API Key--cloudinary-api-secret string Cloudinary API Secret--cloudinary-cloud-name string Cloudinary Environment Name--cloudinary-description string Description of the remote--cloudinary-encoding Encoding The encoding for the backend (default Slash,LtGt,DoubleQuote,Question,Asterisk,Pipe,Hash,Percent,BackSlash,Del,Ctl,RightSpace,InvalidUtf8,Dot)--cloudinary-eventually-consistent-delay Duration Wait N seconds for eventual consistency of the databases that support the backend operation (default 0s)+ --cloudinary-media-extensions stringArray Cloudinary supported media extensions (default 3ds,3g2,3gp,ai,arw,avi,avif,bmp,bw,cr2,cr3,djvu,dng,eps3,fbx,flif,flv,gif,glb,gltf,hdp,heic,heif,ico,indd,jp2,jpe,jpeg,jpg,jxl,jxr,m2ts,mov,mp4,mpeg,mts,mxf,obj,ogv,pdf,ply,png,psd,svg,tga,tif,tiff,ts,u3ma,usdz,wdp,webm,webp,wmv)--cloudinary-upload-prefix string Specify the API endpoint for environments out of the US--cloudinary-upload-preset string Upload Preset to select asset manipulation on upload--combine-description string Description of the remote@@ -20900,6 +22303,10 @@ Backend-only flags (these can be set in the config file also).--crypt-show-mapping For all files listed show how the names encrypt--crypt-strict-names If set, this will raise an error when crypt comes across a filename that can't be decrypted--crypt-suffix string If this is set it will override the default suffix of ".bin" (default ".bin")+ --doi-description string Description of the remote+ --doi-doi string The DOI or the doi.org URL+ --doi-doi-resolver-api-url string The URL of the DOI resolver API to use+ --doi-provider string DOI provider--drive-acknowledge-abuse Set to allow files which return cannotDownloadAbusiveFile to be downloaded--drive-allow-import-name-change Allow the filetype to change when uploading Google docs--drive-auth-owner-only Only consider files owned by the authenticated user@@ -20951,7 +22358,6 @@ Backend-only flags (these can be set in the config file also).--drive-use-trash Send files to the trash instead of deleting permanently (default true)--drive-v2-download-min-size SizeSuffix If Object's are greater, use drive v2 API to download (default off)--dropbox-auth-url string Auth server URL- --dropbox-batch-commit-timeout Duration Max time to wait for a batch to finish committing (default 10m0s)--dropbox-batch-mode string Upload file batching sync|async|off (default "sync")--dropbox-batch-size int Max number of files in upload batch--dropbox-batch-timeout Duration Max time to allow an idle upload batch before uploading (default 0s)@@ -20961,11 +22367,14 @@ Backend-only flags (these can be set in the config file also).--dropbox-client-secret string OAuth Client Secret--dropbox-description string Description of the remote--dropbox-encoding Encoding The encoding for the backend (default Slash,BackSlash,Del,RightSpace,InvalidUtf8,Dot)+ --dropbox-export-formats CommaSepList Comma separated list of preferred formats for exporting files (default html,md)--dropbox-impersonate string Impersonate this user when using a business account--dropbox-pacer-min-sleep Duration Minimum time to sleep between API calls (default 10ms)--dropbox-root-namespace string Specify a different Dropbox namespace ID to use as the root for all paths--dropbox-shared-files Instructs rclone to work on individual shared files--dropbox-shared-folders Instructs rclone to work on shared folders+ --dropbox-show-all-exports Show all exportable files in listings+ --dropbox-skip-exports Skip exportable files in all listings--dropbox-token string OAuth Access Token as a JSON blob--dropbox-token-url string Token server url--fichier-api-key string Your API Key, get it from https://1fichier.com/console/params.pl@@ -20983,6 +22392,9 @@ Backend-only flags (these can be set in the config file also).--filefabric-token-expiry string Token expiry time--filefabric-url string URL of the Enterprise File Fabric to connect to--filefabric-version string Version read from the file fabric+ --filelu-description string Description of the remote+ --filelu-encoding Encoding The encoding for the backend (default Slash,LtGt,DoubleQuote,SingleQuote,BackQuote,Dollar,Colon,Question,Asterisk,Pipe,Hash,Percent,BackSlash,CrLf,Del,Ctl,LeftSpace,LeftPeriod,LeftTilde,LeftCrLfHtVt,RightSpace,RightPeriod,RightCrLfHtVt,InvalidUtf8,Dot,SquareBracket,Semicolon,Exclamation)+ --filelu-key string Your FileLu Rclone key from My Account--filescom-api-key string The API key used to authenticate with Files.com--filescom-description string Description of the remote--filescom-encoding Encoding The encoding for the backend (default Slash,BackSlash,Del,Ctl,RightSpace,RightCrLfHtVt,InvalidUtf8,Dot)@@ -21042,7 +22454,6 @@ Backend-only flags (these can be set in the config file also).--gofile-list-chunk int Number of items to list in each call (default 1000)--gofile-root-folder-id string ID of the root folder--gphotos-auth-url string Auth server URL- --gphotos-batch-commit-timeout Duration Max time to wait for a batch to finish committing (default 10m0s)--gphotos-batch-mode string Upload file batching sync|async|off (default "sync")--gphotos-batch-size int Max number of files in upload batch--gphotos-batch-timeout Duration Max time to allow an idle upload batch before uploading (default 0s)@@ -21110,6 +22521,8 @@ Backend-only flags (these can be set in the config file also).--internetarchive-encoding Encoding The encoding for the backend (default Slash,LtGt,CrLf,Del,Ctl,InvalidUtf8,Dot)--internetarchive-endpoint string IAS3 Endpoint (default "https://s3.us.archive.org")--internetarchive-front-endpoint string Host of InternetArchive Frontend (default "https://archive.org")+ --internetarchive-item-derive Whether to trigger derive on the IA item or not. If set to false, the item will not be derived by IA upon upload (default true)+ --internetarchive-item-metadata stringArray Metadata to be set on the IA item, this is different from file-level metadata that can be set using --metadata-set--internetarchive-secret-access-key string IAS3 Secret Key (password)--internetarchive-wait-archive Duration Timeout for waiting the server's processing tasks (specifically archive and book_op) to finish (default 0s)--jottacloud-auth-url string Auth server URL@@ -21205,6 +22618,7 @@ Backend-only flags (these can be set in the config file also).--onedrive-tenant string ID of the service principal's tenant. Also called its directory ID--onedrive-token string OAuth Access Token as a JSON blob--onedrive-token-url string Token server url+ --onedrive-upload-cutoff SizeSuffix Cutoff for switching to chunked upload (default off)--oos-attempt-resume-upload If true attempt to resume previously started multipart upload for the object--oos-chunk-size SizeSuffix Chunk size to use for uploading (default 5Mi)--oos-compartment string Specify compartment OCID, if you need to list buckets@@ -21230,6 +22644,7 @@ Backend-only flags (these can be set in the config file also).--oos-storage-tier string The storage class to use when storing new objects in storage. https://docs.oracle.com/en-us/iaas/Content/Object/Concepts/understandingstoragetiers.htm (default "Standard")--oos-upload-concurrency int Concurrency for multipart uploads (default 10)--oos-upload-cutoff SizeSuffix Cutoff for switching to chunked upload (default 200Mi)+ --opendrive-access string Files and folders will be uploaded with this access permission (default private) (default "private")--opendrive-chunk-size SizeSuffix Files will be uploaded in chunks this size (default 10Mi)--opendrive-description string Description of the remote--opendrive-encoding Encoding The encoding for the backend (default Slash,LtGt,DoubleQuote,Colon,Question,Asterisk,Pipe,BackSlash,LeftSpace,LeftCrLfHtVt,RightSpace,RightCrLfHtVt,InvalidUtf8,Dot)@@ -21326,6 +22741,8 @@ Backend-only flags (these can be set in the config file also).--s3-endpoint string Endpoint for S3 API--s3-env-auth Get AWS credentials from runtime (environment variables or EC2/ECS meta data if no env vars)--s3-force-path-style If true use path style access if false use virtual hosted style (default true)+ --s3-ibm-api-key string IBM API Key to be used to obtain IAM token+ --s3-ibm-resource-instance-id string IBM service instance id--s3-leave-parts-on-error If true avoid calling abort upload on a failure, leaving all successfully uploaded parts on S3 for manual recovery--s3-list-chunk int Size of listing chunk (response list for each ListObject S3 request) (default 1000)--s3-list-url-encode Tristate Whether to url encode listings: true/false/unset (default unset)@@ -21346,6 +22763,7 @@ Backend-only flags (these can be set in the config file also).--s3-server-side-encryption string The server-side encryption algorithm used when storing this object in S3--s3-session-token string An AWS session token--s3-shared-credentials-file string Path to the shared credentials file+ --s3-sign-accept-encoding Tristate Set if rclone should include Accept-Encoding as part of the signature (default unset)--s3-sse-customer-algorithm string If using SSE-C, the server-side encryption algorithm used when storing this object in S3--s3-sse-customer-key string To use SSE-C you may provide the secret encryption key used to encrypt/decrypt your data--s3-sse-customer-key-base64 string If using SSE-C you must provide the secret encryption key encoded in base64 format to encrypt/decrypt your data@@ -21362,6 +22780,7 @@ Backend-only flags (these can be set in the config file also).--s3-use-multipart-uploads Tristate Set if rclone should use multipart uploads (default unset)--s3-use-presigned-request Whether to use a presigned request or PutObject for single part uploads--s3-use-unsigned-payload Tristate Whether to use an unsigned payload in PutObject (default unset)+ --s3-use-x-id Tristate Set if rclone should add x-id URL parameters (default unset)--s3-v2-auth If true use v2 authentication--s3-version-at Time Show file versions as they were at the specified time (default off)--s3-version-deleted Show deleted file markers when using versions@@ -21387,6 +22806,7 @@ Backend-only flags (these can be set in the config file also).--sftp-disable-hashcheck Disable the execution of SSH commands to determine if remote file hashing is available--sftp-host string SSH host to connect to--sftp-host-key-algorithms SpaceSepList Space separated list of host key algorithms, ordered by preference+ --sftp-http-proxy string URL for HTTP CONNECT proxy--sftp-idle-timeout Duration Max time before closing idle connections (default 1m0s)--sftp-key-exchange SpaceSepList Space separated list of key exchange algorithms, ordered by preference--sftp-key-file string Path to PEM-encoded private key file@@ -21441,6 +22861,7 @@ Backend-only flags (these can be set in the config file also).--smb-pass string SMB password (obscured)--smb-port int SMB port number (default 445)--smb-spn string Service principal name+ --smb-use-kerberos Use Kerberos authentication--smb-user string SMB username (default "$USER")--storj-access-grant string Access grant--storj-api-key string API key@@ -21574,7 +22995,7 @@ Start from installing Docker on the host.The FUSE driver is a prerequisite for rclone mounting and should beinstalled on host:- sudo apt-get -y install fuse+ sudo apt-get -y install fuse3Create two directories required by rclone docker plugin:@@ -22531,7 +23952,7 @@ Also see the all files changed check.By using rclone filter features you can exclude file types or directorysub-trees from the sync. See the bisync filters section and generic--filter-from documentation. An example filters file contains filters-for non-allowed files for synching with Dropbox.+for non-allowed files for syncing with Dropbox.If you make changes to your filters file then bisync requires a run with--resync. This is a safety feature, which prevents existing files on the@@ -22704,7 +24125,7 @@ of a sync. Using --check-sync=false will disable it and maysignificantly reduce the sync run times for very large numbers of files.The check may be run manually with --check-sync=only. It runs only the-integrity check and terminates without actually synching.+integrity check and terminates without actually syncing.Note that currently, --check-sync only checks listing snapshots and NOTthe actual files on the remotes. Note also that the listing snapshots@@ -23237,7 +24658,7 @@ supported.How to filter directoriesFiltering portions of the directory tree is a critical feature for-synching.+syncing.Examples of directory trees (always beneath the Path1/Path2 root level)you may want to exclude from your sync: - Directory trees containing@@ -23348,7 +24769,7 @@ This noise can be quashed by adding --quiet to the bisync command line.Example exclude-style filters files for use with Dropbox-- Dropbox disallows synching the listed temporary and+- Dropbox disallows syncing the listed temporary andconfiguration/data files. The `- ` filters exclude these files whereever they may occur in the sync tree. Consider adding similarexclusions for file types you don't need to sync, such as core dump@@ -23668,7 +25089,7 @@ dash.Running tests- go test . -case basic -remote local -remote2 local runs the- test_basic test case using only the local filesystem, synching one+ test_basic test case using only the local filesystem, syncing onelocal directory with another local directory. Test script output isto the console, while commands within scenario.txt have their outputsent to the .../workdir/test.log file, which is finally compared to@@ -23901,6 +25322,11 @@ Unison and synchronization in general.Changelog+v1.69.1++- Fixed an issue causing listings to not capture concurrent+ modifications under certain conditions+v1.68- Fixed an issue affecting backends that round modtimes to a lower@@ -24473,9 +25899,11 @@ The S3 backend can be used with a number of different providers:- Liara Object Storage- Linode Object Storage- Magalu Object Storage+- MEGA S4 Object Storage- Minio- Outscale- Petabox+- Pure Storage FlashBlade- Qiniu Cloud Object Storage (Kodo)- RackCorp Object Storage- Rclone Serve S3@@ -25192,7 +26620,7 @@ Notes on above:that USER_NAME has been created.2. The Resource entry must include both resource ARNs, as one impliesthe bucket and the other implies the bucket's objects.-3. When using s3-no-check-bucket and the bucket already exsits, the+3. When using s3-no-check-bucket and the bucket already exists, the"arn:aws:s3:::BUCKET_NAME" doesn't have to be included.For reference, here's an Ansible script that will generate one or more@@ -25214,8 +26642,9 @@ glacier storage class you will see an error like below.2017/09/11 19:07:43 Failed to sync: failed to open source object: Object in GLACIER, restore first: path/to/file-In this case you need to restore the object(s) in question before using-rclone.+In this case you need to restore the object(s) in question before+accessing object contents. The restore section below shows how to do+this with rclone.Note that rclone only speaks the S3 API it does not speak the GlacierVault API, so rclone cannot directly access Glacier Vaults.@@ -25236,10 +26665,11 @@ Standard optionsHere are the Standard options specific to s3 (Amazon S3 CompliantStorage Providers including AWS, Alibaba, ArvanCloud, Ceph, ChinaMobile,-Cloudflare, DigitalOcean, Dreamhost, GCS, HuaweiOBS, IBMCOS, IDrive,-IONOS, LyveCloud, Leviia, Liara, Linode, Magalu, Minio, Netease,-Outscale, Petabox, RackCorp, Rclone, Scaleway, SeaweedFS, Selectel,-StackPath, Storj, Synology, TencentCOS, Wasabi, Qiniu and others).+Cloudflare, DigitalOcean, Dreamhost, Exaba, FlashBlade, GCS, HuaweiOBS,+IBMCOS, IDrive, IONOS, LyveCloud, Leviia, Liara, Linode, Magalu, Mega,+Minio, Netease, Outscale, Petabox, RackCorp, Rclone, Scaleway,+SeaweedFS, Selectel, StackPath, Storj, Synology, TencentCOS, Wasabi,+Qiniu and others).--s3-provider@@ -25268,6 +26698,10 @@ Properties:- DigitalOcean Spaces- "Dreamhost"- Dreamhost DreamObjects+ - "Exaba"+ - Exaba Object Storage+ - "FlashBlade"+ - Pure Storage FlashBlade Object Storage- "GCS"- Google Cloud Storage- "HuaweiOBS"@@ -25288,6 +26722,8 @@ Properties:- Linode Object Storage- "Magalu"- Magalu Object Storage+ - "Mega"+ - MEGA S4 Object Storage- "Minio"- Minio Object Storage- "Netease"@@ -25559,7 +26995,7 @@ Properties:- Config: acl- Env Var: RCLONE_S3_ACL-- Provider: !Storj,Selectel,Synology,Cloudflare+- Provider: !Storj,Selectel,Synology,Cloudflare,FlashBlade,Mega- Type: string- Required: false- Examples:@@ -25679,14 +27115,39 @@ Properties:- "GLACIER_IR"- Glacier Instant Retrieval storage class+--s3-ibm-api-key++IBM API Key to be used to obtain IAM token++Properties:++- Config: ibm_api_key+- Env Var: RCLONE_S3_IBM_API_KEY+- Provider: IBMCOS+- Type: string+- Required: false++--s3-ibm-resource-instance-id++IBM service instance id++Properties:++- Config: ibm_resource_instance_id+- Env Var: RCLONE_S3_IBM_RESOURCE_INSTANCE_ID+- Provider: IBMCOS+- Type: string+- Required: false+Advanced optionsHere are the Advanced options specific to s3 (Amazon S3 CompliantStorage Providers including AWS, Alibaba, ArvanCloud, Ceph, ChinaMobile,-Cloudflare, DigitalOcean, Dreamhost, GCS, HuaweiOBS, IBMCOS, IDrive,-IONOS, LyveCloud, Leviia, Liara, Linode, Magalu, Minio, Netease,-Outscale, Petabox, RackCorp, Rclone, Scaleway, SeaweedFS, Selectel,-StackPath, Storj, Synology, TencentCOS, Wasabi, Qiniu and others).+Cloudflare, DigitalOcean, Dreamhost, Exaba, FlashBlade, GCS, HuaweiOBS,+IBMCOS, IDrive, IONOS, LyveCloud, Leviia, Liara, Linode, Magalu, Mega,+Minio, Netease, Outscale, Petabox, RackCorp, Rclone, Scaleway,+SeaweedFS, Selectel, StackPath, Storj, Synology, TencentCOS, Wasabi,+Qiniu and others).--s3-bucket-acl@@ -25705,6 +27166,7 @@ Properties:- Config: bucket_acl- Env Var: RCLONE_S3_BUCKET_ACL+- Provider: !Storj,Selectel,Synology,Cloudflare,FlashBlade- Type: string- Required: false- Examples:@@ -26510,6 +27972,44 @@ Properties:- Type: Tristate- Default: unset+--s3-use-x-id++Set if rclone should add x-id URL parameters.++You can change this if you want to disable the AWS SDK from adding x-id+URL parameters.++This shouldn't be necessary in normal operation.++This should be automatically set correctly for all providers rclone+knows about - please make a bug report if not.++Properties:++- Config: use_x_id+- Env Var: RCLONE_S3_USE_X_ID+- Type: Tristate+- Default: unset++--s3-sign-accept-encoding++Set if rclone should include Accept-Encoding as part of the signature.++You can change this if you want to stop rclone including Accept-Encoding+as part of the signature.++This shouldn't be necessary in normal operation.++This should be automatically set correctly for all providers rclone+knows about - please make a bug report if not.++Properties:++- Config: sign_accept_encoding+- Env Var: RCLONE_S3_SIGN_ACCEPT_ENCODING+- Type: Tristate+- Default: unset+--s3-directory-bucketSet to use AWS Directory Buckets@@ -26646,7 +28146,7 @@ Access tier to the Frequent Access tier.Usage Examples:- rclone backend restore s3:bucket/path/to/object -o priority=PRIORITY -o lifetime=DAYS+ rclone backend restore s3:bucket/path/to/ --include /object -o priority=PRIORITY -o lifetime=DAYSrclone backend restore s3:bucket/path/to/directory -o priority=PRIORITY -o lifetime=DAYSrclone backend restore s3:bucket -o priority=PRIORITY -o lifetime=DAYSrclone backend restore s3:bucket/path/to/directory -o priority=PRIORITY@@ -27410,7 +28910,7 @@ To configure access to IBM COS S3, follow the steps below:\ "tor01-flex"location_constraint>1-9. Specify a canned ACL. IBM Cloud (Storage) supports "public-read" and+8. Specify a canned ACL. IBM Cloud (Storage) supports "public-read" and"private". IBM Cloud(Infra) supports all the canned ACLs. On-PremiseCOS supports all the canned ACLs.@@ -27427,7 +28927,7 @@ To configure access to IBM COS S3, follow the steps below:\ "authenticated-read"acl> 1-12. Review the displayed configuration and accept to save the "remote"+9. Review the displayed configuration and accept to save the "remote"then quit. The config file should look like this[xxx]@@ -27439,7 +28939,7 @@ To configure access to IBM COS S3, follow the steps below:location_constraint = us-standardacl = private-13. Execute rclone commands+10. Execute rclone commands1) Create a bucket.rclone mkdir IBM-COS-XREGION:newbucket@@ -27457,6 +28957,34 @@ To configure access to IBM COS S3, follow the steps below:6) Delete a file on remote.rclone delete IBM-COS-XREGION:newbucket/file.txt+IBM IAM authentication++If using IBM IAM authentication with IBM API KEY you need to fill in+these additional parameters 1. Select false for env_auth 2. Leave+access_key_id and secret_access_key blank 3. Paste your ibm_api_key++ Option ibm_api_key.+ IBM API Key to be used to obtain IAM token+ Enter a value of type string. Press Enter for the default (1).+ ibm_api_key>++4. Paste your ibm_resource_instance_id++ Option ibm_resource_instance_id.+ IBM service instance id+ Enter a value of type string. Press Enter for the default (2).+ ibm_resource_instance_id>++5. In advanced settings type true for v2_auth++ Option v2_auth.+ If true use v2 authentication.+ If this is false (the default) then rclone will use v4 authentication.+ If it is set then rclone will use v2 authentication.+ Use this only if v4 signatures don't work, e.g. pre Jewel/v10 CEPH.+ Enter a boolean value (true or false). Press Enter for the default (true).+ v2_auth>+IDrive e2Here is an example of making an IDrive e2 configuration. First run:@@ -28155,8 +29683,8 @@ this:secret_access_key = SECRET_ACCESS_KEYuse_multipart_uploads = false-Note that setting disable_multipart_uploads = true is to work around a-bug which will be fixed in due course.+Note that setting use_multipart_uploads = false is to work around a bug+which will be fixed in due course.Scaleway@@ -28265,19 +29793,16 @@ Leave region blank\ (other-v2-signature)region>-Choose an endpoint from the list+Enter your Lyve Cloud endpoint. This field cannot be kept empty.- Endpoint for S3 API.+ Endpoint for Lyve Cloud S3 API.Required when using an S3 clone.- Choose a number from below, or type in your own value.- Press Enter to leave empty.- 1 / Seagate Lyve Cloud US East 1 (Virginia)- \ (s3.us-east-1.lyvecloud.seagate.com)- 2 / Seagate Lyve Cloud US West 1 (California)- \ (s3.us-west-1.lyvecloud.seagate.com)- 3 / Seagate Lyve Cloud AP Southeast 1 (Singapore)- \ (s3.ap-southeast-1.lyvecloud.seagate.com)- endpoint> 1+ Please type in your LyveCloud endpoint.+ Examples:+ - s3.us-west-1.{account_name}.lyve.seagate.com (US West 1 - California)+ - s3.eu-west-1.{account_name}.lyve.seagate.com (US West 1 - Ireland)+ Enter a value.+ endpoint> s3.us-west-1.global.lyve.seagate.comLeave location constraint blank@@ -29203,27 +30728,49 @@ This will guide you through an interactive setup process.Endpoint for Linode Object Storage API.Choose a number from below, or type in your own value.Press Enter to leave empty.- 1 / Atlanta, GA (USA), us-southeast-1+ 1 / Amsterdam (Netherlands), nl-ams-1+ \ (nl-ams-1.linodeobjects.com)+ 2 / Atlanta, GA (USA), us-southeast-1\ (us-southeast-1.linodeobjects.com)- 2 / Chicago, IL (USA), us-ord-1+ 3 / Chennai (India), in-maa-1+ \ (in-maa-1.linodeobjects.com)+ 4 / Chicago, IL (USA), us-ord-1\ (us-ord-1.linodeobjects.com)- 3 / Frankfurt (Germany), eu-central-1+ 5 / Frankfurt (Germany), eu-central-1\ (eu-central-1.linodeobjects.com)- 4 / Milan (Italy), it-mil-1+ 6 / Jakarta (Indonesia), id-cgk-1+ \ (id-cgk-1.linodeobjects.com)+ 7 / London 2 (Great Britain), gb-lon-1+ \ (gb-lon-1.linodeobjects.com)+ 8 / Los Angeles, CA (USA), us-lax-1+ \ (us-lax-1.linodeobjects.com)+ 9 / Madrid (Spain), es-mad-1+ \ (es-mad-1.linodeobjects.com)+ 10 / Melbourne (Australia), au-mel-1+ \ (au-mel-1.linodeobjects.com)+ 11 / Miami, FL (USA), us-mia-1+ \ (us-mia-1.linodeobjects.com)+ 12 / Milan (Italy), it-mil-1\ (it-mil-1.linodeobjects.com)- 5 / Newark, NJ (USA), us-east-1+ 13 / Newark, NJ (USA), us-east-1\ (us-east-1.linodeobjects.com)- 6 / Paris (France), fr-par-1+ 14 / Osaka (Japan), jp-osa-1+ \ (jp-osa-1.linodeobjects.com)+ 15 / Paris (France), fr-par-1\ (fr-par-1.linodeobjects.com)- 7 / Seattle, WA (USA), us-sea-1+ 16 / São Paulo (Brazil), br-gru-1+ \ (br-gru-1.linodeobjects.com)+ 17 / Seattle, WA (USA), us-sea-1\ (us-sea-1.linodeobjects.com)- 8 / Singapore ap-south-1+ 18 / Singapore, ap-south-1\ (ap-south-1.linodeobjects.com)- 9 / Stockholm (Sweden), se-sto-1+ 19 / Singapore 2, sg-sin-1+ \ (sg-sin-1.linodeobjects.com)+ 20 / Stockholm (Sweden), se-sto-1\ (se-sto-1.linodeobjects.com)- 10 / Washington, DC, (USA), us-iad-1+ 21 / Washington, DC, (USA), us-iad-1\ (us-iad-1.linodeobjects.com)- endpoint> 3+ endpoint> 5Option acl.Canned ACL used when creating buckets and storing or copying objects.@@ -29381,6 +30928,111 @@ This will leave the config file looking like this.secret_access_key = SECRET_ACCESS_KEYendpoint = br-ne1.magaluobjects.com+MEGA S4++MEGA S4 Object Storage is an S3 compatible object storage system. It has+a single pricing tier with no additional charges for data transfers or+API requests and it is included in existing Pro plans.++Here is an example of making a configuration. First run:++ rclone config++This will guide you through an interactive setup process.++ No remotes found, make a new one?+ n) New remote+ s) Set configuration password+ q) Quit config+ n/s/q> n++ Enter name for new remote.+ name> megas4++ Option Storage.+ Type of storage to configure.+ Choose a number from below, or type in your own value.+ [snip]+ XX / Amazon S3 Compliant Storage Providers including AWS,... Mega, ...+ \ (s3)+ [snip]+ Storage> s3++ Option provider.+ Choose your S3 provider.+ Choose a number from below, or type in your own value.+ Press Enter to leave empty.+ [snip]+ XX / MEGA S4 Object Storage+ \ (Mega)+ [snip]+ provider> Mega++ Option env_auth.+ Get AWS credentials from runtime (environment variables or EC2/ECS meta data if no env vars).+ Only applies if access_key_id and secret_access_key is blank.+ Choose a number from below, or type in your own boolean value (true or false).+ Press Enter for the default (false).+ 1 / Enter AWS credentials in the next step.+ \ (false)+ 2 / Get AWS credentials from the environment (env vars or IAM).+ \ (true)+ env_auth>++ Option access_key_id.+ AWS Access Key ID.+ Leave blank for anonymous access or runtime credentials.+ Enter a value. Press Enter to leave empty.+ access_key_id> XXX++ Option secret_access_key.+ AWS Secret Access Key (password).+ Leave blank for anonymous access or runtime credentials.+ Enter a value. Press Enter to leave empty.+ secret_access_key> XXX++ Option endpoint.+ Endpoint for S3 API.+ Required when using an S3 clone.+ Choose a number from below, or type in your own value.+ Press Enter to leave empty.+ 1 / Mega S4 eu-central-1 (Amsterdam)+ \ (s3.eu-central-1.s4.mega.io)+ 2 / Mega S4 eu-central-2 (Bettembourg)+ \ (s3.eu-central-2.s4.mega.io)+ 3 / Mega S4 ca-central-1 (Montreal)+ \ (s3.ca-central-1.s4.mega.io)+ 4 / Mega S4 ca-west-1 (Vancouver)+ \ (s3.ca-west-1.s4.mega.io)+ endpoint> 1++ Edit advanced config?+ y) Yes+ n) No (default)+ y/n> n++ Configuration complete.+ Options:+ - type: s3+ - provider: Mega+ - access_key_id: XXX+ - secret_access_key: XXX+ - endpoint: s3.eu-central-1.s4.mega.io+ Keep this "megas4" remote?+ y) Yes this is OK (default)+ e) Edit this remote+ d) Delete this remote+ y/e/d> y++This will leave the config file looking like this.++ [megas4]+ type = s3+ provider = Mega+ access_key_id = XXX+ secret_access_key = XXX+ endpoint = s3.eu-central-1.s4.mega.io+ArvanCloudArvanCloud ArvanCloud Object Storage goes beyond the limited traditional@@ -29763,6 +31415,120 @@ This will leave the config file looking like this.region = us-east-1endpoint = s3.petabox.io+Pure Storage FlashBlade++Pure Storage FlashBlade is a high performance S3-compatible object+store.++FlashBlade supports most modern S3 features including:++- ListObjectsV2+- Multipart uploads with AWS-compatible ETags+- Advanced checksum algorithms (SHA256, CRC32, CRC32C) with trailer+ support (Purity//FB 4.4.2+)+- Object versioning and lifecycle management+- Virtual hosted-style requests (requires DNS configuration)++To configure rclone for Pure Storage FlashBlade:++First run:++ rclone config++This will guide you through an interactive setup process:++ No remotes found, make a new one?+ n) New remote+ s) Set configuration password+ q) Quit config+ n/s/q> n++ Enter name for new remote.+ name> flashblade++ Option Storage.+ Type of storage to configure.+ Choose a number from below, or type in your own value.+ [snip]+ 4 / Amazon S3 Compliant Storage Providers including AWS, Alibaba, ArvanCloud, Ceph, ChinaMobile, Cloudflare, DigitalOcean, Dreamhost, FlashBlade, GCS, HuaweiOBS, IBMCOS, IDrive, IONOS, LyveCloud, Leviia, Liara, Linode, Magalu, Minio, Netease, Outscale, Petabox, RackCorp, Rclone, Scaleway, SeaweedFS, Selectel, StackPath, Storj, Synology, TencentCOS, Wasabi, Qiniu and others+ \ (s3)+ [snip]+ Storage> s3++ Option provider.+ Choose your S3 provider.+ Choose a number from below, or type in your own value.+ Press Enter to leave empty.+ [snip]+ 9 / Pure Storage FlashBlade Object Storage+ \ (FlashBlade)+ [snip]+ provider> FlashBlade++ Option env_auth.+ Get AWS credentials from runtime (environment variables or EC2/ECS meta data if no env vars).+ Only applies if access_key_id and secret_access_key is blank.+ Choose a number from below, or type in your own boolean value (true or false).+ Press Enter for the default (false).+ 1 / Enter AWS credentials in the next step.+ \ (false)+ 2 / Get AWS credentials from the environment (env vars or IAM).+ \ (true)+ env_auth> 1++ Option access_key_id.+ AWS Access Key ID.+ Leave blank for anonymous access or runtime credentials.+ Enter a value. Press Enter to leave empty.+ access_key_id> ACCESS_KEY_ID++ Option secret_access_key.+ AWS Secret Access Key (password).+ Leave blank for anonymous access or runtime credentials.+ Enter a value. Press Enter to leave empty.+ secret_access_key> SECRET_ACCESS_KEY++ Option endpoint.+ Endpoint for S3 API.+ Required when using an S3 clone.+ Enter a value. Press Enter to leave empty.+ endpoint> https://s3.flashblade.example.com++ Edit advanced config?+ y) Yes+ n) No (default)+ y/n> n++ Configuration complete.+ Options:+ - type: s3+ - provider: FlashBlade+ - access_key_id: ACCESS_KEY_ID+ - secret_access_key: SECRET_ACCESS_KEY+ - endpoint: https://s3.flashblade.example.com+ Keep this "flashblade" remote?+ y) Yes this is OK (default)+ e) Edit this remote+ d) Delete this remote+ y/e/d> y++This results in the following configuration being stored in+~/.config/rclone/rclone.conf:++ [flashblade]+ type = s3+ provider = FlashBlade+ access_key_id = ACCESS_KEY_ID+ secret_access_key = SECRET_ACCESS_KEY+ endpoint = https://s3.flashblade.example.com++Note: The FlashBlade endpoint should be the S3 data VIP. For+virtual-hosted style requests, ensure proper DNS configuration:+subdomains of the endpoint hostname should resolve to a FlashBlade data+VIP. For example, if your endpoint is https://s3.flashblade.example.com,+then bucket-name.s3.flashblade.example.com should also resolve to the+data VIP.+StorjStorj is a decentralized cloud storage which can be used through its@@ -29828,7 +31594,7 @@ from the source).This has the following consequences:-- Using rclone rcat will fail as the medatada doesn't match after+- Using rclone rcat will fail as the metadata doesn't match afterupload- Uploading files with rclone mount will fail for the same reason- This can worked around by using --vfs-cache-mode writes or@@ -30848,7 +32614,7 @@ Internet browser available.Note that rclone runs a webserver on your local machine to collect thetoken as returned from Box. This only runs from the moment it opens yourbrowser to the moment you get back the verification code. This is on-http://127.0.0.1:53682/ and this it may require you to unblock it+http://127.0.0.1:53682/ and this may require you to unblock ittemporarily if you are running a host firewall.Once configured you can then use rclone like this,@@ -32697,6 +34463,32 @@ Properties:- Type: Duration- Default: 0s+--cloudinary-adjust-media-files-extensions++Cloudinary handles media formats as a file attribute and strips it from+the name, which is unlike most other file systems++Properties:++- Config: adjust_media_files_extensions+- Env Var: RCLONE_CLOUDINARY_ADJUST_MEDIA_FILES_EXTENSIONS+- Type: bool+- Default: true++--cloudinary-media-extensions++Cloudinary supported media extensions++Properties:++- Config: media_extensions+- Env Var: RCLONE_CLOUDINARY_MEDIA_EXTENSIONS+- Type: stringArray+- Default: [3ds 3g2 3gp ai arw avi avif bmp bw cr2 cr3 djvu dng eps3+ fbx flif flv gif glb gltf hdp heic heif ico indd jp2 jpe jpeg jpg+ jxl jxr m2ts mov mp4 mpeg mts mxf obj ogv pdf ply png psd svg tga+ tif tiff ts u3ma usdz wdp webm webp wmv]+--cloudinary-descriptionDescription of the remote.@@ -33757,7 +35549,7 @@ The initial nonce is generated from the operating systems crypto strongrandom number generator. The nonce is incremented for each chunk readmaking sure each nonce is unique for each block written. The chance of anonce being reused is minuscule. If you wrote an exabyte of data (10¹⁸-bytes) you would have a probability of approximately 2×10⁻³² of re-using+bytes) you would have a probability of approximately 2×10⁻³² of reusinga nonce.Chunk@@ -34181,6 +35973,179 @@ Any metadata supported by the underlying remote is read and written.See the metadata docs for more info.+DOI++The DOI remote is a read only remote for reading files from digital+object identifiers (DOI).++Currently, the DOI backend supports supports DOIs hosted with: -+InvenioRDM - Zenodo - CaltechDATA - Other InvenioRDM repositories -+Dataverse - Harvard Dataverse - Other Dataverse repositories++Paths are specified as remote:path++Paths may be as deep as required, e.g. remote:directory/subdirectory.++Configuration++Here is an example of how to make a remote called remote. First run:++ rclone config++This will guide you through an interactive setup process:++ No remotes found, make a new one?+ n) New remote+ s) Set configuration password+ q) Quit config+ n/s/q> n+ Enter name for new remote.+ name> remote+ Type of storage to configure.+ Choose a number from below, or type in your own value+ [snip]+ XX / DOI datasets+ \ (doi)+ [snip]+ Storage> doi+ Option doi.+ The DOI or the doi.org URL.+ Enter a value.+ doi> 10.5281/zenodo.5876941+ Edit advanced config?+ y) Yes+ n) No (default)+ y/n> n+ Configuration complete.+ Options:+ - type: doi+ - doi: 10.5281/zenodo.5876941+ Keep this "remote" remote?+ y) Yes this is OK (default)+ e) Edit this remote+ d) Delete this remote+ y/e/d> y++Standard options++Here are the Standard options specific to doi (DOI datasets).++--doi-doi++The DOI or the doi.org URL.++Properties:++- Config: doi+- Env Var: RCLONE_DOI_DOI+- Type: string+- Required: true++Advanced options++Here are the Advanced options specific to doi (DOI datasets).++--doi-provider++DOI provider.++The DOI provider can be set when rclone does not automatically recognize+a supported DOI provider.++Properties:++- Config: provider+- Env Var: RCLONE_DOI_PROVIDER+- Type: string+- Required: false+- Examples:+ - "auto"+ - Auto-detect provider+ - "zenodo"+ - Zenodo+ - "dataverse"+ - Dataverse+ - "invenio"+ - Invenio++--doi-doi-resolver-api-url++The URL of the DOI resolver API to use.++The DOI resolver can be set for testing or for cases when the the+canonical DOI resolver API cannot be used.++Defaults to "https://doi.org/api".++Properties:++- Config: doi_resolver_api_url+- Env Var: RCLONE_DOI_DOI_RESOLVER_API_URL+- Type: string+- Required: false++--doi-description++Description of the remote.++Properties:++- Config: description+- Env Var: RCLONE_DOI_DESCRIPTION+- Type: string+- Required: false++Backend commands++Here are the commands specific to the doi backend.++Run them with++ rclone backend COMMAND remote:++The help below will explain what arguments each command takes.++See the backend command for more info on how to pass options and+arguments.++These can be run on a running backend using the rc command+backend/command.++metadata++Show metadata about the DOI.++ rclone backend metadata remote: [options] [<arguments>+]++This command returns a JSON object with some information about the DOI.++ rclone backend medatadata doi:++It returns a JSON object representing metadata about the DOI.++set++Set command for updating the config parameters.++ rclone backend set remote: [options] [<arguments>+]++This set command can be used to update the config parameters for a+running doi backend.++Usage Examples:++ rclone backend set doi: [-o opt_name=opt_value] [-o opt_name2=opt_value2]+ rclone rc backend/command command=set fs=doi: [-o opt_name=opt_value] [-o opt_name2=opt_value2]+ rclone rc backend/command command=set fs=doi: -o doi=NEW_DOI++The option keys are named as they are in the config file.++This rebuilds the connection to the doi backend when it is called with+the new parameters. Only new parameters need be passed as the values+will default to those currently in use.++It doesn't return anything.+DropboxPaths are specified as remote:path@@ -34359,6 +36324,42 @@ completes is recommended. Or you could do an initial transfer withNote that there may be a pause when quitting rclone while rclonefinishes up the last batch using this mode.+Exporting files++Certain files in Dropbox are "exportable", such as Dropbox Paper+documents. These files need to be converted to another format in order+to be downloaded. Often multiple formats are available for conversion.++When rclone downloads a exportable file, it chooses the format to+download based on the --dropbox-export-formats setting. By default, the+export formats are html,md, which are sensible defaults for Dropbox+Paper.++Rclone chooses the first format ID in the export formats list that+Dropbox supports for a given file. If no format in the list is usable,+rclone will choose the default format that Dropbox suggests.++Rclone will change the extension to correspond to the export format.+Here are some examples of how extensions are mapped:++ File type Filename in Dropbox Filename in rclone+ ---------------- --------------------- --------------------+ Paper mydoc.paper mydoc.html+ Paper template mydoc.papert mydoc.papert.html+ other mydoc mydoc.html++Importing exportable files is not yet supported by rclone.++Here are the supported export extensions known by rclone. Note that+rclone does not currently support other formats not on this list, even+if Dropbox supports them. Also, Dropbox could change the list of+supported formats at any time.++ Format ID Name Description+ ----------- ---------- ----------------------+ html HTML HTML document+ md Markdown Markdown text format+Standard optionsHere are the Standard options specific to dropbox (Dropbox).@@ -34563,6 +36564,57 @@ Properties:- Type: string- Required: false+--dropbox-export-formats++Comma separated list of preferred formats for exporting files++Certain Dropbox files can only be accessed by exporting them to another+format. These include Dropbox Paper documents.++For each such file, rclone will choose the first format on this list+that Dropbox considers valid. If none is valid, it will choose Dropbox's+default format.++Known formats include: "html", "md" (markdown)++Properties:++- Config: export_formats+- Env Var: RCLONE_DROPBOX_EXPORT_FORMATS+- Type: CommaSepList+- Default: html,md++--dropbox-skip-exports++Skip exportable files in all listings.++If given, exportable files practically become invisible to rclone.++Properties:++- Config: skip_exports+- Env Var: RCLONE_DROPBOX_SKIP_EXPORTS+- Type: bool+- Default: false++--dropbox-show-all-exports++Show all exportable files in listings.++Adding this flag will allow all exportable files to be server side+copied. Note that rclone doesn't add extensions to the exportable file+names in this mode.++Do not use this flag when trying to download exportable files - rclone+will fail to download them.++Properties:++- Config: show_all_exports+- Env Var: RCLONE_DROPBOX_SHOW_ALL_EXPORTS+- Type: bool+- Default: false+--dropbox-batch-modeUpload file batching sync|async|off.@@ -34638,7 +36690,7 @@ Properties:--dropbox-batch-commit-timeout-Max time to wait for a batch to finish committing+Max time to wait for a batch to finish committing. (no longer used)Properties:@@ -34685,6 +36737,11 @@ non-personal account otherwise the visibility may not be correct. (Notethat --expire isn't supported on personal accounts). See the forumdiscussion and the dropbox SDK issue.+Modification times for Dropbox Paper documents are not exact, and may+not change for some period after the document is edited. To make sure+you get recent changes in a sync, either wait an hour or so, or use+--ignore-times to force a full sync.+Get your own Dropbox App IDWhen you use rclone with Dropbox in its default configuration you are@@ -34994,6 +37051,214 @@ Properties:- Type: string- Required: false+FileLu++FileLu is a reliable cloud storage provider offering features like+secure file uploads, downloads, flexible storage options, and sharing+capabilities. With support for high storage limits and seamless+integration with rclone, FileLu makes managing files in the cloud easy.+Its cross-platform file backup services let you upload and back up files+from any internet-connected device.++Configuration++Here is an example of how to make a remote called filelu. First, run:++ rclone config++This will guide you through an interactive setup process:++ No remotes found, make a new one?+ n) New remote+ s) Set configuration password+ q) Quit config+ n/s/q> n+ name> filelu+ Type of storage to configure.+ Choose a number from below, or type in your own value+ [snip]+ xx / FileLu Cloud Storage+ \ "filelu"+ [snip]+ Storage> filelu+ Enter your FileLu Rclone Key:+ key> YOUR_FILELU_RCLONE_KEY RC_xxxxxxxxxxxxxxxxxxxxxxxx+ Configuration complete.++ Keep this "filelu" remote?+ y) Yes this is OK+ e) Edit this remote+ d) Delete this remote+ y/e/d> y++Paths++A path without an initial / will operate in the Rclone directory.++A path with an initial / will operate at the root where you can see the+Rclone directory.++ $ rclone lsf TestFileLu:/+ CCTV/+ Camera/+ Documents/+ Music/+ Photos/+ Rclone/+ Vault/+ Videos/++Example Commands++Create a new folder named foldername in the Rclone directory:++ rclone mkdir filelu:foldername++Delete a folder on FileLu:++ rclone rmdir filelu:/folder/path/++Delete a file on FileLu:++ rclone delete filelu:/hello.txt++List files from your FileLu account:++ rclone ls filelu:++List all folders:++ rclone lsd filelu:++Copy a specific file to the FileLu root:++ rclone copy D:\\hello.txt filelu:++Copy files from a local directory to a FileLu directory:++ rclone copy D:/local-folder filelu:/remote-folder/path/++Download a file from FileLu into a local directory:++ rclone copy filelu:/file-path/hello.txt D:/local-folder++Move files from a local directory to a FileLu directory:++ rclone move D:\\local-folder filelu:/remote-path/++Sync files from a local directory to a FileLu directory:++ rclone sync --interactive D:/local-folder filelu:/remote-path/++Mount remote to local Linux:++ rclone mount filelu: /root/mnt --vfs-cache-mode full++Mount remote to local Windows:++ rclone mount filelu: D:/local_mnt --vfs-cache-mode full++Get storage info about the FileLu account:++ rclone about filelu:++All the other rclone commands are supported by this backend.++FolderID instead of folder path++We use the FolderID instead of the folder name to prevent errors when+users have identical folder names or paths. For example, if a user has+two or three folders named "test_folders," the system may become+confused and won't know which folder to move. In large storage systems,+some clients have hundred of thousands of folders and a few millions of+files, duplicate folder names or paths are quite common.++Modification Times and Hashes++FileLu supports both modification times and MD5 hashes.++FileLu only supports filenames and folder names up to 255 characters in+length, where a character is a Unicode character.++Duplicated Files++When uploading and syncing via Rclone, FileLu does not allow uploading+duplicate files within the same directory. However, you can upload+duplicate files, provided they are in different directories (folders).++Failure to Log / Invalid Credentials or KEY++Ensure that you have the correct Rclone key, which can be found in My+Account. Every time you toggle Rclone OFF and ON in My Account, a new+RC_xxxxxxxxxxxxxxxxxxxx key is generated. Be sure to update your Rclone+configuration with the new key.++If you are connecting to your FileLu remote for the first time and+encounter an error such as:++ Failed to create file system for "my-filelu-remote:": couldn't login: Invalid credentials++Ensure your Rclone Key is correct.++Process killed++Accounts with large files or extensive metadata may experience+significant memory usage during list/sync operations. Ensure the system+running rclone has sufficient memory and CPU to handle these operations.++Standard options++Here are the Standard options specific to filelu (FileLu Cloud Storage).++--filelu-key++Your FileLu Rclone key from My Account++Properties:++- Config: key+- Env Var: RCLONE_FILELU_KEY+- Type: string+- Required: true++Advanced options++Here are the Advanced options specific to filelu (FileLu Cloud Storage).++--filelu-encoding++The encoding for the backend.++See the encoding section in the overview for more info.++Properties:++- Config: encoding+- Env Var: RCLONE_FILELU_ENCODING+- Type: Encoding+- Default:+ Slash,LtGt,DoubleQuote,SingleQuote,BackQuote,Dollar,Colon,Question,Asterisk,Pipe,Hash,Percent,BackSlash,CrLf,Del,Ctl,LeftSpace,LeftPeriod,LeftTilde,LeftCrLfHtVt,RightSpace,RightPeriod,RightCrLfHtVt,InvalidUtf8,Dot,SquareBracket,Semicolon,Exclamation++--filelu-description++Description of the remote.++Properties:++- Config: description+- Env Var: RCLONE_FILELU_DESCRIPTION+- Type: string+- Required: false++Limitations++This backend uses a custom library implementing the FileLu API. While it+supports file transfers, some advanced features may not yet be+available. Please report any issues to the rclone forum for+troubleshooting and updates.++For further information, visit FileLu's website.+Files.comFiles.com is a cloud storage service that provides a secure and easy way@@ -38451,6 +40716,32 @@ attempted if possible.Use the --interactive/-i or --dry-run flag to see what would be copiedbefore copying.+moveid++Move files by ID++ rclone backend moveid remote: [options] [<arguments>+]++This command moves files by ID++Usage:++ rclone backend moveid drive: ID path+ rclone backend moveid drive: ID1 path1 ID2 path2++It moves the drive file with ID given to the path (an rclone path which+will be passed internally to rclone moveto).++The path should end with a / to indicate move the file as named to this+directory. If it doesn't end with a / then the last path component will+be used as the file name.++If the destination is a drive backend then server-side moving will be+attempted if possible.++Use the --interactive/-i or --dry-run flag to see what would be moved+beforehand.+exportformatsDump the export formats for debug purposes@@ -38718,6 +41009,11 @@ NB The Google Photos API which rclone uses has quite a few limitations,so please read the limitations section carefully to make sure it issuitable for your use.+NB From March 31, 2025 rclone can only download photos it uploaded. This+limitation is due to policy changes at Google. You may need to run+rclone config reconnect remote: to make rclone work again after+upgrading to rclone v1.70.+ConfigurationThe initial setup for google cloud storage involves getting a token from@@ -39081,7 +41377,7 @@ Use the gphotosdl proxy for downloading the full resolution imagesThe Google API will deliver images and video which aren't fullresolution, and/or have EXIF data missing.-However if you ue the gphotosdl proxy tnen you can download original,+However if you use the gphotosdl proxy then you can download original,unchanged images.This runs a headless browser in the background.@@ -39192,7 +41488,7 @@ Properties:--gphotos-batch-commit-timeout-Max time to wait for a batch to finish committing+Max time to wait for a batch to finish committing. (no longer used)Properties:@@ -39219,6 +41515,11 @@ videos or images or formats that Google Photos doesn't understand,rclone will upload the file, then Google Photos will give an error whenit is put turned into a media item.+NB From March 31, 2025 rclone can only download photos it uploaded. This+limitation is due to policy changes at Google. You may need to run+rclone config reconnect remote: to make rclone work again after+upgrading to rclone v1.70.+Note that all media items uploaded to Google Photos through the API arestored in full resolution at "original quality" and will count towardsyour storage quota in your Google Account. The API does not offer a way@@ -40978,7 +43279,7 @@ This will guide you through an interactive setup process:config_2fa> 2FACODERemote config--------------------- [koofr]+ [iclouddrive]- type: iclouddrive- apple_id: APPLEID- password: *** ENCRYPTED ***@@ -40994,6 +43295,27 @@ Advanced Data ProtectionADP is currently unsupported and need to be disabled+On iPhone, Settings > Apple Account > iCloud > 'Access iCloud Data on+the Web' must be ON, and 'Advanced Data Protection' OFF.++Troubleshooting++Missing PCS cookies from the request++This means you have Advanced Data Protection (ADP) turned on. This is+not supported at the moment. If you want to use rclone you will have to+turn it off. See above for how to turn it off.++You will need to clear the cookies and the trust_token fields in the+config. Or you can delete the remote config and start again.++You should then run rclone reconnect remote:.++Note that changing the ADP setting may not take effect immediately - you+may need to wait a few hours or a day before you can get rclone to work+- keep clearing the config entry and running rclone reconnect remote:+until rclone functions properly.+Standard optionsHere are the Standard options specific to iclouddrive (iCloud Drive).@@ -41277,6 +43599,22 @@ Properties:- Type: string- Required: false+--internetarchive-item-derive++Whether to trigger derive on the IA item or not. If set to false, the+item will not be derived by IA upon upload. The derive process produces+a number of secondary files from an upload to make an upload more usable+on the web. Setting this to false is useful for uploading files that are+already in a format that IA can display or reduce burden on IA's+infrastructure.++Properties:++- Config: item_derive+- Env Var: RCLONE_INTERNETARCHIVE_ITEM_DERIVE+- Type: bool+- Default: true+Advanced optionsHere are the Advanced options specific to internetarchive (Internet@@ -41308,6 +43646,19 @@ Properties:- Type: string- Default: "https://archive.org"+--internetarchive-item-metadata++Metadata to be set on the IA item, this is different from file-level+metadata that can be set using --metadata-set. Format is key=value and+the 'x-archive-meta-' prefix is automatically added.++Properties:++- Config: item_metadata+- Env Var: RCLONE_INTERNETARCHIVE_ITEM_METADATA+- Type: stringArray+- Default: []+--internetarchive-disable-checksumDon't ask the server to test against MD5 checksum calculated by rclone.@@ -42445,6 +44796,10 @@ error like oauth2: server response missing access_token.- Go to Security / "Пароль и безопасность"- Click password for apps / "Пароли для внешних приложений"- Add the password - give it a name - eg "rclone"+- Select the permissions level. For some reason just "Full access to+ Cloud" (WebDav) doesn't work for Rclone currently. You have to+ select "Full access to Mail, Cloud and Calendar" (all protocols).+ (thread on forum.rclone.org)- Copy the password and use this password below - your normal loginpassword won't work.@@ -44274,6 +46629,63 @@ Properties:- Type: int- Default: 16+--azureblob-copy-cutoff++Cutoff for switching to multipart copy.++Any files larger than this that need to be server-side copied will be+copied in chunks of chunk_size using the put block list API.++Files smaller than this limit will be copied with the Copy Blob API.++Properties:++- Config: copy_cutoff+- Env Var: RCLONE_AZUREBLOB_COPY_CUTOFF+- Type: SizeSuffix+- Default: 8Mi++--azureblob-copy-concurrency++Concurrency for multipart copy.++This is the number of chunks of the same file that are copied+concurrently.++These chunks are not buffered in memory and Microsoft recommends setting+this value to greater than 1000 in the azcopy documentation.++https://learn.microsoft.com/en-us/azure/storage/common/storage-use-azcopy-optimize#increase-concurrency++In tests, copy speed increases almost linearly with copy concurrency.++Properties:++- Config: copy_concurrency+- Env Var: RCLONE_AZUREBLOB_COPY_CONCURRENCY+- Type: int+- Default: 512++--azureblob-use-copy-blob++Whether to use the Copy Blob API when copying to the same storage+account.++If true (the default) then rclone will use the Copy Blob API for copies+to the same storage account even when the size is above the copy_cutoff.++Rclone assumes that the same storage account means the same config and+does not check for the same storage account in different configs.++There should be no need to change this value.++Properties:++- Config: use_copy_blob+- Env Var: RCLONE_AZUREBLOB_USE_COPY_BLOB+- Type: bool+- Default: true+--azureblob-list-chunkSize of blob list.@@ -44492,8 +46904,10 @@ You can set custom upload headers with the --header-upload flag.- Content-Encoding- Content-Language- Content-Type+- X-MS-Tags-Eg --header-upload "Content-Type: text/potato"+Eg --header-upload "Content-Type: text/potato" or+--header-upload "X-MS-Tags: foo=bar"Limitations@@ -44733,6 +47147,13 @@ identity, the user-assigned identity will be used by default.If the resource has multiple user-assigned identities you will need tounset env_auth and set use_msi instead. See the use_msi section.+If you are operating in disconnected clouds, or private clouds such as+Azure Stack you may want to set disable_instance_discovery = true. This+determines whether rclone requests Microsoft Entra instance metadata+from https://login.microsoft.com/ before authenticating. Setting this to+true will skip this request, making you responsible for ensuring the+configured authority is valid and trustworthy.+Env Auth: 3. Azure CLI credentials (as used by the az tool)Credentials created with the az tool can be picked up using env_auth.@@ -44830,6 +47251,13 @@ msi_client_id, or msi_mi_res_id parameters.If none of msi_object_id, msi_client_id, or msi_mi_res_id is set, thisis is equivalent to using env_auth.+Azure CLI tool az++Set to use the Azure CLI tool az as the sole means of authentication.+Setting this can be useful if you wish to use the az CLI on a host with+a System Managed Identity that you do not want to use. Don't set+env_auth at the same time.+Standard optionsHere are the Standard options specific to azurefiles (Microsoft Azure@@ -45128,6 +47556,37 @@ Properties:- Type: string- Required: false+--azurefiles-disable-instance-discovery++Skip requesting Microsoft Entra instance metadata This should be set+true only by applications authenticating in disconnected clouds, or+private clouds such as Azure Stack. It determines whether rclone+requests Microsoft Entra instance metadata from+https://login.microsoft.com/ before authenticating. Setting this to true+will skip this request, making you responsible for ensuring the+configured authority is valid and trustworthy.++Properties:++- Config: disable_instance_discovery+- Env Var: RCLONE_AZUREFILES_DISABLE_INSTANCE_DISCOVERY+- Type: bool+- Default: false++--azurefiles-use-az++Use Azure CLI tool az for authentication Set to use the Azure CLI tool+az as the sole means of authentication. Setting this can be useful if+you wish to use the az CLI on a host with a System Managed Identity that+you do not want to use. Don't set env_auth at the same time.++Properties:++- Config: use_az+- Env Var: RCLONE_AZUREFILES_USE_AZ+- Type: bool+- Default: false+--azurefiles-endpointEndpoint for the service.@@ -45589,7 +48048,8 @@ Properties:- "us"- Microsoft Cloud for US Government- "de"- - Microsoft Cloud Germany+ - Microsoft Cloud Germany (deprecated - try global region+ first).- "cn"- Azure and Office 365 operated by Vnet Group in China@@ -45661,6 +48121,26 @@ Properties:- Type: bool- Default: false+--onedrive-upload-cutoff++Cutoff for switching to chunked upload.++Any files larger than this will be uploaded in chunks of chunk_size.++This is disabled by default as uploading using single part uploads+causes rclone to use twice the storage on Onedrive business as when+rclone sets the modification time after the upload Onedrive creates a+new version.++See: https://github.com/rclone/rclone/issues/1716++Properties:++- Config: upload_cutoff+- Env Var: RCLONE_ONEDRIVE_UPLOAD_CUTOFF+- Type: SizeSuffix+- Default: off+--onedrive-chunk-sizeChunk size to upload files with - must be multiple of 320k (327,680@@ -46248,6 +48728,38 @@ Here are the possible system metadata items for the onedrive backend.See the metadata docs for more info.+Impersonate other users as Admin++Unlike Google Drive and impersonating any domain user via service+accounts, OneDrive requires you to authenticate as an admin account, and+manually setup a remote per user you wish to impersonate.++1. In Microsoft 365 Admin Center, open each user you need to+ "impersonate" and go to the OneDrive section. There is a heading+ called "Get access to files", you need to click to create the link,+ this creates the link of the format+ https://{tenant}-my.sharepoint.com/personal/{user_name_domain_tld}/+ but also changes the permissions so you your admin user has access.+2. Then in powershell run the following commands:++ Install-Module Microsoft.Graph -Scope CurrentUser -Repository PSGallery -Force+ Import-Module Microsoft.Graph.Files+ Connect-MgGraph -Scopes "Files.ReadWrite.All"+ # Follow the steps to allow access to your admin user+ # Then run this for each user you want to impersonate to get the Drive ID+ Get-MgUserDefaultDrive -UserId '{emailaddress}'+ # This will give you output of the format:+ # Name Id DriveType CreatedDateTime+ # ---- -- --------- ---------------+ # OneDrive b!XYZ123 business 14/10/2023 1:00:58 pm++3. Then in rclone add a onedrive remote type, and use the+ Type in driveID with the DriveID you got in the previous step. One+ remote per user. It will then confirm the drive ID, and hopefully+ give you a message of Found drive "root" of type "business" and then+ include the URL of the format+ https://{tenant}-my.sharepoint.com/personal/{user_name_domain_tld}/Documents+LimitationsIf you don't use rclone for 90 days the refresh token will expire. This@@ -46657,6 +49169,30 @@ Properties:- Type: SizeSuffix- Default: 10Mi+--opendrive-access++Files and folders will be uploaded with this access permission (default+private)++Properties:++- Config: access+- Env Var: RCLONE_OPENDRIVE_ACCESS+- Type: string+- Default: "private"+- Examples:+ - "private"+ - The file or folder access can be granted in a way that will+ allow select users to view, read or write what is absolutely+ essential for them.+ - "public"+ - The file or folder can be downloaded by anyone from a web+ browser. The link can be shared in any way,+ - "hidden"+ - The file or folder can be accessed has the same restrictions+ as Public if the user knows the URL of the file or folder+ link in order to access the contents+--opendrive-descriptionDescription of the remote.@@ -52536,6 +55072,20 @@ Properties:- Type: string- Required: false+--sftp-http-proxy++URL for HTTP CONNECT proxy++Set this to a URL for an HTTP proxy which supports the HTTP CONNECT+verb.++Properties:++- Config: http_proxy+- Env Var: RCLONE_SFTP_HTTP_PROXY+- Type: string+- Required: false+--sftp-copy-is-hardlinkSet to enable server side copies using hardlinks.@@ -52576,8 +55126,8 @@ Properties:LimitationsOn some SFTP servers (e.g. Synology) the paths are different for SSH and-SFTP so the hashes can't be calculated properly. For them using-disable_hashcheck is a good idea.+SFTP so the hashes can't be calculated properly. You can either use+--sftp-path-override or disable_hashcheck.The only ssh agent supported under Windows is Putty's pageant.@@ -52795,6 +55345,22 @@ Properties:- Type: string- Required: false+--smb-use-kerberos++Use Kerberos authentication.++If set, rclone will use Kerberos authentication instead of NTLM. This+requires a valid Kerberos configuration and credentials cache to be+available, either in the default locations or as specified by the+KRB5_CONFIG and KRB5CCNAME environment variables.++Properties:++- Config: use_kerberos+- Env Var: RCLONE_SMB_USE_KERBEROS+- Type: bool+- Default: false+Advanced optionsHere are the Advanced options specific to smb (SMB / CIFS).@@ -54494,12 +57060,12 @@ To copy a local directory to an WebDAV directory called backupModification times and hashesPlain WebDAV does not support modified times. However when used with-Fastmail Files, Owncloud or Nextcloud rclone will support modified+Fastmail Files, ownCloud or Nextcloud rclone will support modifiedtimes.Likewise plain WebDAV does not support hashes, however when used with-Fastmail Files, Owncloud or Nextcloud rclone will support SHA1 and MD5-hashes. Depending on the exact version of Owncloud or Nextcloud hashes+Fastmail Files, ownCloud or Nextcloud rclone will support SHA1 and MD5+hashes. Depending on the exact version of ownCloud or Nextcloud hashesmay appear on all objects, or only on objects which had a hash uploadedwith them.@@ -54536,7 +57102,9 @@ Properties:- "nextcloud"- Nextcloud- "owncloud"- - Owncloud+ - Owncloud 10 PHP based WebDAV server+ - "infinitescale"+ - ownCloud Infinite Scale- "sharepoint"- Sharepoint Online, authenticated by Microsoft account- "sharepoint-ntlm"@@ -54748,21 +57316,30 @@ and use this as the password.Fastmail supports modified times using the X-OC-Mtime header.-Owncloud+ownCloudClick on the settings cog in the bottom right of the page and this willshow the WebDAV URL that rclone needs in the config step. It will looksomething like https://example.com/remote.php/webdav/.-Owncloud supports modified times using the X-OC-Mtime header.+ownCloud supports modified times using the X-OC-Mtime header.Nextcloud-This is configured in an identical way to Owncloud. Note that Nextcloud-initially did not support streaming of files (rcat) whereas Owncloud+This is configured in an identical way to ownCloud. Note that Nextcloud+initially did not support streaming of files (rcat) whereas ownClouddid, but this seems to be fixed as of 2020-11-27 (tested with rclonev1.53.1 and Nextcloud Server v19).+ownCloud Infinite Scale++The WebDAV URL for Infinite Scale can be found in the details panel of+any space in Infinite Scale, if the display was enabled in the personal+settings of the user through a checkbox there.++Infinite Scale works with the chunking tus upload protocol. The chunk+size is currently fixed 10 MB.+Sharepoint OnlineRclone can be used with Sharepoint provided by OneDrive for Business or@@ -56157,6 +58734,269 @@ Options:Changelog+v1.70.0 - 2025-06-17++See commits++- New backends+ - DOI (Flora Thiebaut)+ - FileLu (kingston125)+ - New S3 providers:+ - MEGA S4 (Nick Craig-Wood)+ - Pure Storage FlashBlade (Jeremy Daer)+- New commands+ - convmv: for moving and transforming files (nielash)+- New Features+ - Add --max-connections to control maximum backend concurrency+ (Nick Craig-Wood)+ - Add --max-buffer-memory to limit total buffer memory usage (Nick+ Craig-Wood)+ - Add transform library and --name-transform flag (nielash)+ - sync: Implement --list-cutoff to allow on disk sorting for+ reduced memory use (Nick Craig-Wood)+ - accounting: Add listed stat for number of directory entries+ listed (Nick Craig-Wood)+ - backend: Skip hash calculation when the hashType is None+ (Oleksiy Stashok)+ - build+ - Update to go1.24 and make go1.22 the minimum required+ version (Nick Craig-Wood)+ - Disable docker builds on PRs & add missing dockerfile+ changes (Anagh Kumar Baranwal)+ - Modernize Go usage (Nick Craig-Wood)+ - Update all dependencies (Nick Craig-Wood)+ - cmd/authorize: Show required arguments in help text (simwai)+ - cmd/config: add --no-output option (Jess)+ - cmd/gitannex+ - Tweak parsing of "rcloneremotename" config (Dan McArdle)+ - Permit remotes with options (Dan McArdle)+ - Reject unknown layout modes in INITREMOTE (Dan McArdle)+ - docker image: Add label org.opencontainers.image.source for+ release notes in Renovate dependency updates (Robin Schneider)+ - doc fixes (albertony, Andrew Kreimer, Ben Boeckel, Christoph+ Berger, Danny Garside, Dimitri Papadopoulos, eccoisle, Ed+ Craig-Wood, Fernando Fernández, jack, Jeff Geerling, Jugal+ Kishore, kingston125, luzpaz, Markus Gerstel, Matt Ickstadt,+ Michael Kebe, Nick Craig-Wood, PrathameshLakawade, Ser-Bul,+ simonmcnair, Tim White, Zachary Vorhies)+ - filter:+ - Add --hash-filter to deterministically select a subset of+ files (Nick Craig-Wood)+ - Show --min-size and --max-size in --dump filters (Nick+ Craig-Wood)+ - hash: Add SHA512 support for file hashes (Enduriel)+ - http servers: Add --user-from-header to use for authentication+ (Moises Lima)+ - lib/batcher: Deprecate unused option: batch_commit_timeout (Dan+ McArdle)+ - log:+ - Remove github.com/sirupsen/logrus and replace with log/slog+ (Nick Craig-Wood)+ - Add --windows-event-log-level to support Windows Event Log+ (Nick Craig-Wood)+ - rc+ - Add add short parameter to core/stats to not return+ transferring and checking (Nick Craig-Wood)+ - In options/info make FieldName contain a "." if it should be+ nested (Nick Craig-Wood)+ - Add rc control for serve commands (Nick Craig-Wood)+ - rcserver: Improve content-type check (Jonathan Giannuzzi)+ - serve nfs+ - Update docs to note Windows is not supported (Zachary+ Vorhies)+ - Change the format of --nfs-cache-type symlink file handles+ (Nick Craig-Wood)+ - Make metadata files have special file handles (Nick+ Craig-Wood)+ - touch: Make touch obey --transfers (Nick Craig-Wood)+ - version: Add --deps flag to show dependencies and other build+ info (Nick Craig-Wood)+- Bug Fixes+ - serve s3:+ - Fix ListObjectsV2 response (fhuber)+ - Remove redundant handler initialization (Tho Neyugn)+ - stats: Fix goroutine leak and improve stats accounting process+ (Nathanael Demacon)+- VFS+ - Add --vfs-metadata-extension to expose metadata sidecar files+ (Nick Craig-Wood)+- Azure Blob+ - Add support for x-ms-tags header (Trevor Starick)+ - Cleanup uncommitted blocks on upload errors (Nick Craig-Wood)+ - Speed up server side copies for small files (Nick Craig-Wood)+ - Implement multipart server side copy (Nick Craig-Wood)+ - Remove uncommitted blocks on InvalidBlobOrBlock error (Nick+ Craig-Wood)+ - Fix handling of objects with // in (Nick Craig-Wood)+ - Handle retry error codes more carefully (Nick Craig-Wood)+ - Fix errors not being retried when doing single part copy (Nick+ Craig-Wood)+ - Fix multipart server side copies of 0 sized files (Nick+ Craig-Wood)+- Azurefiles+ - Add --azurefiles-use-az and+ --azurefiles-disable-instance-discovery (b-wimmer)+- B2+ - Add SkipDestructive handling to backend commands (Pat Patterson)+ - Use file id from listing when not presented in headers (ahxxm)+- Cloudinary+ - Automatically add/remove known media files extensions+ (yuval-cloudinary)+ - Var naming convention (yuval-cloudinary)+- Drive+ - Added backend moveid command (Spencer McCullough)+- Dropbox+ - Support Dropbox Paper (Dave Vasilevsky)+- FTP+ - Add --ftp-http-proxy to connect via HTTP CONNECT proxy+- Gofile+ - Update to use new direct upload endpoint (wbulot)+- Googlephotos+ - Update read only and read write scopes to meet Google's+ requirements. (Germán Casares)+- Iclouddrive+ - Fix panic and files potentially downloaded twice (Clément+ Wehrung)+- Internetarchive+ - Add --internetarchive-metadata="key=value" for setting item+ metadata (Corentin Barreau)+- Onedrive+ - Fix "The upload session was not found" errors (Nick Craig-Wood)+ - Re-add --onedrive-upload-cutoff flag (Nick Craig-Wood)+ - Fix crash if no metadata was updated (Nick Craig-Wood)+- Opendrive+ - Added --opendrive-access flag to handle permissions (Joel K+ Biju)+- Pcloud+ - Fix "Access denied. You do not have permissions to perform this+ operation" on large uploads (Nick Craig-Wood)+- S3+ - Fix handling of objects with // in (Nick Craig-Wood)+ - Add IBM IAM signer (Alexander Minbaev)+ - Split the GCS quirks into --s3-use-x-id and+ --s3-sign-accept-encoding (Nick Craig-Wood)+ - Implement paged listing interface ListP (Nick Craig-Wood)+ - Add Pure Storage FlashBlade provider support (Jeremy Daer)+ - Require custom endpoint for Lyve Cloud v2 support+ (PrathameshLakawade)+ - MEGA S4 support (Nick Craig-Wood)+- SFTP+ - Add --sftp-http-proxy to connect via HTTP CONNECT proxy (Nick+ Craig-Wood)+- Smb+ - Add support for kerberos authentication (Jonathan Giannuzzi)+ - Improve connection pooling efficiency (Jonathan Giannuzzi)+- WebDAV+ - Retry propfind on 425 status (Jörn Friedrich Dreyer)+ - Add an ownCloud Infinite Scale vendor that enables tus chunked+ upload support (Klaas Freitag)++v1.69.3 - 2025-05-21++See commits++- Bug Fixes+ - build: Reapply update github.com/golang-jwt/jwt/v5 from 5.2.1 to+ 5.2.2 to fix CVE-2025-30204 (dependabot[bot])+ - build: Update github.com/ebitengine/purego to work around bug in+ go1.24.3 (Nick Craig-Wood)++v1.69.2 - 2025-05-01++See commits++- Bug fixes+ - accounting: Fix percentDiff calculation -- (Anagh Kumar+ Baranwal)+ - build+ - Update github.com/golang-jwt/jwt/v4 from 4.5.1 to 4.5.2 to+ fix CVE-2025-30204 (dependabot[bot])+ - Update github.com/golang-jwt/jwt/v5 from 5.2.1 to 5.2.2 to+ fix CVE-2025-30204 (dependabot[bot])+ - Update golang.org/x/crypto to v0.35.0 to fix CVE-2025-22869+ (Nick Craig-Wood)+ - Update golang.org/x/net from 0.36.0 to 0.38.0 to fix+ CVE-2025-22870 (dependabot[bot])+ - Update golang.org/x/net to 0.36.0. to fix CVE-2025-22869+ (dependabot[bot])+ - Stop building with go < go1.23 as security updates forbade+ it (Nick Craig-Wood)+ - Fix docker plugin build (Anagh Kumar Baranwal)+ - cmd: Fix crash if rclone is invoked without any arguments (Janne+ Hellsten)+ - config: Read configuration passwords from stdin even when+ terminated with EOF (Samantha Bowen)+ - doc fixes (Andrew Kreimer, Danny Garside, eccoisle, Ed+ Craig-Wood, emyarod, jack, Jugal Kishore, Markus Gerstel,+ Michael Kebe, Nick Craig-Wood, simonmcnair, simwai, Zachary+ Vorhies)+ - fs: Fix corruption of SizeSuffix with "B" suffix in config (eg+ --min-size) (Nick Craig-Wood)+ - lib/http: Fix race between Serve() and Shutdown() (Nick+ Craig-Wood)+ - object: Fix memory object out of bounds Seek (Nick Craig-Wood)+ - operations: Fix call fmt.Errorf with wrong err (alingse)+ - rc+ - Disable the metrics server when running rclone rc+ (hiddenmarten)+ - Fix debug/* commands not being available over unix sockets+ (Nick Craig-Wood)+ - serve nfs: Fix unlikely crash (Nick Craig-Wood)+ - stats: Fix the speed not getting updated after a pause in the+ processing (Anagh Kumar Baranwal)+ - sync+ - Fix cpu spinning when empty directory finding with leading+ slashes (Nick Craig-Wood)+ - Copy dir modtimes even when copyEmptySrcDirs is false+ (ll3006)+- VFS+ - Fix directory cache serving stale data (Lorenz Brun)+ - Fix inefficient directory caching when directory reads are slow+ (huanghaojun)+ - Fix integration test failures (Nick Craig-Wood)+- Drive+ - Metadata: fix error when setting copy-requires-writer-permission+ on a folder (Nick Craig-Wood)+- Dropbox+ - Retry link without expiry (Dave Vasilevsky)+- HTTP+ - Correct root if definitely pointing to a file (nielash)+- Iclouddrive+ - Fix so created files are writable (Ben Alex)+- Onedrive+ - Fix metadata ordering in permissions (Nick Craig-Wood)++v1.69.1 - 2025-02-14++See commits++- Bug Fixes+ - lib/oauthutil: Fix redirect URL mismatch errors (Nick+ Craig-Wood)+ - bisync: Fix listings missing concurrent modifications (nielash)+ - serve s3: Fix list objects encoding-type (Nick Craig-Wood)+ - fs: Fix confusing "didn't find section in config file" error+ (Nick Craig-Wood)+ - doc fixes (Christoph Berger, Dimitri Papadopoulos, Matt+ Ickstadt, Nick Craig-Wood, Tim White, Zachary Vorhies)+ - build: Added parallel docker builds and caching for go build in+ the container (Anagh Kumar Baranwal)+- VFS+ - Fix the cache failing to upload symlinks when --links was+ specified (Nick Craig-Wood)+ - Fix race detected by race detector (Nick Craig-Wood)+ - Close the change notify channel on Shutdown (izouxv)+- B2+ - Fix "fatal error: concurrent map writes" (Nick Craig-Wood)+- Iclouddrive+ - Add notes on ADP and Missing PCS cookies (Nick Craig-Wood)+- Onedrive+ - Mark German (de) region as deprecated (Nick Craig-Wood)+- S3+ - Added new storage class to magalu provider (Bruno Fernandes)+ - Add DigitalOcean regions SFO2, LON1, TOR1, BLR1 (jkpe)+ - Add latest Linode Object Storage endpoints (jbagwell-akamai)+v1.69.0 - 2025-01-12See commits@@ -56202,7 +59042,7 @@ See commitssockets in http servers (Moises Lima)- This was making it impossible to use unix sockets with anproxy- - This might now cause rclone to need authenticaton where it+ - This might now cause rclone to need authentication where itdidn't before- oauthutil: add support for OAuth client credential flow (MartinHassack, Nick Craig-Wood)@@ -57147,7 +59987,7 @@ See commits- doc updates (albertony, alfish2000, asdffdsazqqq, DimitriPapadopoulos, Herby Gillot, Joda Stößer, Manoj Ghosh, NickCraig-Wood)- - Implement --metadata-mapper to transform metatadata with a user+ - Implement --metadata-mapper to transform metadata with a usersupplied program (Nick Craig-Wood)- Add ChunkWriterDoesntSeek feature flag and set it for b2 (NickCraig-Wood)@@ -57309,7 +60149,7 @@ See commits- B2- Fix multipart upload: corrupted on transfer: sizes differ XXX vs0 (Nick Craig-Wood)- - Fix locking window when getting mutipart upload URL (Nick+ - Fix locking window when getting multipart upload URL (NickCraig-Wood)- Fix server side copies greater than 4GB (Nick Craig-Wood)- Fix chunked streaming uploads (Nick Craig-Wood)@@ -63640,6 +66480,18 @@ How do I configure rclone on a remote / headless box with no browser?This has now been documented in its own remote setup page.+How can I get rid of the "Config file not found" notice?++If you see a notice like 'NOTICE: Config file "rclone.conf" not found',+this means you have not configured any remotes.++If you need to configure a remote, see the config help docs.++If you are using rclone entirely with on the fly remotes, you can create+an empty config file to get rid of this notice, for example:++ rclone config touch+Can rclone sync directly from drive to s3Rclone can sync between two remote cloud storage systems just fine.@@ -63839,10 +66691,18 @@ garbage collector work harder, reducing memory size at the expense ofCPU usage.The most common cause of rclone using lots of memory is a single-directory with millions of files in. Rclone has to load this entirely-into memory as rclone objects. Each rclone object takes 0.5k-1k of-memory. There is a workaround for this which involves a bit of-scripting.+directory with millions of files in.++Before rclone v1.70 has to load this entirely into memory as rclone+objects. Each rclone object takes 0.5k-1k of memory. There is a+workaround for this which involves a bit of scripting.++However with rclone v1.70 and later rclone will automatically save+directory entries to disk when a directory with more than --list-cutoff+(1,000,000 by default) entries is detected.++From v1.70 rclone also has the --max-buffer-memory flag which helps+particularly when multi-thread transfers are using too much memory.Rclone changes fullwidth Unicode punctuation marks in file names@@ -64699,7 +67559,6 @@ email addresses removed from here need to be added to bin/.ignore-emails to make- ben-ba [email protected]- Eli Orzitzer [email protected]- Anthony Metzidis [email protected]-- emyarod [email protected]- keongalvin [email protected]- rarspace01 [email protected]- Paul Stern [email protected]@@ -64817,6 +67676,65 @@ email addresses removed from here need to be added to bin/.ignore-emails to make- TAKEI Yuya [email protected]- Francesco Frassinelli [email protected]+- Matt Ickstadt [email protected] [email protected]+- Spencer McCullough [email protected]+- Jonathan Giannuzzi [email protected]+- Christoph Berger [email protected]+- Tim White [email protected]+- Robin Schneider [email protected]+- izouxv [email protected]+- Moises Lima [email protected]+- Bruno Fernandes [email protected]+- Corentin Barreau [email protected]+- hiddenmarten [email protected]+- Trevor Starick [email protected]+- b-wimmer [email protected]+- Jess [email protected]+- Zachary Vorhies [email protected]+- Alexander Minbaev [email protected]+- Joel K Biju [email protected]+- ll3006 [email protected]+- jbagwell-akamai [email protected]+- Michael Kebe [email protected]+- Lorenz Brun [email protected]+- Dave Vasilevsky [email protected] [email protected]+- luzpaz [email protected]+- jack [email protected]+- Jörn Friedrich Dreyer [email protected]+- alingse [email protected]+- Fernando Fernández [email protected]+- eccoisle [email protected]+- Klaas Freitag [email protected]+- Danny Garside [email protected]+- Samantha Bowen [email protected]+- simonmcnair [email protected]+- huanghaojun [email protected]+- Enduriel [email protected]+- Markus Gerstel [email protected]+- simwai [email protected]+- Ben Alex [email protected]+- Klaas Freitag [email protected] [email protected]+- Andrew Kreimer [email protected]+- Ed Craig-Wood [email protected]+- Christian Richter [email protected]+- Ralf Haferkamp [email protected]+- Jugal Kishore [email protected]+- Tho Neyugn [email protected]+- Ben Boeckel [email protected]+- Clément Wehrung [email protected]+- Jeff Geerling [email protected]+- Germán Casares [email protected]+- fhuber [email protected]+- wbulot [email protected]+- Jeremy Daer [email protected]+- Oleksiy Stashok [email protected]+- PrathameshLakawade [email protected]+- Nathanael Demacon [email protected]+- ahxxm [email protected]+- Flora Thiebaut [email protected]+- kingston125 [email protected]+- Ser-Bul [email protected]Contact the rclone projectdiff --git a/bin/make_manual.py b/bin/make_manual.pyindex 962a4731b..f83e95b8a 100755--- a/bin/make_manual.py+++ b/bin/make_manual.py@@ -41,6 +41,7 @@ docs = ["crypt.md","compress.md","combine.md",+ "doi.md","dropbox.md","filefabric.md","filelu.md",diff --git a/docs/content/azureblob.md b/docs/content/azureblob.mdindex 8f74e072a..9e8970438 100644--- a/docs/content/azureblob.md+++ b/docs/content/azureblob.md@@ -719,6 +719,65 @@ Properties:- Type: int- Default: 16+#### --azureblob-copy-cutoff++Cutoff for switching to multipart copy.++Any files larger than this that need to be server-side copied will be+copied in chunks of chunk_size using the put block list API.++Files smaller than this limit will be copied with the Copy Blob API.++Properties:++- Config: copy_cutoff+- Env Var: RCLONE_AZUREBLOB_COPY_CUTOFF+- Type: SizeSuffix+- Default: 8Mi++#### --azureblob-copy-concurrency++Concurrency for multipart copy.++This is the number of chunks of the same file that are copied+concurrently.++These chunks are not buffered in memory and Microsoft recommends+setting this value to greater than 1000 in the azcopy documentation.++https://learn.microsoft.com/en-us/azure/storage/common/storage-use-azcopy-optimize#increase-concurrency++In tests, copy speed increases almost linearly with copy+concurrency.++Properties:++- Config: copy_concurrency+- Env Var: RCLONE_AZUREBLOB_COPY_CONCURRENCY+- Type: int+- Default: 512++#### --azureblob-use-copy-blob++Whether to use the Copy Blob API when copying to the same storage account.++If true (the default) then rclone will use the Copy Blob API for+copies to the same storage account even when the size is above the+copy_cutoff.++Rclone assumes that the same storage account means the same config+and does not check for the same storage account in different configs.++There should be no need to change this value.+++Properties:++- Config: use_copy_blob+- Env Var: RCLONE_AZUREBLOB_USE_COPY_BLOB+- Type: bool+- Default: true+#### --azureblob-list-chunkSize of blob list.diff --git a/docs/content/azurefiles.md b/docs/content/azurefiles.mdindex 54bb1bd3a..a08e8d9ea 100644--- a/docs/content/azurefiles.md+++ b/docs/content/azurefiles.md@@ -615,6 +615,42 @@ Properties:- Type: string- Required: false+#### --azurefiles-disable-instance-discovery++Skip requesting Microsoft Entra instance metadata+This should be set true only by applications authenticating in+disconnected clouds, or private clouds such as Azure Stack.+It determines whether rclone requests Microsoft Entra instance+metadata from `https://login.microsoft.com/` before+authenticating.+Setting this to true will skip this request, making you responsible+for ensuring the configured authority is valid and trustworthy.+++Properties:++- Config: disable_instance_discovery+- Env Var: RCLONE_AZUREFILES_DISABLE_INSTANCE_DISCOVERY+- Type: bool+- Default: false++#### --azurefiles-use-az++Use Azure CLI tool az for authentication+Set to use the [Azure CLI tool az](https://learn.microsoft.com/en-us/cli/azure/)+as the sole means of authentication.+Setting this can be useful if you wish to use the az CLI on a host with+a System Managed Identity that you do not want to use.+Don't set env_auth at the same time.+++Properties:++- Config: use_az+- Env Var: RCLONE_AZUREFILES_USE_AZ+- Type: bool+- Default: false+#### --azurefiles-endpointEndpoint for the service.diff --git a/docs/content/changelog.md b/docs/content/changelog.mdindex 4eb16138b..adfb44089 100644--- a/docs/content/changelog.md+++ b/docs/content/changelog.md@@ -5,6 +5,122 @@ description: "Rclone Changelog"# Changelog+## v1.70.0 - 2025-06-17++[See commits](https://github.com/rclone/rclone/compare/v1.69.0...v1.70.0)++* New backends+ * [DOI](/doi/) (Flora Thiebaut)+ * [FileLu](/filelu/) (kingston125)+ * New S3 providers:+ * [MEGA S4](/s3/#mega) (Nick Craig-Wood)+ * [Pure Storage FlashBlade](/s3/#pure-storage-flashblade) (Jeremy Daer)+* New commands+ * [convmv](/commands/rclone_convmv/): for moving and transforming files (nielash)+* New Features+ * Add [`--max-connections`](/docs/#max-connections-n) to control maximum backend concurrency (Nick Craig-Wood)+ * Add [`--max-buffer-memory`](/docs/#max-buffer-memory) to limit total buffer memory usage (Nick Craig-Wood)+ * Add transform library and [`--name-transform`](/docs/#name-transform-command-xxxx) flag (nielash)+ * sync: Implement [`--list-cutoff`](/docs/#list-cutoff) to allow on disk sorting for reduced memory use (Nick Craig-Wood)+ * accounting: Add listed stat for number of directory entries listed (Nick Craig-Wood)+ * backend: Skip hash calculation when the hashType is None (Oleksiy Stashok)+ * build+ * Update to go1.24 and make go1.22 the minimum required version (Nick Craig-Wood)+ * Disable docker builds on PRs & add missing dockerfile changes (Anagh Kumar Baranwal)+ * Modernize Go usage (Nick Craig-Wood)+ * Update all dependencies (Nick Craig-Wood)+ * cmd/authorize: Show required arguments in help text (simwai)+ * cmd/config: add `--no-output` option (Jess)+ * cmd/gitannex+ * Tweak parsing of "rcloneremotename" config (Dan McArdle)+ * Permit remotes with options (Dan McArdle)+ * Reject unknown layout modes in INITREMOTE (Dan McArdle)+ * docker image: Add label org.opencontainers.image.source for release notes in Renovate dependency updates (Robin Schneider)+ * doc fixes (albertony, Andrew Kreimer, Ben Boeckel, Christoph Berger, Danny Garside, Dimitri Papadopoulos, eccoisle, Ed Craig-Wood, Fernando Fernández, jack, Jeff Geerling, Jugal Kishore, kingston125, luzpaz, Markus Gerstel, Matt Ickstadt, Michael Kebe, Nick Craig-Wood, PrathameshLakawade, Ser-Bul, simonmcnair, Tim White, Zachary Vorhies)+ * filter:+ * Add `--hash-filter` to deterministically select a subset of files (Nick Craig-Wood)+ * Show `--min-size` and `--max-size` in `--dump` filters (Nick Craig-Wood)+ * hash: Add SHA512 support for file hashes (Enduriel)+ * http servers: Add `--user-from-header` to use for authentication (Moises Lima)+ * lib/batcher: Deprecate unused option: batch_commit_timeout (Dan McArdle)+ * log:+ * Remove github.com/sirupsen/logrus and replace with log/slog (Nick Craig-Wood)+ * Add `--windows-event-log-level` to support Windows Event Log (Nick Craig-Wood)+ * rc+ * Add add `short` parameter to `core/stats` to not return transferring and checking (Nick Craig-Wood)+ * In `options/info` make FieldName contain a "." if it should be nested (Nick Craig-Wood)+ * Add rc control for serve commands (Nick Craig-Wood)+ * rcserver: Improve content-type check (Jonathan Giannuzzi)+ * serve nfs+ * Update docs to note Windows is not supported (Zachary Vorhies)+ * Change the format of `--nfs-cache-type symlink` file handles (Nick Craig-Wood)+ * Make metadata files have special file handles (Nick Craig-Wood)+ * touch: Make touch obey `--transfers` (Nick Craig-Wood)+ * version: Add `--deps` flag to show dependencies and other build info (Nick Craig-Wood)+* Bug Fixes+ * serve s3:+ * Fix ListObjectsV2 response (fhuber)+ * Remove redundant handler initialization (Tho Neyugn)+ * stats: Fix goroutine leak and improve stats accounting process (Nathanael Demacon)+* VFS+ * Add `--vfs-metadata-extension` to expose metadata sidecar files (Nick Craig-Wood)+* Azure Blob+ * Add support for `x-ms-tags` header (Trevor Starick)+ * Cleanup uncommitted blocks on upload errors (Nick Craig-Wood)+ * Speed up server side copies for small files (Nick Craig-Wood)+ * Implement multipart server side copy (Nick Craig-Wood)+ * Remove uncommitted blocks on InvalidBlobOrBlock error (Nick Craig-Wood)+ * Fix handling of objects with // in (Nick Craig-Wood)+ * Handle retry error codes more carefully (Nick Craig-Wood)+ * Fix errors not being retried when doing single part copy (Nick Craig-Wood)+ * Fix multipart server side copies of 0 sized files (Nick Craig-Wood)+* Azurefiles+ * Add `--azurefiles-use-az` and `--azurefiles-disable-instance-discovery` (b-wimmer)+* B2+ * Add SkipDestructive handling to backend commands (Pat Patterson)+ * Use file id from listing when not presented in headers (ahxxm)+* Cloudinary+ * Automatically add/remove known media files extensions (yuval-cloudinary)+ * Var naming convention (yuval-cloudinary)+* Drive+ * Added `backend moveid` command (Spencer McCullough)+* Dropbox+ * Support Dropbox Paper (Dave Vasilevsky)+* FTP+ * Add `--ftp-http-proxy` to connect via HTTP CONNECT proxy+* Gofile+ * Update to use new direct upload endpoint (wbulot)+* Googlephotos+ * Update read only and read write scopes to meet Google's requirements. (Germán Casares)+* Iclouddrive+ * Fix panic and files potentially downloaded twice (Clément Wehrung)+* Internetarchive+ * Add `--internetarchive-metadata="key=value"` for setting item metadata (Corentin Barreau)+* Onedrive+ * Fix "The upload session was not found" errors (Nick Craig-Wood)+ * Re-add `--onedrive-upload-cutoff` flag (Nick Craig-Wood)+ * Fix crash if no metadata was updated (Nick Craig-Wood)+* Opendrive+ * Added `--opendrive-access` flag to handle permissions (Joel K Biju)+* Pcloud+ * Fix "Access denied. You do not have permissions to perform this operation" on large uploads (Nick Craig-Wood)+* S3+ * Fix handling of objects with // in (Nick Craig-Wood)+ * Add IBM IAM signer (Alexander Minbaev)+ * Split the GCS quirks into `--s3-use-x-id` and `--s3-sign-accept-encoding` (Nick Craig-Wood)+ * Implement paged listing interface ListP (Nick Craig-Wood)+ * Add Pure Storage FlashBlade provider support (Jeremy Daer)+ * Require custom endpoint for Lyve Cloud v2 support (PrathameshLakawade)+ * MEGA S4 support (Nick Craig-Wood)+* SFTP+ * Add `--sftp-http-proxy` to connect via HTTP CONNECT proxy (Nick Craig-Wood)+* Smb+ * Add support for kerberos authentication (Jonathan Giannuzzi)+ * Improve connection pooling efficiency (Jonathan Giannuzzi)+* WebDAV+ * Retry propfind on 425 status (Jörn Friedrich Dreyer)+ * Add an ownCloud Infinite Scale vendor that enables tus chunked upload support (Klaas Freitag)+## v1.69.3 - 2025-05-21[See commits](https://github.com/rclone/rclone/compare/v1.69.2...v1.69.3)diff --git a/docs/content/commands/rclone.md b/docs/content/commands/rclone.mdindex 0921995de..fabe44fa9 100644--- a/docs/content/commands/rclone.md+++ b/docs/content/commands/rclone.md@@ -37,6 +37,8 @@ rclone [flags]--azureblob-client-id string The ID of the client in use--azureblob-client-secret string One of the service principal's client secrets--azureblob-client-send-certificate-chain Send the certificate chain when using certificate auth+ --azureblob-copy-concurrency int Concurrency for multipart copy (default 512)+ --azureblob-copy-cutoff SizeSuffix Cutoff for switching to multipart copy (default 8Mi)--azureblob-delete-snapshots string Set to specify how to deal with snapshots on blob deletion--azureblob-description string Description of the remote--azureblob-directory-markers Upload an empty object with a trailing slash when a new directory is created@@ -60,6 +62,7 @@ rclone [flags]--azureblob-upload-concurrency int Concurrency for multipart uploads (default 16)--azureblob-upload-cutoff string Cutoff for switching to chunked upload (<= 256 MiB) (deprecated)--azureblob-use-az Use Azure CLI tool az for authentication+ --azureblob-use-copy-blob Whether to use the Copy Blob API when copying to the same storage account (default true)--azureblob-use-emulator Uses local storage emulator if provided as 'true'--azureblob-use-msi Use a managed service identity to authenticate (only works in Azure)--azureblob-username string User name (usually an email address)@@ -72,6 +75,7 @@ rclone [flags]--azurefiles-client-send-certificate-chain Send the certificate chain when using certificate auth--azurefiles-connection-string string Azure Files Connection String--azurefiles-description string Description of the remote+ --azurefiles-disable-instance-discovery Skip requesting Microsoft Entra instance metadata--azurefiles-encoding Encoding The encoding for the backend (default Slash,LtGt,DoubleQuote,Colon,Question,Asterisk,Pipe,BackSlash,Del,Ctl,RightPeriod,InvalidUtf8,Dot)--azurefiles-endpoint string Endpoint for the service--azurefiles-env-auth Read credentials from runtime (environment variables, CLI or MSI)@@ -86,6 +90,7 @@ rclone [flags]--azurefiles-share-name string Azure Files Share Name--azurefiles-tenant string ID of the service principal's tenant. Also called its directory ID--azurefiles-upload-concurrency int Concurrency for multipart uploads (default 16)+ --azurefiles-use-az Use Azure CLI tool az for authentication--azurefiles-use-msi Use a managed service identity to authenticate (only works in Azure)--azurefiles-username string User name (usually an email address)--b2-account string Account ID or Application Key ID@@ -160,12 +165,14 @@ rclone [flags]--chunker-remote string Remote to chunk/unchunk--client-cert string Client SSL certificate (PEM) for mutual TLS auth--client-key string Client SSL private key (PEM) for mutual TLS auth+ --cloudinary-adjust-media-files-extensions Cloudinary handles media formats as a file attribute and strips it from the name, which is unlike most other file systems (default true)--cloudinary-api-key string Cloudinary API Key--cloudinary-api-secret string Cloudinary API Secret--cloudinary-cloud-name string Cloudinary Environment Name--cloudinary-description string Description of the remote--cloudinary-encoding Encoding The encoding for the backend (default Slash,LtGt,DoubleQuote,Question,Asterisk,Pipe,Hash,Percent,BackSlash,Del,Ctl,RightSpace,InvalidUtf8,Dot)--cloudinary-eventually-consistent-delay Duration Wait N seconds for eventual consistency of the databases that support the backend operation (default 0s)+ --cloudinary-media-extensions stringArray Cloudinary supported media extensions (default 3ds,3g2,3gp,ai,arw,avi,avif,bmp,bw,cr2,cr3,djvu,dng,eps3,fbx,flif,flv,gif,glb,gltf,hdp,heic,heif,ico,indd,jp2,jpe,jpeg,jpg,jxl,jxr,m2ts,mov,mp4,mpeg,mts,mxf,obj,ogv,pdf,ply,png,psd,svg,tga,tif,tiff,ts,u3ma,usdz,wdp,webm,webp,wmv)--cloudinary-upload-prefix string Specify the API endpoint for environments out of the US--cloudinary-upload-preset string Upload Preset to select asset manipulation on upload--color AUTO|NEVER|ALWAYS When to show colors (and other ANSI codes) AUTO|NEVER|ALWAYS (default AUTO)@@ -204,6 +211,10 @@ rclone [flags]--disable string Disable a comma separated list of features (use --disable help to see a list)--disable-http-keep-alives Disable HTTP keep-alives and use each connection once--disable-http2 Disable HTTP/2 in the global transport+ --doi-description string Description of the remote+ --doi-doi string The DOI or the doi.org URL+ --doi-doi-resolver-api-url string The URL of the DOI resolver API to use+ --doi-provider string DOI provider--drive-acknowledge-abuse Set to allow files which return cannotDownloadAbusiveFile to be downloaded--drive-allow-import-name-change Allow the filetype to change when uploading Google docs--drive-auth-owner-only Only consider files owned by the authenticated user@@ -255,7 +266,6 @@ rclone [flags]--drive-use-trash Send files to the trash instead of deleting permanently (default true)--drive-v2-download-min-size SizeSuffix If Object's are greater, use drive v2 API to download (default off)--dropbox-auth-url string Auth server URL- --dropbox-batch-commit-timeout Duration Max time to wait for a batch to finish committing (default 10m0s)--dropbox-batch-mode string Upload file batching sync|async|off (default "sync")--dropbox-batch-size int Max number of files in upload batch--dropbox-batch-timeout Duration Max time to allow an idle upload batch before uploading (default 0s)@@ -265,11 +275,14 @@ rclone [flags]--dropbox-client-secret string OAuth Client Secret--dropbox-description string Description of the remote--dropbox-encoding Encoding The encoding for the backend (default Slash,BackSlash,Del,RightSpace,InvalidUtf8,Dot)+ --dropbox-export-formats CommaSepList Comma separated list of preferred formats for exporting files (default html,md)--dropbox-impersonate string Impersonate this user when using a business account--dropbox-pacer-min-sleep Duration Minimum time to sleep between API calls (default 10ms)--dropbox-root-namespace string Specify a different Dropbox namespace ID to use as the root for all paths--dropbox-shared-files Instructs rclone to work on individual shared files--dropbox-shared-folders Instructs rclone to work on shared folders+ --dropbox-show-all-exports Show all exportable files in listings+ --dropbox-skip-exports Skip exportable files in all listings--dropbox-token string OAuth Access Token as a JSON blob--dropbox-token-url string Token server url-n, --dry-run Do a trial run with no permanent changes@@ -298,6 +311,9 @@ rclone [flags]--filefabric-token-expiry string Token expiry time--filefabric-url string URL of the Enterprise File Fabric to connect to--filefabric-version string Version read from the file fabric+ --filelu-description string Description of the remote+ --filelu-encoding Encoding The encoding for the backend (default Slash,LtGt,DoubleQuote,SingleQuote,BackQuote,Dollar,Colon,Question,Asterisk,Pipe,Hash,Percent,BackSlash,CrLf,Del,Ctl,LeftSpace,LeftPeriod,LeftTilde,LeftCrLfHtVt,RightSpace,RightPeriod,RightCrLfHtVt,InvalidUtf8,Dot,SquareBracket,Semicolon,Exclamation)+ --filelu-key string Your FileLu Rclone key from My Account--files-from stringArray Read list of source-file names from file (use - to read from stdin)--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)--filescom-api-key string The API key used to authenticate with Files.com@@ -364,7 +380,6 @@ rclone [flags]--gofile-list-chunk int Number of items to list in each call (default 1000)--gofile-root-folder-id string ID of the root folder--gphotos-auth-url string Auth server URL- --gphotos-batch-commit-timeout Duration Max time to wait for a batch to finish committing (default 10m0s)--gphotos-batch-mode string Upload file batching sync|async|off (default "sync")--gphotos-batch-size int Max number of files in upload batch--gphotos-batch-timeout Duration Max time to allow an idle upload batch before uploading (default 0s)@@ -380,6 +395,7 @@ rclone [flags]--gphotos-start-year int Year limits the photos to be downloaded to those which are uploaded after the given year (default 2000)--gphotos-token string OAuth Access Token as a JSON blob--gphotos-token-url string Token server url+ --hash-filter string Partition filenames by hash k/n or randomly @/n--hasher-auto-size SizeSuffix Auto-update checksum for files smaller than this size (disabled by default)--hasher-description string Description of the remote--hasher-hashes CommaSepList Comma separated list of supported checksum types (default md5,sha1)@@ -449,6 +465,8 @@ rclone [flags]--internetarchive-encoding Encoding The encoding for the backend (default Slash,LtGt,CrLf,Del,Ctl,InvalidUtf8,Dot)--internetarchive-endpoint string IAS3 Endpoint (default "https://s3.us.archive.org")--internetarchive-front-endpoint string Host of InternetArchive Frontend (default "https://archive.org")+ --internetarchive-item-derive Whether to trigger derive on the IA item or not. If set to false, the item will not be derived by IA upon upload (default true)+ --internetarchive-item-metadata stringArray Metadata to be set on the IA item, this is different from file-level metadata that can be set using --metadata-set--internetarchive-secret-access-key string IAS3 Secret Key (password)--internetarchive-wait-archive Duration Timeout for waiting the server's processing tasks (specifically archive and book_op) to finish (default 0s)--jottacloud-auth-url string Auth server URL@@ -476,6 +494,7 @@ rclone [flags]--linkbox-description string Description of the remote--linkbox-token string Token from https://www.linkbox.to/admin/account-l, --links Translate symlinks to/from regular files with a '.rclonelink' extension+ --list-cutoff int To save memory, sort directory listings on disk above this threshold (default 1000000)--local-case-insensitive Force the filesystem to report itself as case insensitive--local-case-sensitive Force the filesystem to report itself as case sensitive--local-description string Description of the remote@@ -491,7 +510,7 @@ rclone [flags]--local-unicode-normalization Apply unicode NFC normalization to paths and filenames--local-zero-size-links Assume the Stat size of links is zero (and read them instead) (deprecated)--log-file string Log everything to this file- --log-format string Comma separated list of log format options (default "date,time")+ --log-format Bits Comma separated list of log format options (default date,time)--log-level LogLevel Log level DEBUG|INFO|NOTICE|ERROR (default NOTICE)--log-systemd Activate systemd integration for the logger--low-level-retries int Number of low level retries to do (default 10)@@ -512,6 +531,8 @@ rclone [flags]--mailru-user string User name (usually email)--max-age Duration Only transfer files younger than this in s or suffix ms|s|m|h|d|w|M|y (default off)--max-backlog int Maximum number of objects in sync or check backlog (default 10000)+ --max-buffer-memory SizeSuffix If set, don't allocate more than this amount of memory as buffers (default off)+ --max-connections int Maximum number of simultaneous backend API connections, 0 for unlimited--max-delete int When synchronizing, limit the number of deletes (default -1)--max-delete-size SizeSuffix When synchronizing, limit the total size of deletes (default off)--max-depth int If set limits the recursion depth to this (default -1)@@ -553,6 +574,7 @@ rclone [flags]--metrics-server-write-timeout Duration Timeout for server writing data (default 1h0m0s)--metrics-template string User-specified template--metrics-user string User name for authentication+ --metrics-user-from-header string User name from a defined HTTP header--min-age Duration Only transfer files older than this in s or suffix ms|s|m|h|d|w|M|y (default off)--min-size SizeSuffix Only transfer files bigger than this in KiB or suffix B|K|M|G|T|P (default off)--modify-window Duration Max time diff to be considered the same (default 1ns)@@ -560,6 +582,7 @@ rclone [flags]--multi-thread-cutoff SizeSuffix Use multi-thread downloads for files above this size (default 256Mi)--multi-thread-streams int Number of streams to use for multi-thread downloads (default 4)--multi-thread-write-buffer-size SizeSuffix In memory buffer size for writing when in multi-thread mode (default 128Ki)+ --name-transform stringArray Transform paths during the copy process--netstorage-account string Set the NetStorage account name--netstorage-description string Description of the remote--netstorage-host string Domain+path of NetStorage host to connect to@@ -601,6 +624,7 @@ rclone [flags]--onedrive-tenant string ID of the service principal's tenant. Also called its directory ID--onedrive-token string OAuth Access Token as a JSON blob--onedrive-token-url string Token server url+ --onedrive-upload-cutoff SizeSuffix Cutoff for switching to chunked upload (default off)--oos-attempt-resume-upload If true attempt to resume previously started multipart upload for the object--oos-chunk-size SizeSuffix Chunk size to use for uploading (default 5Mi)--oos-compartment string Specify compartment OCID, if you need to list buckets@@ -626,6 +650,7 @@ rclone [flags]--oos-storage-tier string The storage class to use when storing new objects in storage. https://docs.oracle.com/en-us/iaas/Content/Object/Concepts/understandingstoragetiers.htm (default "Standard")--oos-upload-concurrency int Concurrency for multipart uploads (default 10)--oos-upload-cutoff SizeSuffix Cutoff for switching to chunked upload (default 200Mi)+ --opendrive-access string Files and folders will be uploaded with this access permission (default private) (default "private")--opendrive-chunk-size SizeSuffix Files will be uploaded in chunks this size (default 10Mi)--opendrive-description string Description of the remote--opendrive-encoding Encoding The encoding for the backend (default Slash,LtGt,DoubleQuote,Colon,Question,Asterisk,Pipe,BackSlash,LeftSpace,LeftCrLfHtVt,RightSpace,RightCrLfHtVt,InvalidUtf8,Dot)@@ -736,6 +761,7 @@ rclone [flags]--rc-server-write-timeout Duration Timeout for server writing data (default 1h0m0s)--rc-template string User-specified template--rc-user string User name for authentication+ --rc-user-from-header string User name from a defined HTTP header--rc-web-fetch-url string URL to fetch the releases for webgui (default "https://api.github.com/repos/rclone/rclone-webui-react/releases/latest")--rc-web-gui Launch WebGUI on localhost--rc-web-gui-force-update Force update to latest version of web gui@@ -760,6 +786,8 @@ rclone [flags]--s3-endpoint string Endpoint for S3 API--s3-env-auth Get AWS credentials from runtime (environment variables or EC2/ECS meta data if no env vars)--s3-force-path-style If true use path style access if false use virtual hosted style (default true)+ --s3-ibm-api-key string IBM API Key to be used to obtain IAM token+ --s3-ibm-resource-instance-id string IBM service instance id--s3-leave-parts-on-error If true avoid calling abort upload on a failure, leaving all successfully uploaded parts on S3 for manual recovery--s3-list-chunk int Size of listing chunk (response list for each ListObject S3 request) (default 1000)--s3-list-url-encode Tristate Whether to url encode listings: true/false/unset (default unset)@@ -780,6 +808,7 @@ rclone [flags]--s3-server-side-encryption string The server-side encryption algorithm used when storing this object in S3--s3-session-token string An AWS session token--s3-shared-credentials-file string Path to the shared credentials file+ --s3-sign-accept-encoding Tristate Set if rclone should include Accept-Encoding as part of the signature (default unset)--s3-sse-customer-algorithm string If using SSE-C, the server-side encryption algorithm used when storing this object in S3--s3-sse-customer-key string To use SSE-C you may provide the secret encryption key used to encrypt/decrypt your data--s3-sse-customer-key-base64 string If using SSE-C you must provide the secret encryption key encoded in base64 format to encrypt/decrypt your data@@ -796,6 +825,7 @@ rclone [flags]--s3-use-multipart-uploads Tristate Set if rclone should use multipart uploads (default unset)--s3-use-presigned-request Whether to use a presigned request or PutObject for single part uploads--s3-use-unsigned-payload Tristate Whether to use an unsigned payload in PutObject (default unset)+ --s3-use-x-id Tristate Set if rclone should add x-id URL parameters (default unset)--s3-v2-auth If true use v2 authentication--s3-version-at Time Show file versions as they were at the specified time (default off)--s3-version-deleted Show deleted file markers when using versions@@ -822,6 +852,7 @@ rclone [flags]--sftp-disable-hashcheck Disable the execution of SSH commands to determine if remote file hashing is available--sftp-host string SSH host to connect to--sftp-host-key-algorithms SpaceSepList Space separated list of host key algorithms, ordered by preference+ --sftp-http-proxy string URL for HTTP CONNECT proxy--sftp-idle-timeout Duration Max time before closing idle connections (default 1m0s)--sftp-key-exchange SpaceSepList Space separated list of key exchange algorithms, ordered by preference--sftp-key-file string Path to PEM-encoded private key file@@ -877,6 +908,7 @@ rclone [flags]--smb-pass string SMB password (obscured)--smb-port int SMB port number (default 445)--smb-spn string Service principal name+ --smb-use-kerberos Use Kerberos authentication--smb-user string SMB username (default "$USER")--stats Duration Interval between printing stats, e.g. 500ms, 60s, 5m (0 to disable) (default 1m0s)--stats-file-name-length int Max file name length in stats (0 for no limit) (default 45)@@ -965,7 +997,7 @@ rclone [flags]--use-json-log Use json log format--use-mmap Use mmap allocator (see docs)--use-server-modtime Use server modified time instead of object metadata- --user-agent string Set the user-agent to a specified string (default "rclone/v1.69.0")+ --user-agent string Set the user-agent to a specified string (default "rclone/v1.70.0")-v, --verbose count Print lots more stuff (repeat for more)-V, --version Print the version number--webdav-auth-redirect Preserve authentication on redirect@@ -1017,6 +1049,7 @@ rclone [flags]* [rclone cleanup](/commands/rclone_cleanup/) - Clean up the remote if possible.* [rclone completion](/commands/rclone_completion/) - Output completion script for a given shell.* [rclone config](/commands/rclone_config/) - Enter an interactive configuration session.+* [rclone convmv](/commands/rclone_convmv/) - Convert file and directory names in place.* [rclone copy](/commands/rclone_copy/) - Copy files from source to dest, skipping identical files.* [rclone copyto](/commands/rclone_copyto/) - Copy files from source to dest, skipping identical files.* [rclone copyurl](/commands/rclone_copyurl/) - Copy the contents of the URL supplied content to dest:path.diff --git a/docs/content/commands/rclone_authorize.md b/docs/content/commands/rclone_authorize.mdindex abdaff9d2..9e9fbcfa1 100644--- a/docs/content/commands/rclone_authorize.md+++ b/docs/content/commands/rclone_authorize.md@@ -14,13 +14,18 @@ Remote authorization. Used to authorize a remote or headlessrclone from a machine with a browser - use as instructed byrclone config.+The command requires 1-3 arguments:+ - fs name (e.g., "drive", "s3", etc.)+ - Either a base64 encoded JSON blob obtained from a previous rclone config session+ - Or a client_id and client_secret pair obtained from the remote service+Use --auth-no-open-browser to prevent rclone to open authlink in default browser automatically.Use --template to generate HTML output via a custom Go template. If a blank string is provided as an argument to this flag, the default template is used.```-rclone authorize [flags]+rclone authorize <fs name> [base64_json_blob | client_id client_secret] [flags]```## Optionsdiff --git a/docs/content/commands/rclone_bisync.md b/docs/content/commands/rclone_bisync.mdindex 4f7c80d31..d7fb8ea2a 100644--- a/docs/content/commands/rclone_bisync.md+++ b/docs/content/commands/rclone_bisync.md@@ -93,6 +93,7 @@ Flags for anything which can copy a file--multi-thread-cutoff SizeSuffix Use multi-thread downloads for files above this size (default 256Mi)--multi-thread-streams int Number of streams to use for multi-thread downloads (default 4)--multi-thread-write-buffer-size SizeSuffix In memory buffer size for writing when in multi-thread mode (default 128Ki)+ --name-transform stringArray Transform paths during the copy process--no-check-dest Don't check the destination, copy regardless--no-traverse Don't traverse destination file system on copy--no-update-dir-modtime Don't update directory modification times@@ -129,6 +130,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)diff --git a/docs/content/commands/rclone_cat.md b/docs/content/commands/rclone_cat.mdindex 6ec5666a0..71d5a9814 100644--- a/docs/content/commands/rclone_cat.md+++ b/docs/content/commands/rclone_cat.md@@ -74,6 +74,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)diff --git a/docs/content/commands/rclone_check.md b/docs/content/commands/rclone_check.mdindex 9647280b5..2e3e80852 100644--- a/docs/content/commands/rclone_check.md+++ b/docs/content/commands/rclone_check.md@@ -96,6 +96,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)diff --git a/docs/content/commands/rclone_checksum.md b/docs/content/commands/rclone_checksum.mdindex 9f6eaab39..44cd51bb8 100644--- a/docs/content/commands/rclone_checksum.md+++ b/docs/content/commands/rclone_checksum.md@@ -82,6 +82,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)diff --git a/docs/content/commands/rclone_config_create.md b/docs/content/commands/rclone_config_create.mdindex 2832b70a8..22eeb7d85 100644--- a/docs/content/commands/rclone_config_create.md+++ b/docs/content/commands/rclone_config_create.md@@ -123,6 +123,7 @@ rclone config create name type [key value]* [flags]--continue Continue the configuration process with an answer-h, --help help for create--no-obscure Force any passwords not to be obscured+ --no-output Don't provide any output--non-interactive Don't interact with user and return questions--obscure Force any passwords to be obscured--result string Result - use with --continuediff --git a/docs/content/commands/rclone_config_encryption_set.md b/docs/content/commands/rclone_config_encryption_set.mdindex b02dff900..780c086dc 100644--- a/docs/content/commands/rclone_config_encryption_set.md+++ b/docs/content/commands/rclone_config_encryption_set.md@@ -21,12 +21,12 @@ password to re-encrypt the config.When `--password-command` is called to change the password then theenvironment variable `RCLONE_PASSWORD_CHANGE=1` will be set. So if-changing passwords programatically you can use the environment+changing passwords programmatically you can use the environmentvariable to distinguish which password you must supply.Alternatively you can remove the password first (with `rclone configencryption remove`), then set it again with this command which may be-easier if you don't mind the unecrypted config file being on the disk+easier if you don't mind the unencrypted config file being on the diskbriefly.diff --git a/docs/content/commands/rclone_config_update.md b/docs/content/commands/rclone_config_update.mdindex e4a160b6a..af9660db2 100644--- a/docs/content/commands/rclone_config_update.md+++ b/docs/content/commands/rclone_config_update.md@@ -123,6 +123,7 @@ rclone config update name [key value]+ [flags]--continue Continue the configuration process with an answer-h, --help help for update--no-obscure Force any passwords not to be obscured+ --no-output Don't provide any output--non-interactive Don't interact with user and return questions--obscure Force any passwords to be obscured--result string Result - use with --continuediff --git a/docs/content/commands/rclone_convmv.md b/docs/content/commands/rclone_convmv.mdnew file mode 100644index 000000000..d23125618--- /dev/null+++ b/docs/content/commands/rclone_convmv.md@@ -0,0 +1,400 @@+---+title: "rclone convmv"+description: "Convert file and directory names in place."+versionIntroduced: v1.70+# autogenerated - DO NOT EDIT, instead edit the source code in cmd/convmv/ and as part of making a release run "make commanddocs"+---+# rclone convmv++Convert file and directory names in place.++## Synopsis+++convmv supports advanced path name transformations for converting and renaming files and directories by applying prefixes, suffixes, and other alterations.++| Command | Description |+|------|------|+| `--name-transform prefix=XXXX` | Prepends XXXX to the file name. |+| `--name-transform suffix=XXXX` | Appends XXXX to the file name after the extension. |+| `--name-transform suffix_keep_extension=XXXX` | Appends XXXX to the file name while preserving the original file extension. |+| `--name-transform trimprefix=XXXX` | Removes XXXX if it appears at the start of the file name. |+| `--name-transform trimsuffix=XXXX` | Removes XXXX if it appears at the end of the file name. |+| `--name-transform regex=/pattern/replacement/` | Applies a regex-based transformation. |+| `--name-transform replace=old:new` | Replaces occurrences of old with new in the file name. |+| `--name-transform date={YYYYMMDD}` | Appends or prefixes the specified date format. |+| `--name-transform truncate=N` | Truncates the file name to a maximum of N characters. |+| `--name-transform base64encode` | Encodes the file name in Base64. |+| `--name-transform base64decode` | Decodes a Base64-encoded file name. |+| `--name-transform encoder=ENCODING` | Converts the file name to the specified encoding (e.g., ISO-8859-1, Windows-1252, Macintosh). |+| `--name-transform decoder=ENCODING` | Decodes the file name from the specified encoding. |+| `--name-transform charmap=MAP` | Applies a character mapping transformation. |+| `--name-transform lowercase` | Converts the file name to lowercase. |+| `--name-transform uppercase` | Converts the file name to UPPERCASE. |+| `--name-transform titlecase` | Converts the file name to Title Case. |+| `--name-transform ascii` | Strips non-ASCII characters. |+| `--name-transform url` | URL-encodes the file name. |+| `--name-transform nfc` | Converts the file name to NFC Unicode normalization form. |+| `--name-transform nfd` | Converts the file name to NFD Unicode normalization form. |+| `--name-transform nfkc` | Converts the file name to NFKC Unicode normalization form. |+| `--name-transform nfkd` | Converts the file name to NFKD Unicode normalization form. |+| `--name-transform command=/path/to/my/programfile names.` | Executes an external program to transform |+++Conversion modes:+```+none+nfc+nfd+nfkc+nfkd+replace+prefix+suffix+suffix_keep_extension+trimprefix+trimsuffix+index+date+truncate+base64encode+base64decode+encoder+decoder+ISO-8859-1+Windows-1252+Macintosh+charmap+lowercase+uppercase+titlecase+ascii+url+regex+command+```+Char maps:+```++IBM-Code-Page-037+IBM-Code-Page-437+IBM-Code-Page-850+IBM-Code-Page-852+IBM-Code-Page-855+Windows-Code-Page-858+IBM-Code-Page-860+IBM-Code-Page-862+IBM-Code-Page-863+IBM-Code-Page-865+IBM-Code-Page-866+IBM-Code-Page-1047+IBM-Code-Page-1140+ISO-8859-1+ISO-8859-2+ISO-8859-3+ISO-8859-4+ISO-8859-5+ISO-8859-6+ISO-8859-7+ISO-8859-8+ISO-8859-9+ISO-8859-10+ISO-8859-13+ISO-8859-14+ISO-8859-15+ISO-8859-16+KOI8-R+KOI8-U+Macintosh+Macintosh-Cyrillic+Windows-874+Windows-1250+Windows-1251+Windows-1252+Windows-1253+Windows-1254+Windows-1255+Windows-1256+Windows-1257+Windows-1258+X-User-Defined+```+Encoding masks:+```+Asterisk+ BackQuote+ BackSlash+ Colon+ CrLf+ Ctl+ Del+ Dollar+ Dot+ DoubleQuote+ Exclamation+ Hash+ InvalidUtf8+ LeftCrLfHtVt+ LeftPeriod+ LeftSpace+ LeftTilde+ LtGt+ None+ Percent+ Pipe+ Question+ Raw+ RightCrLfHtVt+ RightPeriod+ RightSpace+ Semicolon+ SingleQuote+ Slash+ SquareBracket+```+Examples:++```+rclone convmv "stories/The Quick Brown Fox!.txt" --name-transform "all,uppercase"+// Output: STORIES/THE QUICK BROWN FOX!.TXT+```++```+rclone convmv "stories/The Quick Brown Fox!.txt" --name-transform "all,replace=Fox:Turtle" --name-transform "all,replace=Quick:Slow"+// Output: stories/The Slow Brown Turtle!.txt+```++```+rclone convmv "stories/The Quick Brown Fox!.txt" --name-transform "all,base64encode"+// Output: c3Rvcmllcw==/VGhlIFF1aWNrIEJyb3duIEZveCEudHh0+```++```+rclone convmv "c3Rvcmllcw==/VGhlIFF1aWNrIEJyb3duIEZveCEudHh0" --name-transform "all,base64decode"+// Output: stories/The Quick Brown Fox!.txt+```++```+rclone convmv "stories/The Quick Brown 🦊 Fox Went to the Café!.txt" --name-transform "all,nfc"+// Output: stories/The Quick Brown 🦊 Fox Went to the Café!.txt+```++```+rclone convmv "stories/The Quick Brown 🦊 Fox Went to the Café!.txt" --name-transform "all,nfd"+// Output: stories/The Quick Brown 🦊 Fox Went to the Café!.txt+```++```+rclone convmv "stories/The Quick Brown 🦊 Fox!.txt" --name-transform "all,ascii"+// Output: stories/The Quick Brown Fox!.txt+```++```+rclone convmv "stories/The Quick Brown Fox!.txt" --name-transform "all,trimsuffix=.txt"+// Output: stories/The Quick Brown Fox!+```++```+rclone convmv "stories/The Quick Brown Fox!.txt" --name-transform "all,prefix=OLD_"+// Output: OLD_stories/OLD_The Quick Brown Fox!.txt+```++```+rclone convmv "stories/The Quick Brown 🦊 Fox Went to the Café!.txt" --name-transform "all,charmap=ISO-8859-7"+// Output: stories/The Quick Brown _ Fox Went to the Caf_!.txt+```++```+rclone convmv "stories/The Quick Brown Fox: A Memoir [draft].txt" --name-transform "all,encoder=Colon,SquareBracket"+// Output: stories/The Quick Brown Fox: A Memoir [draft].txt+```++```+rclone convmv "stories/The Quick Brown 🦊 Fox Went to the Café!.txt" --name-transform "all,truncate=21"+// Output: stories/The Quick Brown 🦊 Fox+```++```+rclone convmv "stories/The Quick Brown Fox!.txt" --name-transform "all,command=echo"+// Output: stories/The Quick Brown Fox!.txt+```++```+rclone convmv "stories/The Quick Brown Fox!" --name-transform "date=-{YYYYMMDD}"+// Output: stories/The Quick Brown Fox!-20250617+```++```+rclone convmv "stories/The Quick Brown Fox!" --name-transform "date=-{macfriendlytime}"+// Output: stories/The Quick Brown Fox!-2025-06-17 0551PM+```++```+rclone convmv "stories/The Quick Brown Fox!.txt" --name-transform "all,regex=[\\.\\w]/ab"+// Output: ababababababab/ababab ababababab ababababab ababab!abababab+```++++Multiple transformations can be used in sequence, applied in the order they are specified on the command line.++The `--name-transform` flag is also available in `sync`, `copy`, and `move`.++# Files vs Directories ##++By default `--name-transform` will only apply to file names. The means only the leaf file name will be transformed.+However some of the transforms would be better applied to the whole path or just directories.+To choose which which part of the file path is affected some tags can be added to the `--name-transform`++| Tag | Effect |+|------|------|+| `file` | Only transform the leaf name of files (DEFAULT) |+| `dir` | Only transform name of directories - these may appear anywhere in the path |+| `all` | Transform the entire path for files and directories |++This is used by adding the tag into the transform name like this: `--name-transform file,prefix=ABC` or `--name-transform dir,prefix=DEF`.++For some conversions using all is more likely to be useful, for example `--name-transform all,nfc`++Note that `--name-transform` may not add path separators `/` to the name. This will cause an error.++# Ordering and Conflicts ##++* Transformations will be applied in the order specified by the user.+ * If the `file` tag is in use (the default) then only the leaf name of files will be transformed.+ * If the `dir` tag is in use then directories anywhere in the path will be transformed+ * If the `all` tag is in use then directories and files anywhere in the path will be transformed+ * Each transformation will be run one path segment at a time.+ * If a transformation adds a `/` or ends up with an empty path segment then that will be an error.+* It is up to the user to put the transformations in a sensible order.+ * Conflicting transformations, such as `prefix` followed by `trimprefix` or `nfc` followed by `nfd`, are possible.+ * Instead of enforcing mutual exclusivity, transformations are applied in sequence as specified by the+user, allowing for intentional use cases (e.g., trimming one prefix before adding another).+ * Users should be aware that certain combinations may lead to unexpected results and should verify+transformations using `--dry-run` before execution.++# Race Conditions and Non-Deterministic Behavior ##++Some transformations, such as `replace=old:new`, may introduce conflicts where multiple source files map to the same destination name.+This can lead to race conditions when performing concurrent transfers. It is up to the user to anticipate these.+* If two files from the source are transformed into the same name at the destination, the final state may be non-deterministic.+* Running rclone check after a sync using such transformations may erroneously report missing or differing files due to overwritten results.++* To minimize risks, users should:+ * Carefully review transformations that may introduce conflicts.+ * Use `--dry-run` to inspect changes before executing a sync (but keep in mind that it won't show the effect of non-deterministic transformations).+ * Avoid transformations that cause multiple distinct source files to map to the same destination name.+ * Consider disabling concurrency with `--transfers=1` if necessary.+ * Certain transformations (e.g. `prefix`) will have a multiplying effect every time they are used. Avoid these when using `bisync`.++++```+rclone convmv dest:path --name-transform XXX [flags]+```++## Options++```+ --create-empty-src-dirs Create empty source dirs on destination after move+ --delete-empty-src-dirs Delete empty source dirs after move+ -h, --help help for convmv+```++Options shared with other commands are described next.+See the [global flags page](/flags/) for global options not listed here.++### Copy Options++Flags for anything which can copy a file++```+ --check-first Do all the checks before starting transfers+ -c, --checksum Check for changes with size & checksum (if available, or fallback to size only)+ --compare-dest stringArray Include additional server-side paths during comparison+ --copy-dest stringArray Implies --compare-dest but also copies files from paths into destination+ --cutoff-mode HARD|SOFT|CAUTIOUS Mode to stop transfers when reaching the max transfer limit HARD|SOFT|CAUTIOUS (default HARD)+ --ignore-case-sync Ignore case when synchronizing+ --ignore-checksum Skip post copy check of checksums+ --ignore-existing Skip all files that exist on destination+ --ignore-size Ignore size when skipping use modtime or checksum+ -I, --ignore-times Don't skip items that match size and time - transfer all unconditionally+ --immutable Do not modify files, fail if existing files have been modified+ --inplace Download directly to destination file instead of atomic download to temp/rename+ -l, --links Translate symlinks to/from regular files with a '.rclonelink' extension+ --max-backlog int Maximum number of objects in sync or check backlog (default 10000)+ --max-duration Duration Maximum duration rclone will transfer data for (default 0s)+ --max-transfer SizeSuffix Maximum size of data to transfer (default off)+ -M, --metadata If set, preserve metadata when copying objects+ --modify-window Duration Max time diff to be considered the same (default 1ns)+ --multi-thread-chunk-size SizeSuffix Chunk size for multi-thread downloads / uploads, if not set by filesystem (default 64Mi)+ --multi-thread-cutoff SizeSuffix Use multi-thread downloads for files above this size (default 256Mi)+ --multi-thread-streams int Number of streams to use for multi-thread downloads (default 4)+ --multi-thread-write-buffer-size SizeSuffix In memory buffer size for writing when in multi-thread mode (default 128Ki)+ --name-transform stringArray Transform paths during the copy process+ --no-check-dest Don't check the destination, copy regardless+ --no-traverse Don't traverse destination file system on copy+ --no-update-dir-modtime Don't update directory modification times+ --no-update-modtime Don't update destination modtime if files identical+ --order-by string Instructions on how to order the transfers, e.g. 'size,descending'+ --partial-suffix string Add partial-suffix to temporary file name when --inplace is not used (default ".partial")+ --refresh-times Refresh the modtime of remote files+ --server-side-across-configs Allow server-side operations (e.g. copy) to work across different configs+ --size-only Skip based on size only, not modtime or checksum+ --streaming-upload-cutoff SizeSuffix Cutoff for switching to chunked upload if file size is unknown, upload starts after reaching cutoff or when file ends (default 100Ki)+ -u, --update Skip files that are newer on the destination+```++### Important Options++Important flags useful for most commands++```+ -n, --dry-run Do a trial run with no permanent changes+ -i, --interactive Enable interactive mode+ -v, --verbose count Print lots more stuff (repeat for more)+```++### Filter Options++Flags for filtering directory listings++```+ --delete-excluded Delete files on dest excluded from sync+ --exclude stringArray Exclude files matching pattern+ --exclude-from stringArray Read file exclude patterns from file (use - to read from stdin)+ --exclude-if-present stringArray Exclude directories if filename is present+ --files-from stringArray Read list of source-file names from file (use - to read from stdin)+ --files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)+ -f, --filter stringArray Add a file filtering rule+ --filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n+ --ignore-case Ignore case in filters (case insensitive)+ --include stringArray Include files matching pattern+ --include-from stringArray Read file include patterns from file (use - to read from stdin)+ --max-age Duration Only transfer files younger than this in s or suffix ms|s|m|h|d|w|M|y (default off)+ --max-depth int If set limits the recursion depth to this (default -1)+ --max-size SizeSuffix Only transfer files smaller than this in KiB or suffix B|K|M|G|T|P (default off)+ --metadata-exclude stringArray Exclude metadatas matching pattern+ --metadata-exclude-from stringArray Read metadata exclude patterns from file (use - to read from stdin)+ --metadata-filter stringArray Add a metadata filtering rule+ --metadata-filter-from stringArray Read metadata filtering patterns from a file (use - to read from stdin)+ --metadata-include stringArray Include metadatas matching pattern+ --metadata-include-from stringArray Read metadata include patterns from file (use - to read from stdin)+ --min-age Duration Only transfer files older than this in s or suffix ms|s|m|h|d|w|M|y (default off)+ --min-size SizeSuffix Only transfer files bigger than this in KiB or suffix B|K|M|G|T|P (default off)+```++### Listing Options++Flags for listing directories++```+ --default-time Time Time to show if modtime is unknown for files and directories (default 2000-01-01T00:00:00Z)+ --fast-list Use recursive list if available; uses more memory but fewer transactions+```++## See Also++* [rclone](/commands/rclone/) - Show help for rclone commands, flags and backends.+diff --git a/docs/content/commands/rclone_copy.md b/docs/content/commands/rclone_copy.mdindex e4da96773..db7ebf6d7 100644--- a/docs/content/commands/rclone_copy.md+++ b/docs/content/commands/rclone_copy.md@@ -116,6 +116,7 @@ Flags for anything which can copy a file--multi-thread-cutoff SizeSuffix Use multi-thread downloads for files above this size (default 256Mi)--multi-thread-streams int Number of streams to use for multi-thread downloads (default 4)--multi-thread-write-buffer-size SizeSuffix In memory buffer size for writing when in multi-thread mode (default 128Ki)+ --name-transform stringArray Transform paths during the copy process--no-check-dest Don't check the destination, copy regardless--no-traverse Don't traverse destination file system on copy--no-update-dir-modtime Don't update directory modification times@@ -152,6 +153,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)diff --git a/docs/content/commands/rclone_copyto.md b/docs/content/commands/rclone_copyto.mdindex 4a2152c86..b5026bbc5 100644--- a/docs/content/commands/rclone_copyto.md+++ b/docs/content/commands/rclone_copyto.md@@ -36,6 +36,8 @@ This doesn't transfer files that are identical on src and dst, testingby size and modification time or MD5SUM. It doesn't delete files fromthe destination.+*If you are looking to copy just a byte range of a file, please see 'rclone cat --offset X --count Y'*+**Note**: Use the `-P`/`--progress` flag to view real-time transfer statistics@@ -79,6 +81,7 @@ Flags for anything which can copy a file--multi-thread-cutoff SizeSuffix Use multi-thread downloads for files above this size (default 256Mi)--multi-thread-streams int Number of streams to use for multi-thread downloads (default 4)--multi-thread-write-buffer-size SizeSuffix In memory buffer size for writing when in multi-thread mode (default 128Ki)+ --name-transform stringArray Transform paths during the copy process--no-check-dest Don't check the destination, copy regardless--no-traverse Don't traverse destination file system on copy--no-update-dir-modtime Don't update directory modification times@@ -115,6 +118,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)diff --git a/docs/content/commands/rclone_copyurl.md b/docs/content/commands/rclone_copyurl.mdindex 061644fa3..779b6b5e1 100644--- a/docs/content/commands/rclone_copyurl.md+++ b/docs/content/commands/rclone_copyurl.md@@ -17,7 +17,7 @@ Setting `--auto-filename` will attempt to automatically determine thefilename from the URL (after any redirections) and used in thedestination path.-With `--auto-filename-header` in addition, if a specific filename is+With `--header-filename` in addition, if a specific filename isset in HTTP headers, it will be used instead of the name from the URL.With `--print-filename` in addition, the resulting file name will beprinted.@@ -28,7 +28,7 @@ destination if there is one with the same name.Setting `--stdout` or making the output file name `-`will cause the output to be written to standard output.-## Troublshooting+## TroubleshootingIf you can't get `rclone copyurl` to work then here are some things you can try:diff --git a/docs/content/commands/rclone_cryptcheck.md b/docs/content/commands/rclone_cryptcheck.mdindex 1f3a916bd..0f59f6893 100644--- a/docs/content/commands/rclone_cryptcheck.md+++ b/docs/content/commands/rclone_cryptcheck.md@@ -99,6 +99,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)diff --git a/docs/content/commands/rclone_delete.md b/docs/content/commands/rclone_delete.mdindex 542cfcd16..d4153f87d 100644--- a/docs/content/commands/rclone_delete.md+++ b/docs/content/commands/rclone_delete.md@@ -75,6 +75,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)diff --git a/docs/content/commands/rclone_hashsum.md b/docs/content/commands/rclone_hashsum.mdindex 4ca4f30a2..ab0609a55 100644--- a/docs/content/commands/rclone_hashsum.md+++ b/docs/content/commands/rclone_hashsum.md@@ -36,6 +36,7 @@ Run without a hash to see the list of all supported hashes, e.g.* whirlpool* crc32* sha256+ * sha512Then@@ -74,6 +75,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)diff --git a/docs/content/commands/rclone_ls.md b/docs/content/commands/rclone_ls.mdindex 54ad257f1..30b8cfd88 100644--- a/docs/content/commands/rclone_ls.md+++ b/docs/content/commands/rclone_ls.md@@ -70,6 +70,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)diff --git a/docs/content/commands/rclone_lsd.md b/docs/content/commands/rclone_lsd.mdindex 90fafb28d..0fa31360c 100644--- a/docs/content/commands/rclone_lsd.md+++ b/docs/content/commands/rclone_lsd.md@@ -81,6 +81,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)diff --git a/docs/content/commands/rclone_lsf.md b/docs/content/commands/rclone_lsf.mdindex a02014a66..73ca2077a 100644--- a/docs/content/commands/rclone_lsf.md+++ b/docs/content/commands/rclone_lsf.md@@ -178,6 +178,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)diff --git a/docs/content/commands/rclone_lsjson.md b/docs/content/commands/rclone_lsjson.mdindex 48ea8b155..952828ff4 100644--- a/docs/content/commands/rclone_lsjson.md+++ b/docs/content/commands/rclone_lsjson.md@@ -150,6 +150,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)diff --git a/docs/content/commands/rclone_lsl.md b/docs/content/commands/rclone_lsl.mdindex ba2d587ca..d02090071 100644--- a/docs/content/commands/rclone_lsl.md+++ b/docs/content/commands/rclone_lsl.md@@ -71,6 +71,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)diff --git a/docs/content/commands/rclone_md5sum.md b/docs/content/commands/rclone_md5sum.mdindex fe40b7b1e..435ca45b1 100644--- a/docs/content/commands/rclone_md5sum.md+++ b/docs/content/commands/rclone_md5sum.md@@ -58,6 +58,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)diff --git a/docs/content/commands/rclone_mount.md b/docs/content/commands/rclone_mount.mdindex 7ce79eb5c..3d324847d 100644--- a/docs/content/commands/rclone_mount.md+++ b/docs/content/commands/rclone_mount.md@@ -571,11 +571,11 @@ seconds. If rclone is quit or dies with files that haven't beenuploaded, these will be uploaded next time rclone is run with the sameflags.-If using `--vfs-cache-max-size` or `--vfs-cache-min-free-size` note+If using `--vfs-cache-max-size` or `--vfs-cache-min-free-space` notethat the cache may exceed these quotas for two reasons. Firstlybecause it is only checked every `--vfs-cache-poll-interval`. Secondlybecause open files cannot be evicted from the cache. When-`--vfs-cache-max-size` or `--vfs-cache-min-free-size` is exceeded,+`--vfs-cache-max-size` or `--vfs-cache-min-free-space` is exceeded,rclone will attempt to evict the least accessed files from the cachefirst. rclone will start with files that haven't been accessed for thelongest. This cache flushing strategy is efficient and more relevant@@ -900,6 +900,45 @@ _WARNING._ Contrary to `rclone size`, this flag ignores filters so that theresult is accurate. However, this is very inefficient and may cost lots of APIcalls resulting in extra charges. Use it as a last resort and only with caching.+## VFS Metadata++If you use the `--vfs-metadata-extension` flag you can get the VFS to+expose files which contain the [metadata](/docs/#metadata) as a JSON+blob. These files will not appear in the directory listing, but can be+`stat`-ed and opened and once they have been they **will** appear in+directory listings until the directory cache expires.++Note that some backends won't create metadata unless you pass in the+`--metadata` flag.++For example, using `rclone mount` with `--metadata --vfs-metadata-extension .metadata`+we get++```+$ ls -l /mnt/+total 1048577+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++$ cat /mnt/1G.metadata+{+ "atime": "2025-03-04T17:34:22.317069787Z",+ "btime": "2025-03-03T16:03:37.708253808Z",+ "gid": "1000",+ "mode": "100664",+ "mtime": "2025-03-03T16:03:39.640238323Z",+ "uid": "1000"+}++$ ls -l /mnt/+total 1048578+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+-rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata+```++If the file has no metadata it will be returned as `{}` and if there+is an error reading the metadata the error will be returned as+`{"error":"error string"}`.+```@@ -951,6 +990,7 @@ rclone mount remote:path /path/to/mountpoint [flags]--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a '.rclonelink' extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached ('off' is unlimited) (default off)@@ -980,6 +1020,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)diff --git a/docs/content/commands/rclone_move.md b/docs/content/commands/rclone_move.mdindex 1d9930121..a705635ab 100644--- a/docs/content/commands/rclone_move.md+++ b/docs/content/commands/rclone_move.md@@ -91,6 +91,7 @@ Flags for anything which can copy a file--multi-thread-cutoff SizeSuffix Use multi-thread downloads for files above this size (default 256Mi)--multi-thread-streams int Number of streams to use for multi-thread downloads (default 4)--multi-thread-write-buffer-size SizeSuffix In memory buffer size for writing when in multi-thread mode (default 128Ki)+ --name-transform stringArray Transform paths during the copy process--no-check-dest Don't check the destination, copy regardless--no-traverse Don't traverse destination file system on copy--no-update-dir-modtime Don't update directory modification times@@ -127,6 +128,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)diff --git a/docs/content/commands/rclone_moveto.md b/docs/content/commands/rclone_moveto.mdindex 0de165dc2..14d1646de 100644--- a/docs/content/commands/rclone_moveto.md+++ b/docs/content/commands/rclone_moveto.md@@ -82,6 +82,7 @@ Flags for anything which can copy a file--multi-thread-cutoff SizeSuffix Use multi-thread downloads for files above this size (default 256Mi)--multi-thread-streams int Number of streams to use for multi-thread downloads (default 4)--multi-thread-write-buffer-size SizeSuffix In memory buffer size for writing when in multi-thread mode (default 128Ki)+ --name-transform stringArray Transform paths during the copy process--no-check-dest Don't check the destination, copy regardless--no-traverse Don't traverse destination file system on copy--no-update-dir-modtime Don't update directory modification times@@ -118,6 +119,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)diff --git a/docs/content/commands/rclone_ncdu.md b/docs/content/commands/rclone_ncdu.mdindex 62623c59d..08387a1c2 100644--- a/docs/content/commands/rclone_ncdu.md+++ b/docs/content/commands/rclone_ncdu.md@@ -98,6 +98,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)diff --git a/docs/content/commands/rclone_nfsmount.md b/docs/content/commands/rclone_nfsmount.mdindex 079eabbef..9bb84225b 100644--- a/docs/content/commands/rclone_nfsmount.md+++ b/docs/content/commands/rclone_nfsmount.md@@ -572,11 +572,11 @@ seconds. If rclone is quit or dies with files that haven't beenuploaded, these will be uploaded next time rclone is run with the sameflags.-If using `--vfs-cache-max-size` or `--vfs-cache-min-free-size` note+If using `--vfs-cache-max-size` or `--vfs-cache-min-free-space` notethat the cache may exceed these quotas for two reasons. Firstlybecause it is only checked every `--vfs-cache-poll-interval`. Secondlybecause open files cannot be evicted from the cache. When-`--vfs-cache-max-size` or `--vfs-cache-min-free-size` is exceeded,+`--vfs-cache-max-size` or `--vfs-cache-min-free-space` is exceeded,rclone will attempt to evict the least accessed files from the cachefirst. rclone will start with files that haven't been accessed for thelongest. This cache flushing strategy is efficient and more relevant@@ -901,6 +901,45 @@ _WARNING._ Contrary to `rclone size`, this flag ignores filters so that theresult is accurate. However, this is very inefficient and may cost lots of APIcalls resulting in extra charges. Use it as a last resort and only with caching.+## VFS Metadata++If you use the `--vfs-metadata-extension` flag you can get the VFS to+expose files which contain the [metadata](/docs/#metadata) as a JSON+blob. These files will not appear in the directory listing, but can be+`stat`-ed and opened and once they have been they **will** appear in+directory listings until the directory cache expires.++Note that some backends won't create metadata unless you pass in the+`--metadata` flag.++For example, using `rclone mount` with `--metadata --vfs-metadata-extension .metadata`+we get++```+$ ls -l /mnt/+total 1048577+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++$ cat /mnt/1G.metadata+{+ "atime": "2025-03-04T17:34:22.317069787Z",+ "btime": "2025-03-03T16:03:37.708253808Z",+ "gid": "1000",+ "mode": "100664",+ "mtime": "2025-03-03T16:03:39.640238323Z",+ "uid": "1000"+}++$ ls -l /mnt/+total 1048578+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+-rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata+```++If the file has no metadata it will be returned as `{}` and if there+is an error reading the metadata the error will be returned as+`{"error":"error string"}`.+```@@ -957,6 +996,7 @@ rclone nfsmount remote:path /path/to/mountpoint [flags]--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a '.rclonelink' extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached ('off' is unlimited) (default off)@@ -986,6 +1026,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)diff --git a/docs/content/commands/rclone_purge.md b/docs/content/commands/rclone_purge.mdindex ab191f57e..c1fded41c 100644--- a/docs/content/commands/rclone_purge.md+++ b/docs/content/commands/rclone_purge.md@@ -15,6 +15,9 @@ include/exclude filters - everything will be removed. Use thedelete files. To delete empty directories only, use command[rmdir](/commands/rclone_rmdir/) or [rmdirs](/commands/rclone_rmdirs/).+The concurrency of this operation is controlled by the `--checkers` global flag. However, some backends will+implement this command directly, in which case `--checkers` will be ignored.+**Important**: Since this can cause data loss, test first with the`--dry-run` or the `--interactive`/`-i` flag.diff --git a/docs/content/commands/rclone_rcd.md b/docs/content/commands/rclone_rcd.mdindex 912a0f677..126727b34 100644--- a/docs/content/commands/rclone_rcd.md+++ b/docs/content/commands/rclone_rcd.md@@ -126,7 +126,11 @@ By default this will serve files without needing a login.You can either use an htpasswd file which can take lots of users, orset a single username and password with the `--rc-user` and `--rc-pass` flags.-If no static users are configured by either of the above methods, and client+Alternatively, you can have the reverse proxy manage authentication and use the+username provided in the configured header with `--user-from-header` (e.g., `--rc---user-from-header=x-remote-user`).+Ensure the proxy is trusted and headers cannot be spoofed, as misconfiguration may lead to unauthorized access.++If either of the above authentication methods is not configured and clientcertificates are required by the `--client-ca` flag passed to the server, theclient certificate common name will be considered as the username.@@ -190,6 +194,7 @@ Flags to control the Remote Control API--rc-server-write-timeout Duration Timeout for server writing data (default 1h0m0s)--rc-template string User-specified template--rc-user string User name for authentication+ --rc-user-from-header string User name from a defined HTTP header--rc-web-fetch-url string URL to fetch the releases for webgui (default "https://api.github.com/repos/rclone/rclone-webui-react/releases/latest")--rc-web-gui Launch WebGUI on localhost--rc-web-gui-force-update Force update to latest version of web guidiff --git a/docs/content/commands/rclone_serve_dlna.md b/docs/content/commands/rclone_serve_dlna.mdindex 9ac076f2d..a0c8b8d4d 100644--- a/docs/content/commands/rclone_serve_dlna.md+++ b/docs/content/commands/rclone_serve_dlna.md@@ -134,11 +134,11 @@ seconds. If rclone is quit or dies with files that haven't beenuploaded, these will be uploaded next time rclone is run with the sameflags.-If using `--vfs-cache-max-size` or `--vfs-cache-min-free-size` note+If using `--vfs-cache-max-size` or `--vfs-cache-min-free-space` notethat the cache may exceed these quotas for two reasons. Firstlybecause it is only checked every `--vfs-cache-poll-interval`. Secondlybecause open files cannot be evicted from the cache. When-`--vfs-cache-max-size` or `--vfs-cache-min-free-size` is exceeded,+`--vfs-cache-max-size` or `--vfs-cache-min-free-space` is exceeded,rclone will attempt to evict the least accessed files from the cachefirst. rclone will start with files that haven't been accessed for thelongest. This cache flushing strategy is efficient and more relevant@@ -463,6 +463,45 @@ _WARNING._ Contrary to `rclone size`, this flag ignores filters so that theresult is accurate. However, this is very inefficient and may cost lots of APIcalls resulting in extra charges. Use it as a last resort and only with caching.+## VFS Metadata++If you use the `--vfs-metadata-extension` flag you can get the VFS to+expose files which contain the [metadata](/docs/#metadata) as a JSON+blob. These files will not appear in the directory listing, but can be+`stat`-ed and opened and once they have been they **will** appear in+directory listings until the directory cache expires.++Note that some backends won't create metadata unless you pass in the+`--metadata` flag.++For example, using `rclone mount` with `--metadata --vfs-metadata-extension .metadata`+we get++```+$ ls -l /mnt/+total 1048577+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++$ cat /mnt/1G.metadata+{+ "atime": "2025-03-04T17:34:22.317069787Z",+ "btime": "2025-03-03T16:03:37.708253808Z",+ "gid": "1000",+ "mode": "100664",+ "mtime": "2025-03-03T16:03:39.640238323Z",+ "uid": "1000"+}++$ ls -l /mnt/+total 1048578+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+-rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata+```++If the file has no metadata it will be returned as `{}` and if there+is an error reading the metadata the error will be returned as+`{"error":"error string"}`.+```@@ -500,6 +539,7 @@ rclone serve dlna remote:path [flags]--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a '.rclonelink' extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached ('off' is unlimited) (default off)@@ -527,6 +567,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)diff --git a/docs/content/commands/rclone_serve_docker.md b/docs/content/commands/rclone_serve_docker.mdindex 6c2f84f29..5f4536ba4 100644--- a/docs/content/commands/rclone_serve_docker.md+++ b/docs/content/commands/rclone_serve_docker.md@@ -146,11 +146,11 @@ seconds. If rclone is quit or dies with files that haven't beenuploaded, these will be uploaded next time rclone is run with the sameflags.-If using `--vfs-cache-max-size` or `--vfs-cache-min-free-size` note+If using `--vfs-cache-max-size` or `--vfs-cache-min-free-space` notethat the cache may exceed these quotas for two reasons. Firstlybecause it is only checked every `--vfs-cache-poll-interval`. Secondlybecause open files cannot be evicted from the cache. When-`--vfs-cache-max-size` or `--vfs-cache-min-free-size` is exceeded,+`--vfs-cache-max-size` or `--vfs-cache-min-free-space` is exceeded,rclone will attempt to evict the least accessed files from the cachefirst. rclone will start with files that haven't been accessed for thelongest. This cache flushing strategy is efficient and more relevant@@ -475,6 +475,45 @@ _WARNING._ Contrary to `rclone size`, this flag ignores filters so that theresult is accurate. However, this is very inefficient and may cost lots of APIcalls resulting in extra charges. Use it as a last resort and only with caching.+## VFS Metadata++If you use the `--vfs-metadata-extension` flag you can get the VFS to+expose files which contain the [metadata](/docs/#metadata) as a JSON+blob. These files will not appear in the directory listing, but can be+`stat`-ed and opened and once they have been they **will** appear in+directory listings until the directory cache expires.++Note that some backends won't create metadata unless you pass in the+`--metadata` flag.++For example, using `rclone mount` with `--metadata --vfs-metadata-extension .metadata`+we get++```+$ ls -l /mnt/+total 1048577+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++$ cat /mnt/1G.metadata+{+ "atime": "2025-03-04T17:34:22.317069787Z",+ "btime": "2025-03-03T16:03:37.708253808Z",+ "gid": "1000",+ "mode": "100664",+ "mtime": "2025-03-03T16:03:39.640238323Z",+ "uid": "1000"+}++$ ls -l /mnt/+total 1048578+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+-rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata+```++If the file has no metadata it will be returned as `{}` and if there+is an error reading the metadata the error will be returned as+`{"error":"error string"}`.+```@@ -531,6 +570,7 @@ rclone serve docker [flags]--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a '.rclonelink' extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached ('off' is unlimited) (default off)@@ -560,6 +600,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)diff --git a/docs/content/commands/rclone_serve_ftp.md b/docs/content/commands/rclone_serve_ftp.mdindex e96f68116..219b1dd79 100644--- a/docs/content/commands/rclone_serve_ftp.md+++ b/docs/content/commands/rclone_serve_ftp.md@@ -127,11 +127,11 @@ seconds. If rclone is quit or dies with files that haven't beenuploaded, these will be uploaded next time rclone is run with the sameflags.-If using `--vfs-cache-max-size` or `--vfs-cache-min-free-size` note+If using `--vfs-cache-max-size` or `--vfs-cache-min-free-space` notethat the cache may exceed these quotas for two reasons. Firstlybecause it is only checked every `--vfs-cache-poll-interval`. Secondlybecause open files cannot be evicted from the cache. When-`--vfs-cache-max-size` or `--vfs-cache-min-free-size` is exceeded,+`--vfs-cache-max-size` or `--vfs-cache-min-free-space` is exceeded,rclone will attempt to evict the least accessed files from the cachefirst. rclone will start with files that haven't been accessed for thelongest. This cache flushing strategy is efficient and more relevant@@ -456,6 +456,45 @@ _WARNING._ Contrary to `rclone size`, this flag ignores filters so that theresult is accurate. However, this is very inefficient and may cost lots of APIcalls resulting in extra charges. Use it as a last resort and only with caching.+## VFS Metadata++If you use the `--vfs-metadata-extension` flag you can get the VFS to+expose files which contain the [metadata](/docs/#metadata) as a JSON+blob. These files will not appear in the directory listing, but can be+`stat`-ed and opened and once they have been they **will** appear in+directory listings until the directory cache expires.++Note that some backends won't create metadata unless you pass in the+`--metadata` flag.++For example, using `rclone mount` with `--metadata --vfs-metadata-extension .metadata`+we get++```+$ ls -l /mnt/+total 1048577+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++$ cat /mnt/1G.metadata+{+ "atime": "2025-03-04T17:34:22.317069787Z",+ "btime": "2025-03-03T16:03:37.708253808Z",+ "gid": "1000",+ "mode": "100664",+ "mtime": "2025-03-03T16:03:39.640238323Z",+ "uid": "1000"+}++$ ls -l /mnt/+total 1048578+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+-rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata+```++If the file has no metadata it will be returned as `{}` and if there+is an error reading the metadata the error will be returned as+`{"error":"error string"}`.+## Auth ProxyIf you supply the parameter `--auth-proxy /path/to/program` then@@ -577,6 +616,7 @@ rclone serve ftp remote:path [flags]--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a '.rclonelink' extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached ('off' is unlimited) (default off)@@ -604,6 +644,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)diff --git a/docs/content/commands/rclone_serve_http.md b/docs/content/commands/rclone_serve_http.mdindex f87db8730..36c3de07e 100644--- a/docs/content/commands/rclone_serve_http.md+++ b/docs/content/commands/rclone_serve_http.md@@ -128,7 +128,11 @@ By default this will serve files without needing a login.You can either use an htpasswd file which can take lots of users, orset a single username and password with the `--user` and `--pass` flags.-If no static users are configured by either of the above methods, and client+Alternatively, you can have the reverse proxy manage authentication and use the+username provided in the configured header with `--user-from-header` (e.g., `----user-from-header=x-remote-user`).+Ensure the proxy is trusted and headers cannot be spoofed, as misconfiguration may lead to unauthorized access.++If either of the above authentication methods is not configured and clientcertificates are required by the `--client-ca` flag passed to the server, theclient certificate common name will be considered as the username.@@ -245,11 +249,11 @@ seconds. If rclone is quit or dies with files that haven't beenuploaded, these will be uploaded next time rclone is run with the sameflags.-If using `--vfs-cache-max-size` or `--vfs-cache-min-free-size` note+If using `--vfs-cache-max-size` or `--vfs-cache-min-free-space` notethat the cache may exceed these quotas for two reasons. Firstlybecause it is only checked every `--vfs-cache-poll-interval`. Secondlybecause open files cannot be evicted from the cache. When-`--vfs-cache-max-size` or `--vfs-cache-min-free-size` is exceeded,+`--vfs-cache-max-size` or `--vfs-cache-min-free-space` is exceeded,rclone will attempt to evict the least accessed files from the cachefirst. rclone will start with files that haven't been accessed for thelongest. This cache flushing strategy is efficient and more relevant@@ -574,6 +578,45 @@ _WARNING._ Contrary to `rclone size`, this flag ignores filters so that theresult is accurate. However, this is very inefficient and may cost lots of APIcalls resulting in extra charges. Use it as a last resort and only with caching.+## VFS Metadata++If you use the `--vfs-metadata-extension` flag you can get the VFS to+expose files which contain the [metadata](/docs/#metadata) as a JSON+blob. These files will not appear in the directory listing, but can be+`stat`-ed and opened and once they have been they **will** appear in+directory listings until the directory cache expires.++Note that some backends won't create metadata unless you pass in the+`--metadata` flag.++For example, using `rclone mount` with `--metadata --vfs-metadata-extension .metadata`+we get++```+$ ls -l /mnt/+total 1048577+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++$ cat /mnt/1G.metadata+{+ "atime": "2025-03-04T17:34:22.317069787Z",+ "btime": "2025-03-03T16:03:37.708253808Z",+ "gid": "1000",+ "mode": "100664",+ "mtime": "2025-03-03T16:03:39.640238323Z",+ "uid": "1000"+}++$ ls -l /mnt/+total 1048578+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+-rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata+```++If the file has no metadata it will be returned as `{}` and if there+is an error reading the metadata the error will be returned as+`{"error":"error string"}`.+## Auth ProxyIf you supply the parameter `--auth-proxy /path/to/program` then@@ -664,19 +707,19 @@ rclone serve http remote:path [flags]## Options```- --addr stringArray IPaddress:Port, :Port or [unix://]/path/to/socket to bind server to (default [127.0.0.1:8080])+ --addr stringArray IPaddress:Port or :Port to bind server to (default 127.0.0.1:8080)--allow-origin string Origin which cross-domain request (CORS) can be executed from--auth-proxy string A program to use to create the backend from the auth--baseurl string Prefix for URLs - leave blank for root- --cert string Path to TLS PEM public key certificate file (can also include intermediate/CA certificates)- --client-ca string Path to TLS PEM CA file with certificate authorities to verify clients with+ --cert string TLS PEM key (concatenation of certificate and CA certificate)+ --client-ca string Client certificate authority to verify clients with--dir-cache-time Duration Time to cache directory entries for (default 5m0s)--dir-perms FileMode Directory permissions (default 777)--file-perms FileMode File permissions (default 666)--gid uint32 Override the gid field set by the filesystem (not supported on Windows) (default 1000)-h, --help help for http--htpasswd string A htpasswd file - if not provided no authentication is done- --key string Path to TLS PEM private key file+ --key string TLS PEM Private key--link-perms FileMode Link permissions (default 666)--max-header-bytes int Maximum size of request header (default 4096)--min-tls-version string Minimum TLS version that is acceptable (default "tls1.0")@@ -694,6 +737,7 @@ rclone serve http remote:path [flags]--uid uint32 Override the uid field set by the filesystem (not supported on Windows) (default 1000)--umask FileMode Override the permission bits set by the filesystem (not supported on Windows) (default 002)--user string User name for authentication+ --user-from-header string User name from a defined HTTP header--vfs-block-norm-dupes If duplicate filenames exist in the same directory (after normalization), log an error and hide the duplicates (may have a performance cost)--vfs-cache-max-age Duration Max time since last access of objects in the cache (default 1h0m0s)--vfs-cache-max-size SizeSuffix Max total size of objects in the cache (default off)@@ -704,6 +748,7 @@ rclone serve http remote:path [flags]--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a '.rclonelink' extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached ('off' is unlimited) (default off)@@ -731,6 +776,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)diff --git a/docs/content/commands/rclone_serve_nfs.md b/docs/content/commands/rclone_serve_nfs.mdindex ed8358ec2..7f5b88b37 100644--- a/docs/content/commands/rclone_serve_nfs.md+++ b/docs/content/commands/rclone_serve_nfs.md@@ -7,8 +7,6 @@ versionIntroduced: v1.65---# rclone serve nfs-*Not available in Windows.*-Serve the remote as an NFS mount## Synopsis@@ -55,7 +53,7 @@ that it uses an on disk cache, but the cache entries are held assymlinks. Rclone will use the handle of the underlying file as the NFShandle which improves performance. This sort of cache can't be backedup and restored as the underlying handles will change. This is Linux-only. It requres running rclone as root or with `CAP_DAC_READ_SEARCH`.+only. It requires running rclone as root or with `CAP_DAC_READ_SEARCH`.You can run rclone with this extra permission by doing this to therclone binary `sudo setcap cap_dac_read_search+ep /path/to/rclone`.@@ -79,6 +77,12 @@ Where `$PORT` is the same port number used in the `serve nfs` commandand `$HOSTNAME` is the network address of the machine that `serve nfs`was run on.+If `--vfs-metadata-extension` is in use then for the `--nfs-cache-type disk`+and `--nfs-cache-type cache` the metadata files will have the file+handle of their parent file suffixed with `0x00, 0x00, 0x00, 0x01`.+This means they can be looked up directly from the parent file handle+is desired.+This command is only available on Unix platforms.## VFS - Virtual File System@@ -178,11 +182,11 @@ seconds. If rclone is quit or dies with files that haven't beenuploaded, these will be uploaded next time rclone is run with the sameflags.-If using `--vfs-cache-max-size` or `--vfs-cache-min-free-size` note+If using `--vfs-cache-max-size` or `--vfs-cache-min-free-space` notethat the cache may exceed these quotas for two reasons. Firstlybecause it is only checked every `--vfs-cache-poll-interval`. Secondlybecause open files cannot be evicted from the cache. When-`--vfs-cache-max-size` or `--vfs-cache-min-free-size` is exceeded,+`--vfs-cache-max-size` or `--vfs-cache-min-free-space` is exceeded,rclone will attempt to evict the least accessed files from the cachefirst. rclone will start with files that haven't been accessed for thelongest. This cache flushing strategy is efficient and more relevant@@ -507,6 +511,45 @@ _WARNING._ Contrary to `rclone size`, this flag ignores filters so that theresult is accurate. However, this is very inefficient and may cost lots of APIcalls resulting in extra charges. Use it as a last resort and only with caching.+## VFS Metadata++If you use the `--vfs-metadata-extension` flag you can get the VFS to+expose files which contain the [metadata](/docs/#metadata) as a JSON+blob. These files will not appear in the directory listing, but can be+`stat`-ed and opened and once they have been they **will** appear in+directory listings until the directory cache expires.++Note that some backends won't create metadata unless you pass in the+`--metadata` flag.++For example, using `rclone mount` with `--metadata --vfs-metadata-extension .metadata`+we get++```+$ ls -l /mnt/+total 1048577+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++$ cat /mnt/1G.metadata+{+ "atime": "2025-03-04T17:34:22.317069787Z",+ "btime": "2025-03-03T16:03:37.708253808Z",+ "gid": "1000",+ "mode": "100664",+ "mtime": "2025-03-03T16:03:39.640238323Z",+ "uid": "1000"+}++$ ls -l /mnt/+total 1048578+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+-rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata+```++If the file has no metadata it will be returned as `{}` and if there+is an error reading the metadata the error will be returned as+`{"error":"error string"}`.+```@@ -543,6 +586,7 @@ rclone serve nfs remote:path [flags]--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a '.rclonelink' extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached ('off' is unlimited) (default off)@@ -570,6 +614,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)diff --git a/docs/content/commands/rclone_serve_restic.md b/docs/content/commands/rclone_serve_restic.mdindex dca327576..6bc94f3d8 100644--- a/docs/content/commands/rclone_serve_restic.md+++ b/docs/content/commands/rclone_serve_restic.md@@ -162,7 +162,11 @@ By default this will serve files without needing a login.You can either use an htpasswd file which can take lots of users, orset a single username and password with the `--user` and `--pass` flags.-If no static users are configured by either of the above methods, and client+Alternatively, you can have the reverse proxy manage authentication and use the+username provided in the configured header with `--user-from-header` (e.g., `----user-from-header=x-remote-user`).+Ensure the proxy is trusted and headers cannot be spoofed, as misconfiguration may lead to unauthorized access.++If either of the above authentication methods is not configured and clientcertificates are required by the `--client-ca` flag passed to the server, theclient certificate common name will be considered as the username.@@ -191,16 +195,16 @@ rclone serve restic remote:path [flags]## Options```- --addr stringArray IPaddress:Port, :Port or [unix://]/path/to/socket to bind server to (default [127.0.0.1:8080])+ --addr stringArray IPaddress:Port or :Port to bind server to (default 127.0.0.1:8080)--allow-origin string Origin which cross-domain request (CORS) can be executed from--append-only Disallow deletion of repository data--baseurl string Prefix for URLs - leave blank for root--cache-objects Cache listed objects (default true)- --cert string Path to TLS PEM public key certificate file (can also include intermediate/CA certificates)- --client-ca string Path to TLS PEM CA file with certificate authorities to verify clients with+ --cert string TLS PEM key (concatenation of certificate and CA certificate)+ --client-ca string Client certificate authority to verify clients with-h, --help help for restic--htpasswd string A htpasswd file - if not provided no authentication is done- --key string Path to TLS PEM private key file+ --key string TLS PEM Private key--max-header-bytes int Maximum size of request header (default 4096)--min-tls-version string Minimum TLS version that is acceptable (default "tls1.0")--pass string Password for authentication@@ -211,6 +215,7 @@ rclone serve restic remote:path [flags]--server-write-timeout Duration Timeout for server writing data (default 1h0m0s)--stdio Run an HTTP2 server on stdin/stdout--user string User name for authentication+ --user-from-header string User name from a defined HTTP header```See the [global flags page](/flags/) for global options not listed here.diff --git a/docs/content/commands/rclone_serve_s3.md b/docs/content/commands/rclone_serve_s3.mdindex 40813321b..21d72f4e6 100644--- a/docs/content/commands/rclone_serve_s3.md+++ b/docs/content/commands/rclone_serve_s3.md@@ -27,7 +27,7 @@ docs](https://docs.aws.amazon.com/general/latest/gr/signature-version-4.html)).access.Please note that some clients may require HTTPS endpoints. See [the-SSL docs](#ssl-tls) for more information.+SSL docs](#tls-ssl) for more information.This command uses the [VFS directory cache](#vfs-virtual-file-system).All the functionality will work with `--vfs-cache-mode off`. Using@@ -82,7 +82,7 @@ secret_access_key = SECRET_ACCESS_KEYuse_multipart_uploads = false```-Note that setting `disable_multipart_uploads = true` is to work around+Note that setting `use_multipart_uploads = false` is to work around[a bug](#bugs) which will be fixed in due course.## Bugs@@ -154,7 +154,11 @@ By default this will serve files without needing a login.You can either use an htpasswd file which can take lots of users, orset a single username and password with the `--user` and `--pass` flags.-If no static users are configured by either of the above methods, and client+Alternatively, you can have the reverse proxy manage authentication and use the+username provided in the configured header with `--user-from-header` (e.g., `----user-from-header=x-remote-user`).+Ensure the proxy is trusted and headers cannot be spoofed, as misconfiguration may lead to unauthorized access.++If either of the above authentication methods is not configured and clientcertificates are required by the `--client-ca` flag passed to the server, theclient certificate common name will be considered as the username.@@ -334,11 +338,11 @@ seconds. If rclone is quit or dies with files that haven't beenuploaded, these will be uploaded next time rclone is run with the sameflags.-If using `--vfs-cache-max-size` or `--vfs-cache-min-free-size` note+If using `--vfs-cache-max-size` or `--vfs-cache-min-free-space` notethat the cache may exceed these quotas for two reasons. Firstlybecause it is only checked every `--vfs-cache-poll-interval`. Secondlybecause open files cannot be evicted from the cache. When-`--vfs-cache-max-size` or `--vfs-cache-min-free-size` is exceeded,+`--vfs-cache-max-size` or `--vfs-cache-min-free-space` is exceeded,rclone will attempt to evict the least accessed files from the cachefirst. rclone will start with files that haven't been accessed for thelongest. This cache flushing strategy is efficient and more relevant@@ -663,6 +667,45 @@ _WARNING._ Contrary to `rclone size`, this flag ignores filters so that theresult is accurate. However, this is very inefficient and may cost lots of APIcalls resulting in extra charges. Use it as a last resort and only with caching.+## VFS Metadata++If you use the `--vfs-metadata-extension` flag you can get the VFS to+expose files which contain the [metadata](/docs/#metadata) as a JSON+blob. These files will not appear in the directory listing, but can be+`stat`-ed and opened and once they have been they **will** appear in+directory listings until the directory cache expires.++Note that some backends won't create metadata unless you pass in the+`--metadata` flag.++For example, using `rclone mount` with `--metadata --vfs-metadata-extension .metadata`+we get++```+$ ls -l /mnt/+total 1048577+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++$ cat /mnt/1G.metadata+{+ "atime": "2025-03-04T17:34:22.317069787Z",+ "btime": "2025-03-03T16:03:37.708253808Z",+ "gid": "1000",+ "mode": "100664",+ "mtime": "2025-03-03T16:03:39.640238323Z",+ "uid": "1000"+}++$ ls -l /mnt/+total 1048578+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+-rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata+```++If the file has no metadata it will be returned as `{}` and if there+is an error reading the metadata the error will be returned as+`{"error":"error string"}`.+```@@ -672,22 +715,22 @@ rclone serve s3 remote:path [flags]## Options```- --addr stringArray IPaddress:Port, :Port or [unix://]/path/to/socket to bind server to (default [127.0.0.1:8080])+ --addr stringArray IPaddress:Port or :Port to bind server to (default 127.0.0.1:8080)--allow-origin string Origin which cross-domain request (CORS) can be executed from--auth-key stringArray Set key pair for v4 authorization: access_key_id,secret_access_key--auth-proxy string A program to use to create the backend from the auth--baseurl string Prefix for URLs - leave blank for root- --cert string Path to TLS PEM public key certificate file (can also include intermediate/CA certificates)- --client-ca string Path to TLS PEM CA file with certificate authorities to verify clients with+ --cert string TLS PEM key (concatenation of certificate and CA certificate)+ --client-ca string Client certificate authority to verify clients with--dir-cache-time Duration Time to cache directory entries for (default 5m0s)--dir-perms FileMode Directory permissions (default 777)--etag-hash string Which hash to use for the ETag, or auto or blank for off (default "MD5")--file-perms FileMode File permissions (default 666)- --force-path-style If true use path style access if false use virtual hosted style (default true) (default true)+ --force-path-style If true use path style access if false use virtual hosted style (default true)--gid uint32 Override the gid field set by the filesystem (not supported on Windows) (default 1000)-h, --help help for s3--htpasswd string A htpasswd file - if not provided no authentication is done- --key string Path to TLS PEM private key file+ --key string TLS PEM Private key--link-perms FileMode Link permissions (default 666)--max-header-bytes int Maximum size of request header (default 4096)--min-tls-version string Minimum TLS version that is acceptable (default "tls1.0")@@ -705,6 +748,7 @@ rclone serve s3 remote:path [flags]--uid uint32 Override the uid field set by the filesystem (not supported on Windows) (default 1000)--umask FileMode Override the permission bits set by the filesystem (not supported on Windows) (default 002)--user string User name for authentication+ --user-from-header string User name from a defined HTTP header--vfs-block-norm-dupes If duplicate filenames exist in the same directory (after normalization), log an error and hide the duplicates (may have a performance cost)--vfs-cache-max-age Duration Max time since last access of objects in the cache (default 1h0m0s)--vfs-cache-max-size SizeSuffix Max total size of objects in the cache (default off)@@ -715,6 +759,7 @@ rclone serve s3 remote:path [flags]--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a '.rclonelink' extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached ('off' is unlimited) (default off)@@ -742,6 +787,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)diff --git a/docs/content/commands/rclone_serve_sftp.md b/docs/content/commands/rclone_serve_sftp.mdindex 477e35dfe..2d2c6974d 100644--- a/docs/content/commands/rclone_serve_sftp.md+++ b/docs/content/commands/rclone_serve_sftp.md@@ -170,11 +170,11 @@ seconds. If rclone is quit or dies with files that haven't beenuploaded, these will be uploaded next time rclone is run with the sameflags.-If using `--vfs-cache-max-size` or `--vfs-cache-min-free-size` note+If using `--vfs-cache-max-size` or `--vfs-cache-min-free-space` notethat the cache may exceed these quotas for two reasons. Firstlybecause it is only checked every `--vfs-cache-poll-interval`. Secondlybecause open files cannot be evicted from the cache. When-`--vfs-cache-max-size` or `--vfs-cache-min-free-size` is exceeded,+`--vfs-cache-max-size` or `--vfs-cache-min-free-space` is exceeded,rclone will attempt to evict the least accessed files from the cachefirst. rclone will start with files that haven't been accessed for thelongest. This cache flushing strategy is efficient and more relevant@@ -499,6 +499,45 @@ _WARNING._ Contrary to `rclone size`, this flag ignores filters so that theresult is accurate. However, this is very inefficient and may cost lots of APIcalls resulting in extra charges. Use it as a last resort and only with caching.+## VFS Metadata++If you use the `--vfs-metadata-extension` flag you can get the VFS to+expose files which contain the [metadata](/docs/#metadata) as a JSON+blob. These files will not appear in the directory listing, but can be+`stat`-ed and opened and once they have been they **will** appear in+directory listings until the directory cache expires.++Note that some backends won't create metadata unless you pass in the+`--metadata` flag.++For example, using `rclone mount` with `--metadata --vfs-metadata-extension .metadata`+we get++```+$ ls -l /mnt/+total 1048577+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++$ cat /mnt/1G.metadata+{+ "atime": "2025-03-04T17:34:22.317069787Z",+ "btime": "2025-03-03T16:03:37.708253808Z",+ "gid": "1000",+ "mode": "100664",+ "mtime": "2025-03-03T16:03:39.640238323Z",+ "uid": "1000"+}++$ ls -l /mnt/+total 1048578+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+-rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata+```++If the file has no metadata it will be returned as `{}` and if there+is an error reading the metadata the error will be returned as+`{"error":"error string"}`.+## Auth ProxyIf you supply the parameter `--auth-proxy /path/to/program` then@@ -620,6 +659,7 @@ rclone serve sftp remote:path [flags]--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a '.rclonelink' extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached ('off' is unlimited) (default off)@@ -647,6 +687,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)diff --git a/docs/content/commands/rclone_serve_webdav.md b/docs/content/commands/rclone_serve_webdav.mdindex 397b9a5f3..5da838fa3 100644--- a/docs/content/commands/rclone_serve_webdav.md+++ b/docs/content/commands/rclone_serve_webdav.md@@ -171,7 +171,11 @@ By default this will serve files without needing a login.You can either use an htpasswd file which can take lots of users, orset a single username and password with the `--user` and `--pass` flags.-If no static users are configured by either of the above methods, and client+Alternatively, you can have the reverse proxy manage authentication and use the+username provided in the configured header with `--user-from-header` (e.g., `----user-from-header=x-remote-user`).+Ensure the proxy is trusted and headers cannot be spoofed, as misconfiguration may lead to unauthorized access.++If either of the above authentication methods is not configured and clientcertificates are required by the `--client-ca` flag passed to the server, theclient certificate common name will be considered as the username.@@ -288,11 +292,11 @@ seconds. If rclone is quit or dies with files that haven't beenuploaded, these will be uploaded next time rclone is run with the sameflags.-If using `--vfs-cache-max-size` or `--vfs-cache-min-free-size` note+If using `--vfs-cache-max-size` or `--vfs-cache-min-free-space` notethat the cache may exceed these quotas for two reasons. Firstlybecause it is only checked every `--vfs-cache-poll-interval`. Secondlybecause open files cannot be evicted from the cache. When-`--vfs-cache-max-size` or `--vfs-cache-min-free-size` is exceeded,+`--vfs-cache-max-size` or `--vfs-cache-min-free-space` is exceeded,rclone will attempt to evict the least accessed files from the cachefirst. rclone will start with files that haven't been accessed for thelongest. This cache flushing strategy is efficient and more relevant@@ -617,6 +621,45 @@ _WARNING._ Contrary to `rclone size`, this flag ignores filters so that theresult is accurate. However, this is very inefficient and may cost lots of APIcalls resulting in extra charges. Use it as a last resort and only with caching.+## VFS Metadata++If you use the `--vfs-metadata-extension` flag you can get the VFS to+expose files which contain the [metadata](/docs/#metadata) as a JSON+blob. These files will not appear in the directory listing, but can be+`stat`-ed and opened and once they have been they **will** appear in+directory listings until the directory cache expires.++Note that some backends won't create metadata unless you pass in the+`--metadata` flag.++For example, using `rclone mount` with `--metadata --vfs-metadata-extension .metadata`+we get++```+$ ls -l /mnt/+total 1048577+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++$ cat /mnt/1G.metadata+{+ "atime": "2025-03-04T17:34:22.317069787Z",+ "btime": "2025-03-03T16:03:37.708253808Z",+ "gid": "1000",+ "mode": "100664",+ "mtime": "2025-03-03T16:03:39.640238323Z",+ "uid": "1000"+}++$ ls -l /mnt/+total 1048578+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+-rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata+```++If the file has no metadata it will be returned as `{}` and if there+is an error reading the metadata the error will be returned as+`{"error":"error string"}`.+## Auth ProxyIf you supply the parameter `--auth-proxy /path/to/program` then@@ -707,12 +750,12 @@ rclone serve webdav remote:path [flags]## Options```- --addr stringArray IPaddress:Port, :Port or [unix://]/path/to/socket to bind server to (default [127.0.0.1:8080])+ --addr stringArray IPaddress:Port or :Port to bind server to (default 127.0.0.1:8080)--allow-origin string Origin which cross-domain request (CORS) can be executed from--auth-proxy string A program to use to create the backend from the auth--baseurl string Prefix for URLs - leave blank for root- --cert string Path to TLS PEM public key certificate file (can also include intermediate/CA certificates)- --client-ca string Path to TLS PEM CA file with certificate authorities to verify clients with+ --cert string TLS PEM key (concatenation of certificate and CA certificate)+ --client-ca string Client certificate authority to verify clients with--dir-cache-time Duration Time to cache directory entries for (default 5m0s)--dir-perms FileMode Directory permissions (default 777)--disable-dir-list Disable HTML directory list on GET request for a directory@@ -721,7 +764,7 @@ rclone serve webdav remote:path [flags]--gid uint32 Override the gid field set by the filesystem (not supported on Windows) (default 1000)-h, --help help for webdav--htpasswd string A htpasswd file - if not provided no authentication is done- --key string Path to TLS PEM private key file+ --key string TLS PEM Private key--link-perms FileMode Link permissions (default 666)--max-header-bytes int Maximum size of request header (default 4096)--min-tls-version string Minimum TLS version that is acceptable (default "tls1.0")@@ -739,6 +782,7 @@ rclone serve webdav remote:path [flags]--uid uint32 Override the uid field set by the filesystem (not supported on Windows) (default 1000)--umask FileMode Override the permission bits set by the filesystem (not supported on Windows) (default 002)--user string User name for authentication+ --user-from-header string User name from a defined HTTP header--vfs-block-norm-dupes If duplicate filenames exist in the same directory (after normalization), log an error and hide the duplicates (may have a performance cost)--vfs-cache-max-age Duration Max time since last access of objects in the cache (default 1h0m0s)--vfs-cache-max-size SizeSuffix Max total size of objects in the cache (default off)@@ -749,6 +793,7 @@ rclone serve webdav remote:path [flags]--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a '.rclonelink' extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached ('off' is unlimited) (default off)@@ -776,6 +821,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)diff --git a/docs/content/commands/rclone_sha1sum.md b/docs/content/commands/rclone_sha1sum.mdindex ad6450d9b..cae7f22b9 100644--- a/docs/content/commands/rclone_sha1sum.md+++ b/docs/content/commands/rclone_sha1sum.md@@ -61,6 +61,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)diff --git a/docs/content/commands/rclone_size.md b/docs/content/commands/rclone_size.mdindex 7e241f557..c4bcc0367 100644--- a/docs/content/commands/rclone_size.md+++ b/docs/content/commands/rclone_size.md@@ -56,6 +56,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)diff --git a/docs/content/commands/rclone_sync.md b/docs/content/commands/rclone_sync.mdindex e06b1ccd0..d4ce2f3cd 100644--- a/docs/content/commands/rclone_sync.md+++ b/docs/content/commands/rclone_sync.md@@ -147,6 +147,7 @@ Flags for anything which can copy a file--multi-thread-cutoff SizeSuffix Use multi-thread downloads for files above this size (default 256Mi)--multi-thread-streams int Number of streams to use for multi-thread downloads (default 4)--multi-thread-write-buffer-size SizeSuffix In memory buffer size for writing when in multi-thread mode (default 128Ki)+ --name-transform stringArray Transform paths during the copy process--no-check-dest Don't check the destination, copy regardless--no-traverse Don't traverse destination file system on copy--no-update-dir-modtime Don't update directory modification times@@ -171,6 +172,7 @@ Flags used for sync commands--delete-during When synchronizing, delete files during transfer--fix-case Force rename of case insensitive dest to match source--ignore-errors Delete even if there are I/O errors+ --list-cutoff int To save memory, sort directory listings on disk above this threshold (default 1000000)--max-delete int When synchronizing, limit the number of deletes (default -1)--max-delete-size SizeSuffix When synchronizing, limit the total size of deletes (default off)--suffix string Suffix to add to changed files@@ -202,6 +204,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)diff --git a/docs/content/commands/rclone_touch.md b/docs/content/commands/rclone_touch.mdindex f1725579f..82b5bf4df 100644--- a/docs/content/commands/rclone_touch.md+++ b/docs/content/commands/rclone_touch.md@@ -19,6 +19,7 @@ unless `--no-create` or `--recursive` is provided.If `--recursive` is used then recursively sets the modificationtime on all existing files that is found under the path. Filters are supported,and you can test with the `--dry-run` or the `--interactive`/`-i` flag.+This will touch `--transfers` files concurrently.If `--timestamp` is used then sets the modification time to thattime instead of the current time. Times may be specified as one of:@@ -71,6 +72,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)diff --git a/docs/content/commands/rclone_tree.md b/docs/content/commands/rclone_tree.mdindex 0460b61b3..74bfa15fe 100644--- a/docs/content/commands/rclone_tree.md+++ b/docs/content/commands/rclone_tree.md@@ -81,6 +81,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)diff --git a/docs/content/commands/rclone_version.md b/docs/content/commands/rclone_version.mdindex 127ded349..9aca17dd8 100644--- a/docs/content/commands/rclone_version.md+++ b/docs/content/commands/rclone_version.md@@ -46,6 +46,9 @@ Orbeta: 1.42.0.5 (released 2018-06-17)upgrade: https://beta.rclone.org/v1.42-005-g56e1e820+If you supply the --deps flag then rclone will print a list of all the+packages it depends on and their versions along with some other+information about the build.```@@ -56,6 +59,7 @@ rclone version [flags]```--check Check for new version+ --deps Show the Go dependencies-h, --help help for version```diff --git a/docs/content/drive.md b/docs/content/drive.mdindex 775163a8f..55607450a 100644--- a/docs/content/drive.md+++ b/docs/content/drive.md@@ -1641,6 +1641,32 @@ attempted if possible.Use the --interactive/-i or --dry-run flag to see what would be copied before copying.+### moveid++Move files by ID++ rclone backend moveid remote: [options] [<arguments>+]++This command moves files by ID++Usage:++ rclone backend moveid drive: ID path+ rclone backend moveid drive: ID1 path1 ID2 path2++It moves the drive file with ID given to the path (an rclone path which+will be passed internally to rclone moveto).++The path should end with a / to indicate move the file as named to+this directory. If it doesn't end with a / then the last path+component will be used as the file name.++If the destination is a drive backend then server-side moving will be+attempted if possible.++Use the --interactive/-i or --dry-run flag to see what would be moved beforehand.++### exportformatsDump the export formats for debug purposesdiff --git a/docs/content/dropbox.md b/docs/content/dropbox.mdindex 6a9211299..af461e859 100644--- a/docs/content/dropbox.md+++ b/docs/content/dropbox.md@@ -431,6 +431,56 @@ Properties:- Type: string- Required: false+#### --dropbox-export-formats++Comma separated list of preferred formats for exporting files++Certain Dropbox files can only be accessed by exporting them to another format.+These include Dropbox Paper documents.++For each such file, rclone will choose the first format on this list that Dropbox+considers valid. If none is valid, it will choose Dropbox's default format.++Known formats include: "html", "md" (markdown)++Properties:++- Config: export_formats+- Env Var: RCLONE_DROPBOX_EXPORT_FORMATS+- Type: CommaSepList+- Default: html,md++#### --dropbox-skip-exports++Skip exportable files in all listings.++If given, exportable files practically become invisible to rclone.++Properties:++- Config: skip_exports+- Env Var: RCLONE_DROPBOX_SKIP_EXPORTS+- Type: bool+- Default: false++#### --dropbox-show-all-exports++Show all exportable files in listings.++Adding this flag will allow all exportable files to be server side copied.+Note that rclone doesn't add extensions to the exportable file names in this mode.++Do **not** use this flag when trying to download exportable files - rclone+will fail to download them.+++Properties:++- Config: show_all_exports+- Env Var: RCLONE_DROPBOX_SHOW_ALL_EXPORTS+- Type: bool+- Default: false+#### --dropbox-batch-modeUpload file batching sync|async|off.@@ -508,7 +558,7 @@ Properties:#### --dropbox-batch-commit-timeout-Max time to wait for a batch to finish committing+Max time to wait for a batch to finish committing. (no longer used)Properties:diff --git a/docs/content/filelu.md b/docs/content/filelu.mdindex fb411c469..766330e8f 100644--- a/docs/content/filelu.md+++ b/docs/content/filelu.md@@ -188,6 +188,19 @@ Properties:Here are the Advanced options specific to filelu (FileLu Cloud Storage).+#### --filelu-encoding++The encoding for the backend.++See the [encoding section in the overview](/overview/#encoding) for more info.++Properties:++- Config: encoding+- Env Var: RCLONE_FILELU_ENCODING+- Type: Encoding+- Default: Slash,LtGt,DoubleQuote,SingleQuote,BackQuote,Dollar,Colon,Question,Asterisk,Pipe,Hash,Percent,BackSlash,CrLf,Del,Ctl,LeftSpace,LeftPeriod,LeftTilde,LeftCrLfHtVt,RightSpace,RightPeriod,RightCrLfHtVt,InvalidUtf8,Dot,SquareBracket,Semicolon,Exclamation+#### --filelu-descriptionDescription of the remote.@@ -199,70 +212,6 @@ Properties:- Type: string- Required: false-## Backend commands--Here are the commands specific to the filelu backend.--Run them with-- rclone backend COMMAND remote:--The help below will explain what arguments each command takes.--See the [backend](/commands/rclone_backend/) command for more-info on how to pass options and arguments.--These can be run on a running backend using the rc command-[backend/command](/rc/#backend-command).--### rename--Rename a file in a FileLu directory-- rclone backend rename remote: [options] [<arguments>+]---For example:-- rclone backend rename filelu:/file-path/hello.txt "hello_new_name.txt"---### movefile--Move file within the remote FileLu directory-- rclone backend movefile remote: [options] [<arguments>+]---For example:-- rclone backend movefile filelu:/source-path/hello.txt /destination-path/---### movefolder--Move a folder on remote FileLu-- rclone backend movefolder remote: [options] [<arguments>+]---For example:-- rclone backend movefolder filelu:/sorce-fld-path/hello-folder/ /destication-fld-path/hello-folder/---### renamefolder--Rename a folder on FileLu-- rclone backend renamefolder remote: [options] [<arguments>+]---For example:-- rclone backend renamefolder filelu:/folder-path/folder-name "new-folder-name"--{{< rem autogenerated options stop >}}## Limitationsdiff --git a/docs/content/flags.md b/docs/content/flags.mdindex f9d32c490..b830e66b4 100644--- a/docs/content/flags.md+++ b/docs/content/flags.md@@ -9,8 +9,6 @@ description: "Rclone Global Flags"This describes the global flags available to every rclone commandsplit into groups.-See the [Options section](/docs/#options) for syntax and usage advice.-## Copy@@ -39,6 +37,7 @@ Flags for anything which can copy a file.--multi-thread-cutoff SizeSuffix Use multi-thread downloads for files above this size (default 256Mi)--multi-thread-streams int Number of streams to use for multi-thread downloads (default 4)--multi-thread-write-buffer-size SizeSuffix In memory buffer size for writing when in multi-thread mode (default 128Ki)+ --name-transform stringArray Transform paths during the copy process--no-check-dest Don't check the destination, copy regardless--no-traverse Don't traverse destination file system on copy--no-update-dir-modtime Don't update directory modification times@@ -64,6 +63,7 @@ Flags used for sync commands.--delete-during When synchronizing, delete files during transfer--fix-case Force rename of case insensitive dest to match source--ignore-errors Delete even if there are I/O errors+ --list-cutoff int To save memory, sort directory listings on disk above this threshold (default 1000000)--max-delete int When synchronizing, limit the number of deletes (default -1)--max-delete-size SizeSuffix When synchronizing, limit the total size of deletes (default off)--suffix string Suffix to add to changed files@@ -112,13 +112,14 @@ Flags for general networking and HTTP stuff.--header stringArray Set HTTP header for all transactions--header-download stringArray Set HTTP header for download transactions--header-upload stringArray Set HTTP header for upload transactions+ --max-connections int Maximum number of simultaneous backend API connections, 0 for unlimited--no-check-certificate Do not verify the server SSL certificate (insecure)--no-gzip-encoding Don't set Accept-Encoding: gzip--timeout Duration IO idle timeout (default 5m0s)--tpslimit float Limit HTTP transactions per second to this--tpslimit-burst int Max burst of transactions for --tpslimit (default 1)--use-cookies Enable session cookiejar- --user-agent string Set the user-agent to a specified string (default "rclone/v1.69.0")+ --user-agent string Set the user-agent to a specified string (default "rclone/v1.70.0")```@@ -153,6 +154,7 @@ Flags for general configuration of rclone.-i, --interactive Enable interactive mode--kv-lock-time Duration Maximum time to keep key-value database locked by process (default 1s)--low-level-retries int Number of low level retries to do (default 10)+ --max-buffer-memory SizeSuffix If set, don't allocate more than this amount of memory as buffers (default off)--no-console Hide console window (supported on Windows only)--no-unicode-normalization Don't normalize unicode characters in filenames--password-command SpaceSepList Command for supplying password for encrypted configuration@@ -190,6 +192,7 @@ Flags for filtering directory listings.--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly @/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -223,7 +226,7 @@ Flags for logging and statistics.```--log-file string Log everything to this file- --log-format string Comma separated list of log format options (default "date,time")+ --log-format Bits Comma separated list of log format options (default date,time)--log-level LogLevel Log level DEBUG|INFO|NOTICE|ERROR (default NOTICE)--log-systemd Activate systemd integration for the logger--max-stats-groups int Maximum number of stats groups to keep in memory, on max oldest is discarded (default 1000)@@ -290,6 +293,7 @@ Flags to control the Remote Control API.--rc-server-write-timeout Duration Timeout for server writing data (default 1h0m0s)--rc-template string User-specified template--rc-user string User name for authentication+ --rc-user-from-header string User name from a defined HTTP header--rc-web-fetch-url string URL to fetch the releases for webgui (default "https://api.github.com/repos/rclone/rclone-webui-react/releases/latest")--rc-web-gui Launch WebGUI on localhost--rc-web-gui-force-update Force update to latest version of web gui@@ -319,6 +323,7 @@ Flags to control the Metrics HTTP endpoint..--metrics-server-write-timeout Duration Timeout for server writing data (default 1h0m0s)--metrics-template string User-specified template--metrics-user string User name for authentication+ --metrics-user-from-header string User name from a defined HTTP header--rc-enable-metrics Enable the Prometheus metrics path at the remote control server```@@ -339,6 +344,8 @@ Backend-only flags (these can be set in the config file also).--azureblob-client-id string The ID of the client in use--azureblob-client-secret string One of the service principal's client secrets--azureblob-client-send-certificate-chain Send the certificate chain when using certificate auth+ --azureblob-copy-concurrency int Concurrency for multipart copy (default 512)+ --azureblob-copy-cutoff SizeSuffix Cutoff for switching to multipart copy (default 8Mi)--azureblob-delete-snapshots string Set to specify how to deal with snapshots on blob deletion--azureblob-description string Description of the remote--azureblob-directory-markers Upload an empty object with a trailing slash when a new directory is created@@ -362,6 +369,7 @@ Backend-only flags (these can be set in the config file also).--azureblob-upload-concurrency int Concurrency for multipart uploads (default 16)--azureblob-upload-cutoff string Cutoff for switching to chunked upload (<= 256 MiB) (deprecated)--azureblob-use-az Use Azure CLI tool az for authentication+ --azureblob-use-copy-blob Whether to use the Copy Blob API when copying to the same storage account (default true)--azureblob-use-emulator Uses local storage emulator if provided as 'true'--azureblob-use-msi Use a managed service identity to authenticate (only works in Azure)--azureblob-username string User name (usually an email address)@@ -374,6 +382,7 @@ Backend-only flags (these can be set in the config file also).--azurefiles-client-send-certificate-chain Send the certificate chain when using certificate auth--azurefiles-connection-string string Azure Files Connection String--azurefiles-description string Description of the remote+ --azurefiles-disable-instance-discovery Skip requesting Microsoft Entra instance metadata--azurefiles-encoding Encoding The encoding for the backend (default Slash,LtGt,DoubleQuote,Colon,Question,Asterisk,Pipe,BackSlash,Del,Ctl,RightPeriod,InvalidUtf8,Dot)--azurefiles-endpoint string Endpoint for the service--azurefiles-env-auth Read credentials from runtime (environment variables, CLI or MSI)@@ -388,6 +397,7 @@ Backend-only flags (these can be set in the config file also).--azurefiles-share-name string Azure Files Share Name--azurefiles-tenant string ID of the service principal's tenant. Also called its directory ID--azurefiles-upload-concurrency int Concurrency for multipart uploads (default 16)+ --azurefiles-use-az Use Azure CLI tool az for authentication--azurefiles-use-msi Use a managed service identity to authenticate (only works in Azure)--azurefiles-username string User name (usually an email address)--b2-account string Account ID or Application Key ID@@ -450,12 +460,14 @@ Backend-only flags (these can be set in the config file also).--chunker-fail-hard Choose how chunker should handle files with missing or invalid chunks--chunker-hash-type string Choose how chunker handles hash sums (default "md5")--chunker-remote string Remote to chunk/unchunk+ --cloudinary-adjust-media-files-extensions Cloudinary handles media formats as a file attribute and strips it from the name, which is unlike most other file systems (default true)--cloudinary-api-key string Cloudinary API Key--cloudinary-api-secret string Cloudinary API Secret--cloudinary-cloud-name string Cloudinary Environment Name--cloudinary-description string Description of the remote--cloudinary-encoding Encoding The encoding for the backend (default Slash,LtGt,DoubleQuote,Question,Asterisk,Pipe,Hash,Percent,BackSlash,Del,Ctl,RightSpace,InvalidUtf8,Dot)--cloudinary-eventually-consistent-delay Duration Wait N seconds for eventual consistency of the databases that support the backend operation (default 0s)+ --cloudinary-media-extensions stringArray Cloudinary supported media extensions (default 3ds,3g2,3gp,ai,arw,avi,avif,bmp,bw,cr2,cr3,djvu,dng,eps3,fbx,flif,flv,gif,glb,gltf,hdp,heic,heif,ico,indd,jp2,jpe,jpeg,jpg,jxl,jxr,m2ts,mov,mp4,mpeg,mts,mxf,obj,ogv,pdf,ply,png,psd,svg,tga,tif,tiff,ts,u3ma,usdz,wdp,webm,webp,wmv)--cloudinary-upload-prefix string Specify the API endpoint for environments out of the US--cloudinary-upload-preset string Upload Preset to select asset manipulation on upload--combine-description string Description of the remote@@ -479,6 +491,10 @@ Backend-only flags (these can be set in the config file also).--crypt-show-mapping For all files listed show how the names encrypt--crypt-strict-names If set, this will raise an error when crypt comes across a filename that can't be decrypted--crypt-suffix string If this is set it will override the default suffix of ".bin" (default ".bin")+ --doi-description string Description of the remote+ --doi-doi string The DOI or the doi.org URL+ --doi-doi-resolver-api-url string The URL of the DOI resolver API to use+ --doi-provider string DOI provider--drive-acknowledge-abuse Set to allow files which return cannotDownloadAbusiveFile to be downloaded--drive-allow-import-name-change Allow the filetype to change when uploading Google docs--drive-auth-owner-only Only consider files owned by the authenticated user@@ -530,7 +546,6 @@ Backend-only flags (these can be set in the config file also).--drive-use-trash Send files to the trash instead of deleting permanently (default true)--drive-v2-download-min-size SizeSuffix If Object's are greater, use drive v2 API to download (default off)--dropbox-auth-url string Auth server URL- --dropbox-batch-commit-timeout Duration Max time to wait for a batch to finish committing (default 10m0s)--dropbox-batch-mode string Upload file batching sync|async|off (default "sync")--dropbox-batch-size int Max number of files in upload batch--dropbox-batch-timeout Duration Max time to allow an idle upload batch before uploading (default 0s)@@ -540,11 +555,14 @@ Backend-only flags (these can be set in the config file also).--dropbox-client-secret string OAuth Client Secret--dropbox-description string Description of the remote--dropbox-encoding Encoding The encoding for the backend (default Slash,BackSlash,Del,RightSpace,InvalidUtf8,Dot)+ --dropbox-export-formats CommaSepList Comma separated list of preferred formats for exporting files (default html,md)--dropbox-impersonate string Impersonate this user when using a business account--dropbox-pacer-min-sleep Duration Minimum time to sleep between API calls (default 10ms)--dropbox-root-namespace string Specify a different Dropbox namespace ID to use as the root for all paths--dropbox-shared-files Instructs rclone to work on individual shared files--dropbox-shared-folders Instructs rclone to work on shared folders+ --dropbox-show-all-exports Show all exportable files in listings+ --dropbox-skip-exports Skip exportable files in all listings--dropbox-token string OAuth Access Token as a JSON blob--dropbox-token-url string Token server url--fichier-api-key string Your API Key, get it from https://1fichier.com/console/params.pl@@ -562,6 +580,9 @@ Backend-only flags (these can be set in the config file also).--filefabric-token-expiry string Token expiry time--filefabric-url string URL of the Enterprise File Fabric to connect to--filefabric-version string Version read from the file fabric+ --filelu-description string Description of the remote+ --filelu-encoding Encoding The encoding for the backend (default Slash,LtGt,DoubleQuote,SingleQuote,BackQuote,Dollar,Colon,Question,Asterisk,Pipe,Hash,Percent,BackSlash,CrLf,Del,Ctl,LeftSpace,LeftPeriod,LeftTilde,LeftCrLfHtVt,RightSpace,RightPeriod,RightCrLfHtVt,InvalidUtf8,Dot,SquareBracket,Semicolon,Exclamation)+ --filelu-key string Your FileLu Rclone key from My Account--filescom-api-key string The API key used to authenticate with Files.com--filescom-description string Description of the remote--filescom-encoding Encoding The encoding for the backend (default Slash,BackSlash,Del,Ctl,RightSpace,RightCrLfHtVt,InvalidUtf8,Dot)@@ -621,7 +642,6 @@ Backend-only flags (these can be set in the config file also).--gofile-list-chunk int Number of items to list in each call (default 1000)--gofile-root-folder-id string ID of the root folder--gphotos-auth-url string Auth server URL- --gphotos-batch-commit-timeout Duration Max time to wait for a batch to finish committing (default 10m0s)--gphotos-batch-mode string Upload file batching sync|async|off (default "sync")--gphotos-batch-size int Max number of files in upload batch--gphotos-batch-timeout Duration Max time to allow an idle upload batch before uploading (default 0s)@@ -689,6 +709,8 @@ Backend-only flags (these can be set in the config file also).--internetarchive-encoding Encoding The encoding for the backend (default Slash,LtGt,CrLf,Del,Ctl,InvalidUtf8,Dot)--internetarchive-endpoint string IAS3 Endpoint (default "https://s3.us.archive.org")--internetarchive-front-endpoint string Host of InternetArchive Frontend (default "https://archive.org")+ --internetarchive-item-derive Whether to trigger derive on the IA item or not. If set to false, the item will not be derived by IA upon upload (default true)+ --internetarchive-item-metadata stringArray Metadata to be set on the IA item, this is different from file-level metadata that can be set using --metadata-set--internetarchive-secret-access-key string IAS3 Secret Key (password)--internetarchive-wait-archive Duration Timeout for waiting the server's processing tasks (specifically archive and book_op) to finish (default 0s)--jottacloud-auth-url string Auth server URL@@ -784,6 +806,7 @@ Backend-only flags (these can be set in the config file also).--onedrive-tenant string ID of the service principal's tenant. Also called its directory ID--onedrive-token string OAuth Access Token as a JSON blob--onedrive-token-url string Token server url+ --onedrive-upload-cutoff SizeSuffix Cutoff for switching to chunked upload (default off)--oos-attempt-resume-upload If true attempt to resume previously started multipart upload for the object--oos-chunk-size SizeSuffix Chunk size to use for uploading (default 5Mi)--oos-compartment string Specify compartment OCID, if you need to list buckets@@ -809,6 +832,7 @@ Backend-only flags (these can be set in the config file also).--oos-storage-tier string The storage class to use when storing new objects in storage. https://docs.oracle.com/en-us/iaas/Content/Object/Concepts/understandingstoragetiers.htm (default "Standard")--oos-upload-concurrency int Concurrency for multipart uploads (default 10)--oos-upload-cutoff SizeSuffix Cutoff for switching to chunked upload (default 200Mi)+ --opendrive-access string Files and folders will be uploaded with this access permission (default private) (default "private")--opendrive-chunk-size SizeSuffix Files will be uploaded in chunks this size (default 10Mi)--opendrive-description string Description of the remote--opendrive-encoding Encoding The encoding for the backend (default Slash,LtGt,DoubleQuote,Colon,Question,Asterisk,Pipe,BackSlash,LeftSpace,LeftCrLfHtVt,RightSpace,RightCrLfHtVt,InvalidUtf8,Dot)@@ -905,6 +929,8 @@ Backend-only flags (these can be set in the config file also).--s3-endpoint string Endpoint for S3 API--s3-env-auth Get AWS credentials from runtime (environment variables or EC2/ECS meta data if no env vars)--s3-force-path-style If true use path style access if false use virtual hosted style (default true)+ --s3-ibm-api-key string IBM API Key to be used to obtain IAM token+ --s3-ibm-resource-instance-id string IBM service instance id--s3-leave-parts-on-error If true avoid calling abort upload on a failure, leaving all successfully uploaded parts on S3 for manual recovery--s3-list-chunk int Size of listing chunk (response list for each ListObject S3 request) (default 1000)--s3-list-url-encode Tristate Whether to url encode listings: true/false/unset (default unset)@@ -925,6 +951,7 @@ Backend-only flags (these can be set in the config file also).--s3-server-side-encryption string The server-side encryption algorithm used when storing this object in S3--s3-session-token string An AWS session token--s3-shared-credentials-file string Path to the shared credentials file+ --s3-sign-accept-encoding Tristate Set if rclone should include Accept-Encoding as part of the signature (default unset)--s3-sse-customer-algorithm string If using SSE-C, the server-side encryption algorithm used when storing this object in S3--s3-sse-customer-key string To use SSE-C you may provide the secret encryption key used to encrypt/decrypt your data--s3-sse-customer-key-base64 string If using SSE-C you must provide the secret encryption key encoded in base64 format to encrypt/decrypt your data@@ -941,6 +968,7 @@ Backend-only flags (these can be set in the config file also).--s3-use-multipart-uploads Tristate Set if rclone should use multipart uploads (default unset)--s3-use-presigned-request Whether to use a presigned request or PutObject for single part uploads--s3-use-unsigned-payload Tristate Whether to use an unsigned payload in PutObject (default unset)+ --s3-use-x-id Tristate Set if rclone should add x-id URL parameters (default unset)--s3-v2-auth If true use v2 authentication--s3-version-at Time Show file versions as they were at the specified time (default off)--s3-version-deleted Show deleted file markers when using versions@@ -966,6 +994,7 @@ Backend-only flags (these can be set in the config file also).--sftp-disable-hashcheck Disable the execution of SSH commands to determine if remote file hashing is available--sftp-host string SSH host to connect to--sftp-host-key-algorithms SpaceSepList Space separated list of host key algorithms, ordered by preference+ --sftp-http-proxy string URL for HTTP CONNECT proxy--sftp-idle-timeout Duration Max time before closing idle connections (default 1m0s)--sftp-key-exchange SpaceSepList Space separated list of key exchange algorithms, ordered by preference--sftp-key-file string Path to PEM-encoded private key file@@ -1020,6 +1049,7 @@ Backend-only flags (these can be set in the config file also).--smb-pass string SMB password (obscured)--smb-port int SMB port number (default 445)--smb-spn string Service principal name+ --smb-use-kerberos Use Kerberos authentication--smb-user string SMB username (default "$USER")--storj-access-grant string Access grant--storj-api-key string API keydiff --git a/docs/content/googlephotos.md b/docs/content/googlephotos.mdindex 65db63340..8b38c5594 100644--- a/docs/content/googlephotos.md+++ b/docs/content/googlephotos.md@@ -504,7 +504,7 @@ Properties:#### --gphotos-batch-commit-timeout-Max time to wait for a batch to finish committing+Max time to wait for a batch to finish committing. (no longer used)Properties:diff --git a/docs/content/internetarchive.md b/docs/content/internetarchive.mdindex aacafb65b..a165c90a8 100644--- a/docs/content/internetarchive.md+++ b/docs/content/internetarchive.md@@ -192,6 +192,19 @@ Properties:- Type: string- Required: false+#### --internetarchive-item-derive++Whether to trigger derive on the IA item or not. If set to false, the item will not be derived by IA upon upload.+The derive process produces a number of secondary files from an upload to make an upload more usable on the web.+Setting this to false is useful for uploading files that are already in a format that IA can display or reduce burden on IA's infrastructure.++Properties:++- Config: item_derive+- Env Var: RCLONE_INTERNETARCHIVE_ITEM_DERIVE+- Type: bool+- Default: true+### Advanced optionsHere are the Advanced options specific to internetarchive (Internet Archive).@@ -222,6 +235,18 @@ Properties:- Type: string- Default: "https://archive.org"+#### --internetarchive-item-metadata++Metadata to be set on the IA item, this is different from file-level metadata that can be set using --metadata-set.+Format is key=value and the 'x-archive-meta-' prefix is automatically added.++Properties:++- Config: item_metadata+- Env Var: RCLONE_INTERNETARCHIVE_ITEM_METADATA+- Type: stringArray+- Default: []+#### --internetarchive-disable-checksumDon't ask the server to test against MD5 checksum calculated by rclone.diff --git a/docs/content/onedrive.md b/docs/content/onedrive.mdindex 91c852083..1206064be 100644--- a/docs/content/onedrive.md+++ b/docs/content/onedrive.md@@ -319,7 +319,7 @@ Properties:- "us"- Microsoft Cloud for US Government- "de"- - Microsoft Cloud Germany+ - Microsoft Cloud Germany (deprecated - try global region first).- "cn"- Azure and Office 365 operated by Vnet Group in China@@ -392,6 +392,27 @@ Properties:- Type: bool- Default: false+#### --onedrive-upload-cutoff++Cutoff for switching to chunked upload.++Any files larger than this will be uploaded in chunks of chunk_size.++This is disabled by default as uploading using single part uploads+causes rclone to use twice the storage on Onedrive business as when+rclone sets the modification time after the upload Onedrive creates a+new version.++See: https://github.com/rclone/rclone/issues/1716+++Properties:++- Config: upload_cutoff+- Env Var: RCLONE_ONEDRIVE_UPLOAD_CUTOFF+- Type: SizeSuffix+- Default: off+#### --onedrive-chunk-sizeChunk size to upload files with - must be multiple of 320k (327,680 bytes).diff --git a/docs/content/opendrive.md b/docs/content/opendrive.mdindex 6908cfdf1..b38b8d01a 100644--- a/docs/content/opendrive.md+++ b/docs/content/opendrive.md@@ -163,6 +163,24 @@ Properties:- Type: SizeSuffix- Default: 10Mi+#### --opendrive-access++Files and folders will be uploaded with this access permission (default private)++Properties:++- Config: access+- Env Var: RCLONE_OPENDRIVE_ACCESS+- Type: string+- Default: "private"+- Examples:+ - "private"+ - The file or folder access can be granted in a way that will allow select users to view, read or write what is absolutely essential for them.+ - "public"+ - The file or folder can be downloaded by anyone from a web browser. The link can be shared in any way,+ - "hidden"+ - The file or folder can be accessed has the same restrictions as Public if the user knows the URL of the file or folder link in order to access the contents+#### --opendrive-descriptionDescription of the remote.diff --git a/docs/content/rc.md b/docs/content/rc.mdindex 142e8ba59..03cdcf777 100644--- a/docs/content/rc.md+++ b/docs/content/rc.md@@ -652,6 +652,7 @@ This takes the following parameters:- opt - a dictionary of options to control the configuration- obscure - declare passwords are plain and need obscuring- noObscure - declare passwords are already obscured and don't need obscuring+ - noOutput - don't print anything to stdout- nonInteractive - don't interact with a user, return questions- continue - continue the config process with an answer- all - ask all the config questions not just the post config ones@@ -766,6 +767,7 @@ This takes the following parameters:- opt - a dictionary of options to control the configuration- obscure - declare passwords are plain and need obscuring- noObscure - declare passwords are already obscured and don't need obscuring+ - noOutput - don't print anything to stdout- nonInteractive - don't interact with a user, return questions- continue - continue the config process with an answer- all - ask all the config questions not just the post config ones@@ -950,7 +952,8 @@ returned.Parameters-- group - name of the stats group (string)+- group - name of the stats group (string, optional)+- short - if true will not return the transferring and checking arrays (boolean, optional)Returns the following values:@@ -965,6 +968,7 @@ Returns the following values:"fatalError": boolean whether there has been at least one fatal error,"lastError": last error string,"renames" : number of files renamed,+ "listed" : number of directory entries listed,"retryError": boolean showing whether there has been at least one non-NoRetryError,"serverSideCopies": number of server side copies done,"serverSideCopyBytes": number bytes server side copied,@@ -1931,6 +1935,141 @@ check that parameter passing is working properly.**Authentication is required for this call.**+### serve/list: Show running servers {#serve-list}++Show running servers with IDs.++This takes no parameters and returns++- list: list of running serve commands++Each list element will have++- id: ID of the server+- addr: address the server is running on+- params: parameters used to start the server++Eg++ rclone rc serve/list++Returns++```json+{+ "list": [+ {+ "addr": "[::]:4321",+ "id": "nfs-ffc2a4e5",+ "params": {+ "fs": "remote:",+ "opt": {+ "ListenAddr": ":4321"+ },+ "type": "nfs",+ "vfsOpt": {+ "CacheMode": "full"+ }+ }+ }+ ]+}+```++**Authentication is required for this call.**++### serve/start: Create a new server {#serve-start}++Create a new server with the specified parameters.++This takes the following parameters:++- `type` - type of server: `http`, `webdav`, `ftp`, `sftp`, `nfs`, etc.+- `fs` - remote storage path to serve+- `addr` - the ip:port to run the server on, eg ":1234" or "localhost:1234"++Other parameters are as described in the documentation for the+relevant [rclone serve](/commands/rclone_serve/) command line options.+To translate a command line option to an rc parameter, remove the+leading `--` and replace `-` with `_`, so `--vfs-cache-mode` becomes+`vfs_cache_mode`. Note that global parameters must be set with+`_config` and `_filter` as described above.++Examples:++ rclone rc serve/start type=nfs fs=remote: addr=:4321 vfs_cache_mode=full+ rclone rc serve/start --json '{"type":"nfs","fs":"remote:","addr":":1234","vfs_cache_mode":"full"}'++This will give the reply++```json+{+ "addr": "[::]:4321", // Address the server was started on+ "id": "nfs-ecfc6852" // Unique identifier for the server instance+}+```++Or an error if it failed to start.++Stop the server with `serve/stop` and list the running servers with `serve/list`.++**Authentication is required for this call.**++### serve/stop: Unserve selected active serve {#serve-stop}++Stops a running `serve` instance by ID.++This takes the following parameters:++- id: as returned by serve/start++This will give an empty response if successful or an error if not.++Example:++ rclone rc serve/stop id=12345++**Authentication is required for this call.**++### serve/stopall: Stop all active servers {#serve-stopall}++Stop all active servers.++This will stop all active servers.++ rclone rc serve/stopall++**Authentication is required for this call.**++### serve/types: Show all possible serve types {#serve-types}++This shows all possible serve types and returns them as a list.++This takes no parameters and returns++- types: list of serve types, eg "nfs", "sftp", etc++The serve types are strings like "serve", "serve2", "cserve" and can+be passed to serve/start as the serveType parameter.++Eg++ rclone rc serve/types++Returns++```json+{+ "types": [+ "http",+ "sftp",+ "nfs"+ ]+}+```++**Authentication is required for this call.**+### sync/bisync: Perform bidirectional synchronization between two paths. {#sync-bisync}This takes the following parametersdiff --git a/docs/content/s3.md b/docs/content/s3.mdindex 48bc4c4fb..0225e9da7 100644--- a/docs/content/s3.md+++ b/docs/content/s3.md@@ -792,7 +792,7 @@ A simple solution is to set the `--s3-upload-cutoff 0` and force all the files t{{< rem autogenerated options start" - DO NOT EDIT - instead edit fs.RegInfo in backend/s3/s3.go then run make backenddocs" >}}### Standard options-Here are the Standard options specific to s3 (Amazon S3 Compliant Storage Providers including AWS, Alibaba, ArvanCloud, Ceph, ChinaMobile, Cloudflare, DigitalOcean, Dreamhost, GCS, HuaweiOBS, IBMCOS, IDrive, IONOS, LyveCloud, Leviia, Liara, Linode, Magalu, Minio, Netease, Outscale, Petabox, RackCorp, Rclone, Scaleway, SeaweedFS, Selectel, StackPath, Storj, Synology, TencentCOS, Wasabi, Qiniu and others).+Here are the Standard options specific to s3 (Amazon S3 Compliant Storage Providers including AWS, Alibaba, ArvanCloud, Ceph, ChinaMobile, Cloudflare, DigitalOcean, Dreamhost, Exaba, FlashBlade, GCS, HuaweiOBS, IBMCOS, IDrive, IONOS, LyveCloud, Leviia, Liara, Linode, Magalu, Mega, Minio, Netease, Outscale, Petabox, RackCorp, Rclone, Scaleway, SeaweedFS, Selectel, StackPath, Storj, Synology, TencentCOS, Wasabi, Qiniu and others).#### --s3-provider@@ -821,6 +821,10 @@ Properties:- DigitalOcean Spaces- "Dreamhost"- Dreamhost DreamObjects+ - "Exaba"+ - Exaba Object Storage+ - "FlashBlade"+ - Pure Storage FlashBlade Object Storage- "GCS"- Google Cloud Storage- "HuaweiOBS"@@ -841,6 +845,8 @@ Properties:- Linode Object Storage- "Magalu"- Magalu Object Storage+ - "Mega"+ - MEGA S4 Object Storage- "Minio"- Minio Object Storage- "Netease"@@ -1110,7 +1116,7 @@ Properties:- Config: acl- Env Var: RCLONE_S3_ACL-- Provider: !Storj,Selectel,Synology,Cloudflare+- Provider: !Storj,Selectel,Synology,Cloudflare,FlashBlade,Mega- Type: string- Required: false- Examples:@@ -1222,9 +1228,33 @@ Properties:- "GLACIER_IR"- Glacier Instant Retrieval storage class+#### --s3-ibm-api-key++IBM API Key to be used to obtain IAM token++Properties:++- Config: ibm_api_key+- Env Var: RCLONE_S3_IBM_API_KEY+- Provider: IBMCOS+- Type: string+- Required: false++#### --s3-ibm-resource-instance-id++IBM service instance id++Properties:++- Config: ibm_resource_instance_id+- Env Var: RCLONE_S3_IBM_RESOURCE_INSTANCE_ID+- Provider: IBMCOS+- Type: string+- Required: false+### Advanced options-Here are the Advanced options specific to s3 (Amazon S3 Compliant Storage Providers including AWS, Alibaba, ArvanCloud, Ceph, ChinaMobile, Cloudflare, DigitalOcean, Dreamhost, GCS, HuaweiOBS, IBMCOS, IDrive, IONOS, LyveCloud, Leviia, Liara, Linode, Magalu, Minio, Netease, Outscale, Petabox, RackCorp, Rclone, Scaleway, SeaweedFS, Selectel, StackPath, Storj, Synology, TencentCOS, Wasabi, Qiniu and others).+Here are the Advanced options specific to s3 (Amazon S3 Compliant Storage Providers including AWS, Alibaba, ArvanCloud, Ceph, ChinaMobile, Cloudflare, DigitalOcean, Dreamhost, Exaba, FlashBlade, GCS, HuaweiOBS, IBMCOS, IDrive, IONOS, LyveCloud, Leviia, Liara, Linode, Magalu, Mega, Minio, Netease, Outscale, Petabox, RackCorp, Rclone, Scaleway, SeaweedFS, Selectel, StackPath, Storj, Synology, TencentCOS, Wasabi, Qiniu and others).#### --s3-bucket-acl@@ -1243,6 +1273,7 @@ Properties:- Config: bucket_acl- Env Var: RCLONE_S3_BUCKET_ACL+- Provider: !Storj,Selectel,Synology,Cloudflare,FlashBlade- Type: string- Required: false- Examples:@@ -2058,6 +2089,46 @@ Properties:- Type: Tristate- Default: unset+#### --s3-use-x-id++Set if rclone should add x-id URL parameters.++You can change this if you want to disable the AWS SDK from+adding x-id URL parameters.++This shouldn't be necessary in normal operation.++This should be automatically set correctly for all providers rclone+knows about - please make a bug report if not.+++Properties:++- Config: use_x_id+- Env Var: RCLONE_S3_USE_X_ID+- Type: Tristate+- Default: unset++#### --s3-sign-accept-encoding++Set if rclone should include Accept-Encoding as part of the signature.++You can change this if you want to stop rclone including+Accept-Encoding as part of the signature.++This shouldn't be necessary in normal operation.++This should be automatically set correctly for all providers rclone+knows about - please make a bug report if not.+++Properties:++- Config: sign_accept_encoding+- Env Var: RCLONE_S3_SIGN_ACCEPT_ENCODING+- Type: Tristate+- Default: unset+#### --s3-directory-bucketSet to use AWS Directory Buckets@@ -2177,7 +2248,7 @@ or from INTELLIGENT-TIERING Archive Access / Deep Archive Access tier to the FreUsage Examples:- rclone backend restore s3:bucket/path/to/object -o priority=PRIORITY -o lifetime=DAYS+ rclone backend restore s3:bucket/path/to/ --include /object -o priority=PRIORITY -o lifetime=DAYSrclone backend restore s3:bucket/path/to/directory -o priority=PRIORITY -o lifetime=DAYSrclone backend restore s3:bucket -o priority=PRIORITY -o lifetime=DAYSrclone backend restore s3:bucket/path/to/directory -o priority=PRIORITYdiff --git a/docs/content/sftp.md b/docs/content/sftp.mdindex 5da567247..e5389269f 100644--- a/docs/content/sftp.md+++ b/docs/content/sftp.md@@ -1065,6 +1065,20 @@ Properties:- Type: string- Required: false+#### --sftp-http-proxy++URL for HTTP CONNECT proxy++Set this to a URL for an HTTP proxy which supports the HTTP CONNECT verb.+++Properties:++- Config: http_proxy+- Env Var: RCLONE_SFTP_HTTP_PROXY+- Type: string+- Required: false+#### --sftp-copy-is-hardlinkSet to enable server side copies using hardlinks.diff --git a/docs/content/smb.md b/docs/content/smb.mdindex 0529f1dd6..a78e6da6d 100644--- a/docs/content/smb.md+++ b/docs/content/smb.md@@ -190,6 +190,23 @@ Properties:- Type: string- Required: false+#### --smb-use-kerberos++Use Kerberos authentication.++If set, rclone will use Kerberos authentication instead of NTLM. This+requires a valid Kerberos configuration and credentials cache to be+available, either in the default locations or as specified by the+KRB5_CONFIG and KRB5CCNAME environment variables.+++Properties:++- Config: use_kerberos+- Env Var: RCLONE_SMB_USE_KERBEROS+- Type: bool+- Default: false+### Advanced optionsHere are the Advanced options specific to smb (SMB / CIFS).diff --git a/docs/content/webdav.md b/docs/content/webdav.mdindex 7c9835365..72a9c71af 100644--- a/docs/content/webdav.md+++ b/docs/content/webdav.md@@ -146,7 +146,9 @@ Properties:- "nextcloud"- Nextcloud- "owncloud"- - Owncloud+ - Owncloud 10 PHP based WebDAV server+ - "infinitescale"+ - ownCloud Infinite Scale- "sharepoint"- Sharepoint Online, authenticated by Microsoft account- "sharepoint-ntlm"diff --git a/rclone.1 b/rclone.1index 28e0c3304..e2c6b3c5f 100644--- a/rclone.1+++ b/rclone.1@@ -1,8 +1,80 @@.\"t.\" Automatically generated by Pandoc 2.9.2.1.\"-.TH "rclone" "1" "Jan 12, 2025" "User Manual" ""+.TH "rclone" "1" "Jun 17, 2025" "User Manual" "".hy+.SH NAME+.PP+rclone - manage files on cloud storage+.SH SYNOPSIS+.IP+.nf+\f[C]+Usage:+ rclone [flags]+ rclone [command]++Available commands:+ about Get quota information from the remote.+ authorize Remote authorization.+ backend Run a backend-specific command.+ bisync Perform bidirectional synchronization between two paths.+ cat Concatenates any files and sends them to stdout.+ check Checks the files in the source and destination match.+ checksum Checks the files in the destination against a SUM file.+ cleanup Clean up the remote if possible.+ completion Output completion script for a given shell.+ config Enter an interactive configuration session.+ convmv Convert file and directory names in place.+ copy Copy files from source to dest, skipping identical files.+ copyto Copy files from source to dest, skipping identical files.+ copyurl Copy the contents of the URL supplied content to dest:path.+ cryptcheck Cryptcheck checks the integrity of an encrypted remote.+ cryptdecode Cryptdecode returns unencrypted file names.+ dedupe Interactively find duplicate filenames and delete/rename them.+ delete Remove the files in path.+ deletefile Remove a single file from remote.+ gendocs Output markdown docs for rclone to the directory supplied.+ gitannex Speaks with git-annex over stdin/stdout.+ hashsum Produces a hashsum file for all the objects in the path.+ help Show help for rclone commands, flags and backends.+ link Generate public link to file/folder.+ listremotes List all the remotes in the config file and defined in environment variables.+ ls List the objects in the path with size and path.+ lsd List all directories/containers/buckets in the path.+ lsf List directories and objects in remote:path formatted for parsing.+ lsjson List directories and objects in the path in JSON format.+ lsl List the objects in path with modification time, size and path.+ md5sum Produces an md5sum file for all the objects in the path.+ mkdir Make the path if it doesn\[aq]t already exist.+ mount Mount the remote as file system on a mountpoint.+ move Move files from source to dest.+ moveto Move file or directory from source to dest.+ ncdu Explore a remote with a text based user interface.+ nfsmount Mount the remote as file system on a mountpoint.+ obscure Obscure password for use in the rclone config file.+ purge Remove the path and all of its contents.+ rc Run a command against a running rclone.+ rcat Copies standard input to file on remote.+ rcd Run rclone listening to remote control commands only.+ rmdir Remove the empty directory at path.+ rmdirs Remove empty directories under the path.+ selfupdate Update the rclone binary.+ serve Serve a remote over a protocol.+ settier Changes storage class/tier of objects in remote.+ sha1sum Produces an sha1sum file for all the objects in the path.+ size Prints the total size and number of objects in remote:path.+ sync Make source and dest identical, modifying destination only.+ test Run a test command+ touch Create new file or change file modification time.+ tree List the contents of the remote in a tree like fashion.+ version Show the version number.++Use \[dq]rclone [command] --help\[dq] for more information about a command.+Use \[dq]rclone help flags\[dq] for to see the global flags.+Use \[dq]rclone help backends\[dq] for a list of supported services.+\f[R]+.fi.SH Rclone syncs your files to cloud storage.PP.IP \[bu] 2@@ -182,6 +254,10 @@ Fastmail Files.IP \[bu] 2Files.com.IP \[bu] 2+FileLu Cloud Storage+.IP \[bu] 2+FlashBlade+.IP \[bu] 2FTP.IP \[bu] 2Gofile@@ -230,7 +306,9 @@ Mail.ru Cloud.IP \[bu] 2Memset Memstore.IP \[bu] 2-Mega+MEGA+.IP \[bu] 2+MEGA S4.IP \[bu] 2Memory.IP \[bu] 2@@ -808,7 +886,7 @@ Its current version is as below..SS Source installation.PPMake sure you have git and Go (https://golang.org/) installed.-Go version 1.18 or newer is required, the latest release is recommended.+Go version 1.22 or newer is required, the latest release is recommended.You can get it from your package manager, or download it fromgolang.org/dl (https://golang.org/dl/).Then you can run the following:@@ -1240,6 +1318,8 @@ Dropbox (https://rclone.org/dropbox/).IP \[bu] 2Enterprise File Fabric (https://rclone.org/filefabric/).IP \[bu] 2+FileLu Cloud Storage (https://rclone.org/filelu/)+.IP \[bu] 2Files.com (https://rclone.org/filescom/).IP \[bu] 2FTP (https://rclone.org/ftp/)@@ -1616,6 +1696,7 @@ Flags for anything which can copy a file--multi-thread-cutoff SizeSuffix Use multi-thread downloads for files above this size (default 256Mi)--multi-thread-streams int Number of streams to use for multi-thread downloads (default 4)--multi-thread-write-buffer-size SizeSuffix In memory buffer size for writing when in multi-thread mode (default 128Ki)+ --name-transform stringArray Transform paths during the copy process--no-check-dest Don\[aq]t check the destination, copy regardless--no-traverse Don\[aq]t traverse destination file system on copy--no-update-dir-modtime Don\[aq]t update directory modification times@@ -1654,6 +1735,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly \[at]/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -1861,6 +1943,7 @@ Flags for anything which can copy a file--multi-thread-cutoff SizeSuffix Use multi-thread downloads for files above this size (default 256Mi)--multi-thread-streams int Number of streams to use for multi-thread downloads (default 4)--multi-thread-write-buffer-size SizeSuffix In memory buffer size for writing when in multi-thread mode (default 128Ki)+ --name-transform stringArray Transform paths during the copy process--no-check-dest Don\[aq]t check the destination, copy regardless--no-traverse Don\[aq]t traverse destination file system on copy--no-update-dir-modtime Don\[aq]t update directory modification times@@ -1886,6 +1969,7 @@ Flags used for sync commands--delete-during When synchronizing, delete files during transfer--fix-case Force rename of case insensitive dest to match source--ignore-errors Delete even if there are I/O errors+ --list-cutoff int To save memory, sort directory listings on disk above this threshold (default 1000000)--max-delete int When synchronizing, limit the number of deletes (default -1)--max-delete-size SizeSuffix When synchronizing, limit the total size of deletes (default off)--suffix string Suffix to add to changed files@@ -1919,6 +2003,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly \[at]/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -2039,6 +2124,7 @@ Flags for anything which can copy a file--multi-thread-cutoff SizeSuffix Use multi-thread downloads for files above this size (default 256Mi)--multi-thread-streams int Number of streams to use for multi-thread downloads (default 4)--multi-thread-write-buffer-size SizeSuffix In memory buffer size for writing when in multi-thread mode (default 128Ki)+ --name-transform stringArray Transform paths during the copy process--no-check-dest Don\[aq]t check the destination, copy regardless--no-traverse Don\[aq]t traverse destination file system on copy--no-update-dir-modtime Don\[aq]t update directory modification times@@ -2077,6 +2163,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly \[at]/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -2194,6 +2281,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly \[at]/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -2238,6 +2326,11 @@ To delete empty directories only, use commandrmdir (https://rclone.org/commands/rclone_rmdir/) orrmdirs (https://rclone.org/commands/rclone_rmdirs/)..PP+The concurrency of this operation is controlled by the+\f[C]--checkers\f[R] global flag.+However, some backends will implement this command directly, in which+case \f[C]--checkers\f[R] will be ignored.+.PP\f[B]Important\f[R]: Since this can cause data loss, test first with the\f[C]--dry-run\f[R] or the \f[C]--interactive\f[R]/\f[C]-i\f[R] flag..IP@@ -2466,6 +2559,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly \[at]/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -2576,6 +2670,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly \[at]/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -2702,6 +2797,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly \[at]/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -2812,6 +2908,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly \[at]/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -2899,6 +2996,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly \[at]/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -2989,6 +3087,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly \[at]/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -3072,6 +3171,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly \[at]/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -3155,6 +3255,10 @@ beta: 1.42.0.5 (released 2018-06-17)upgrade: https://beta.rclone.org/v1.42-005-g56e1e820\f[R].fi+.PP+If you supply the --deps flag then rclone will print a list of all the+packages it depends on and their versions along with some other+information about the build..IP.nf\f[C]@@ -3166,6 +3270,7 @@ rclone version [flags].nf\f[C]--check Check for new version+ --deps Show the Go dependencies-h, --help help for version\f[R].fi@@ -3507,6 +3612,11 @@ Remote authorization.Used to authorize a remote or headless rclone from a machine with abrowser - use as instructed by rclone config..PP+The command requires 1-3 arguments: - fs name (e.g., \[dq]drive\[dq],+\[dq]s3\[dq], etc.) - Either a base64 encoded JSON blob obtained from a+previous rclone config session - Or a client_id and client_secret pair+obtained from the remote service+.PPUse --auth-no-open-browser to prevent rclone to open auth link indefault browser automatically..PP@@ -3516,7 +3626,7 @@ template is used..IP.nf\f[C]-rclone authorize [flags]+rclone authorize <fs name> [base64_json_blob | client_id client_secret] [flags]\f[R].fi.SS Options@@ -3711,6 +3821,7 @@ Flags for anything which can copy a file--multi-thread-cutoff SizeSuffix Use multi-thread downloads for files above this size (default 256Mi)--multi-thread-streams int Number of streams to use for multi-thread downloads (default 4)--multi-thread-write-buffer-size SizeSuffix In memory buffer size for writing when in multi-thread mode (default 128Ki)+ --name-transform stringArray Transform paths during the copy process--no-check-dest Don\[aq]t check the destination, copy regardless--no-traverse Don\[aq]t traverse destination file system on copy--no-update-dir-modtime Don\[aq]t update directory modification times@@ -3749,6 +3860,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly \[at]/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -3867,6 +3979,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly \[at]/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -3993,6 +4106,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly \[at]/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -4415,6 +4529,7 @@ rclone config create name type [key value]* [flags]--continue Continue the configuration process with an answer-h, --help help for create--no-obscure Force any passwords not to be obscured+ --no-output Don\[aq]t provide any output--non-interactive Don\[aq]t interact with user and return questions--obscure Force any passwords to be obscured--result string Result - use with --continue@@ -4652,12 +4767,12 @@ password to re-encrypt the config..PPWhen \f[C]--password-command\f[R] is called to change the password thenthe environment variable \f[C]RCLONE_PASSWORD_CHANGE=1\f[R] will be set.-So if changing passwords programatically you can use the environment+So if changing passwords programmatically you can use the environmentvariable to distinguish which password you must supply..PPAlternatively you can remove the password first (with\f[C]rclone config encryption remove\f[R]), then set it again with this-command which may be easier if you don\[aq]t mind the unecrypted config+command which may be easier if you don\[aq]t mind the unencrypted configfile being on the disk briefly..IP.nf@@ -5054,6 +5169,7 @@ rclone config update name [key value]+ [flags]--continue Continue the configuration process with an answer-h, --help help for update--no-obscure Force any passwords not to be obscured+ --no-output Don\[aq]t provide any output--non-interactive Don\[aq]t interact with user and return questions--obscure Force any passwords to be obscured--result string Result - use with --continue@@ -5095,6 +5211,620 @@ not listed here..IP \[bu] 2rclone config (https://rclone.org/commands/rclone_config/) - Enter aninteractive configuration session.+.SH rclone convmv+.PP+Convert file and directory names in place.+.SS Synopsis+.PP+convmv supports advanced path name transformations for converting and+renaming files and directories by applying prefixes, suffixes, and other+alterations.+.PP+.TS+tab(@);+lw(35.0n) lw(35.0n).+T{+Command+T}@T{+Description+T}+_+T{+\f[C]--name-transform prefix=XXXX\f[R]+T}@T{+Prepends XXXX to the file name.+T}+T{+\f[C]--name-transform suffix=XXXX\f[R]+T}@T{+Appends XXXX to the file name after the extension.+T}+T{+\f[C]--name-transform suffix_keep_extension=XXXX\f[R]+T}@T{+Appends XXXX to the file name while preserving the original file+extension.+T}+T{+\f[C]--name-transform trimprefix=XXXX\f[R]+T}@T{+Removes XXXX if it appears at the start of the file name.+T}+T{+\f[C]--name-transform trimsuffix=XXXX\f[R]+T}@T{+Removes XXXX if it appears at the end of the file name.+T}+T{+\f[C]--name-transform regex=/pattern/replacement/\f[R]+T}@T{+Applies a regex-based transformation.+T}+T{+\f[C]--name-transform replace=old:new\f[R]+T}@T{+Replaces occurrences of old with new in the file name.+T}+T{+\f[C]--name-transform date={YYYYMMDD}\f[R]+T}@T{+Appends or prefixes the specified date format.+T}+T{+\f[C]--name-transform truncate=N\f[R]+T}@T{+Truncates the file name to a maximum of N characters.+T}+T{+\f[C]--name-transform base64encode\f[R]+T}@T{+Encodes the file name in Base64.+T}+T{+\f[C]--name-transform base64decode\f[R]+T}@T{+Decodes a Base64-encoded file name.+T}+T{+\f[C]--name-transform encoder=ENCODING\f[R]+T}@T{+Converts the file name to the specified encoding (e.g., ISO-8859-1,+Windows-1252, Macintosh).+T}+T{+\f[C]--name-transform decoder=ENCODING\f[R]+T}@T{+Decodes the file name from the specified encoding.+T}+T{+\f[C]--name-transform charmap=MAP\f[R]+T}@T{+Applies a character mapping transformation.+T}+T{+\f[C]--name-transform lowercase\f[R]+T}@T{+Converts the file name to lowercase.+T}+T{+\f[C]--name-transform uppercase\f[R]+T}@T{+Converts the file name to UPPERCASE.+T}+T{+\f[C]--name-transform titlecase\f[R]+T}@T{+Converts the file name to Title Case.+T}+T{+\f[C]--name-transform ascii\f[R]+T}@T{+Strips non-ASCII characters.+T}+T{+\f[C]--name-transform url\f[R]+T}@T{+URL-encodes the file name.+T}+T{+\f[C]--name-transform nfc\f[R]+T}@T{+Converts the file name to NFC Unicode normalization form.+T}+T{+\f[C]--name-transform nfd\f[R]+T}@T{+Converts the file name to NFD Unicode normalization form.+T}+T{+\f[C]--name-transform nfkc\f[R]+T}@T{+Converts the file name to NFKC Unicode normalization form.+T}+T{+\f[C]--name-transform nfkd\f[R]+T}@T{+Converts the file name to NFKD Unicode normalization form.+T}+T{+\f[C]--name-transform command=/path/to/my/programfile names.\f[R]+T}@T{+Executes an external program to transform+T}+.TE+.PP+Conversion modes:+.IP+.nf+\f[C]+none+nfc+nfd+nfkc+nfkd+replace+prefix+suffix+suffix_keep_extension+trimprefix+trimsuffix+index+date+truncate+base64encode+base64decode+encoder+decoder+ISO-8859-1+Windows-1252+Macintosh+charmap+lowercase+uppercase+titlecase+ascii+url+regex+command+\f[R]+.fi+.PP+Char maps:+.IP+.nf+\f[C]++IBM-Code-Page-037+IBM-Code-Page-437+IBM-Code-Page-850+IBM-Code-Page-852+IBM-Code-Page-855+Windows-Code-Page-858+IBM-Code-Page-860+IBM-Code-Page-862+IBM-Code-Page-863+IBM-Code-Page-865+IBM-Code-Page-866+IBM-Code-Page-1047+IBM-Code-Page-1140+ISO-8859-1+ISO-8859-2+ISO-8859-3+ISO-8859-4+ISO-8859-5+ISO-8859-6+ISO-8859-7+ISO-8859-8+ISO-8859-9+ISO-8859-10+ISO-8859-13+ISO-8859-14+ISO-8859-15+ISO-8859-16+KOI8-R+KOI8-U+Macintosh+Macintosh-Cyrillic+Windows-874+Windows-1250+Windows-1251+Windows-1252+Windows-1253+Windows-1254+Windows-1255+Windows-1256+Windows-1257+Windows-1258+X-User-Defined+\f[R]+.fi+.PP+Encoding masks:+.IP+.nf+\f[C]+Asterisk+ BackQuote+ BackSlash+ Colon+ CrLf+ Ctl+ Del+ Dollar+ Dot+ DoubleQuote+ Exclamation+ Hash+ InvalidUtf8+ LeftCrLfHtVt+ LeftPeriod+ LeftSpace+ LeftTilde+ LtGt+ None+ Percent+ Pipe+ Question+ Raw+ RightCrLfHtVt+ RightPeriod+ RightSpace+ Semicolon+ SingleQuote+ Slash+ SquareBracket+\f[R]+.fi+.PP+Examples:+.IP+.nf+\f[C]+rclone convmv \[dq]stories/The Quick Brown Fox!.txt\[dq] --name-transform \[dq]all,uppercase\[dq]+// Output: STORIES/THE QUICK BROWN FOX!.TXT+\f[R]+.fi+.IP+.nf+\f[C]+rclone convmv \[dq]stories/The Quick Brown Fox!.txt\[dq] --name-transform \[dq]all,replace=Fox:Turtle\[dq] --name-transform \[dq]all,replace=Quick:Slow\[dq]+// Output: stories/The Slow Brown Turtle!.txt+\f[R]+.fi+.IP+.nf+\f[C]+rclone convmv \[dq]stories/The Quick Brown Fox!.txt\[dq] --name-transform \[dq]all,base64encode\[dq]+// Output: c3Rvcmllcw==/VGhlIFF1aWNrIEJyb3duIEZveCEudHh0+\f[R]+.fi+.IP+.nf+\f[C]+rclone convmv \[dq]c3Rvcmllcw==/VGhlIFF1aWNrIEJyb3duIEZveCEudHh0\[dq] --name-transform \[dq]all,base64decode\[dq]+// Output: stories/The Quick Brown Fox!.txt+\f[R]+.fi+.IP+.nf+\f[C]+rclone convmv \[dq]stories/The Quick Brown \[u1F98A] Fox Went to the Caf\['e]!.txt\[dq] --name-transform \[dq]all,nfc\[dq]+// Output: stories/The Quick Brown \[u1F98A] Fox Went to the Caf\['e]!.txt+\f[R]+.fi+.IP+.nf+\f[C]+rclone convmv \[dq]stories/The Quick Brown \[u1F98A] Fox Went to the Caf\['e]!.txt\[dq] --name-transform \[dq]all,nfd\[dq]+// Output: stories/The Quick Brown \[u1F98A] Fox Went to the Cafe\[u0301]!.txt+\f[R]+.fi+.IP+.nf+\f[C]+rclone convmv \[dq]stories/The Quick Brown \[u1F98A] Fox!.txt\[dq] --name-transform \[dq]all,ascii\[dq]+// Output: stories/The Quick Brown Fox!.txt+\f[R]+.fi+.IP+.nf+\f[C]+rclone convmv \[dq]stories/The Quick Brown Fox!.txt\[dq] --name-transform \[dq]all,trimsuffix=.txt\[dq]+// Output: stories/The Quick Brown Fox!+\f[R]+.fi+.IP+.nf+\f[C]+rclone convmv \[dq]stories/The Quick Brown Fox!.txt\[dq] --name-transform \[dq]all,prefix=OLD_\[dq]+// Output: OLD_stories/OLD_The Quick Brown Fox!.txt+\f[R]+.fi+.IP+.nf+\f[C]+rclone convmv \[dq]stories/The Quick Brown \[u1F98A] Fox Went to the Caf\['e]!.txt\[dq] --name-transform \[dq]all,charmap=ISO-8859-7\[dq]+// Output: stories/The Quick Brown _ Fox Went to the Caf_!.txt+\f[R]+.fi+.IP+.nf+\f[C]+rclone convmv \[dq]stories/The Quick Brown Fox: A Memoir [draft].txt\[dq] --name-transform \[dq]all,encoder=Colon,SquareBracket\[dq]+// Output: stories/The Quick Brown Fox\[uFF1A] A Memoir \[uFF3B]draft\[uFF3D].txt+\f[R]+.fi+.IP+.nf+\f[C]+rclone convmv \[dq]stories/The Quick Brown \[u1F98A] Fox Went to the Caf\['e]!.txt\[dq] --name-transform \[dq]all,truncate=21\[dq]+// Output: stories/The Quick Brown \[u1F98A] Fox+\f[R]+.fi+.IP+.nf+\f[C]+rclone convmv \[dq]stories/The Quick Brown Fox!.txt\[dq] --name-transform \[dq]all,command=echo\[dq]+// Output: stories/The Quick Brown Fox!.txt+\f[R]+.fi+.IP+.nf+\f[C]+rclone convmv \[dq]stories/The Quick Brown Fox!\[dq] --name-transform \[dq]date=-{YYYYMMDD}\[dq]+// Output: stories/The Quick Brown Fox!-20250617+\f[R]+.fi+.IP+.nf+\f[C]+rclone convmv \[dq]stories/The Quick Brown Fox!\[dq] --name-transform \[dq]date=-{macfriendlytime}\[dq]+// Output: stories/The Quick Brown Fox!-2025-06-17 0551PM+\f[R]+.fi+.IP+.nf+\f[C]+rclone convmv \[dq]stories/The Quick Brown Fox!.txt\[dq] --name-transform \[dq]all,regex=[\[rs]\[rs].\[rs]\[rs]w]/ab\[dq]+// Output: ababababababab/ababab ababababab ababababab ababab!abababab+\f[R]+.fi+.PP+Multiple transformations can be used in sequence, applied in the order+they are specified on the command line.+.PP+The \f[C]--name-transform\f[R] flag is also available in \f[C]sync\f[R],+\f[C]copy\f[R], and \f[C]move\f[R].+.SH Files vs Directories+.PP+By default \f[C]--name-transform\f[R] will only apply to file names.+The means only the leaf file name will be transformed.+However some of the transforms would be better applied to the whole path+or just directories.+To choose which which part of the file path is affected some tags can be+added to the \f[C]--name-transform\f[R]+.PP+.TS+tab(@);+lw(35.0n) lw(35.0n).+T{+Tag+T}@T{+Effect+T}+_+T{+\f[C]file\f[R]+T}@T{+Only transform the leaf name of files (DEFAULT)+T}+T{+\f[C]dir\f[R]+T}@T{+Only transform name of directories - these may appear anywhere in the+path+T}+T{+\f[C]all\f[R]+T}@T{+Transform the entire path for files and directories+T}+.TE+.PP+This is used by adding the tag into the transform name like this:+\f[C]--name-transform file,prefix=ABC\f[R] or+\f[C]--name-transform dir,prefix=DEF\f[R].+.PP+For some conversions using all is more likely to be useful, for example+\f[C]--name-transform all,nfc\f[R]+.PP+Note that \f[C]--name-transform\f[R] may not add path separators+\f[C]/\f[R] to the name.+This will cause an error.+.SH Ordering and Conflicts+.IP \[bu] 2+Transformations will be applied in the order specified by the user.+.RS 2+.IP \[bu] 2+If the \f[C]file\f[R] tag is in use (the default) then only the leaf+name of files will be transformed.+.IP \[bu] 2+If the \f[C]dir\f[R] tag is in use then directories anywhere in the path+will be transformed+.IP \[bu] 2+If the \f[C]all\f[R] tag is in use then directories and files anywhere+in the path will be transformed+.IP \[bu] 2+Each transformation will be run one path segment at a time.+.IP \[bu] 2+If a transformation adds a \f[C]/\f[R] or ends up with an empty path+segment then that will be an error.+.RE+.IP \[bu] 2+It is up to the user to put the transformations in a sensible order.+.RS 2+.IP \[bu] 2+Conflicting transformations, such as \f[C]prefix\f[R] followed by+\f[C]trimprefix\f[R] or \f[C]nfc\f[R] followed by \f[C]nfd\f[R], are+possible.+.IP \[bu] 2+Instead of enforcing mutual exclusivity, transformations are applied in+sequence as specified by the user, allowing for intentional use cases+(e.g., trimming one prefix before adding another).+.IP \[bu] 2+Users should be aware that certain combinations may lead to unexpected+results and should verify transformations using \f[C]--dry-run\f[R]+before execution.+.RE+.SH Race Conditions and Non-Deterministic Behavior+.PP+Some transformations, such as \f[C]replace=old:new\f[R], may introduce+conflicts where multiple source files map to the same destination name.+This can lead to race conditions when performing concurrent transfers.+It is up to the user to anticipate these.+* If two files from the source are transformed into the same name at the+destination, the final state may be non-deterministic.+* Running rclone check after a sync using such transformations may+erroneously report missing or differing files due to overwritten+results.+.IP \[bu] 2+To minimize risks, users should:+.RS 2+.IP \[bu] 2+Carefully review transformations that may introduce conflicts.+.IP \[bu] 2+Use \f[C]--dry-run\f[R] to inspect changes before executing a sync (but+keep in mind that it won\[aq]t show the effect of non-deterministic+transformations).+.IP \[bu] 2+Avoid transformations that cause multiple distinct source files to map+to the same destination name.+.IP \[bu] 2+Consider disabling concurrency with \f[C]--transfers=1\f[R] if+necessary.+.IP \[bu] 2+Certain transformations (e.g.+\f[C]prefix\f[R]) will have a multiplying effect every time they are+used.+Avoid these when using \f[C]bisync\f[R].+.RE+.IP+.nf+\f[C]+rclone convmv dest:path --name-transform XXX [flags]+\f[R]+.fi+.SS Options+.IP+.nf+\f[C]+ --create-empty-src-dirs Create empty source dirs on destination after move+ --delete-empty-src-dirs Delete empty source dirs after move+ -h, --help help for convmv+\f[R]+.fi+.PP+Options shared with other commands are described next.+See the global flags page (https://rclone.org/flags/) for global options+not listed here.+.SS Copy Options+.PP+Flags for anything which can copy a file+.IP+.nf+\f[C]+ --check-first Do all the checks before starting transfers+ -c, --checksum Check for changes with size & checksum (if available, or fallback to size only)+ --compare-dest stringArray Include additional server-side paths during comparison+ --copy-dest stringArray Implies --compare-dest but also copies files from paths into destination+ --cutoff-mode HARD|SOFT|CAUTIOUS Mode to stop transfers when reaching the max transfer limit HARD|SOFT|CAUTIOUS (default HARD)+ --ignore-case-sync Ignore case when synchronizing+ --ignore-checksum Skip post copy check of checksums+ --ignore-existing Skip all files that exist on destination+ --ignore-size Ignore size when skipping use modtime or checksum+ -I, --ignore-times Don\[aq]t skip items that match size and time - transfer all unconditionally+ --immutable Do not modify files, fail if existing files have been modified+ --inplace Download directly to destination file instead of atomic download to temp/rename+ -l, --links Translate symlinks to/from regular files with a \[aq].rclonelink\[aq] extension+ --max-backlog int Maximum number of objects in sync or check backlog (default 10000)+ --max-duration Duration Maximum duration rclone will transfer data for (default 0s)+ --max-transfer SizeSuffix Maximum size of data to transfer (default off)+ -M, --metadata If set, preserve metadata when copying objects+ --modify-window Duration Max time diff to be considered the same (default 1ns)+ --multi-thread-chunk-size SizeSuffix Chunk size for multi-thread downloads / uploads, if not set by filesystem (default 64Mi)+ --multi-thread-cutoff SizeSuffix Use multi-thread downloads for files above this size (default 256Mi)+ --multi-thread-streams int Number of streams to use for multi-thread downloads (default 4)+ --multi-thread-write-buffer-size SizeSuffix In memory buffer size for writing when in multi-thread mode (default 128Ki)+ --name-transform stringArray Transform paths during the copy process+ --no-check-dest Don\[aq]t check the destination, copy regardless+ --no-traverse Don\[aq]t traverse destination file system on copy+ --no-update-dir-modtime Don\[aq]t update directory modification times+ --no-update-modtime Don\[aq]t update destination modtime if files identical+ --order-by string Instructions on how to order the transfers, e.g. \[aq]size,descending\[aq]+ --partial-suffix string Add partial-suffix to temporary file name when --inplace is not used (default \[dq].partial\[dq])+ --refresh-times Refresh the modtime of remote files+ --server-side-across-configs Allow server-side operations (e.g. copy) to work across different configs+ --size-only Skip based on size only, not modtime or checksum+ --streaming-upload-cutoff SizeSuffix Cutoff for switching to chunked upload if file size is unknown, upload starts after reaching cutoff or when file ends (default 100Ki)+ -u, --update Skip files that are newer on the destination+\f[R]+.fi+.SS Important Options+.PP+Important flags useful for most commands+.IP+.nf+\f[C]+ -n, --dry-run Do a trial run with no permanent changes+ -i, --interactive Enable interactive mode+ -v, --verbose count Print lots more stuff (repeat for more)+\f[R]+.fi+.SS Filter Options+.PP+Flags for filtering directory listings+.IP+.nf+\f[C]+ --delete-excluded Delete files on dest excluded from sync+ --exclude stringArray Exclude files matching pattern+ --exclude-from stringArray Read file exclude patterns from file (use - to read from stdin)+ --exclude-if-present stringArray Exclude directories if filename is present+ --files-from stringArray Read list of source-file names from file (use - to read from stdin)+ --files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)+ -f, --filter stringArray Add a file filtering rule+ --filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly \[at]/n+ --ignore-case Ignore case in filters (case insensitive)+ --include stringArray Include files matching pattern+ --include-from stringArray Read file include patterns from file (use - to read from stdin)+ --max-age Duration Only transfer files younger than this in s or suffix ms|s|m|h|d|w|M|y (default off)+ --max-depth int If set limits the recursion depth to this (default -1)+ --max-size SizeSuffix Only transfer files smaller than this in KiB or suffix B|K|M|G|T|P (default off)+ --metadata-exclude stringArray Exclude metadatas matching pattern+ --metadata-exclude-from stringArray Read metadata exclude patterns from file (use - to read from stdin)+ --metadata-filter stringArray Add a metadata filtering rule+ --metadata-filter-from stringArray Read metadata filtering patterns from a file (use - to read from stdin)+ --metadata-include stringArray Include metadatas matching pattern+ --metadata-include-from stringArray Read metadata include patterns from file (use - to read from stdin)+ --min-age Duration Only transfer files older than this in s or suffix ms|s|m|h|d|w|M|y (default off)+ --min-size SizeSuffix Only transfer files bigger than this in KiB or suffix B|K|M|G|T|P (default off)+\f[R]+.fi+.SS Listing Options+.PP+Flags for listing directories+.IP+.nf+\f[C]+ --default-time Time Time to show if modtime is unknown for files and directories (default 2000-01-01T00:00:00Z)+ --fast-list Use recursive list if available; uses more memory but fewer transactions+\f[R]+.fi+.SS See Also+.IP \[bu] 2+rclone (https://rclone.org/commands/rclone/) - Show help for rclone+commands, flags and backends..SH rclone copyto.PPCopy files from source to dest, skipping identical files.@@ -5135,6 +5865,9 @@ This doesn\[aq]t transfer files that are identical on src and dst,testing by size and modification time or MD5SUM.It doesn\[aq]t delete files from the destination..PP+\f[I]If you are looking to copy just a byte range of a file, please see+\[aq]rclone cat --offset X --count Y\[aq]\f[R]+.PP\f[B]Note\f[R]: Use the \f[C]-P\f[R]/\f[C]--progress\f[R] flag to viewreal-time transfer statistics.IP@@ -5182,6 +5915,7 @@ Flags for anything which can copy a file--multi-thread-cutoff SizeSuffix Use multi-thread downloads for files above this size (default 256Mi)--multi-thread-streams int Number of streams to use for multi-thread downloads (default 4)--multi-thread-write-buffer-size SizeSuffix In memory buffer size for writing when in multi-thread mode (default 128Ki)+ --name-transform stringArray Transform paths during the copy process--no-check-dest Don\[aq]t check the destination, copy regardless--no-traverse Don\[aq]t traverse destination file system on copy--no-update-dir-modtime Don\[aq]t update directory modification times@@ -5220,6 +5954,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly \[at]/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -5262,9 +5997,8 @@ Setting \f[C]--auto-filename\f[R] will attempt to automaticallydetermine the filename from the URL (after any redirections) and used inthe destination path..PP-With \f[C]--auto-filename-header\f[R] in addition, if a specific-filename is set in HTTP headers, it will be used instead of the name-from the URL.+With \f[C]--header-filename\f[R] in addition, if a specific filename is+set in HTTP headers, it will be used instead of the name from the URL.With \f[C]--print-filename\f[R] in addition, the resulting file namewill be printed..PP@@ -5273,7 +6007,7 @@ destination if there is one with the same name..PPSetting \f[C]--stdout\f[R] or making the output file name \f[C]-\f[R]will cause the output to be written to standard output.-.SS Troublshooting+.SS Troubleshooting.PPIf you can\[aq]t get \f[C]rclone copyurl\f[R] to work then here are somethings you can try:@@ -5448,6 +6182,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly \[at]/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -5740,6 +6475,7 @@ Supported hashes are:* whirlpool* crc32* sha256+ * sha512\f[R].fi.PP@@ -5788,6 +6524,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly \[at]/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -6142,6 +6879,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly \[at]/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -6349,6 +7087,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly \[at]/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -7102,13 +7841,13 @@ If rclone is quit or dies with files that haven\[aq]t been uploaded,these will be uploaded next time rclone is run with the same flags..PPIf using \f[C]--vfs-cache-max-size\f[R] or-\f[C]--vfs-cache-min-free-size\f[R] note that the cache may exceed these-quotas for two reasons.+\f[C]--vfs-cache-min-free-space\f[R] note that the cache may exceed+these quotas for two reasons.Firstly because it is only checked every\f[C]--vfs-cache-poll-interval\f[R].Secondly because open files cannot be evicted from the cache.When \f[C]--vfs-cache-max-size\f[R] or-\f[C]--vfs-cache-min-free-size\f[R] is exceeded, rclone will attempt to+\f[C]--vfs-cache-min-free-space\f[R] is exceeded, rclone will attempt toevict the least accessed files from the cache first.rclone will start with files that haven\[aq]t been accessed for thelongest.@@ -7500,6 +8239,47 @@ filters so that the result is accurate.However, this is very inefficient and may cost lots of API callsresulting in extra charges.Use it as a last resort and only with caching.+.SS VFS Metadata+.PP+If you use the \f[C]--vfs-metadata-extension\f[R] flag you can get the+VFS to expose files which contain the+metadata (https://rclone.org/docs/#metadata) as a JSON blob.+These files will not appear in the directory listing, but can be+\f[C]stat\f[R]-ed and opened and once they have been they \f[B]will\f[R]+appear in directory listings until the directory cache expires.+.PP+Note that some backends won\[aq]t create metadata unless you pass in the+\f[C]--metadata\f[R] flag.+.PP+For example, using \f[C]rclone mount\f[R] with+\f[C]--metadata --vfs-metadata-extension .metadata\f[R] we get+.IP+.nf+\f[C]+$ ls -l /mnt/+total 1048577+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++$ cat /mnt/1G.metadata+{+ \[dq]atime\[dq]: \[dq]2025-03-04T17:34:22.317069787Z\[dq],+ \[dq]btime\[dq]: \[dq]2025-03-03T16:03:37.708253808Z\[dq],+ \[dq]gid\[dq]: \[dq]1000\[dq],+ \[dq]mode\[dq]: \[dq]100664\[dq],+ \[dq]mtime\[dq]: \[dq]2025-03-03T16:03:39.640238323Z\[dq],+ \[dq]uid\[dq]: \[dq]1000\[dq]+}++$ ls -l /mnt/+total 1048578+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+-rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata+\f[R]+.fi+.PP+If the file has no metadata it will be returned as \f[C]{}\f[R] and if+there is an error reading the metadata the error will be returned as+\f[C]{\[dq]error\[dq]:\[dq]error string\[dq]}\f[R]..IP.nf\f[C]@@ -7552,6 +8332,7 @@ rclone mount remote:path /path/to/mountpoint [flags]--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a \[aq].rclonelink\[aq] extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached (\[aq]off\[aq] is unlimited) (default off)@@ -7583,6 +8364,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly \[at]/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -7693,6 +8475,7 @@ Flags for anything which can copy a file--multi-thread-cutoff SizeSuffix Use multi-thread downloads for files above this size (default 256Mi)--multi-thread-streams int Number of streams to use for multi-thread downloads (default 4)--multi-thread-write-buffer-size SizeSuffix In memory buffer size for writing when in multi-thread mode (default 128Ki)+ --name-transform stringArray Transform paths during the copy process--no-check-dest Don\[aq]t check the destination, copy regardless--no-traverse Don\[aq]t traverse destination file system on copy--no-update-dir-modtime Don\[aq]t update directory modification times@@ -7731,6 +8514,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly \[at]/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -7868,6 +8652,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly \[at]/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -8622,13 +9407,13 @@ If rclone is quit or dies with files that haven\[aq]t been uploaded,these will be uploaded next time rclone is run with the same flags..PPIf using \f[C]--vfs-cache-max-size\f[R] or-\f[C]--vfs-cache-min-free-size\f[R] note that the cache may exceed these-quotas for two reasons.+\f[C]--vfs-cache-min-free-space\f[R] note that the cache may exceed+these quotas for two reasons.Firstly because it is only checked every\f[C]--vfs-cache-poll-interval\f[R].Secondly because open files cannot be evicted from the cache.When \f[C]--vfs-cache-max-size\f[R] or-\f[C]--vfs-cache-min-free-size\f[R] is exceeded, rclone will attempt to+\f[C]--vfs-cache-min-free-space\f[R] is exceeded, rclone will attempt toevict the least accessed files from the cache first.rclone will start with files that haven\[aq]t been accessed for thelongest.@@ -9020,6 +9805,47 @@ filters so that the result is accurate.However, this is very inefficient and may cost lots of API callsresulting in extra charges.Use it as a last resort and only with caching.+.SS VFS Metadata+.PP+If you use the \f[C]--vfs-metadata-extension\f[R] flag you can get the+VFS to expose files which contain the+metadata (https://rclone.org/docs/#metadata) as a JSON blob.+These files will not appear in the directory listing, but can be+\f[C]stat\f[R]-ed and opened and once they have been they \f[B]will\f[R]+appear in directory listings until the directory cache expires.+.PP+Note that some backends won\[aq]t create metadata unless you pass in the+\f[C]--metadata\f[R] flag.+.PP+For example, using \f[C]rclone mount\f[R] with+\f[C]--metadata --vfs-metadata-extension .metadata\f[R] we get+.IP+.nf+\f[C]+$ ls -l /mnt/+total 1048577+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++$ cat /mnt/1G.metadata+{+ \[dq]atime\[dq]: \[dq]2025-03-04T17:34:22.317069787Z\[dq],+ \[dq]btime\[dq]: \[dq]2025-03-03T16:03:37.708253808Z\[dq],+ \[dq]gid\[dq]: \[dq]1000\[dq],+ \[dq]mode\[dq]: \[dq]100664\[dq],+ \[dq]mtime\[dq]: \[dq]2025-03-03T16:03:39.640238323Z\[dq],+ \[dq]uid\[dq]: \[dq]1000\[dq]+}++$ ls -l /mnt/+total 1048578+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+-rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata+\f[R]+.fi+.PP+If the file has no metadata it will be returned as \f[C]{}\f[R] and if+there is an error reading the metadata the error will be returned as+\f[C]{\[dq]error\[dq]:\[dq]error string\[dq]}\f[R]..IP.nf\f[C]@@ -9077,6 +9903,7 @@ rclone nfsmount remote:path /path/to/mountpoint [flags]--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a \[aq].rclonelink\[aq] extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached (\[aq]off\[aq] is unlimited) (default off)@@ -9108,6 +9935,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly \[at]/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -9616,7 +10444,14 @@ You can either use an htpasswd file which can take lots of users, or seta single username and password with the \f[C]--rc-user\f[R] and\f[C]--rc-pass\f[R] flags..PP-If no static users are configured by either of the above methods, and+Alternatively, you can have the reverse proxy manage authentication and+use the username provided in the configured header with+\f[C]--user-from-header\f[R] (e.g.,+\f[C]--rc---user-from-header=x-remote-user\f[R]).+Ensure the proxy is trusted and headers cannot be spoofed, as+misconfiguration may lead to unauthorized access.+.PP+If either of the above authentication methods is not configured andclient certificates are required by the \f[C]--client-ca\f[R] flagpassed to the server, the client certificate common name will beconsidered as the username.@@ -9690,6 +10525,7 @@ Flags to control the Remote Control API--rc-server-write-timeout Duration Timeout for server writing data (default 1h0m0s)--rc-template string User-specified template--rc-user string User name for authentication+ --rc-user-from-header string User name from a defined HTTP header--rc-web-fetch-url string URL to fetch the releases for webgui (default \[dq]https://api.github.com/repos/rclone/rclone-webui-react/releases/latest\[dq])--rc-web-gui Launch WebGUI on localhost--rc-web-gui-force-update Force update to latest version of web gui@@ -10071,13 +10907,13 @@ If rclone is quit or dies with files that haven\[aq]t been uploaded,these will be uploaded next time rclone is run with the same flags..PPIf using \f[C]--vfs-cache-max-size\f[R] or-\f[C]--vfs-cache-min-free-size\f[R] note that the cache may exceed these-quotas for two reasons.+\f[C]--vfs-cache-min-free-space\f[R] note that the cache may exceed+these quotas for two reasons.Firstly because it is only checked every\f[C]--vfs-cache-poll-interval\f[R].Secondly because open files cannot be evicted from the cache.When \f[C]--vfs-cache-max-size\f[R] or-\f[C]--vfs-cache-min-free-size\f[R] is exceeded, rclone will attempt to+\f[C]--vfs-cache-min-free-space\f[R] is exceeded, rclone will attempt toevict the least accessed files from the cache first.rclone will start with files that haven\[aq]t been accessed for thelongest.@@ -10469,6 +11305,47 @@ filters so that the result is accurate.However, this is very inefficient and may cost lots of API callsresulting in extra charges.Use it as a last resort and only with caching.+.SS VFS Metadata+.PP+If you use the \f[C]--vfs-metadata-extension\f[R] flag you can get the+VFS to expose files which contain the+metadata (https://rclone.org/docs/#metadata) as a JSON blob.+These files will not appear in the directory listing, but can be+\f[C]stat\f[R]-ed and opened and once they have been they \f[B]will\f[R]+appear in directory listings until the directory cache expires.+.PP+Note that some backends won\[aq]t create metadata unless you pass in the+\f[C]--metadata\f[R] flag.+.PP+For example, using \f[C]rclone mount\f[R] with+\f[C]--metadata --vfs-metadata-extension .metadata\f[R] we get+.IP+.nf+\f[C]+$ ls -l /mnt/+total 1048577+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++$ cat /mnt/1G.metadata+{+ \[dq]atime\[dq]: \[dq]2025-03-04T17:34:22.317069787Z\[dq],+ \[dq]btime\[dq]: \[dq]2025-03-03T16:03:37.708253808Z\[dq],+ \[dq]gid\[dq]: \[dq]1000\[dq],+ \[dq]mode\[dq]: \[dq]100664\[dq],+ \[dq]mtime\[dq]: \[dq]2025-03-03T16:03:39.640238323Z\[dq],+ \[dq]uid\[dq]: \[dq]1000\[dq]+}++$ ls -l /mnt/+total 1048578+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+-rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata+\f[R]+.fi+.PP+If the file has no metadata it will be returned as \f[C]{}\f[R] and if+there is an error reading the metadata the error will be returned as+\f[C]{\[dq]error\[dq]:\[dq]error string\[dq]}\f[R]..IP.nf\f[C]@@ -10507,6 +11384,7 @@ rclone serve dlna remote:path [flags]--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a \[aq].rclonelink\[aq] extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached (\[aq]off\[aq] is unlimited) (default off)@@ -10536,6 +11414,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly \[at]/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -10732,13 +11611,13 @@ If rclone is quit or dies with files that haven\[aq]t been uploaded,these will be uploaded next time rclone is run with the same flags..PPIf using \f[C]--vfs-cache-max-size\f[R] or-\f[C]--vfs-cache-min-free-size\f[R] note that the cache may exceed these-quotas for two reasons.+\f[C]--vfs-cache-min-free-space\f[R] note that the cache may exceed+these quotas for two reasons.Firstly because it is only checked every\f[C]--vfs-cache-poll-interval\f[R].Secondly because open files cannot be evicted from the cache.When \f[C]--vfs-cache-max-size\f[R] or-\f[C]--vfs-cache-min-free-size\f[R] is exceeded, rclone will attempt to+\f[C]--vfs-cache-min-free-space\f[R] is exceeded, rclone will attempt toevict the least accessed files from the cache first.rclone will start with files that haven\[aq]t been accessed for thelongest.@@ -11130,6 +12009,47 @@ filters so that the result is accurate.However, this is very inefficient and may cost lots of API callsresulting in extra charges.Use it as a last resort and only with caching.+.SS VFS Metadata+.PP+If you use the \f[C]--vfs-metadata-extension\f[R] flag you can get the+VFS to expose files which contain the+metadata (https://rclone.org/docs/#metadata) as a JSON blob.+These files will not appear in the directory listing, but can be+\f[C]stat\f[R]-ed and opened and once they have been they \f[B]will\f[R]+appear in directory listings until the directory cache expires.+.PP+Note that some backends won\[aq]t create metadata unless you pass in the+\f[C]--metadata\f[R] flag.+.PP+For example, using \f[C]rclone mount\f[R] with+\f[C]--metadata --vfs-metadata-extension .metadata\f[R] we get+.IP+.nf+\f[C]+$ ls -l /mnt/+total 1048577+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++$ cat /mnt/1G.metadata+{+ \[dq]atime\[dq]: \[dq]2025-03-04T17:34:22.317069787Z\[dq],+ \[dq]btime\[dq]: \[dq]2025-03-03T16:03:37.708253808Z\[dq],+ \[dq]gid\[dq]: \[dq]1000\[dq],+ \[dq]mode\[dq]: \[dq]100664\[dq],+ \[dq]mtime\[dq]: \[dq]2025-03-03T16:03:39.640238323Z\[dq],+ \[dq]uid\[dq]: \[dq]1000\[dq]+}++$ ls -l /mnt/+total 1048578+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+-rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata+\f[R]+.fi+.PP+If the file has no metadata it will be returned as \f[C]{}\f[R] and if+there is an error reading the metadata the error will be returned as+\f[C]{\[dq]error\[dq]:\[dq]error string\[dq]}\f[R]..IP.nf\f[C]@@ -11187,6 +12107,7 @@ rclone serve docker [flags]--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a \[aq].rclonelink\[aq] extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached (\[aq]off\[aq] is unlimited) (default off)@@ -11218,6 +12139,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly \[at]/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -11384,13 +12306,13 @@ If rclone is quit or dies with files that haven\[aq]t been uploaded,these will be uploaded next time rclone is run with the same flags..PPIf using \f[C]--vfs-cache-max-size\f[R] or-\f[C]--vfs-cache-min-free-size\f[R] note that the cache may exceed these-quotas for two reasons.+\f[C]--vfs-cache-min-free-space\f[R] note that the cache may exceed+these quotas for two reasons.Firstly because it is only checked every\f[C]--vfs-cache-poll-interval\f[R].Secondly because open files cannot be evicted from the cache.When \f[C]--vfs-cache-max-size\f[R] or-\f[C]--vfs-cache-min-free-size\f[R] is exceeded, rclone will attempt to+\f[C]--vfs-cache-min-free-space\f[R] is exceeded, rclone will attempt toevict the least accessed files from the cache first.rclone will start with files that haven\[aq]t been accessed for thelongest.@@ -11782,6 +12704,47 @@ filters so that the result is accurate.However, this is very inefficient and may cost lots of API callsresulting in extra charges.Use it as a last resort and only with caching.+.SS VFS Metadata+.PP+If you use the \f[C]--vfs-metadata-extension\f[R] flag you can get the+VFS to expose files which contain the+metadata (https://rclone.org/docs/#metadata) as a JSON blob.+These files will not appear in the directory listing, but can be+\f[C]stat\f[R]-ed and opened and once they have been they \f[B]will\f[R]+appear in directory listings until the directory cache expires.+.PP+Note that some backends won\[aq]t create metadata unless you pass in the+\f[C]--metadata\f[R] flag.+.PP+For example, using \f[C]rclone mount\f[R] with+\f[C]--metadata --vfs-metadata-extension .metadata\f[R] we get+.IP+.nf+\f[C]+$ ls -l /mnt/+total 1048577+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++$ cat /mnt/1G.metadata+{+ \[dq]atime\[dq]: \[dq]2025-03-04T17:34:22.317069787Z\[dq],+ \[dq]btime\[dq]: \[dq]2025-03-03T16:03:37.708253808Z\[dq],+ \[dq]gid\[dq]: \[dq]1000\[dq],+ \[dq]mode\[dq]: \[dq]100664\[dq],+ \[dq]mtime\[dq]: \[dq]2025-03-03T16:03:39.640238323Z\[dq],+ \[dq]uid\[dq]: \[dq]1000\[dq]+}++$ ls -l /mnt/+total 1048578+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+-rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata+\f[R]+.fi+.PP+If the file has no metadata it will be returned as \f[C]{}\f[R] and if+there is an error reading the metadata the error will be returned as+\f[C]{\[dq]error\[dq]:\[dq]error string\[dq]}\f[R]..SS Auth Proxy.PPIf you supply the parameter \f[C]--auth-proxy /path/to/program\f[R] then@@ -11916,6 +12879,7 @@ rclone serve ftp remote:path [flags]--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a \[aq].rclonelink\[aq] extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached (\[aq]off\[aq] is unlimited) (default off)@@ -11945,6 +12909,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly \[at]/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -12201,7 +13166,14 @@ You can either use an htpasswd file which can take lots of users, or seta single username and password with the \f[C]--user\f[R] and\f[C]--pass\f[R] flags..PP-If no static users are configured by either of the above methods, and+Alternatively, you can have the reverse proxy manage authentication and+use the username provided in the configured header with+\f[C]--user-from-header\f[R] (e.g.,+\f[C]----user-from-header=x-remote-user\f[R]).+Ensure the proxy is trusted and headers cannot be spoofed, as+misconfiguration may lead to unauthorized access.+.PP+If either of the above authentication methods is not configured andclient certificates are required by the \f[C]--client-ca\f[R] flagpassed to the server, the client certificate common name will beconsidered as the username.@@ -12349,13 +13321,13 @@ If rclone is quit or dies with files that haven\[aq]t been uploaded,these will be uploaded next time rclone is run with the same flags..PPIf using \f[C]--vfs-cache-max-size\f[R] or-\f[C]--vfs-cache-min-free-size\f[R] note that the cache may exceed these-quotas for two reasons.+\f[C]--vfs-cache-min-free-space\f[R] note that the cache may exceed+these quotas for two reasons.Firstly because it is only checked every\f[C]--vfs-cache-poll-interval\f[R].Secondly because open files cannot be evicted from the cache.When \f[C]--vfs-cache-max-size\f[R] or-\f[C]--vfs-cache-min-free-size\f[R] is exceeded, rclone will attempt to+\f[C]--vfs-cache-min-free-space\f[R] is exceeded, rclone will attempt toevict the least accessed files from the cache first.rclone will start with files that haven\[aq]t been accessed for thelongest.@@ -12747,6 +13719,47 @@ filters so that the result is accurate.However, this is very inefficient and may cost lots of API callsresulting in extra charges.Use it as a last resort and only with caching.+.SS VFS Metadata+.PP+If you use the \f[C]--vfs-metadata-extension\f[R] flag you can get the+VFS to expose files which contain the+metadata (https://rclone.org/docs/#metadata) as a JSON blob.+These files will not appear in the directory listing, but can be+\f[C]stat\f[R]-ed and opened and once they have been they \f[B]will\f[R]+appear in directory listings until the directory cache expires.+.PP+Note that some backends won\[aq]t create metadata unless you pass in the+\f[C]--metadata\f[R] flag.+.PP+For example, using \f[C]rclone mount\f[R] with+\f[C]--metadata --vfs-metadata-extension .metadata\f[R] we get+.IP+.nf+\f[C]+$ ls -l /mnt/+total 1048577+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++$ cat /mnt/1G.metadata+{+ \[dq]atime\[dq]: \[dq]2025-03-04T17:34:22.317069787Z\[dq],+ \[dq]btime\[dq]: \[dq]2025-03-03T16:03:37.708253808Z\[dq],+ \[dq]gid\[dq]: \[dq]1000\[dq],+ \[dq]mode\[dq]: \[dq]100664\[dq],+ \[dq]mtime\[dq]: \[dq]2025-03-03T16:03:39.640238323Z\[dq],+ \[dq]uid\[dq]: \[dq]1000\[dq]+}++$ ls -l /mnt/+total 1048578+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+-rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata+\f[R]+.fi+.PP+If the file has no metadata it will be returned as \f[C]{}\f[R] and if+there is an error reading the metadata the error will be returned as+\f[C]{\[dq]error\[dq]:\[dq]error string\[dq]}\f[R]..SS Auth Proxy.PPIf you supply the parameter \f[C]--auth-proxy /path/to/program\f[R] then@@ -12850,19 +13863,19 @@ rclone serve http remote:path [flags].IP.nf\f[C]- --addr stringArray IPaddress:Port, :Port or [unix://]/path/to/socket to bind server to (default [127.0.0.1:8080])+ --addr stringArray IPaddress:Port or :Port to bind server to (default 127.0.0.1:8080)--allow-origin string Origin which cross-domain request (CORS) can be executed from--auth-proxy string A program to use to create the backend from the auth--baseurl string Prefix for URLs - leave blank for root- --cert string Path to TLS PEM public key certificate file (can also include intermediate/CA certificates)- --client-ca string Path to TLS PEM CA file with certificate authorities to verify clients with+ --cert string TLS PEM key (concatenation of certificate and CA certificate)+ --client-ca string Client certificate authority to verify clients with--dir-cache-time Duration Time to cache directory entries for (default 5m0s)--dir-perms FileMode Directory permissions (default 777)--file-perms FileMode File permissions (default 666)--gid uint32 Override the gid field set by the filesystem (not supported on Windows) (default 1000)-h, --help help for http--htpasswd string A htpasswd file - if not provided no authentication is done- --key string Path to TLS PEM private key file+ --key string TLS PEM Private key--link-perms FileMode Link permissions (default 666)--max-header-bytes int Maximum size of request header (default 4096)--min-tls-version string Minimum TLS version that is acceptable (default \[dq]tls1.0\[dq])@@ -12880,6 +13893,7 @@ rclone serve http remote:path [flags]--uid uint32 Override the uid field set by the filesystem (not supported on Windows) (default 1000)--umask FileMode Override the permission bits set by the filesystem (not supported on Windows) (default 002)--user string User name for authentication+ --user-from-header string User name from a defined HTTP header--vfs-block-norm-dupes If duplicate filenames exist in the same directory (after normalization), log an error and hide the duplicates (may have a performance cost)--vfs-cache-max-age Duration Max time since last access of objects in the cache (default 1h0m0s)--vfs-cache-max-size SizeSuffix Max total size of objects in the cache (default off)@@ -12890,6 +13904,7 @@ rclone serve http remote:path [flags]--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a \[aq].rclonelink\[aq] extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached (\[aq]off\[aq] is unlimited) (default off)@@ -12919,6 +13934,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly \[at]/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -12993,7 +14009,8 @@ which improves performance.This sort of cache can\[aq]t be backed up and restored as the underlyinghandles will change.This is Linux only.-It requres running rclone as root or with \f[C]CAP_DAC_READ_SEARCH\f[R].+It requires running rclone as root or with+\f[C]CAP_DAC_READ_SEARCH\f[R].You can run rclone with this extra permission by doing this to therclone binary\f[C]sudo setcap cap_dac_read_search+ep /path/to/rclone\f[R].@@ -13027,6 +14044,13 @@ Where \f[C]$PORT\f[R] is the same port number used in the\f[C]serve nfs\f[R] command and \f[C]$HOSTNAME\f[R] is the networkaddress of the machine that \f[C]serve nfs\f[R] was run on..PP+If \f[C]--vfs-metadata-extension\f[R] is in use then for the+\f[C]--nfs-cache-type disk\f[R] and \f[C]--nfs-cache-type cache\f[R] the+metadata files will have the file handle of their parent file suffixed+with \f[C]0x00, 0x00, 0x00, 0x01\f[R].+This means they can be looked up directly from the parent file handle is+desired.+.PPThis command is only available on Unix platforms..SS VFS - Virtual File System.PP@@ -13150,13 +14174,13 @@ If rclone is quit or dies with files that haven\[aq]t been uploaded,these will be uploaded next time rclone is run with the same flags..PPIf using \f[C]--vfs-cache-max-size\f[R] or-\f[C]--vfs-cache-min-free-size\f[R] note that the cache may exceed these-quotas for two reasons.+\f[C]--vfs-cache-min-free-space\f[R] note that the cache may exceed+these quotas for two reasons.Firstly because it is only checked every\f[C]--vfs-cache-poll-interval\f[R].Secondly because open files cannot be evicted from the cache.When \f[C]--vfs-cache-max-size\f[R] or-\f[C]--vfs-cache-min-free-size\f[R] is exceeded, rclone will attempt to+\f[C]--vfs-cache-min-free-space\f[R] is exceeded, rclone will attempt toevict the least accessed files from the cache first.rclone will start with files that haven\[aq]t been accessed for thelongest.@@ -13548,6 +14572,47 @@ filters so that the result is accurate.However, this is very inefficient and may cost lots of API callsresulting in extra charges.Use it as a last resort and only with caching.+.SS VFS Metadata+.PP+If you use the \f[C]--vfs-metadata-extension\f[R] flag you can get the+VFS to expose files which contain the+metadata (https://rclone.org/docs/#metadata) as a JSON blob.+These files will not appear in the directory listing, but can be+\f[C]stat\f[R]-ed and opened and once they have been they \f[B]will\f[R]+appear in directory listings until the directory cache expires.+.PP+Note that some backends won\[aq]t create metadata unless you pass in the+\f[C]--metadata\f[R] flag.+.PP+For example, using \f[C]rclone mount\f[R] with+\f[C]--metadata --vfs-metadata-extension .metadata\f[R] we get+.IP+.nf+\f[C]+$ ls -l /mnt/+total 1048577+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++$ cat /mnt/1G.metadata+{+ \[dq]atime\[dq]: \[dq]2025-03-04T17:34:22.317069787Z\[dq],+ \[dq]btime\[dq]: \[dq]2025-03-03T16:03:37.708253808Z\[dq],+ \[dq]gid\[dq]: \[dq]1000\[dq],+ \[dq]mode\[dq]: \[dq]100664\[dq],+ \[dq]mtime\[dq]: \[dq]2025-03-03T16:03:39.640238323Z\[dq],+ \[dq]uid\[dq]: \[dq]1000\[dq]+}++$ ls -l /mnt/+total 1048578+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+-rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata+\f[R]+.fi+.PP+If the file has no metadata it will be returned as \f[C]{}\f[R] and if+there is an error reading the metadata the error will be returned as+\f[C]{\[dq]error\[dq]:\[dq]error string\[dq]}\f[R]..IP.nf\f[C]@@ -13585,6 +14650,7 @@ rclone serve nfs remote:path [flags]--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a \[aq].rclonelink\[aq] extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached (\[aq]off\[aq] is unlimited) (default off)@@ -13614,6 +14680,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly \[at]/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -13818,7 +14885,14 @@ You can either use an htpasswd file which can take lots of users, or seta single username and password with the \f[C]--user\f[R] and\f[C]--pass\f[R] flags..PP-If no static users are configured by either of the above methods, and+Alternatively, you can have the reverse proxy manage authentication and+use the username provided in the configured header with+\f[C]--user-from-header\f[R] (e.g.,+\f[C]----user-from-header=x-remote-user\f[R]).+Ensure the proxy is trusted and headers cannot be spoofed, as+misconfiguration may lead to unauthorized access.+.PP+If either of the above authentication methods is not configured andclient certificates are required by the \f[C]--client-ca\f[R] flagpassed to the server, the client certificate common name will beconsidered as the username.@@ -13854,16 +14928,16 @@ rclone serve restic remote:path [flags].IP.nf\f[C]- --addr stringArray IPaddress:Port, :Port or [unix://]/path/to/socket to bind server to (default [127.0.0.1:8080])+ --addr stringArray IPaddress:Port or :Port to bind server to (default 127.0.0.1:8080)--allow-origin string Origin which cross-domain request (CORS) can be executed from--append-only Disallow deletion of repository data--baseurl string Prefix for URLs - leave blank for root--cache-objects Cache listed objects (default true)- --cert string Path to TLS PEM public key certificate file (can also include intermediate/CA certificates)- --client-ca string Path to TLS PEM CA file with certificate authorities to verify clients with+ --cert string TLS PEM key (concatenation of certificate and CA certificate)+ --client-ca string Client certificate authority to verify clients with-h, --help help for restic--htpasswd string A htpasswd file - if not provided no authentication is done- --key string Path to TLS PEM private key file+ --key string TLS PEM Private key--max-header-bytes int Maximum size of request header (default 4096)--min-tls-version string Minimum TLS version that is acceptable (default \[dq]tls1.0\[dq])--pass string Password for authentication@@ -13874,6 +14948,7 @@ rclone serve restic remote:path [flags]--server-write-timeout Duration Timeout for server writing data (default 1h0m0s)--stdio Run an HTTP2 server on stdin/stdout--user string User name for authentication+ --user-from-header string User name from a defined HTTP header\f[R].fi.PP@@ -13973,7 +15048,7 @@ use_multipart_uploads = false\f[R].fi.PP-Note that setting \f[C]disable_multipart_uploads = true\f[R] is to work+Note that setting \f[C]use_multipart_uploads = false\f[R] is to workaround a bug which will be fixed in due course..SS Bugs.PP@@ -14064,7 +15139,14 @@ You can either use an htpasswd file which can take lots of users, or seta single username and password with the \f[C]--user\f[R] and\f[C]--pass\f[R] flags..PP-If no static users are configured by either of the above methods, and+Alternatively, you can have the reverse proxy manage authentication and+use the username provided in the configured header with+\f[C]--user-from-header\f[R] (e.g.,+\f[C]----user-from-header=x-remote-user\f[R]).+Ensure the proxy is trusted and headers cannot be spoofed, as+misconfiguration may lead to unauthorized access.+.PP+If either of the above authentication methods is not configured andclient certificates are required by the \f[C]--client-ca\f[R] flagpassed to the server, the client certificate common name will beconsidered as the username.@@ -14289,13 +15371,13 @@ If rclone is quit or dies with files that haven\[aq]t been uploaded,these will be uploaded next time rclone is run with the same flags..PPIf using \f[C]--vfs-cache-max-size\f[R] or-\f[C]--vfs-cache-min-free-size\f[R] note that the cache may exceed these-quotas for two reasons.+\f[C]--vfs-cache-min-free-space\f[R] note that the cache may exceed+these quotas for two reasons.Firstly because it is only checked every\f[C]--vfs-cache-poll-interval\f[R].Secondly because open files cannot be evicted from the cache.When \f[C]--vfs-cache-max-size\f[R] or-\f[C]--vfs-cache-min-free-size\f[R] is exceeded, rclone will attempt to+\f[C]--vfs-cache-min-free-space\f[R] is exceeded, rclone will attempt toevict the least accessed files from the cache first.rclone will start with files that haven\[aq]t been accessed for thelongest.@@ -14687,6 +15769,47 @@ filters so that the result is accurate.However, this is very inefficient and may cost lots of API callsresulting in extra charges.Use it as a last resort and only with caching.+.SS VFS Metadata+.PP+If you use the \f[C]--vfs-metadata-extension\f[R] flag you can get the+VFS to expose files which contain the+metadata (https://rclone.org/docs/#metadata) as a JSON blob.+These files will not appear in the directory listing, but can be+\f[C]stat\f[R]-ed and opened and once they have been they \f[B]will\f[R]+appear in directory listings until the directory cache expires.+.PP+Note that some backends won\[aq]t create metadata unless you pass in the+\f[C]--metadata\f[R] flag.+.PP+For example, using \f[C]rclone mount\f[R] with+\f[C]--metadata --vfs-metadata-extension .metadata\f[R] we get+.IP+.nf+\f[C]+$ ls -l /mnt/+total 1048577+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++$ cat /mnt/1G.metadata+{+ \[dq]atime\[dq]: \[dq]2025-03-04T17:34:22.317069787Z\[dq],+ \[dq]btime\[dq]: \[dq]2025-03-03T16:03:37.708253808Z\[dq],+ \[dq]gid\[dq]: \[dq]1000\[dq],+ \[dq]mode\[dq]: \[dq]100664\[dq],+ \[dq]mtime\[dq]: \[dq]2025-03-03T16:03:39.640238323Z\[dq],+ \[dq]uid\[dq]: \[dq]1000\[dq]+}++$ ls -l /mnt/+total 1048578+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+-rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata+\f[R]+.fi+.PP+If the file has no metadata it will be returned as \f[C]{}\f[R] and if+there is an error reading the metadata the error will be returned as+\f[C]{\[dq]error\[dq]:\[dq]error string\[dq]}\f[R]..IP.nf\f[C]@@ -14697,22 +15820,22 @@ rclone serve s3 remote:path [flags].IP.nf\f[C]- --addr stringArray IPaddress:Port, :Port or [unix://]/path/to/socket to bind server to (default [127.0.0.1:8080])+ --addr stringArray IPaddress:Port or :Port to bind server to (default 127.0.0.1:8080)--allow-origin string Origin which cross-domain request (CORS) can be executed from--auth-key stringArray Set key pair for v4 authorization: access_key_id,secret_access_key--auth-proxy string A program to use to create the backend from the auth--baseurl string Prefix for URLs - leave blank for root- --cert string Path to TLS PEM public key certificate file (can also include intermediate/CA certificates)- --client-ca string Path to TLS PEM CA file with certificate authorities to verify clients with+ --cert string TLS PEM key (concatenation of certificate and CA certificate)+ --client-ca string Client certificate authority to verify clients with--dir-cache-time Duration Time to cache directory entries for (default 5m0s)--dir-perms FileMode Directory permissions (default 777)--etag-hash string Which hash to use for the ETag, or auto or blank for off (default \[dq]MD5\[dq])--file-perms FileMode File permissions (default 666)- --force-path-style If true use path style access if false use virtual hosted style (default true) (default true)+ --force-path-style If true use path style access if false use virtual hosted style (default true)--gid uint32 Override the gid field set by the filesystem (not supported on Windows) (default 1000)-h, --help help for s3--htpasswd string A htpasswd file - if not provided no authentication is done- --key string Path to TLS PEM private key file+ --key string TLS PEM Private key--link-perms FileMode Link permissions (default 666)--max-header-bytes int Maximum size of request header (default 4096)--min-tls-version string Minimum TLS version that is acceptable (default \[dq]tls1.0\[dq])@@ -14730,6 +15853,7 @@ rclone serve s3 remote:path [flags]--uid uint32 Override the uid field set by the filesystem (not supported on Windows) (default 1000)--umask FileMode Override the permission bits set by the filesystem (not supported on Windows) (default 002)--user string User name for authentication+ --user-from-header string User name from a defined HTTP header--vfs-block-norm-dupes If duplicate filenames exist in the same directory (after normalization), log an error and hide the duplicates (may have a performance cost)--vfs-cache-max-age Duration Max time since last access of objects in the cache (default 1h0m0s)--vfs-cache-max-size SizeSuffix Max total size of objects in the cache (default off)@@ -14740,6 +15864,7 @@ rclone serve s3 remote:path [flags]--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a \[aq].rclonelink\[aq] extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached (\[aq]off\[aq] is unlimited) (default off)@@ -14769,6 +15894,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly \[at]/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -14995,13 +16121,13 @@ If rclone is quit or dies with files that haven\[aq]t been uploaded,these will be uploaded next time rclone is run with the same flags..PPIf using \f[C]--vfs-cache-max-size\f[R] or-\f[C]--vfs-cache-min-free-size\f[R] note that the cache may exceed these-quotas for two reasons.+\f[C]--vfs-cache-min-free-space\f[R] note that the cache may exceed+these quotas for two reasons.Firstly because it is only checked every\f[C]--vfs-cache-poll-interval\f[R].Secondly because open files cannot be evicted from the cache.When \f[C]--vfs-cache-max-size\f[R] or-\f[C]--vfs-cache-min-free-size\f[R] is exceeded, rclone will attempt to+\f[C]--vfs-cache-min-free-space\f[R] is exceeded, rclone will attempt toevict the least accessed files from the cache first.rclone will start with files that haven\[aq]t been accessed for thelongest.@@ -15393,6 +16519,47 @@ filters so that the result is accurate.However, this is very inefficient and may cost lots of API callsresulting in extra charges.Use it as a last resort and only with caching.+.SS VFS Metadata+.PP+If you use the \f[C]--vfs-metadata-extension\f[R] flag you can get the+VFS to expose files which contain the+metadata (https://rclone.org/docs/#metadata) as a JSON blob.+These files will not appear in the directory listing, but can be+\f[C]stat\f[R]-ed and opened and once they have been they \f[B]will\f[R]+appear in directory listings until the directory cache expires.+.PP+Note that some backends won\[aq]t create metadata unless you pass in the+\f[C]--metadata\f[R] flag.+.PP+For example, using \f[C]rclone mount\f[R] with+\f[C]--metadata --vfs-metadata-extension .metadata\f[R] we get+.IP+.nf+\f[C]+$ ls -l /mnt/+total 1048577+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++$ cat /mnt/1G.metadata+{+ \[dq]atime\[dq]: \[dq]2025-03-04T17:34:22.317069787Z\[dq],+ \[dq]btime\[dq]: \[dq]2025-03-03T16:03:37.708253808Z\[dq],+ \[dq]gid\[dq]: \[dq]1000\[dq],+ \[dq]mode\[dq]: \[dq]100664\[dq],+ \[dq]mtime\[dq]: \[dq]2025-03-03T16:03:39.640238323Z\[dq],+ \[dq]uid\[dq]: \[dq]1000\[dq]+}++$ ls -l /mnt/+total 1048578+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+-rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata+\f[R]+.fi+.PP+If the file has no metadata it will be returned as \f[C]{}\f[R] and if+there is an error reading the metadata the error will be returned as+\f[C]{\[dq]error\[dq]:\[dq]error string\[dq]}\f[R]..SS Auth Proxy.PPIf you supply the parameter \f[C]--auth-proxy /path/to/program\f[R] then@@ -15527,6 +16694,7 @@ rclone serve sftp remote:path [flags]--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a \[aq].rclonelink\[aq] extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached (\[aq]off\[aq] is unlimited) (default off)@@ -15556,6 +16724,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly \[at]/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -15865,7 +17034,14 @@ You can either use an htpasswd file which can take lots of users, or seta single username and password with the \f[C]--user\f[R] and\f[C]--pass\f[R] flags..PP-If no static users are configured by either of the above methods, and+Alternatively, you can have the reverse proxy manage authentication and+use the username provided in the configured header with+\f[C]--user-from-header\f[R] (e.g.,+\f[C]----user-from-header=x-remote-user\f[R]).+Ensure the proxy is trusted and headers cannot be spoofed, as+misconfiguration may lead to unauthorized access.+.PP+If either of the above authentication methods is not configured andclient certificates are required by the \f[C]--client-ca\f[R] flagpassed to the server, the client certificate common name will beconsidered as the username.@@ -16013,13 +17189,13 @@ If rclone is quit or dies with files that haven\[aq]t been uploaded,these will be uploaded next time rclone is run with the same flags..PPIf using \f[C]--vfs-cache-max-size\f[R] or-\f[C]--vfs-cache-min-free-size\f[R] note that the cache may exceed these-quotas for two reasons.+\f[C]--vfs-cache-min-free-space\f[R] note that the cache may exceed+these quotas for two reasons.Firstly because it is only checked every\f[C]--vfs-cache-poll-interval\f[R].Secondly because open files cannot be evicted from the cache.When \f[C]--vfs-cache-max-size\f[R] or-\f[C]--vfs-cache-min-free-size\f[R] is exceeded, rclone will attempt to+\f[C]--vfs-cache-min-free-space\f[R] is exceeded, rclone will attempt toevict the least accessed files from the cache first.rclone will start with files that haven\[aq]t been accessed for thelongest.@@ -16411,6 +17587,47 @@ filters so that the result is accurate.However, this is very inefficient and may cost lots of API callsresulting in extra charges.Use it as a last resort and only with caching.+.SS VFS Metadata+.PP+If you use the \f[C]--vfs-metadata-extension\f[R] flag you can get the+VFS to expose files which contain the+metadata (https://rclone.org/docs/#metadata) as a JSON blob.+These files will not appear in the directory listing, but can be+\f[C]stat\f[R]-ed and opened and once they have been they \f[B]will\f[R]+appear in directory listings until the directory cache expires.+.PP+Note that some backends won\[aq]t create metadata unless you pass in the+\f[C]--metadata\f[R] flag.+.PP+For example, using \f[C]rclone mount\f[R] with+\f[C]--metadata --vfs-metadata-extension .metadata\f[R] we get+.IP+.nf+\f[C]+$ ls -l /mnt/+total 1048577+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G++$ cat /mnt/1G.metadata+{+ \[dq]atime\[dq]: \[dq]2025-03-04T17:34:22.317069787Z\[dq],+ \[dq]btime\[dq]: \[dq]2025-03-03T16:03:37.708253808Z\[dq],+ \[dq]gid\[dq]: \[dq]1000\[dq],+ \[dq]mode\[dq]: \[dq]100664\[dq],+ \[dq]mtime\[dq]: \[dq]2025-03-03T16:03:39.640238323Z\[dq],+ \[dq]uid\[dq]: \[dq]1000\[dq]+}++$ ls -l /mnt/+total 1048578+-rw-rw-r-- 1 user user 1073741824 Mar 3 16:03 1G+-rw-rw-r-- 1 user user 185 Mar 3 16:03 1G.metadata+\f[R]+.fi+.PP+If the file has no metadata it will be returned as \f[C]{}\f[R] and if+there is an error reading the metadata the error will be returned as+\f[C]{\[dq]error\[dq]:\[dq]error string\[dq]}\f[R]..SS Auth Proxy.PPIf you supply the parameter \f[C]--auth-proxy /path/to/program\f[R] then@@ -16514,12 +17731,12 @@ rclone serve webdav remote:path [flags].IP.nf\f[C]- --addr stringArray IPaddress:Port, :Port or [unix://]/path/to/socket to bind server to (default [127.0.0.1:8080])+ --addr stringArray IPaddress:Port or :Port to bind server to (default 127.0.0.1:8080)--allow-origin string Origin which cross-domain request (CORS) can be executed from--auth-proxy string A program to use to create the backend from the auth--baseurl string Prefix for URLs - leave blank for root- --cert string Path to TLS PEM public key certificate file (can also include intermediate/CA certificates)- --client-ca string Path to TLS PEM CA file with certificate authorities to verify clients with+ --cert string TLS PEM key (concatenation of certificate and CA certificate)+ --client-ca string Client certificate authority to verify clients with--dir-cache-time Duration Time to cache directory entries for (default 5m0s)--dir-perms FileMode Directory permissions (default 777)--disable-dir-list Disable HTML directory list on GET request for a directory@@ -16528,7 +17745,7 @@ rclone serve webdav remote:path [flags]--gid uint32 Override the gid field set by the filesystem (not supported on Windows) (default 1000)-h, --help help for webdav--htpasswd string A htpasswd file - if not provided no authentication is done- --key string Path to TLS PEM private key file+ --key string TLS PEM Private key--link-perms FileMode Link permissions (default 666)--max-header-bytes int Maximum size of request header (default 4096)--min-tls-version string Minimum TLS version that is acceptable (default \[dq]tls1.0\[dq])@@ -16546,6 +17763,7 @@ rclone serve webdav remote:path [flags]--uid uint32 Override the uid field set by the filesystem (not supported on Windows) (default 1000)--umask FileMode Override the permission bits set by the filesystem (not supported on Windows) (default 002)--user string User name for authentication+ --user-from-header string User name from a defined HTTP header--vfs-block-norm-dupes If duplicate filenames exist in the same directory (after normalization), log an error and hide the duplicates (may have a performance cost)--vfs-cache-max-age Duration Max time since last access of objects in the cache (default 1h0m0s)--vfs-cache-max-size SizeSuffix Max total size of objects in the cache (default off)@@ -16556,6 +17774,7 @@ rclone serve webdav remote:path [flags]--vfs-disk-space-total-size SizeSuffix Specify the total space of disk (default off)--vfs-fast-fingerprint Use fast (less accurate) fingerprints for change detection--vfs-links Translate symlinks to/from regular files with a \[aq].rclonelink\[aq] extension for the VFS+ --vfs-metadata-extension string Set the extension to read metadata from--vfs-read-ahead SizeSuffix Extra read ahead over --buffer-size when using cache-mode full--vfs-read-chunk-size SizeSuffix Read the source objects in chunks (default 128Mi)--vfs-read-chunk-size-limit SizeSuffix If greater than --vfs-read-chunk-size, double the chunk size after each chunk read, until the limit is reached (\[aq]off\[aq] is unlimited) (default off)@@ -16585,6 +17804,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly \[at]/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -16920,6 +18140,7 @@ If \f[C]--recursive\f[R] is used then recursively sets the modificationtime on all existing files that is found under the path.Filters are supported, and you can test with the \f[C]--dry-run\f[R] orthe \f[C]--interactive\f[R]/\f[C]-i\f[R] flag.+This will touch \f[C]--transfers\f[R] files concurrently..PPIf \f[C]--timestamp\f[R] is used then sets the modification time to thattime instead of the current time.@@ -16982,6 +18203,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly \[at]/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -17098,6 +18320,7 @@ Flags for filtering directory listings--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly \[at]/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -17806,6 +19029,11 @@ It is also possible to specify \f[C]--boolean=false\f[R] orNote that \f[C]--boolean false\f[R] is not valid - this is parsed as\f[C]--boolean\f[R] and the \f[C]false\f[R] is parsed as an extracommand line argument for rclone.+.PP+Options documented to take a \f[C]stringArray\f[R] parameter accept+multiple values.+To pass more than one value, repeat the option; for example:+\f[C]--include value1 --include value2\f[R]..SS Time or duration options.PPTIME or DURATION options can be specified as a duration string or a time@@ -18239,6 +19467,8 @@ passwd file), or else use the result from shell command.PPIf you run \f[C]rclone config file\f[R] you will see where the defaultlocation is for you.+Running \f[C]rclone config touch\f[R] will ensure a configuration file+exists, creating an empty one in the default location if there is none..PPThe fact that an existing file \f[C]rclone.conf\f[R] in the samedirectory as the rclone executable is always preferred, means that it is@@ -18249,7 +19479,15 @@ to a writable directory and then create an empty fileIf the location is set to empty string \f[C]\[dq]\[dq]\f[R] or path to afile with name \f[C]notfound\f[R], or the os null device represented byvalue \f[C]NUL\f[R] on Windows and \f[C]/dev/null\f[R] on Unix systems,-then rclone will keep the config file in memory only.+then rclone will keep the configuration file in memory only.+.PP+You may see a log message \[dq]Config file not found - using+defaults\[dq] if there is no configuration file.+This can be supressed, e.g.+if you are using rclone entirely with on the fly+remotes (https://rclone.org/docs/#backend-path-to-dir), by using+memory-only configuration file or by creating an empty configuration+file, as described above..PPThe file format is basicINI (https://en.wikipedia.org/wiki/INI_file#Format): Sections of text,@@ -18797,6 +20035,20 @@ supported backends and the VFS.There are individual flags for just enabling it for the VFS\f[C]--vfs-links\f[R] and the local backend \f[C]--local-links\f[R] ifrequired.+.SS --list-cutoff N+.PP+When syncing rclone needs to sort directory entries before comparing+them.+Below this threshold (1,000,000) by default, rclone will store the+directory entries in memory.+1,000,000 entries will take approx 1GB of RAM to store.+Above this threshold rclone will store directory entries on disk and+sort them without using a lot of memory.+.PP+Doing this is slightly less efficient then sorting them in memory and+will only work well for the bucket based backends (eg s3, b2, azureblob,+swift) but these are the only backends likely to have millions of+entries in a directory..SS --log-file=FILE.PPLog all of rclone\[aq]s output to FILE.@@ -18813,15 +20065,33 @@ as rclone doesn\[aq]t have a signal to rotate logs..SS --log-format LIST.PPComma separated list of log format options.-Accepted options are \f[C]date\f[R], \f[C]time\f[R],-\f[C]microseconds\f[R], \f[C]pid\f[R], \f[C]longfile\f[R],-\f[C]shortfile\f[R], \f[C]UTC\f[R].-Any other keywords will be silently ignored.-\f[C]pid\f[R] will tag log messages with process identifier which useful-with \f[C]rclone mount --daemon\f[R].-Other accepted options are explained in the go-documentation (https://pkg.go.dev/log#pkg-constants).-The default log format is \[dq]\f[C]date\f[R],\f[C]time\f[R]\[dq].+The accepted options are:+.IP \[bu] 2+\f[C]date\f[R] - Add a date in the format YYYY/MM/YY to the log.+.IP \[bu] 2+\f[C]time\f[R] - Add a time to the log in format HH:MM:SS.+.IP \[bu] 2+\f[C]microseconds\f[R] - Add microseconds to the time in format+HH:MM:SS.SSSSSS.+.IP \[bu] 2+\f[C]UTC\f[R] - Make the logs in UTC not localtime.+.IP \[bu] 2+\f[C]longfile\f[R] - Adds the source file and line number of the log+statement.+.IP \[bu] 2+\f[C]shortfile\f[R] - Adds the source file and line number of the log+statement.+.IP \[bu] 2+\f[C]pid\f[R] - Add the process ID to the log - useful with+\f[C]rclone mount --daemon\f[R].+.IP \[bu] 2+\f[C]nolevel\f[R] - Don\[aq]t add the level to the log.+.IP \[bu] 2+\f[C]json\f[R] - Equivalent to adding \f[C]--use-json-log\f[R]+.PP+They are added to the log line in the order above.+.PP+The default log format is \f[C]\[dq]date,time\[dq]\f[R]..SS --log-level LEVEL.PPThis sets the log level for rclone.@@ -18842,10 +20112,108 @@ It outputs warnings and significant events..PP\f[C]ERROR\f[R] is equivalent to \f[C]-q\f[R].It only outputs error messages.+.SS --windows-event-log LEVEL+.PP+If this is configured (the default is \f[C]OFF\f[R]) then logs of this+level and above will be logged to the Windows event log in+\f[B]addition\f[R] to the normal logs.+These will be logged in JSON format as described below regardless of+what format the main logs are configured for.+.PP+The Windows event log only has 3 levels of severity \f[C]Info\f[R],+\f[C]Warning\f[R] and \f[C]Error\f[R].+If enabled we map rclone levels like this.+.IP \[bu] 2+\f[C]Error\f[R] \[<-] \f[C]ERROR\f[R] (and above)+.IP \[bu] 2+\f[C]Warning\f[R] \[<-] \f[C]WARNING\f[R] (note that this level is+defined but not currently used).+.IP \[bu] 2+\f[C]Info\f[R] \[<-] \f[C]NOTICE\f[R], \f[C]INFO\f[R] and+\f[C]DEBUG\f[R].+.PP+Rclone will declare its log source as \[dq]rclone\[dq] if it is has+enough permissions to create the registry key needed.+If not then logs will appear as \[dq]Application\[dq].+You can run \f[C]rclone version --windows-event-log DEBUG\f[R] once as+administrator to create the registry key in advance.+.PP+\f[B]Note\f[R] that the \f[C]--windows-event-log\f[R] level must be+greater (more severe) than or equal to the \f[C]--log-level\f[R].+For example to log DEBUG to a log file but ERRORs to the event log you+would use+.IP+.nf+\f[C]+--log-file rclone.log --log-level DEBUG --windows-event-log ERROR+\f[R]+.fi+.PP+This option is only supported Windows platforms..SS --use-json-log.PPThis switches the log format to JSON for rclone.-The fields of json log are level, msg, source, time.+The fields of JSON log are \f[C]level\f[R], \f[C]msg\f[R],+\f[C]source\f[R], \f[C]time\f[R].+The JSON logs will be printed on a single line, but are shown expanded+here for clarity.+.IP+.nf+\f[C]+{+ \[dq]time\[dq]: \[dq]2025-05-13T17:30:51.036237518+01:00\[dq],+ \[dq]level\[dq]: \[dq]debug\[dq],+ \[dq]msg\[dq]: \[dq]4 go routines active\[rs]n\[dq],+ \[dq]source\[dq]: \[dq]cmd/cmd.go:298\[dq]+}+\f[R]+.fi+.PP+Completed data transfer logs will have extra \f[C]size\f[R] information.+Logs which are about a particular object will have \f[C]object\f[R] and+\f[C]objectType\f[R] fields also.+.IP+.nf+\f[C]+{+ \[dq]time\[dq]: \[dq]2025-05-13T17:38:05.540846352+01:00\[dq],+ \[dq]level\[dq]: \[dq]info\[dq],+ \[dq]msg\[dq]: \[dq]Copied (new) to: file2.txt\[dq],+ \[dq]size\[dq]: 6,+ \[dq]object\[dq]: \[dq]file.txt\[dq],+ \[dq]objectType\[dq]: \[dq]*local.Object\[dq],+ \[dq]source\[dq]: \[dq]operations/copy.go:368\[dq]+}+\f[R]+.fi+.PP+Stats logs will contain a \f[C]stats\f[R] field which is the same as+returned from the rc call+core/stats (https://rclone.org/rc/#core-stats).+.IP+.nf+\f[C]+{+ \[dq]time\[dq]: \[dq]2025-05-13T17:38:05.540912847+01:00\[dq],+ \[dq]level\[dq]: \[dq]info\[dq],+ \[dq]msg\[dq]: \[dq]...text version of the stats...\[dq],+ \[dq]stats\[dq]: {+ \[dq]bytes\[dq]: 6,+ \[dq]checks\[dq]: 0,+ \[dq]deletedDirs\[dq]: 0,+ \[dq]deletes\[dq]: 0,+ \[dq]elapsedTime\[dq]: 0.000904825,+ ...truncated for clarity...+ \[dq]totalBytes\[dq]: 6,+ \[dq]totalChecks\[dq]: 0,+ \[dq]totalTransfers\[dq]: 1,+ \[dq]transferTime\[dq]: 0.000882794,+ \[dq]transfers\[dq]: 1+ },+ \[dq]source\[dq]: \[dq]accounting/stats.go:569\[dq]+}+\f[R]+.fi.SS --low-level-retries NUMBER.PPThis controls the number of low level retries rclone does.@@ -18881,6 +20249,52 @@ the remote which may be desirable..PPSetting this to a negative number will make the backlog as large aspossible.+.SS --max-buffer-memory=SIZE+.PP+If set, don\[aq]t allocate more than SIZE amount of memory as buffers.+If not set or set to \f[C]0\f[R] or \f[C]off\f[R] this will not limit+the amount of memory in use.+.PP+This includes memory used by buffers created by the \f[C]--buffer\f[R]+flag and buffers used by multi-thread transfers.+.PP+Most multi-thread transfers do not take additional memory, but some do+depending on the backend (eg the s3 backend for uploads).+This means there is a tension between total setting+\f[C]--transfers\f[R] as high as possible and memory use.+.PP+Setting \f[C]--max-buffer-memory\f[R] allows the buffer memory to be+controlled so that it doesn\[aq]t overwhelm the machine and allows+\f[C]--transfers\f[R] to be set large.+.SS --max-connections=N+.PP+This sets the maximum number of concurrent calls to the backend API.+It may not map 1:1 to TCP or HTTP connections depending on the backend+in use and the use of HTTP1 vs HTTP2.+.PP+When downloading files, backends only limit the initial opening of the+stream.+The bulk data download is not counted as a connection.+This means that the \f[C]--max--connections\f[R] flag won\[aq]t limit+the total number of downloads.+.PP+Note that it is possible to cause deadlocks with this setting so it+should be used with care.+.PP+If you are doing a sync or copy then make sure+\f[C]--max-connections\f[R] is one more than the sum of+\f[C]--transfers\f[R] and \f[C]--checkers\f[R].+.PP+If you use \f[C]--check-first\f[R] then \f[C]--max-connections\f[R] just+needs to be one more than the maximum of \f[C]--checkers\f[R] and+\f[C]--transfers\f[R].+.PP+So for \f[C]--max-connections 3\f[R] you\[aq]d use+\f[C]--checkers 2 --transfers 2 --check-first\f[R] or+\f[C]--checkers 1 --transfers 1\f[R].+.PP+Setting this flag can be useful for backends which do multipart uploads+to limit the number of simultaneous parts being transferred..SS --max-delete=N.PPThis tells rclone not to delete more than N files.@@ -19172,6 +20586,17 @@ Multi thread transfers will be used with \f[C]rclone mount\f[R] and\f[C]rclone serve\f[R] if \f[C]--vfs-cache-mode\f[R] is set to\f[C]writes\f[R] or above..PP+Most multi-thread transfers do not take additional memory, but some do+(for example uploading to s3).+In the worst case memory usage can be at maximum \f[C]--transfers\f[R] *+\f[C]--multi-thread-chunk-size\f[R] \f[I]+\f[CI]--multi-thread-streams\f[I] or specifically for the s3 backend+\f[CI]--transfers\f[I] \f[R] \f[C]--s3-chunk-size\f[R] *+\f[C]--s3-concurrency\f[R].+However you can use the the+--max-buffer-memory (https://rclone.org/docs/#max-buffer-memory) flag to+control the maximum memory used here.+.PP\f[B]NB\f[R] that this \f[B]only\f[R] works with supported backends asthe destination but will work with any backend as the source..PP@@ -19196,6 +20621,15 @@ If the backend has a \f[C]--backend-upload-concurrency\f[R] setting (egnumber of transfers instead if it is larger than the value of\f[C]--multi-thread-streams\f[R] or \f[C]--multi-thread-streams\f[R]isn\[aq]t set.+.SS --name-transform COMMAND[=XXXX]+.PP+\f[C]--name-transform\f[R] introduces path name transformations for+\f[C]rclone copy\f[R], \f[C]rclone sync\f[R], and \f[C]rclone move\f[R].+These transformations enable modifications to source and destination+file names by applying prefixes, suffixes, and other alterations during+transfer operations.+For detailed docs and examples, see+\f[C]convmv\f[R] (https://rclone.org/commands/rclone_convmv/)..SS --no-check-dest.PPThe \f[C]--no-check-dest\f[R] can be used with \f[C]move\f[R] or@@ -20297,6 +21731,8 @@ For the filtering options.IP \[bu] 2\f[C]--max-age\f[R].IP \[bu] 2+\f[C]--hash-filter\f[R]+.IP \[bu] 2\f[C]--dump filters\f[R].IP \[bu] 2\f[C]--metadata-include\f[R]@@ -20455,8 +21891,8 @@ The options set by environment variables can be seen with the\f[C]rclone version -vv\f[R]..PPOptions that can appear multiple times (type \f[C]stringArray\f[R]) are-treated slighly differently as environment variables can only be defined-once.+treated slightly differently as environment variables can only be+defined once.In order to allow a simple mechanism for adding one or many items, theinput is treated as a CSV encoded (https://godoc.org/encoding/csv)string.@@ -21853,6 +23289,122 @@ E.g..PPSee the time option docs (https://rclone.org/docs/#time-option) forvalid formats.+.SS \f[C]--hash-filter\f[R] - Deterministically select a subset of files+.PP+The \f[C]--hash-filter\f[R] flag enables selecting a deterministic+subset of files, useful for:+.IP "1." 3+Running large sync operations across multiple machines.+.IP "2." 3+Checking a subset of files for bitrot.+.IP "3." 3+Any other operations where a sample of files is required.+.SS Syntax+.PP+The flag takes two parameters expressed as a fraction:+.IP+.nf+\f[C]+--hash-filter K/N+\f[R]+.fi+.IP \[bu] 2+\f[C]N\f[R]: The total number of partitions (must be a positive+integer).+.IP \[bu] 2+\f[C]K\f[R]: The specific partition to select (an integer from+\f[C]0\f[R] to \f[C]N\f[R]).+.PP+For example: - \f[C]--hash-filter 1/3\f[R]: Selects the first third of+the files.+- \f[C]--hash-filter 2/3\f[R] and \f[C]--hash-filter 3/3\f[R]: Select+the second and third partitions, respectively.+.PP+Each partition is non-overlapping, ensuring all files are covered+without duplication.+.SS Random Partition Selection+.PP+Use \f[C]\[at]\f[R] as \f[C]K\f[R] to randomly select a partition:+.IP+.nf+\f[C]+--hash-filter \[at]/M+\f[R]+.fi+.PP+For example, \f[C]--hash-filter \[at]/3\f[R] will randomly select a+number between 0 and 2.+This will stay constant across retries.+.SS How It Works+.IP \[bu] 2+Rclone takes each file\[aq]s full path, normalizes it to lowercase, and+applies Unicode normalization.+.IP \[bu] 2+It then hashes the normalized path into a 64 bit number.+.IP \[bu] 2+The hash result is reduced modulo \f[C]N\f[R] to assign the file to a+partition.+.IP \[bu] 2+If the calculated partition does not match \f[C]K\f[R] the file is+excluded.+.IP \[bu] 2+Other filters may apply if the file is not excluded.+.PP+\f[B]Important:\f[R] Rclone will traverse all directories to apply the+filter.+.SS Usage Notes+.IP \[bu] 2+Safe to use with \f[C]rclone sync\f[R]; source and destination+selections will match.+.IP \[bu] 2+\f[B]Do not\f[R] use with \f[C]--delete-excluded\f[R], as this could+delete unselected files.+.IP \[bu] 2+Ignored if \f[C]--files-from\f[R] is used.+.SS Examples+.SS Dividing files into 4 partitions+.PP+Assuming the current directory contains \f[C]file1.jpg\f[R] through+\f[C]file9.jpg\f[R]:+.IP+.nf+\f[C]+$ rclone lsf --hash-filter 0/4 .+file1.jpg+file5.jpg++$ rclone lsf --hash-filter 1/4 .+file3.jpg+file6.jpg+file9.jpg++$ rclone lsf --hash-filter 2/4 .+file2.jpg+file4.jpg++$ rclone lsf --hash-filter 3/4 .+file7.jpg+file8.jpg++$ rclone lsf --hash-filter 4/4 . # the same as --hash-filter 0/4+file1.jpg+file5.jpg+\f[R]+.fi+.SS Syncing the first quarter of files+.IP+.nf+\f[C]+rclone sync --hash-filter 1/4 source:path destination:path+\f[R]+.fi+.SS Checking a random 1% of files for integrity+.IP+.nf+\f[C]+rclone check --download --hash-filter \[at]/100 source:path destination:path+\f[R]+.fi.SS Other flags.SS \f[C]--delete-excluded\f[R] - Delete files on dest excluded from sync.PP@@ -22421,8 +23973,23 @@ If you wish to set config (the equivalent of the global flags) for theduration of an rc call only then pass in the \f[C]_config\f[R]parameter..PP-This should be in the same format as the \f[C]config\f[R] key returned-by options/get.+This should be in the same format as the \f[C]main\f[R] key returned by+options/get.+.IP+.nf+\f[C]+rclone rc --loopback options/get blocks=main+\f[R]+.fi+.PP+You can see more help on these options with this command (see the+options blocks section for more info).+.IP+.nf+\f[C]+rclone rc --loopback options/info blocks=main+\f[R]+.fi.PPFor example, if you wished to run a sync with the \f[C]--checksum\f[R]parameter, you would pass this parameter in your JSON blob.@@ -22466,6 +24033,21 @@ in the \f[C]_filter\f[R] parameter..PPThis should be in the same format as the \f[C]filter\f[R] key returnedby options/get.+.IP+.nf+\f[C]+rclone rc --loopback options/get blocks=filter+\f[R]+.fi+.PP+You can see more help on these options with this command (see the+options blocks section for more info).+.IP+.nf+\f[C]+rclone rc --loopback options/info blocks=filter+\f[R]+.fi.PPFor example, if you wished to run a sync with these flags.IP@@ -22602,7 +24184,8 @@ stringT}@T{NT}@T{-name of the field used in the rc - if blank use Name+name of the field used in the rc - if blank use Name.+May contain \[dq].\[dq] for nested fields.T}T{Help@@ -22971,6 +24554,8 @@ obscure - declare passwords are plain and need obscuringnoObscure - declare passwords are already obscured and don\[aq]t needobscuring.IP \[bu] 2+noOutput - don\[aq]t print anything to stdout+.IP \[bu] 2nonInteractive - don\[aq]t interact with a user, return questions.IP \[bu] 2continue - continue the config process with an answer@@ -23101,6 +24686,8 @@ obscure - declare passwords are plain and need obscuringnoObscure - declare passwords are already obscured and don\[aq]t needobscuring.IP \[bu] 2+noOutput - don\[aq]t print anything to stdout+.IP \[bu] 2nonInteractive - don\[aq]t interact with a user, return questions.IP \[bu] 2continue - continue the config process with an answer@@ -23325,7 +24912,10 @@ returned..PPParameters.IP \[bu] 2-group - name of the stats group (string)+group - name of the stats group (string, optional)+.IP \[bu] 2+short - if true will not return the transferring and checking arrays+(boolean, optional).PPReturns the following values:.IP@@ -23341,6 +24931,7 @@ Returns the following values:\[dq]fatalError\[dq]: boolean whether there has been at least one fatal error,\[dq]lastError\[dq]: last error string,\[dq]renames\[dq] : number of files renamed,+ \[dq]listed\[dq] : number of directory entries listed,\[dq]retryError\[dq]: boolean showing whether there has been at least one non-NoRetryError,\[dq]serverSideCopies\[dq]: number of server side copies done,\[dq]serverSideCopyBytes\[dq]: number bytes server side copied,@@ -24531,6 +26122,172 @@ It can be used to check that rclone is still alive and to check thatparameter passing is working properly..PP\f[B]Authentication is required for this call.\f[R]+.SS serve/list: Show running servers+.PP+Show running servers with IDs.+.PP+This takes no parameters and returns+.IP \[bu] 2+list: list of running serve commands+.PP+Each list element will have+.IP \[bu] 2+id: ID of the server+.IP \[bu] 2+addr: address the server is running on+.IP \[bu] 2+params: parameters used to start the server+.PP+Eg+.IP+.nf+\f[C]+rclone rc serve/list+\f[R]+.fi+.PP+Returns+.IP+.nf+\f[C]+{+ \[dq]list\[dq]: [+ {+ \[dq]addr\[dq]: \[dq][::]:4321\[dq],+ \[dq]id\[dq]: \[dq]nfs-ffc2a4e5\[dq],+ \[dq]params\[dq]: {+ \[dq]fs\[dq]: \[dq]remote:\[dq],+ \[dq]opt\[dq]: {+ \[dq]ListenAddr\[dq]: \[dq]:4321\[dq]+ },+ \[dq]type\[dq]: \[dq]nfs\[dq],+ \[dq]vfsOpt\[dq]: {+ \[dq]CacheMode\[dq]: \[dq]full\[dq]+ }+ }+ }+ ]+}+\f[R]+.fi+.PP+\f[B]Authentication is required for this call.\f[R]+.SS serve/start: Create a new server+.PP+Create a new server with the specified parameters.+.PP+This takes the following parameters:+.IP \[bu] 2+\f[C]type\f[R] - type of server: \f[C]http\f[R], \f[C]webdav\f[R],+\f[C]ftp\f[R], \f[C]sftp\f[R], \f[C]nfs\f[R], etc.+.IP \[bu] 2+\f[C]fs\f[R] - remote storage path to serve+.IP \[bu] 2+\f[C]addr\f[R] - the ip:port to run the server on, eg \[dq]:1234\[dq] or+\[dq]localhost:1234\[dq]+.PP+Other parameters are as described in the documentation for the relevant+rclone serve (https://rclone.org/commands/rclone_serve/) command line+options.+To translate a command line option to an rc parameter, remove the+leading \f[C]--\f[R] and replace \f[C]-\f[R] with \f[C]_\f[R], so+\f[C]--vfs-cache-mode\f[R] becomes \f[C]vfs_cache_mode\f[R].+Note that global parameters must be set with \f[C]_config\f[R] and+\f[C]_filter\f[R] as described above.+.PP+Examples:+.IP+.nf+\f[C]+rclone rc serve/start type=nfs fs=remote: addr=:4321 vfs_cache_mode=full+rclone rc serve/start --json \[aq]{\[dq]type\[dq]:\[dq]nfs\[dq],\[dq]fs\[dq]:\[dq]remote:\[dq],\[dq]addr\[dq]:\[dq]:1234\[dq],\[dq]vfs_cache_mode\[dq]:\[dq]full\[dq]}\[aq]+\f[R]+.fi+.PP+This will give the reply+.IP+.nf+\f[C]+{+ \[dq]addr\[dq]: \[dq][::]:4321\[dq], // Address the server was started on+ \[dq]id\[dq]: \[dq]nfs-ecfc6852\[dq] // Unique identifier for the server instance+}+\f[R]+.fi+.PP+Or an error if it failed to start.+.PP+Stop the server with \f[C]serve/stop\f[R] and list the running servers+with \f[C]serve/list\f[R].+.PP+\f[B]Authentication is required for this call.\f[R]+.SS serve/stop: Unserve selected active serve+.PP+Stops a running \f[C]serve\f[R] instance by ID.+.PP+This takes the following parameters:+.IP \[bu] 2+id: as returned by serve/start+.PP+This will give an empty response if successful or an error if not.+.PP+Example:+.IP+.nf+\f[C]+rclone rc serve/stop id=12345+\f[R]+.fi+.PP+\f[B]Authentication is required for this call.\f[R]+.SS serve/stopall: Stop all active servers+.PP+Stop all active servers.+.PP+This will stop all active servers.+.IP+.nf+\f[C]+rclone rc serve/stopall+\f[R]+.fi+.PP+\f[B]Authentication is required for this call.\f[R]+.SS serve/types: Show all possible serve types+.PP+This shows all possible serve types and returns them as a list.+.PP+This takes no parameters and returns+.IP \[bu] 2+types: list of serve types, eg \[dq]nfs\[dq], \[dq]sftp\[dq], etc+.PP+The serve types are strings like \[dq]serve\[dq], \[dq]serve2\[dq],+\[dq]cserve\[dq] and can be passed to serve/start as the serveType+parameter.+.PP+Eg+.IP+.nf+\f[C]+rclone rc serve/types+\f[R]+.fi+.PP+Returns+.IP+.nf+\f[C]+{+ \[dq]types\[dq]: [+ \[dq]http\[dq],+ \[dq]sftp\[dq],+ \[dq]nfs\[dq]+ ]+}+\f[R]+.fi+.PP+\f[B]Authentication is required for this call.\f[R].SS sync/bisync: Perform bidirectional synchronization between two paths..PPThis takes the following parameters@@ -24731,7 +26488,7 @@ return an empty result.\f[R].fi.PP-The \f[C]expiry\f[R] time is the time until the file is elegible for+The \f[C]expiry\f[R] time is the time until the file is eligible forbeing uploaded in floating point seconds.This may go negative.As rclone only transfers \f[C]--transfers\f[R] files at once, only the@@ -25288,6 +27045,21 @@ T}@T{-T}T{+FileLu Cloud Storage+T}@T{+MD5+T}@T{+R/W+T}@T{+No+T}@T{+Yes+T}@T{+R+T}@T{+-+T}+T{Files.comT}@T{MD5, CRC32@@ -28363,6 +30135,7 @@ Flags for anything which can copy a file.--multi-thread-cutoff SizeSuffix Use multi-thread downloads for files above this size (default 256Mi)--multi-thread-streams int Number of streams to use for multi-thread downloads (default 4)--multi-thread-write-buffer-size SizeSuffix In memory buffer size for writing when in multi-thread mode (default 128Ki)+ --name-transform stringArray Transform paths during the copy process--no-check-dest Don\[aq]t check the destination, copy regardless--no-traverse Don\[aq]t traverse destination file system on copy--no-update-dir-modtime Don\[aq]t update directory modification times@@ -28388,6 +30161,7 @@ Flags used for sync commands.--delete-during When synchronizing, delete files during transfer--fix-case Force rename of case insensitive dest to match source--ignore-errors Delete even if there are I/O errors+ --list-cutoff int To save memory, sort directory listings on disk above this threshold (default 1000000)--max-delete int When synchronizing, limit the number of deletes (default -1)--max-delete-size SizeSuffix When synchronizing, limit the total size of deletes (default off)--suffix string Suffix to add to changed files@@ -28436,13 +30210,14 @@ Flags for general networking and HTTP stuff.--header stringArray Set HTTP header for all transactions--header-download stringArray Set HTTP header for download transactions--header-upload stringArray Set HTTP header for upload transactions+ --max-connections int Maximum number of simultaneous backend API connections, 0 for unlimited--no-check-certificate Do not verify the server SSL certificate (insecure)--no-gzip-encoding Don\[aq]t set Accept-Encoding: gzip--timeout Duration IO idle timeout (default 5m0s)--tpslimit float Limit HTTP transactions per second to this--tpslimit-burst int Max burst of transactions for --tpslimit (default 1)--use-cookies Enable session cookiejar- --user-agent string Set the user-agent to a specified string (default \[dq]rclone/v1.69.0\[dq])+ --user-agent string Set the user-agent to a specified string (default \[dq]rclone/v1.70.0\[dq])\f[R].fi.SS Performance@@ -28477,6 +30252,7 @@ Flags for general configuration of rclone.-i, --interactive Enable interactive mode--kv-lock-time Duration Maximum time to keep key-value database locked by process (default 1s)--low-level-retries int Number of low level retries to do (default 10)+ --max-buffer-memory SizeSuffix If set, don\[aq]t allocate more than this amount of memory as buffers (default off)--no-console Hide console window (supported on Windows only)--no-unicode-normalization Don\[aq]t normalize unicode characters in filenames--password-command SpaceSepList Command for supplying password for encrypted configuration@@ -28514,6 +30290,7 @@ Flags for filtering directory listings.--files-from-raw stringArray Read list of source-file names from file without any processing of lines (use - to read from stdin)-f, --filter stringArray Add a file filtering rule--filter-from stringArray Read file filtering patterns from a file (use - to read from stdin)+ --hash-filter string Partition filenames by hash k/n or randomly \[at]/n--ignore-case Ignore case in filters (case insensitive)--include stringArray Include files matching pattern--include-from stringArray Read file include patterns from file (use - to read from stdin)@@ -28547,7 +30324,7 @@ Flags for logging and statistics..nf\f[C]--log-file string Log everything to this file- --log-format string Comma separated list of log format options (default \[dq]date,time\[dq])+ --log-format Bits Comma separated list of log format options (default date,time)--log-level LogLevel Log level DEBUG|INFO|NOTICE|ERROR (default NOTICE)--log-systemd Activate systemd integration for the logger--max-stats-groups int Maximum number of stats groups to keep in memory, on max oldest is discarded (default 1000)@@ -28614,6 +30391,7 @@ Flags to control the Remote Control API.--rc-server-write-timeout Duration Timeout for server writing data (default 1h0m0s)--rc-template string User-specified template--rc-user string User name for authentication+ --rc-user-from-header string User name from a defined HTTP header--rc-web-fetch-url string URL to fetch the releases for webgui (default \[dq]https://api.github.com/repos/rclone/rclone-webui-react/releases/latest\[dq])--rc-web-gui Launch WebGUI on localhost--rc-web-gui-force-update Force update to latest version of web gui@@ -28643,6 +30421,7 @@ Flags to control the Metrics HTTP endpoint..--metrics-server-write-timeout Duration Timeout for server writing data (default 1h0m0s)--metrics-template string User-specified template--metrics-user string User name for authentication+ --metrics-user-from-header string User name from a defined HTTP header--rc-enable-metrics Enable the Prometheus metrics path at the remote control server\f[R].fi@@ -28663,6 +30442,8 @@ Backend-only flags (these can be set in the config file also).--azureblob-client-id string The ID of the client in use--azureblob-client-secret string One of the service principal\[aq]s client secrets--azureblob-client-send-certificate-chain Send the certificate chain when using certificate auth+ --azureblob-copy-concurrency int Concurrency for multipart copy (default 512)+ --azureblob-copy-cutoff SizeSuffix Cutoff for switching to multipart copy (default 8Mi)--azureblob-delete-snapshots string Set to specify how to deal with snapshots on blob deletion--azureblob-description string Description of the remote--azureblob-directory-markers Upload an empty object with a trailing slash when a new directory is created@@ -28686,6 +30467,7 @@ Backend-only flags (these can be set in the config file also).--azureblob-upload-concurrency int Concurrency for multipart uploads (default 16)--azureblob-upload-cutoff string Cutoff for switching to chunked upload (<= 256 MiB) (deprecated)--azureblob-use-az Use Azure CLI tool az for authentication+ --azureblob-use-copy-blob Whether to use the Copy Blob API when copying to the same storage account (default true)--azureblob-use-emulator Uses local storage emulator if provided as \[aq]true\[aq]--azureblob-use-msi Use a managed service identity to authenticate (only works in Azure)--azureblob-username string User name (usually an email address)@@ -28698,6 +30480,7 @@ Backend-only flags (these can be set in the config file also).--azurefiles-client-send-certificate-chain Send the certificate chain when using certificate auth--azurefiles-connection-string string Azure Files Connection String--azurefiles-description string Description of the remote+ --azurefiles-disable-instance-discovery Skip requesting Microsoft Entra instance metadata--azurefiles-encoding Encoding The encoding for the backend (default Slash,LtGt,DoubleQuote,Colon,Question,Asterisk,Pipe,BackSlash,Del,Ctl,RightPeriod,InvalidUtf8,Dot)--azurefiles-endpoint string Endpoint for the service--azurefiles-env-auth Read credentials from runtime (environment variables, CLI or MSI)@@ -28712,6 +30495,7 @@ Backend-only flags (these can be set in the config file also).--azurefiles-share-name string Azure Files Share Name--azurefiles-tenant string ID of the service principal\[aq]s tenant. Also called its directory ID--azurefiles-upload-concurrency int Concurrency for multipart uploads (default 16)+ --azurefiles-use-az Use Azure CLI tool az for authentication--azurefiles-use-msi Use a managed service identity to authenticate (only works in Azure)--azurefiles-username string User name (usually an email address)--b2-account string Account ID or Application Key ID@@ -28774,12 +30558,14 @@ Backend-only flags (these can be set in the config file also).--chunker-fail-hard Choose how chunker should handle files with missing or invalid chunks--chunker-hash-type string Choose how chunker handles hash sums (default \[dq]md5\[dq])--chunker-remote string Remote to chunk/unchunk+ --cloudinary-adjust-media-files-extensions Cloudinary handles media formats as a file attribute and strips it from the name, which is unlike most other file systems (default true)--cloudinary-api-key string Cloudinary API Key--cloudinary-api-secret string Cloudinary API Secret--cloudinary-cloud-name string Cloudinary Environment Name--cloudinary-description string Description of the remote--cloudinary-encoding Encoding The encoding for the backend (default Slash,LtGt,DoubleQuote,Question,Asterisk,Pipe,Hash,Percent,BackSlash,Del,Ctl,RightSpace,InvalidUtf8,Dot)--cloudinary-eventually-consistent-delay Duration Wait N seconds for eventual consistency of the databases that support the backend operation (default 0s)+ --cloudinary-media-extensions stringArray Cloudinary supported media extensions (default 3ds,3g2,3gp,ai,arw,avi,avif,bmp,bw,cr2,cr3,djvu,dng,eps3,fbx,flif,flv,gif,glb,gltf,hdp,heic,heif,ico,indd,jp2,jpe,jpeg,jpg,jxl,jxr,m2ts,mov,mp4,mpeg,mts,mxf,obj,ogv,pdf,ply,png,psd,svg,tga,tif,tiff,ts,u3ma,usdz,wdp,webm,webp,wmv)--cloudinary-upload-prefix string Specify the API endpoint for environments out of the US--cloudinary-upload-preset string Upload Preset to select asset manipulation on upload--combine-description string Description of the remote@@ -28803,6 +30589,10 @@ Backend-only flags (these can be set in the config file also).--crypt-show-mapping For all files listed show how the names encrypt--crypt-strict-names If set, this will raise an error when crypt comes across a filename that can\[aq]t be decrypted--crypt-suffix string If this is set it will override the default suffix of \[dq].bin\[dq] (default \[dq].bin\[dq])+ --doi-description string Description of the remote+ --doi-doi string The DOI or the doi.org URL+ --doi-doi-resolver-api-url string The URL of the DOI resolver API to use+ --doi-provider string DOI provider--drive-acknowledge-abuse Set to allow files which return cannotDownloadAbusiveFile to be downloaded--drive-allow-import-name-change Allow the filetype to change when uploading Google docs--drive-auth-owner-only Only consider files owned by the authenticated user@@ -28854,7 +30644,6 @@ Backend-only flags (these can be set in the config file also).--drive-use-trash Send files to the trash instead of deleting permanently (default true)--drive-v2-download-min-size SizeSuffix If Object\[aq]s are greater, use drive v2 API to download (default off)--dropbox-auth-url string Auth server URL- --dropbox-batch-commit-timeout Duration Max time to wait for a batch to finish committing (default 10m0s)--dropbox-batch-mode string Upload file batching sync|async|off (default \[dq]sync\[dq])--dropbox-batch-size int Max number of files in upload batch--dropbox-batch-timeout Duration Max time to allow an idle upload batch before uploading (default 0s)@@ -28864,11 +30653,14 @@ Backend-only flags (these can be set in the config file also).--dropbox-client-secret string OAuth Client Secret--dropbox-description string Description of the remote--dropbox-encoding Encoding The encoding for the backend (default Slash,BackSlash,Del,RightSpace,InvalidUtf8,Dot)+ --dropbox-export-formats CommaSepList Comma separated list of preferred formats for exporting files (default html,md)--dropbox-impersonate string Impersonate this user when using a business account--dropbox-pacer-min-sleep Duration Minimum time to sleep between API calls (default 10ms)--dropbox-root-namespace string Specify a different Dropbox namespace ID to use as the root for all paths--dropbox-shared-files Instructs rclone to work on individual shared files--dropbox-shared-folders Instructs rclone to work on shared folders+ --dropbox-show-all-exports Show all exportable files in listings+ --dropbox-skip-exports Skip exportable files in all listings--dropbox-token string OAuth Access Token as a JSON blob--dropbox-token-url string Token server url--fichier-api-key string Your API Key, get it from https://1fichier.com/console/params.pl@@ -28886,6 +30678,9 @@ Backend-only flags (these can be set in the config file also).--filefabric-token-expiry string Token expiry time--filefabric-url string URL of the Enterprise File Fabric to connect to--filefabric-version string Version read from the file fabric+ --filelu-description string Description of the remote+ --filelu-encoding Encoding The encoding for the backend (default Slash,LtGt,DoubleQuote,SingleQuote,BackQuote,Dollar,Colon,Question,Asterisk,Pipe,Hash,Percent,BackSlash,CrLf,Del,Ctl,LeftSpace,LeftPeriod,LeftTilde,LeftCrLfHtVt,RightSpace,RightPeriod,RightCrLfHtVt,InvalidUtf8,Dot,SquareBracket,Semicolon,Exclamation)+ --filelu-key string Your FileLu Rclone key from My Account--filescom-api-key string The API key used to authenticate with Files.com--filescom-description string Description of the remote--filescom-encoding Encoding The encoding for the backend (default Slash,BackSlash,Del,Ctl,RightSpace,RightCrLfHtVt,InvalidUtf8,Dot)@@ -28945,7 +30740,6 @@ Backend-only flags (these can be set in the config file also).--gofile-list-chunk int Number of items to list in each call (default 1000)--gofile-root-folder-id string ID of the root folder--gphotos-auth-url string Auth server URL- --gphotos-batch-commit-timeout Duration Max time to wait for a batch to finish committing (default 10m0s)--gphotos-batch-mode string Upload file batching sync|async|off (default \[dq]sync\[dq])--gphotos-batch-size int Max number of files in upload batch--gphotos-batch-timeout Duration Max time to allow an idle upload batch before uploading (default 0s)@@ -29013,6 +30807,8 @@ Backend-only flags (these can be set in the config file also).--internetarchive-encoding Encoding The encoding for the backend (default Slash,LtGt,CrLf,Del,Ctl,InvalidUtf8,Dot)--internetarchive-endpoint string IAS3 Endpoint (default \[dq]https://s3.us.archive.org\[dq])--internetarchive-front-endpoint string Host of InternetArchive Frontend (default \[dq]https://archive.org\[dq])+ --internetarchive-item-derive Whether to trigger derive on the IA item or not. If set to false, the item will not be derived by IA upon upload (default true)+ --internetarchive-item-metadata stringArray Metadata to be set on the IA item, this is different from file-level metadata that can be set using --metadata-set--internetarchive-secret-access-key string IAS3 Secret Key (password)--internetarchive-wait-archive Duration Timeout for waiting the server\[aq]s processing tasks (specifically archive and book_op) to finish (default 0s)--jottacloud-auth-url string Auth server URL@@ -29108,6 +30904,7 @@ Backend-only flags (these can be set in the config file also).--onedrive-tenant string ID of the service principal\[aq]s tenant. Also called its directory ID--onedrive-token string OAuth Access Token as a JSON blob--onedrive-token-url string Token server url+ --onedrive-upload-cutoff SizeSuffix Cutoff for switching to chunked upload (default off)--oos-attempt-resume-upload If true attempt to resume previously started multipart upload for the object--oos-chunk-size SizeSuffix Chunk size to use for uploading (default 5Mi)--oos-compartment string Specify compartment OCID, if you need to list buckets@@ -29133,6 +30930,7 @@ Backend-only flags (these can be set in the config file also).--oos-storage-tier string The storage class to use when storing new objects in storage. https://docs.oracle.com/en-us/iaas/Content/Object/Concepts/understandingstoragetiers.htm (default \[dq]Standard\[dq])--oos-upload-concurrency int Concurrency for multipart uploads (default 10)--oos-upload-cutoff SizeSuffix Cutoff for switching to chunked upload (default 200Mi)+ --opendrive-access string Files and folders will be uploaded with this access permission (default private) (default \[dq]private\[dq])--opendrive-chunk-size SizeSuffix Files will be uploaded in chunks this size (default 10Mi)--opendrive-description string Description of the remote--opendrive-encoding Encoding The encoding for the backend (default Slash,LtGt,DoubleQuote,Colon,Question,Asterisk,Pipe,BackSlash,LeftSpace,LeftCrLfHtVt,RightSpace,RightCrLfHtVt,InvalidUtf8,Dot)@@ -29229,6 +31027,8 @@ Backend-only flags (these can be set in the config file also).--s3-endpoint string Endpoint for S3 API--s3-env-auth Get AWS credentials from runtime (environment variables or EC2/ECS meta data if no env vars)--s3-force-path-style If true use path style access if false use virtual hosted style (default true)+ --s3-ibm-api-key string IBM API Key to be used to obtain IAM token+ --s3-ibm-resource-instance-id string IBM service instance id--s3-leave-parts-on-error If true avoid calling abort upload on a failure, leaving all successfully uploaded parts on S3 for manual recovery--s3-list-chunk int Size of listing chunk (response list for each ListObject S3 request) (default 1000)--s3-list-url-encode Tristate Whether to url encode listings: true/false/unset (default unset)@@ -29249,6 +31049,7 @@ Backend-only flags (these can be set in the config file also).--s3-server-side-encryption string The server-side encryption algorithm used when storing this object in S3--s3-session-token string An AWS session token--s3-shared-credentials-file string Path to the shared credentials file+ --s3-sign-accept-encoding Tristate Set if rclone should include Accept-Encoding as part of the signature (default unset)--s3-sse-customer-algorithm string If using SSE-C, the server-side encryption algorithm used when storing this object in S3--s3-sse-customer-key string To use SSE-C you may provide the secret encryption key used to encrypt/decrypt your data--s3-sse-customer-key-base64 string If using SSE-C you must provide the secret encryption key encoded in base64 format to encrypt/decrypt your data@@ -29265,6 +31066,7 @@ Backend-only flags (these can be set in the config file also).--s3-use-multipart-uploads Tristate Set if rclone should use multipart uploads (default unset)--s3-use-presigned-request Whether to use a presigned request or PutObject for single part uploads--s3-use-unsigned-payload Tristate Whether to use an unsigned payload in PutObject (default unset)+ --s3-use-x-id Tristate Set if rclone should add x-id URL parameters (default unset)--s3-v2-auth If true use v2 authentication--s3-version-at Time Show file versions as they were at the specified time (default off)--s3-version-deleted Show deleted file markers when using versions@@ -29290,6 +31092,7 @@ Backend-only flags (these can be set in the config file also).--sftp-disable-hashcheck Disable the execution of SSH commands to determine if remote file hashing is available--sftp-host string SSH host to connect to--sftp-host-key-algorithms SpaceSepList Space separated list of host key algorithms, ordered by preference+ --sftp-http-proxy string URL for HTTP CONNECT proxy--sftp-idle-timeout Duration Max time before closing idle connections (default 1m0s)--sftp-key-exchange SpaceSepList Space separated list of key exchange algorithms, ordered by preference--sftp-key-file string Path to PEM-encoded private key file@@ -29344,6 +31147,7 @@ Backend-only flags (these can be set in the config file also).--smb-pass string SMB password (obscured)--smb-port int SMB port number (default 445)--smb-spn string Service principal name+ --smb-use-kerberos Use Kerberos authentication--smb-user string SMB username (default \[dq]$USER\[dq])--storj-access-grant string Access grant--storj-api-key string API key@@ -29489,7 +31293,7 @@ should be installed on host:.IP.nf\f[C]-sudo apt-get -y install fuse+sudo apt-get -y install fuse3\f[R].fi.PP@@ -30761,7 +32565,7 @@ See the bisync filters section and generic--filter-from (https://rclone.org/filtering/#filter-from-read-filtering-patterns-from-a-file)documentation.An example filters file contains filters for non-allowed files for-synching with Dropbox.+syncing with Dropbox..PPIf you make changes to your filters file then bisync requires a run with\f[C]--resync\f[R].@@ -30987,7 +32791,7 @@ reduce the sync run times for very large numbers of files..PPThe check may be run manually with \f[C]--check-sync=only\f[R].It runs only the integrity check and terminates without actually-synching.+syncing..PPNote that currently, \f[C]--check-sync\f[R] \f[B]only checks listingsnapshots and NOT the actual files on the remotes.\f[R] Note also that@@ -31701,7 +33505,7 @@ flags are also supported..SS How to filter directories.PPFiltering portions of the directory tree is a critical feature for-synching.+syncing..PPExamples of directory trees (always beneath the Path1/Path2 root level)you may want to exclude from your sync: - Directory trees containing@@ -31859,7 +33663,7 @@ This noise can be quashed by adding \f[C]--quiet\f[R] to the bisynccommand line..SS Example exclude-style filters files for use with Dropbox.IP \[bu] 2-Dropbox disallows synching the listed temporary and configuration/data+Dropbox disallows syncing the listed temporary and configuration/datafiles.The \[ga]- \[ga] filters exclude these files where ever they may occurin the sync tree.@@ -32246,7 +34050,7 @@ single \f[C]-\f[R] or double dash..SS Running tests.IP \[bu] 2\f[C]go test . -case basic -remote local -remote2 local\f[R] runs the-\f[C]test_basic\f[R] test case using only the local filesystem, synching+\f[C]test_basic\f[R] test case using only the local filesystem, syncingone local directory with another local directory.Test script output is to the console, while commands within scenario.txthave their output sent to the \f[C].../workdir/test.log\f[R] file, which@@ -32579,6 +34383,10 @@ Also note a number of academic publications by BenjaminPierce (http://www.cis.upenn.edu/%7Ebcpierce/papers/index.shtml#File%20Synchronization)about \f[I]Unison\f[R] and synchronization in general..SS Changelog+.SS \f[C]v1.69.1\f[R]+.IP \[bu] 2+Fixed an issue causing listings to not capture concurrent modifications+under certain conditions.SS \f[C]v1.68\f[R].IP \[bu] 2Fixed an issue affecting backends that round modtimes to a lower@@ -33381,12 +35189,16 @@ Linode Object Storage.IP \[bu] 2Magalu Object Storage.IP \[bu] 2+MEGA S4 Object Storage+.IP \[bu] 2Minio.IP \[bu] 2Outscale.IP \[bu] 2Petabox.IP \[bu] 2+Pure Storage FlashBlade+.IP \[bu] 2Qiniu Cloud Object Storage (Kodo).IP \[bu] 2RackCorp Object Storage@@ -34293,7 +36105,7 @@ It assumes that \f[C]USER_NAME\f[R] has been created.The Resource entry must include both resource ARNs, as one implies thebucket and the other implies the bucket\[aq]s objects..IP "3." 3-When using s3-no-check-bucket and the bucket already exsits, the+When using s3-no-check-bucket and the bucket already exists, the\f[C]\[dq]arn:aws:s3:::BUCKET_NAME\[dq]\f[R] doesn\[aq]t have to beincluded..PP@@ -34324,7 +36136,8 @@ error like below..PPIn this case you need torestore (http://docs.aws.amazon.com/AmazonS3/latest/user-guide/restore-archived-objects.html)-the object(s) in question before using rclone.+the object(s) in question before accessing object contents.+The restore section below shows how to do this with rclone..PPNote that rclone only speaks the S3 API it does not speak the GlacierVault API, so rclone cannot directly access Glacier Vaults.@@ -34347,10 +36160,11 @@ all the files to be uploaded as multipart..PPHere are the Standard options specific to s3 (Amazon S3 CompliantStorage Providers including AWS, Alibaba, ArvanCloud, Ceph, ChinaMobile,-Cloudflare, DigitalOcean, Dreamhost, GCS, HuaweiOBS, IBMCOS, IDrive,-IONOS, LyveCloud, Leviia, Liara, Linode, Magalu, Minio, Netease,-Outscale, Petabox, RackCorp, Rclone, Scaleway, SeaweedFS, Selectel,-StackPath, Storj, Synology, TencentCOS, Wasabi, Qiniu and others).+Cloudflare, DigitalOcean, Dreamhost, Exaba, FlashBlade, GCS, HuaweiOBS,+IBMCOS, IDrive, IONOS, LyveCloud, Leviia, Liara, Linode, Magalu, Mega,+Minio, Netease, Outscale, Petabox, RackCorp, Rclone, Scaleway,+SeaweedFS, Selectel, StackPath, Storj, Synology, TencentCOS, Wasabi,+Qiniu and others)..SS --s3-provider.PPChoose your S3 provider.@@ -34416,6 +36230,18 @@ DigitalOcean SpacesDreamhost DreamObjects.RE.IP \[bu] 2+\[dq]Exaba\[dq]+.RS 2+.IP \[bu] 2+Exaba Object Storage+.RE+.IP \[bu] 2+\[dq]FlashBlade\[dq]+.RS 2+.IP \[bu] 2+Pure Storage FlashBlade Object Storage+.RE+.IP \[bu] 2\[dq]GCS\[dq].RS 2.IP \[bu] 2@@ -34476,6 +36302,12 @@ Linode Object StorageMagalu Object Storage.RE.IP \[bu] 2+\[dq]Mega\[dq]+.RS 2+.IP \[bu] 2+MEGA S4 Object Storage+.RE+.IP \[bu] 2\[dq]Minio\[dq].RS 2.IP \[bu] 2@@ -35079,7 +36911,7 @@ Config: acl.IP \[bu] 2Env Var: RCLONE_S3_ACL.IP \[bu] 2-Provider: !Storj,Selectel,Synology,Cloudflare+Provider: !Storj,Selectel,Synology,Cloudflare,FlashBlade,Mega.IP \[bu] 2Type: string.IP \[bu] 2@@ -35337,14 +37169,45 @@ Intelligent-Tiering storage classGlacier Instant Retrieval storage class.RE.RE+.SS --s3-ibm-api-key+.PP+IBM API Key to be used to obtain IAM token+.PP+Properties:+.IP \[bu] 2+Config: ibm_api_key+.IP \[bu] 2+Env Var: RCLONE_S3_IBM_API_KEY+.IP \[bu] 2+Provider: IBMCOS+.IP \[bu] 2+Type: string+.IP \[bu] 2+Required: false+.SS --s3-ibm-resource-instance-id+.PP+IBM service instance id+.PP+Properties:+.IP \[bu] 2+Config: ibm_resource_instance_id+.IP \[bu] 2+Env Var: RCLONE_S3_IBM_RESOURCE_INSTANCE_ID+.IP \[bu] 2+Provider: IBMCOS+.IP \[bu] 2+Type: string+.IP \[bu] 2+Required: false.SS Advanced options.PPHere are the Advanced options specific to s3 (Amazon S3 CompliantStorage Providers including AWS, Alibaba, ArvanCloud, Ceph, ChinaMobile,-Cloudflare, DigitalOcean, Dreamhost, GCS, HuaweiOBS, IBMCOS, IDrive,-IONOS, LyveCloud, Leviia, Liara, Linode, Magalu, Minio, Netease,-Outscale, Petabox, RackCorp, Rclone, Scaleway, SeaweedFS, Selectel,-StackPath, Storj, Synology, TencentCOS, Wasabi, Qiniu and others).+Cloudflare, DigitalOcean, Dreamhost, Exaba, FlashBlade, GCS, HuaweiOBS,+IBMCOS, IDrive, IONOS, LyveCloud, Leviia, Liara, Linode, Magalu, Mega,+Minio, Netease, Outscale, Petabox, RackCorp, Rclone, Scaleway,+SeaweedFS, Selectel, StackPath, Storj, Synology, TencentCOS, Wasabi,+Qiniu and others)..SS --s3-bucket-acl.PPCanned ACL used when creating buckets.@@ -35364,6 +37227,8 @@ Config: bucket_acl.IP \[bu] 2Env Var: RCLONE_S3_BUCKET_ACL.IP \[bu] 2+Provider: !Storj,Selectel,Synology,Cloudflare,FlashBlade+.IP \[bu] 2Type: string.IP \[bu] 2Required: false@@ -36358,6 +38223,48 @@ Env Var: RCLONE_S3_USE_MULTIPART_UPLOADSType: Tristate.IP \[bu] 2Default: unset+.SS --s3-use-x-id+.PP+Set if rclone should add x-id URL parameters.+.PP+You can change this if you want to disable the AWS SDK from adding x-id+URL parameters.+.PP+This shouldn\[aq]t be necessary in normal operation.+.PP+This should be automatically set correctly for all providers rclone+knows about - please make a bug report if not.+.PP+Properties:+.IP \[bu] 2+Config: use_x_id+.IP \[bu] 2+Env Var: RCLONE_S3_USE_X_ID+.IP \[bu] 2+Type: Tristate+.IP \[bu] 2+Default: unset+.SS --s3-sign-accept-encoding+.PP+Set if rclone should include Accept-Encoding as part of the signature.+.PP+You can change this if you want to stop rclone including Accept-Encoding+as part of the signature.+.PP+This shouldn\[aq]t be necessary in normal operation.+.PP+This should be automatically set correctly for all providers rclone+knows about - please make a bug report if not.+.PP+Properties:+.IP \[bu] 2+Config: sign_accept_encoding+.IP \[bu] 2+Env Var: RCLONE_S3_SIGN_ACCEPT_ENCODING+.IP \[bu] 2+Type: Tristate+.IP \[bu] 2+Default: unset.SS --s3-directory-bucket.PPSet to use AWS Directory Buckets@@ -36605,7 +38512,7 @@ Usage Examples:.IP.nf\f[C]-rclone backend restore s3:bucket/path/to/object -o priority=PRIORITY -o lifetime=DAYS+rclone backend restore s3:bucket/path/to/ --include /object -o priority=PRIORITY -o lifetime=DAYSrclone backend restore s3:bucket/path/to/directory -o priority=PRIORITY -o lifetime=DAYSrclone backend restore s3:bucket -o priority=PRIORITY -o lifetime=DAYSrclone backend restore s3:bucket/path/to/directory -o priority=PRIORITY@@ -37544,7 +39451,7 @@ For on-prem COS, do not make a selection from this list, hit enterlocation_constraint>1\f[R].fi-.IP "9." 3+.IP "8." 3Specify a canned ACL.IBM Cloud (Storage) supports \[dq]public-read\[dq] and\[dq]private\[dq].@@ -37567,7 +39474,7 @@ Choose a number from below, or type in your own valueacl> 1\f[R].fi-.IP "12." 4+.IP "9." 3Review the displayed configuration and accept to save the\[dq]remote\[dq] then quit.The config file should look like this@@ -37584,7 +39491,7 @@ The config file should look like thisacl = private\f[R].fi-.IP "13." 4+.IP "10." 4Execute rclone commands.IP.nf@@ -37606,6 +39513,47 @@ Execute rclone commandsrclone delete IBM-COS-XREGION:newbucket/file.txt\f[R].fi+.SS IBM IAM authentication+.PP+If using IBM IAM authentication with IBM API KEY you need to fill in+these additional parameters 1.+Select false for env_auth 2.+Leave \f[C]access_key_id\f[R] and \f[C]secret_access_key\f[R] blank 3.+Paste your \f[C]ibm_api_key\f[R]+.IP+.nf+\f[C]+Option ibm_api_key.+IBM API Key to be used to obtain IAM token+Enter a value of type string. Press Enter for the default (1).+ibm_api_key>+\f[R]+.fi+.IP "4." 3+Paste your \f[C]ibm_resource_instance_id\f[R]+.IP+.nf+\f[C]+Option ibm_resource_instance_id.+IBM service instance id+Enter a value of type string. Press Enter for the default (2).+ibm_resource_instance_id>+\f[R]+.fi+.IP "5." 3+In advanced settings type true for \f[C]v2_auth\f[R]+.IP+.nf+\f[C]+Option v2_auth.+If true use v2 authentication.+If this is false (the default) then rclone will use v4 authentication.+If it is set then rclone will use v2 authentication.+Use this only if v4 signatures don\[aq]t work, e.g. pre Jewel/v10 CEPH.+Enter a boolean value (true or false). Press Enter for the default (true).+v2_auth>+\f[R]+.fi.SS IDrive e2.PPHere is an example of making an IDrive e2 (https://www.idrive.com/e2/)@@ -38469,7 +40417,7 @@ location_constraint = au-nsw.PPRclone can serve any remote over the S3 protocol.For details see the rclone serve-s3 (https://rclone.org/commands/rclone_serve_http/) documentation.+s3 (https://rclone.org/commands/rclone_serve_s3/) documentation..PPFor example, to serve \f[C]remote:path\f[R] over s3, run the server likethis:@@ -38495,8 +40443,8 @@ use_multipart_uploads = false\f[R].fi.PP-Note that setting \f[C]disable_multipart_uploads = true\f[R] is to work-around a bug (https://rclone.org/commands/rclone_serve_http/#bugs) which+Note that setting \f[C]use_multipart_uploads = false\f[R] is to work+around a bug (https://rclone.org/commands/rclone_serve_s3/#bugs) whichwill be fixed in due course..SS Scaleway.PP@@ -38642,21 +40590,19 @@ region>\f[R].fi.PP-Choose an endpoint from the list+Enter your Lyve Cloud endpoint.+This field cannot be kept empty..IP.nf\f[C]-Endpoint for S3 API.+Endpoint for Lyve Cloud S3 API.Required when using an S3 clone.-Choose a number from below, or type in your own value.-Press Enter to leave empty.- 1 / Seagate Lyve Cloud US East 1 (Virginia)- \[rs] (s3.us-east-1.lyvecloud.seagate.com)- 2 / Seagate Lyve Cloud US West 1 (California)- \[rs] (s3.us-west-1.lyvecloud.seagate.com)- 3 / Seagate Lyve Cloud AP Southeast 1 (Singapore)- \[rs] (s3.ap-southeast-1.lyvecloud.seagate.com)-endpoint> 1+Please type in your LyveCloud endpoint.+Examples:+- s3.us-west-1.{account_name}.lyve.seagate.com (US West 1 - California)+- s3.eu-west-1.{account_name}.lyve.seagate.com (US West 1 - Ireland)+Enter a value.+endpoint> s3.us-west-1.global.lyve.seagate.com\f[R].fi.PP@@ -39689,27 +41635,49 @@ Option endpoint.Endpoint for Linode Object Storage API.Choose a number from below, or type in your own value.Press Enter to leave empty.- 1 / Atlanta, GA (USA), us-southeast-1+ 1 / Amsterdam (Netherlands), nl-ams-1+ \[rs] (nl-ams-1.linodeobjects.com)+ 2 / Atlanta, GA (USA), us-southeast-1\[rs] (us-southeast-1.linodeobjects.com)- 2 / Chicago, IL (USA), us-ord-1+ 3 / Chennai (India), in-maa-1+ \[rs] (in-maa-1.linodeobjects.com)+ 4 / Chicago, IL (USA), us-ord-1\[rs] (us-ord-1.linodeobjects.com)- 3 / Frankfurt (Germany), eu-central-1+ 5 / Frankfurt (Germany), eu-central-1\[rs] (eu-central-1.linodeobjects.com)- 4 / Milan (Italy), it-mil-1+ 6 / Jakarta (Indonesia), id-cgk-1+ \[rs] (id-cgk-1.linodeobjects.com)+ 7 / London 2 (Great Britain), gb-lon-1+ \[rs] (gb-lon-1.linodeobjects.com)+ 8 / Los Angeles, CA (USA), us-lax-1+ \[rs] (us-lax-1.linodeobjects.com)+ 9 / Madrid (Spain), es-mad-1+ \[rs] (es-mad-1.linodeobjects.com)+10 / Melbourne (Australia), au-mel-1+ \[rs] (au-mel-1.linodeobjects.com)+11 / Miami, FL (USA), us-mia-1+ \[rs] (us-mia-1.linodeobjects.com)+12 / Milan (Italy), it-mil-1\[rs] (it-mil-1.linodeobjects.com)- 5 / Newark, NJ (USA), us-east-1+13 / Newark, NJ (USA), us-east-1\[rs] (us-east-1.linodeobjects.com)- 6 / Paris (France), fr-par-1+14 / Osaka (Japan), jp-osa-1+ \[rs] (jp-osa-1.linodeobjects.com)+15 / Paris (France), fr-par-1\[rs] (fr-par-1.linodeobjects.com)- 7 / Seattle, WA (USA), us-sea-1+16 / S\[~a]o Paulo (Brazil), br-gru-1+ \[rs] (br-gru-1.linodeobjects.com)+17 / Seattle, WA (USA), us-sea-1\[rs] (us-sea-1.linodeobjects.com)- 8 / Singapore ap-south-1+18 / Singapore, ap-south-1\[rs] (ap-south-1.linodeobjects.com)- 9 / Stockholm (Sweden), se-sto-1+19 / Singapore 2, sg-sin-1+ \[rs] (sg-sin-1.linodeobjects.com)+20 / Stockholm (Sweden), se-sto-1\[rs] (se-sto-1.linodeobjects.com)-10 / Washington, DC, (USA), us-iad-1+21 / Washington, DC, (USA), us-iad-1\[rs] (us-iad-1.linodeobjects.com)-endpoint> 3+endpoint> 5Option acl.Canned ACL used when creating buckets and storing or copying objects.@@ -39884,6 +41852,124 @@ secret_access_key = SECRET_ACCESS_KEYendpoint = br-ne1.magaluobjects.com\f[R].fi+.SS MEGA S4+.PP+MEGA S4 Object Storage (https://mega.io/objectstorage) is an S3+compatible object storage system.+It has a single pricing tier with no additional charges for data+transfers or API requests and it is included in existing Pro plans.+.PP+Here is an example of making a configuration.+First run:+.IP+.nf+\f[C]+rclone config+\f[R]+.fi+.PP+This will guide you through an interactive setup process.+.IP+.nf+\f[C]+No remotes found, make a new one?+n) New remote+s) Set configuration password+q) Quit config+n/s/q> n++Enter name for new remote.+name> megas4++Option Storage.+Type of storage to configure.+Choose a number from below, or type in your own value.+[snip]+XX / Amazon S3 Compliant Storage Providers including AWS,... Mega, ...+ \[rs] (s3)+[snip]+Storage> s3++Option provider.+Choose your S3 provider.+Choose a number from below, or type in your own value.+Press Enter to leave empty.+[snip]+XX / MEGA S4 Object Storage+ \[rs] (Mega)+[snip]+provider> Mega++Option env_auth.+Get AWS credentials from runtime (environment variables or EC2/ECS meta data if no env vars).+Only applies if access_key_id and secret_access_key is blank.+Choose a number from below, or type in your own boolean value (true or false).+Press Enter for the default (false).+ 1 / Enter AWS credentials in the next step.+ \[rs] (false)+ 2 / Get AWS credentials from the environment (env vars or IAM).+ \[rs] (true)+env_auth>++Option access_key_id.+AWS Access Key ID.+Leave blank for anonymous access or runtime credentials.+Enter a value. Press Enter to leave empty.+access_key_id> XXX++Option secret_access_key.+AWS Secret Access Key (password).+Leave blank for anonymous access or runtime credentials.+Enter a value. Press Enter to leave empty.+secret_access_key> XXX++Option endpoint.+Endpoint for S3 API.+Required when using an S3 clone.+Choose a number from below, or type in your own value.+Press Enter to leave empty.+ 1 / Mega S4 eu-central-1 (Amsterdam)+ \[rs] (s3.eu-central-1.s4.mega.io)+ 2 / Mega S4 eu-central-2 (Bettembourg)+ \[rs] (s3.eu-central-2.s4.mega.io)+ 3 / Mega S4 ca-central-1 (Montreal)+ \[rs] (s3.ca-central-1.s4.mega.io)+ 4 / Mega S4 ca-west-1 (Vancouver)+ \[rs] (s3.ca-west-1.s4.mega.io)+endpoint> 1++Edit advanced config?+y) Yes+n) No (default)+y/n> n++Configuration complete.+Options:+- type: s3+- provider: Mega+- access_key_id: XXX+- secret_access_key: XXX+- endpoint: s3.eu-central-1.s4.mega.io+Keep this \[dq]megas4\[dq] remote?+y) Yes this is OK (default)+e) Edit this remote+d) Delete this remote+y/e/d> y+\f[R]+.fi+.PP+This will leave the config file looking like this.+.IP+.nf+\f[C]+[megas4]+type = s3+provider = Mega+access_key_id = XXX+secret_access_key = XXX+endpoint = s3.eu-central-1.s4.mega.io+\f[R]+.fi.SS ArvanCloud.PPArvanCloud (https://www.arvancloud.com/en/products/cloud-storage)@@ -40317,6 +42403,138 @@ region = us-east-1endpoint = s3.petabox.io\f[R].fi+.SS Pure Storage FlashBlade+.PP+Pure Storage+FlashBlade (https://www.purestorage.com/products/unstructured-data-storage.html)+is a high performance S3-compatible object store.+.PP+FlashBlade supports most modern S3 features including:+.IP \[bu] 2+ListObjectsV2+.IP \[bu] 2+Multipart uploads with AWS-compatible ETags+.IP \[bu] 2+Advanced checksum algorithms (SHA256, CRC32, CRC32C) with trailer+support (Purity//FB 4.4.2+)+.IP \[bu] 2+Object versioning and lifecycle management+.IP \[bu] 2+Virtual hosted-style requests (requires DNS configuration)+.PP+To configure rclone for Pure Storage FlashBlade:+.PP+First run:+.IP+.nf+\f[C]+rclone config+\f[R]+.fi+.PP+This will guide you through an interactive setup process:+.IP+.nf+\f[C]+No remotes found, make a new one?+n) New remote+s) Set configuration password+q) Quit config+n/s/q> n++Enter name for new remote.+name> flashblade++Option Storage.+Type of storage to configure.+Choose a number from below, or type in your own value.+[snip]+ 4 / Amazon S3 Compliant Storage Providers including AWS, Alibaba, ArvanCloud, Ceph, ChinaMobile, Cloudflare, DigitalOcean, Dreamhost, FlashBlade, GCS, HuaweiOBS, IBMCOS, IDrive, IONOS, LyveCloud, Leviia, Liara, Linode, Magalu, Minio, Netease, Outscale, Petabox, RackCorp, Rclone, Scaleway, SeaweedFS, Selectel, StackPath, Storj, Synology, TencentCOS, Wasabi, Qiniu and others+ \[rs] (s3)+[snip]+Storage> s3++Option provider.+Choose your S3 provider.+Choose a number from below, or type in your own value.+Press Enter to leave empty.+[snip]+ 9 / Pure Storage FlashBlade Object Storage+ \[rs] (FlashBlade)+[snip]+provider> FlashBlade++Option env_auth.+Get AWS credentials from runtime (environment variables or EC2/ECS meta data if no env vars).+Only applies if access_key_id and secret_access_key is blank.+Choose a number from below, or type in your own boolean value (true or false).+Press Enter for the default (false).+ 1 / Enter AWS credentials in the next step.+ \[rs] (false)+ 2 / Get AWS credentials from the environment (env vars or IAM).+ \[rs] (true)+env_auth> 1++Option access_key_id.+AWS Access Key ID.+Leave blank for anonymous access or runtime credentials.+Enter a value. Press Enter to leave empty.+access_key_id> ACCESS_KEY_ID++Option secret_access_key.+AWS Secret Access Key (password).+Leave blank for anonymous access or runtime credentials.+Enter a value. Press Enter to leave empty.+secret_access_key> SECRET_ACCESS_KEY++Option endpoint.+Endpoint for S3 API.+Required when using an S3 clone.+Enter a value. Press Enter to leave empty.+endpoint> https://s3.flashblade.example.com++Edit advanced config?+y) Yes+n) No (default)+y/n> n++Configuration complete.+Options:+- type: s3+- provider: FlashBlade+- access_key_id: ACCESS_KEY_ID+- secret_access_key: SECRET_ACCESS_KEY+- endpoint: https://s3.flashblade.example.com+Keep this \[dq]flashblade\[dq] remote?+y) Yes this is OK (default)+e) Edit this remote+d) Delete this remote+y/e/d> y+\f[R]+.fi+.PP+This results in the following configuration being stored in+\f[C]\[ti]/.config/rclone/rclone.conf\f[R]:+.IP+.nf+\f[C]+[flashblade]+type = s3+provider = FlashBlade+access_key_id = ACCESS_KEY_ID+secret_access_key = SECRET_ACCESS_KEY+endpoint = https://s3.flashblade.example.com+\f[R]+.fi+.PP+Note: The FlashBlade endpoint should be the S3 data VIP.+For virtual-hosted style requests, ensure proper DNS configuration:+subdomains of the endpoint hostname should resolve to a FlashBlade data+VIP.+For example, if your endpoint is+\f[C]https://s3.flashblade.example.com\f[R], then+\f[C]bucket-name.s3.flashblade.example.com\f[R] should also resolve to+the data VIP..SS Storj.PPStorj is a decentralized cloud storage which can be used through its@@ -40388,7 +42606,7 @@ stored, nor is any MD5SUM (if one is available from the source)..PPThis has the following consequences:.IP \[bu] 2-Using \f[C]rclone rcat\f[R] will fail as the medatada doesn\[aq]t match+Using \f[C]rclone rcat\f[R] will fail as the metadata doesn\[aq]t matchafter upload.IP \[bu] 2Uploading files with \f[C]rclone mount\f[R] will fail for the same@@ -41644,8 +43862,8 @@ Note that rclone runs a webserver on your local machine to collect thetoken as returned from Box.This only runs from the moment it opens your browser to the moment youget back the verification code.-This is on \f[C]http://127.0.0.1:53682/\f[R] and this it may require you-to unblock it temporarily if you are running a host firewall.+This is on \f[C]http://127.0.0.1:53682/\f[R] and this may require you to+unblock it temporarily if you are running a host firewall..PPOnce configured you can then use \f[C]rclone\f[R] like this,.PP@@ -43895,6 +46113,36 @@ Env Var: RCLONE_CLOUDINARY_EVENTUALLY_CONSISTENT_DELAYType: Duration.IP \[bu] 2Default: 0s+.SS --cloudinary-adjust-media-files-extensions+.PP+Cloudinary handles media formats as a file attribute and strips it from+the name, which is unlike most other file systems+.PP+Properties:+.IP \[bu] 2+Config: adjust_media_files_extensions+.IP \[bu] 2+Env Var: RCLONE_CLOUDINARY_ADJUST_MEDIA_FILES_EXTENSIONS+.IP \[bu] 2+Type: bool+.IP \[bu] 2+Default: true+.SS --cloudinary-media-extensions+.PP+Cloudinary supported media extensions+.PP+Properties:+.IP \[bu] 2+Config: media_extensions+.IP \[bu] 2+Env Var: RCLONE_CLOUDINARY_MEDIA_EXTENSIONS+.IP \[bu] 2+Type: stringArray+.IP \[bu] 2+Default: [3ds 3g2 3gp ai arw avi avif bmp bw cr2 cr3 djvu dng eps3 fbx+flif flv gif glb gltf hdp heic heif ico indd jp2 jpe jpeg jpg jxl jxr+m2ts mov mp4 mpeg mts mxf obj ogv pdf ply png psd svg tga tif tiff ts+u3ma usdz wdp webm webp wmv].SS --cloudinary-description.PPDescription of the remote.@@ -45295,7 +47543,7 @@ The nonce is incremented for each chunk read making sure each nonce isunique for each block written.The chance of a nonce being reused is minuscule.If you wrote an exabyte of data (10\[S1]\[u2078] bytes) you would have a-probability of approximately 2\[tmu]10\[u207B]\[S3]\[S2] of re-using a+probability of approximately 2\[tmu]10\[u207B]\[S3]\[S2] of reusing anonce..SS Chunk.PP@@ -45779,6 +48027,234 @@ Required: falseAny metadata supported by the underlying remote is read and written..PPSee the metadata (https://rclone.org/docs/#metadata) docs for more info.+.SH DOI+.PP+The DOI remote is a read only remote for reading files from digital+object identifiers (DOI).+.PP+Currently, the DOI backend supports supports DOIs hosted with: -+InvenioRDM (https://inveniosoftware.org/products/rdm/) -+Zenodo (https://zenodo.org) - CaltechDATA (https://data.caltech.edu) -+Other InvenioRDM repositories (https://inveniosoftware.org/showcase/) -+Dataverse (https://dataverse.org) - Harvard+Dataverse (https://dataverse.harvard.edu) - Other Dataverse+repositories (https://dataverse.org/installations)+.PP+Paths are specified as \f[C]remote:path\f[R]+.PP+Paths may be as deep as required, e.g.+\f[C]remote:directory/subdirectory\f[R].+.SS Configuration+.PP+Here is an example of how to make a remote called \f[C]remote\f[R].+First run:+.IP+.nf+\f[C]+ rclone config+\f[R]+.fi+.PP+This will guide you through an interactive setup process:+.IP+.nf+\f[C]+No remotes found, make a new one?+n) New remote+s) Set configuration password+q) Quit config+n/s/q> n+Enter name for new remote.+name> remote+Type of storage to configure.+Choose a number from below, or type in your own value+[snip]+XX / DOI datasets+ \[rs] (doi)+[snip]+Storage> doi+Option doi.+The DOI or the doi.org URL.+Enter a value.+doi> 10.5281/zenodo.5876941+Edit advanced config?+y) Yes+n) No (default)+y/n> n+Configuration complete.+Options:+- type: doi+- doi: 10.5281/zenodo.5876941+Keep this \[dq]remote\[dq] remote?+y) Yes this is OK (default)+e) Edit this remote+d) Delete this remote+y/e/d> y+\f[R]+.fi+.SS Standard options+.PP+Here are the Standard options specific to doi (DOI datasets).+.SS --doi-doi+.PP+The DOI or the doi.org URL.+.PP+Properties:+.IP \[bu] 2+Config: doi+.IP \[bu] 2+Env Var: RCLONE_DOI_DOI+.IP \[bu] 2+Type: string+.IP \[bu] 2+Required: true+.SS Advanced options+.PP+Here are the Advanced options specific to doi (DOI datasets).+.SS --doi-provider+.PP+DOI provider.+.PP+The DOI provider can be set when rclone does not automatically recognize+a supported DOI provider.+.PP+Properties:+.IP \[bu] 2+Config: provider+.IP \[bu] 2+Env Var: RCLONE_DOI_PROVIDER+.IP \[bu] 2+Type: string+.IP \[bu] 2+Required: false+.IP \[bu] 2+Examples:+.RS 2+.IP \[bu] 2+\[dq]auto\[dq]+.RS 2+.IP \[bu] 2+Auto-detect provider+.RE+.IP \[bu] 2+\[dq]zenodo\[dq]+.RS 2+.IP \[bu] 2+Zenodo+.RE+.IP \[bu] 2+\[dq]dataverse\[dq]+.RS 2+.IP \[bu] 2+Dataverse+.RE+.IP \[bu] 2+\[dq]invenio\[dq]+.RS 2+.IP \[bu] 2+Invenio+.RE+.RE+.SS --doi-doi-resolver-api-url+.PP+The URL of the DOI resolver API to use.+.PP+The DOI resolver can be set for testing or for cases when the the+canonical DOI resolver API cannot be used.+.PP+Defaults to \[dq]https://doi.org/api\[dq].+.PP+Properties:+.IP \[bu] 2+Config: doi_resolver_api_url+.IP \[bu] 2+Env Var: RCLONE_DOI_DOI_RESOLVER_API_URL+.IP \[bu] 2+Type: string+.IP \[bu] 2+Required: false+.SS --doi-description+.PP+Description of the remote.+.PP+Properties:+.IP \[bu] 2+Config: description+.IP \[bu] 2+Env Var: RCLONE_DOI_DESCRIPTION+.IP \[bu] 2+Type: string+.IP \[bu] 2+Required: false+.SS Backend commands+.PP+Here are the commands specific to the doi backend.+.PP+Run them with+.IP+.nf+\f[C]+rclone backend COMMAND remote:+\f[R]+.fi+.PP+The help below will explain what arguments each command takes.+.PP+See the backend (https://rclone.org/commands/rclone_backend/) command+for more info on how to pass options and arguments.+.PP+These can be run on a running backend using the rc command+backend/command (https://rclone.org/rc/#backend-command).+.SS metadata+.PP+Show metadata about the DOI.+.IP+.nf+\f[C]+rclone backend metadata remote: [options] [<arguments>+]+\f[R]+.fi+.PP+This command returns a JSON object with some information about the DOI.+.IP+.nf+\f[C]+rclone backend medatadata doi:+\f[R]+.fi+.PP+It returns a JSON object representing metadata about the DOI.+.SS set+.PP+Set command for updating the config parameters.+.IP+.nf+\f[C]+rclone backend set remote: [options] [<arguments>+]+\f[R]+.fi+.PP+This set command can be used to update the config parameters for a+running doi backend.+.PP+Usage Examples:+.IP+.nf+\f[C]+rclone backend set doi: [-o opt_name=opt_value] [-o opt_name2=opt_value2]+rclone rc backend/command command=set fs=doi: [-o opt_name=opt_value] [-o opt_name2=opt_value2]+rclone rc backend/command command=set fs=doi: -o doi=NEW_DOI+\f[R]+.fi+.PP+The option keys are named as they are in the config file.+.PP+This rebuilds the connection to the doi backend when it is called with+the new parameters.+Only new parameters need be passed as the values will default to those+currently in use.+.PP+It doesn\[aq]t return anything..SH Dropbox.PPPaths are specified as \f[C]remote:path\f[R]@@ -46037,6 +48513,94 @@ Or you could do an initial transfer with.PPNote that there may be a pause when quitting rclone while rclonefinishes up the last batch using this mode.+.SS Exporting files+.PP+Certain files in Dropbox are \[dq]exportable\[dq], such as Dropbox Paper+documents.+These files need to be converted to another format in order to be+downloaded.+Often multiple formats are available for conversion.+.PP+When rclone downloads a exportable file, it chooses the format to+download based on the \f[C]--dropbox-export-formats\f[R] setting.+By default, the export formats are \f[C]html,md\f[R], which are sensible+defaults for Dropbox Paper.+.PP+Rclone chooses the first format ID in the export formats list that+Dropbox supports for a given file.+If no format in the list is usable, rclone will choose the default+format that Dropbox suggests.+.PP+Rclone will change the extension to correspond to the export format.+Here are some examples of how extensions are mapped:+.PP+.TS+tab(@);+l l l.+T{+File type+T}@T{+Filename in Dropbox+T}@T{+Filename in rclone+T}+_+T{+Paper+T}@T{+mydoc.paper+T}@T{+mydoc.html+T}+T{+Paper template+T}@T{+mydoc.papert+T}@T{+mydoc.papert.html+T}+T{+other+T}@T{+mydoc+T}@T{+mydoc.html+T}+.TE+.PP+\f[I]Importing\f[R] exportable files is not yet supported by rclone.+.PP+Here are the supported export extensions known by rclone.+Note that rclone does not currently support other formats not on this+list, even if Dropbox supports them.+Also, Dropbox could change the list of supported formats at any time.+.PP+.TS+tab(@);+l l l.+T{+Format ID+T}@T{+Name+T}@T{+Description+T}+_+T{+html+T}@T{+HTML+T}@T{+HTML document+T}+T{+md+T}@T{+Markdown+T}@T{+Markdown text format+T}+.TE.SS Standard options.PPHere are the Standard options specific to dropbox (Dropbox).@@ -46270,6 +48834,65 @@ Env Var: RCLONE_DROPBOX_ROOT_NAMESPACEType: string.IP \[bu] 2Required: false+.SS --dropbox-export-formats+.PP+Comma separated list of preferred formats for exporting files+.PP+Certain Dropbox files can only be accessed by exporting them to another+format.+These include Dropbox Paper documents.+.PP+For each such file, rclone will choose the first format on this list+that Dropbox considers valid.+If none is valid, it will choose Dropbox\[aq]s default format.+.PP+Known formats include: \[dq]html\[dq], \[dq]md\[dq] (markdown)+.PP+Properties:+.IP \[bu] 2+Config: export_formats+.IP \[bu] 2+Env Var: RCLONE_DROPBOX_EXPORT_FORMATS+.IP \[bu] 2+Type: CommaSepList+.IP \[bu] 2+Default: html,md+.SS --dropbox-skip-exports+.PP+Skip exportable files in all listings.+.PP+If given, exportable files practically become invisible to rclone.+.PP+Properties:+.IP \[bu] 2+Config: skip_exports+.IP \[bu] 2+Env Var: RCLONE_DROPBOX_SKIP_EXPORTS+.IP \[bu] 2+Type: bool+.IP \[bu] 2+Default: false+.SS --dropbox-show-all-exports+.PP+Show all exportable files in listings.+.PP+Adding this flag will allow all exportable files to be server side+copied.+Note that rclone doesn\[aq]t add extensions to the exportable file names+in this mode.+.PP+Do \f[B]not\f[R] use this flag when trying to download exportable files+- rclone will fail to download them.+.PP+Properties:+.IP \[bu] 2+Config: show_all_exports+.IP \[bu] 2+Env Var: RCLONE_DROPBOX_SHOW_ALL_EXPORTS+.IP \[bu] 2+Type: bool+.IP \[bu] 2+Default: false.SS --dropbox-batch-mode.PPUpload file batching sync|async|off.@@ -46357,7 +48980,8 @@ Type: DurationDefault: 0s.SS --dropbox-batch-commit-timeout.PP-Max time to wait for a batch to finish committing+Max time to wait for a batch to finish committing.+(no longer used).PPProperties:.IP \[bu] 2@@ -46415,6 +49039,11 @@ See the forumdiscussion (https://forum.rclone.org/t/rclone-link-dropbox-permissions/23211)and the dropbox SDKissue (https://github.com/dropbox/dropbox-sdk-go-unofficial/issues/75).+.PP+Modification times for Dropbox Paper documents are not exact, and may+not change for some period after the document is edited.+To make sure you get recent changes in a sync, either wait an hour or+so, or use \f[C]--ignore-times\f[R] to force a full sync..SS Get your own Dropbox App ID.PPWhen you use rclone with Dropbox in its default configuration you are@@ -46789,6 +49418,288 @@ Env Var: RCLONE_FILEFABRIC_DESCRIPTIONType: string.IP \[bu] 2Required: false+.SH FileLu+.PP+FileLu (https://filelu.com/) is a reliable cloud storage provider+offering features like secure file uploads, downloads, flexible storage+options, and sharing capabilities.+With support for high storage limits and seamless integration with+rclone, FileLu makes managing files in the cloud easy.+Its cross-platform file backup services let you upload and back up files+from any internet-connected device.+.SS Configuration+.PP+Here is an example of how to make a remote called \f[C]filelu\f[R].+First, run:+.IP+.nf+\f[C]+ rclone config+\f[R]+.fi+.PP+This will guide you through an interactive setup process:+.IP+.nf+\f[C]+No remotes found, make a new one?+n) New remote+s) Set configuration password+q) Quit config+n/s/q> n+name> filelu+Type of storage to configure.+Choose a number from below, or type in your own value+[snip]+xx / FileLu Cloud Storage+ \[rs] \[dq]filelu\[dq]+[snip]+Storage> filelu+Enter your FileLu Rclone Key:+key> YOUR_FILELU_RCLONE_KEY RC_xxxxxxxxxxxxxxxxxxxxxxxx+Configuration complete.++Keep this \[dq]filelu\[dq] remote?+y) Yes this is OK+e) Edit this remote+d) Delete this remote+y/e/d> y+\f[R]+.fi+.SS Paths+.PP+A path without an initial \f[C]/\f[R] will operate in the+\f[C]Rclone\f[R] directory.+.PP+A path with an initial \f[C]/\f[R] will operate at the root where you+can see the \f[C]Rclone\f[R] directory.+.IP+.nf+\f[C]+$ rclone lsf TestFileLu:/+CCTV/+Camera/+Documents/+Music/+Photos/+Rclone/+Vault/+Videos/+\f[R]+.fi+.SS Example Commands+.PP+Create a new folder named \f[C]foldername\f[R] in the \f[C]Rclone\f[R]+directory:+.IP+.nf+\f[C]+rclone mkdir filelu:foldername+\f[R]+.fi+.PP+Delete a folder on FileLu:+.IP+.nf+\f[C]+rclone rmdir filelu:/folder/path/+\f[R]+.fi+.PP+Delete a file on FileLu:+.IP+.nf+\f[C]+rclone delete filelu:/hello.txt+\f[R]+.fi+.PP+List files from your FileLu account:+.IP+.nf+\f[C]+rclone ls filelu:+\f[R]+.fi+.PP+List all folders:+.IP+.nf+\f[C]+rclone lsd filelu:+\f[R]+.fi+.PP+Copy a specific file to the FileLu root:+.IP+.nf+\f[C]+rclone copy D:\[rs]\[rs]hello.txt filelu:+\f[R]+.fi+.PP+Copy files from a local directory to a FileLu directory:+.IP+.nf+\f[C]+rclone copy D:/local-folder filelu:/remote-folder/path/+\f[R]+.fi+.PP+Download a file from FileLu into a local directory:+.IP+.nf+\f[C]+rclone copy filelu:/file-path/hello.txt D:/local-folder+\f[R]+.fi+.PP+Move files from a local directory to a FileLu directory:+.IP+.nf+\f[C]+rclone move D:\[rs]\[rs]local-folder filelu:/remote-path/+\f[R]+.fi+.PP+Sync files from a local directory to a FileLu directory:+.IP+.nf+\f[C]+rclone sync --interactive D:/local-folder filelu:/remote-path/+\f[R]+.fi+.PP+Mount remote to local Linux:+.IP+.nf+\f[C]+rclone mount filelu: /root/mnt --vfs-cache-mode full+\f[R]+.fi+.PP+Mount remote to local Windows:+.IP+.nf+\f[C]+rclone mount filelu: D:/local_mnt --vfs-cache-mode full+\f[R]+.fi+.PP+Get storage info about the FileLu account:+.IP+.nf+\f[C]+rclone about filelu:+\f[R]+.fi+.PP+All the other rclone commands are supported by this backend.+.SS FolderID instead of folder path+.PP+We use the FolderID instead of the folder name to prevent errors when+users have identical folder names or paths.+For example, if a user has two or three folders named+\[dq]test_folders,\[dq] the system may become confused and won\[aq]t+know which folder to move.+In large storage systems, some clients have hundred of thousands of+folders and a few millions of files, duplicate folder names or paths are+quite common.+.SS Modification Times and Hashes+.PP+FileLu supports both modification times and MD5 hashes.+.PP+FileLu only supports filenames and folder names up to 255 characters in+length, where a character is a Unicode character.+.SS Duplicated Files+.PP+When uploading and syncing via Rclone, FileLu does not allow uploading+duplicate files within the same directory.+However, you can upload duplicate files, provided they are in different+directories (folders).+.SS Failure to Log / Invalid Credentials or KEY+.PP+Ensure that you have the correct Rclone key, which can be found in My+Account (https://filelu.com/account/).+Every time you toggle Rclone OFF and ON in My Account, a new+RC_xxxxxxxxxxxxxxxxxxxx key is generated.+Be sure to update your Rclone configuration with the new key.+.PP+If you are connecting to your FileLu remote for the first time and+encounter an error such as:+.IP+.nf+\f[C]+Failed to create file system for \[dq]my-filelu-remote:\[dq]: couldn\[aq]t login: Invalid credentials+\f[R]+.fi+.PP+Ensure your Rclone Key is correct.+.SS Process \f[C]killed\f[R]+.PP+Accounts with large files or extensive metadata may experience+significant memory usage during list/sync operations.+Ensure the system running \f[C]rclone\f[R] has sufficient memory and CPU+to handle these operations.+.SS Standard options+.PP+Here are the Standard options specific to filelu (FileLu Cloud Storage).+.SS --filelu-key+.PP+Your FileLu Rclone key from My Account+.PP+Properties:+.IP \[bu] 2+Config: key+.IP \[bu] 2+Env Var: RCLONE_FILELU_KEY+.IP \[bu] 2+Type: string+.IP \[bu] 2+Required: true+.SS Advanced options+.PP+Here are the Advanced options specific to filelu (FileLu Cloud Storage).+.SS --filelu-encoding+.PP+The encoding for the backend.+.PP+See the encoding section in the+overview (https://rclone.org/overview/#encoding) for more info.+.PP+Properties:+.IP \[bu] 2+Config: encoding+.IP \[bu] 2+Env Var: RCLONE_FILELU_ENCODING+.IP \[bu] 2+Type: Encoding+.IP \[bu] 2+Default:+Slash,LtGt,DoubleQuote,SingleQuote,BackQuote,Dollar,Colon,Question,Asterisk,Pipe,Hash,Percent,BackSlash,CrLf,Del,Ctl,LeftSpace,LeftPeriod,LeftTilde,LeftCrLfHtVt,RightSpace,RightPeriod,RightCrLfHtVt,InvalidUtf8,Dot,SquareBracket,Semicolon,Exclamation+.SS --filelu-description+.PP+Description of the remote.+.PP+Properties:+.IP \[bu] 2+Config: description+.IP \[bu] 2+Env Var: RCLONE_FILELU_DESCRIPTION+.IP \[bu] 2+Type: string+.IP \[bu] 2+Required: false+.SS Limitations+.PP+This backend uses a custom library implementing the FileLu API.+While it supports file transfers, some advanced features may not yet be+available.+Please report any issues to the rclone forum (https://forum.rclone.org/)+for troubleshooting and updates.+.PP+For further information, visit FileLu\[aq]s+website (https://filelu.com/)..SH Files.com.PPFiles.com (https://www.files.com/) is a cloud storage service that@@ -51683,6 +54594,40 @@ attempted if possible..PPUse the --interactive/-i or --dry-run flag to see what would be copiedbefore copying.+.SS moveid+.PP+Move files by ID+.IP+.nf+\f[C]+rclone backend moveid remote: [options] [<arguments>+]+\f[R]+.fi+.PP+This command moves files by ID+.PP+Usage:+.IP+.nf+\f[C]+rclone backend moveid drive: ID path+rclone backend moveid drive: ID1 path1 ID2 path2+\f[R]+.fi+.PP+It moves the drive file with ID given to the path (an rclone path which+will be passed internally to rclone moveto).+.PP+The path should end with a / to indicate move the file as named to this+directory.+If it doesn\[aq]t end with a / then the last path component will be used+as the file name.+.PP+If the destination is a drive backend then server-side moving will be+attempted if possible.+.PP+Use the --interactive/-i or --dry-run flag to see what would be moved+beforehand..SS exportformats.PPDump the export formats for debug purposes@@ -52019,6 +54964,12 @@ for transferring photos and videos to and from Google Photos.\f[B]NB\f[R] The Google Photos API which rclone uses has quite a fewlimitations, so please read the limitations section carefully to makesure it is suitable for your use.+.PP+\f[B]NB\f[R] From March 31, 2025 rclone can only download photos it+uploaded.+This limitation is due to policy changes at Google.+You may need to run \f[C]rclone config reconnect remote:\f[R] to make+rclone work again after upgrading to rclone v1.70..SS Configuration.PPThe initial setup for google cloud storage involves getting a token from@@ -52457,7 +55408,7 @@ Use the gphotosdl proxy for downloading the full resolution imagesThe Google API will deliver images and video which aren\[aq]t fullresolution, and/or have EXIF data missing..PP-However if you ue the gphotosdl proxy tnen you can download original,+However if you use the gphotosdl proxy then you can download original,unchanged images..PPThis runs a headless browser in the background.@@ -52596,7 +55547,8 @@ Type: DurationDefault: 0s.SS --gphotos-batch-commit-timeout.PP-Max time to wait for a batch to finish committing+Max time to wait for a batch to finish committing.+(no longer used).PPProperties:.IP \[bu] 2@@ -52627,6 +55579,12 @@ If you attempt to upload non videos or images or formats that GooglePhotos doesn\[aq]t understand, rclone will upload the file, then GooglePhotos will give an error when it is put turned into a media item..PP+\f[B]NB\f[R] From March 31, 2025 rclone can only download photos it+uploaded.+This limitation is due to policy changes at Google.+You may need to run \f[C]rclone config reconnect remote:\f[R] to make+rclone work again after upgrading to rclone v1.70.+.PPNote that all media items uploaded to Google Photos through the API arestored in full resolution at \[dq]original quality\[dq] and\f[B]will\f[R] count towards your storage quota in your Google Account.@@ -54838,7 +57796,7 @@ Enter a value.config_2fa> 2FACODERemote config---------------------[koofr]+[iclouddrive]- type: iclouddrive- apple_id: APPLEID- password: *** ENCRYPTED ***@@ -54854,6 +57812,28 @@ y/e/d> y.SS Advanced Data Protection.PPADP is currently unsupported and need to be disabled+.PP+On iPhone, Settings \f[C]>\f[R] Apple Account \f[C]>\f[R] iCloud+\f[C]>\f[R] \[aq]Access iCloud Data on the Web\[aq] must be ON, and+\[aq]Advanced Data Protection\[aq] OFF.+.SS Troubleshooting+.SS Missing PCS cookies from the request+.PP+This means you have Advanced Data Protection (ADP) turned on.+This is not supported at the moment.+If you want to use rclone you will have to turn it off.+See above for how to turn it off.+.PP+You will need to clear the \f[C]cookies\f[R] and the+\f[C]trust_token\f[R] fields in the config.+Or you can delete the remote config and start again.+.PP+You should then run \f[C]rclone reconnect remote:\f[R].+.PP+Note that changing the ADP setting may not take effect immediately - you+may need to wait a few hours or a day before you can get rclone to work+- keep clearing the config entry and running+\f[C]rclone reconnect remote:\f[R] until rclone functions properly..SS Standard options.PPHere are the Standard options specific to iclouddrive (iCloud Drive).@@ -55184,6 +58164,25 @@ Env Var: RCLONE_INTERNETARCHIVE_SECRET_ACCESS_KEYType: string.IP \[bu] 2Required: false+.SS --internetarchive-item-derive+.PP+Whether to trigger derive on the IA item or not.+If set to false, the item will not be derived by IA upon upload.+The derive process produces a number of secondary files from an upload+to make an upload more usable on the web.+Setting this to false is useful for uploading files that are already in+a format that IA can display or reduce burden on IA\[aq]s+infrastructure.+.PP+Properties:+.IP \[bu] 2+Config: item_derive+.IP \[bu] 2+Env Var: RCLONE_INTERNETARCHIVE_ITEM_DERIVE+.IP \[bu] 2+Type: bool+.IP \[bu] 2+Default: true.SS Advanced options.PPHere are the Advanced options specific to internetarchive (Internet@@ -55218,6 +58217,22 @@ Env Var: RCLONE_INTERNETARCHIVE_FRONT_ENDPOINTType: string.IP \[bu] 2Default: \[dq]https://archive.org\[dq]+.SS --internetarchive-item-metadata+.PP+Metadata to be set on the IA item, this is different from file-level+metadata that can be set using --metadata-set.+Format is key=value and the \[aq]x-archive-meta-\[aq] prefix is+automatically added.+.PP+Properties:+.IP \[bu] 2+Config: item_metadata+.IP \[bu] 2+Env Var: RCLONE_INTERNETARCHIVE_ITEM_METADATA+.IP \[bu] 2+Type: stringArray+.IP \[bu] 2+Default: [].SS --internetarchive-disable-checksum.PPDon\[aq]t ask the server to test against MD5 checksum calculated by@@ -56753,6 +59768,14 @@ Click password for apps /.IP \[bu] 2Add the password - give it a name - eg \[dq]rclone\[dq].IP \[bu] 2+Select the permissions level.+For some reason just \[dq]Full access to Cloud\[dq] (WebDav) doesn\[aq]t+work for Rclone currently.+You have to select \[dq]Full access to Mail, Cloud and Calendar\[dq]+(all protocols).+(thread on+forum.rclone.org (https://forum.rclone.org/t/failed-to-create-file-system-for-mailru-failed-to-authorize-oauth2-invalid-username-or-password-username-or-password-is-incorrect/49298))+.IP \[bu] 2Copy the password and use this password below - your normal loginpassword won\[aq]t work..PP@@ -59157,6 +62180,69 @@ Env Var: RCLONE_AZUREBLOB_UPLOAD_CONCURRENCYType: int.IP \[bu] 2Default: 16+.SS --azureblob-copy-cutoff+.PP+Cutoff for switching to multipart copy.+.PP+Any files larger than this that need to be server-side copied will be+copied in chunks of chunk_size using the put block list API.+.PP+Files smaller than this limit will be copied with the Copy Blob API.+.PP+Properties:+.IP \[bu] 2+Config: copy_cutoff+.IP \[bu] 2+Env Var: RCLONE_AZUREBLOB_COPY_CUTOFF+.IP \[bu] 2+Type: SizeSuffix+.IP \[bu] 2+Default: 8Mi+.SS --azureblob-copy-concurrency+.PP+Concurrency for multipart copy.+.PP+This is the number of chunks of the same file that are copied+concurrently.+.PP+These chunks are not buffered in memory and Microsoft recommends setting+this value to greater than 1000 in the azcopy documentation.+.PP+https://learn.microsoft.com/en-us/azure/storage/common/storage-use-azcopy-optimize#increase-concurrency+.PP+In tests, copy speed increases almost linearly with copy concurrency.+.PP+Properties:+.IP \[bu] 2+Config: copy_concurrency+.IP \[bu] 2+Env Var: RCLONE_AZUREBLOB_COPY_CONCURRENCY+.IP \[bu] 2+Type: int+.IP \[bu] 2+Default: 512+.SS --azureblob-use-copy-blob+.PP+Whether to use the Copy Blob API when copying to the same storage+account.+.PP+If true (the default) then rclone will use the Copy Blob API for copies+to the same storage account even when the size is above the copy_cutoff.+.PP+Rclone assumes that the same storage account means the same config and+does not check for the same storage account in different configs.+.PP+There should be no need to change this value.+.PP+Properties:+.IP \[bu] 2+Config: use_copy_blob+.IP \[bu] 2+Env Var: RCLONE_AZUREBLOB_USE_COPY_BLOB+.IP \[bu] 2+Type: bool+.IP \[bu] 2+Default: true.SS --azureblob-list-chunk.PPSize of blob list.@@ -59451,8 +62537,11 @@ Content-EncodingContent-Language.IP \[bu] 2Content-Type+.IP \[bu] 2+X-MS-Tags.PP-Eg \f[C]--header-upload \[dq]Content-Type: text/potato\[dq]\f[R]+Eg \f[C]--header-upload \[dq]Content-Type: text/potato\[dq]\f[R] or+\f[C]--header-upload \[dq]X-MS-Tags: foo=bar\[dq]\f[R].SS Limitations.PPMD5 sums are only uploaded with chunked files if the source has an MD5@@ -59825,6 +62914,16 @@ identity, the user-assigned identity will be used by default.If the resource has multiple user-assigned identities you will need tounset \f[C]env_auth\f[R] and set \f[C]use_msi\f[R] instead.See the \f[C]use_msi\f[R] section.+.PP+If you are operating in disconnected clouds, or private clouds such as+Azure Stack you may want to set+\f[C]disable_instance_discovery = true\f[R].+This determines whether rclone requests Microsoft Entra instance+metadata from \f[C]https://login.microsoft.com/\f[R] before+authenticating.+Setting this to \f[C]true\f[R] will skip this request, making you+responsible for ensuring the configured authority is valid and+trustworthy..SS Env Auth: 3. Azure CLI credentials (as used by the az tool).PPCredentials created with the \f[C]az\f[R] tool can be picked up using@@ -59945,6 +63044,14 @@ be explicitly specified using exactly one of theIf none of \f[C]msi_object_id\f[R], \f[C]msi_client_id\f[R], or\f[C]msi_mi_res_id\f[R] is set, this is is equivalent to using\f[C]env_auth\f[R].+.SS Azure CLI tool \f[C]az\f[R]+.PP+Set to use the Azure CLI tool+\f[C]az\f[R] (https://learn.microsoft.com/en-us/cli/azure/) as the sole+means of authentication.+Setting this can be useful if you wish to use the \f[C]az\f[R] CLI on a+host with a System Managed Identity that you do not want to use.+Don\[aq]t set \f[C]env_auth\f[R] at the same time..SS Standard options.PPHere are the Standard options specific to azurefiles (Microsoft Azure@@ -60292,6 +63399,43 @@ Env Var: RCLONE_AZUREFILES_MSI_MI_RES_IDType: string.IP \[bu] 2Required: false+.SS --azurefiles-disable-instance-discovery+.PP+Skip requesting Microsoft Entra instance metadata This should be set+true only by applications authenticating in disconnected clouds, or+private clouds such as Azure Stack.+It determines whether rclone requests Microsoft Entra instance metadata+from \f[C]https://login.microsoft.com/\f[R] before authenticating.+Setting this to true will skip this request, making you responsible for+ensuring the configured authority is valid and trustworthy.+.PP+Properties:+.IP \[bu] 2+Config: disable_instance_discovery+.IP \[bu] 2+Env Var: RCLONE_AZUREFILES_DISABLE_INSTANCE_DISCOVERY+.IP \[bu] 2+Type: bool+.IP \[bu] 2+Default: false+.SS --azurefiles-use-az+.PP+Use Azure CLI tool az for authentication Set to use the Azure CLI tool+az (https://learn.microsoft.com/en-us/cli/azure/) as the sole means of+authentication.+Setting this can be useful if you wish to use the az CLI on a host with+a System Managed Identity that you do not want to use.+Don\[aq]t set env_auth at the same time.+.PP+Properties:+.IP \[bu] 2+Config: use_az+.IP \[bu] 2+Env Var: RCLONE_AZUREFILES_USE_AZ+.IP \[bu] 2+Type: bool+.IP \[bu] 2+Default: false.SS --azurefiles-endpoint.PPEndpoint for the service.@@ -60946,7 +64090,7 @@ Microsoft Cloud for US Government\[dq]de\[dq].RS 2.IP \[bu] 2-Microsoft Cloud Germany+Microsoft Cloud Germany (deprecated - try global region first)..RE.IP \[bu] 2\[dq]cn\[dq]@@ -61033,6 +64177,28 @@ Env Var: RCLONE_ONEDRIVE_CLIENT_CREDENTIALSType: bool.IP \[bu] 2Default: false+.SS --onedrive-upload-cutoff+.PP+Cutoff for switching to chunked upload.+.PP+Any files larger than this will be uploaded in chunks of chunk_size.+.PP+This is disabled by default as uploading using single part uploads+causes rclone to use twice the storage on Onedrive business as when+rclone sets the modification time after the upload Onedrive creates a+new version.+.PP+See: https://github.com/rclone/rclone/issues/1716+.PP+Properties:+.IP \[bu] 2+Config: upload_cutoff+.IP \[bu] 2+Env Var: RCLONE_ONEDRIVE_UPLOAD_CUTOFF+.IP \[bu] 2+Type: SizeSuffix+.IP \[bu] 2+Default: off.SS --onedrive-chunk-size.PPChunk size to upload files with - must be multiple of 320k (327,680@@ -61951,6 +65117,43 @@ T}.TE.PPSee the metadata (https://rclone.org/docs/#metadata) docs for more info.+.SS Impersonate other users as Admin+.PP+Unlike Google Drive and impersonating any domain user via service+accounts, OneDrive requires you to authenticate as an admin account, and+manually setup a remote per user you wish to impersonate.+.IP "1." 3+In Microsoft 365 Admin Center (https://admin.microsoft.com), open each+user you need to \[dq]impersonate\[dq] and go to the OneDrive section.+There is a heading called \[dq]Get access to files\[dq], you need to+click to create the link, this creates the link of the format+\f[C]https://{tenant}-my.sharepoint.com/personal/{user_name_domain_tld}/\f[R]+but also changes the permissions so you your admin user has access.+.IP "2." 3+Then in powershell run the following commands:+.IP+.nf+\f[C]+Install-Module Microsoft.Graph -Scope CurrentUser -Repository PSGallery -Force+Import-Module Microsoft.Graph.Files+Connect-MgGraph -Scopes \[dq]Files.ReadWrite.All\[dq]+# Follow the steps to allow access to your admin user+# Then run this for each user you want to impersonate to get the Drive ID+Get-MgUserDefaultDrive -UserId \[aq]{emailaddress}\[aq]+# This will give you output of the format:+# Name Id DriveType CreatedDateTime+# ---- -- --------- ---------------+# OneDrive b!XYZ123 business 14/10/2023 1:00:58\[u202F]pm+\f[R]+.fi+.IP "3." 3+Then in rclone add a onedrive remote type, and use the+\f[C]Type in driveID\f[R] with the DriveID you got in the previous step.+One remote per user.+It will then confirm the drive ID, and hopefully give you a message of+\f[C]Found drive \[dq]root\[dq] of type \[dq]business\[dq]\f[R] and then+include the URL of the format+\f[C]https://{tenant}-my.sharepoint.com/personal/{user_name_domain_tld}/Documents\f[R].SS Limitations.PPIf you don\[aq]t use rclone for 90 days the refresh token will expire.@@ -62568,6 +65771,46 @@ Env Var: RCLONE_OPENDRIVE_CHUNK_SIZEType: SizeSuffix.IP \[bu] 2Default: 10Mi+.SS --opendrive-access+.PP+Files and folders will be uploaded with this access permission (default+private)+.PP+Properties:+.IP \[bu] 2+Config: access+.IP \[bu] 2+Env Var: RCLONE_OPENDRIVE_ACCESS+.IP \[bu] 2+Type: string+.IP \[bu] 2+Default: \[dq]private\[dq]+.IP \[bu] 2+Examples:+.RS 2+.IP \[bu] 2+\[dq]private\[dq]+.RS 2+.IP \[bu] 2+The file or folder access can be granted in a way that will allow select+users to view, read or write what is absolutely essential for them.+.RE+.IP \[bu] 2+\[dq]public\[dq]+.RS 2+.IP \[bu] 2+The file or folder can be downloaded by anyone from a web browser.+The link can be shared in any way,+.RE+.IP \[bu] 2+\[dq]hidden\[dq]+.RS 2+.IP \[bu] 2+The file or folder can be accessed has the same restrictions as Public+if the user knows the URL of the file or folder link in order to access+the contents+.RE+.RE.SS --opendrive-description.PPDescription of the remote.@@ -69938,6 +73181,22 @@ Env Var: RCLONE_SFTP_SOCKS_PROXYType: string.IP \[bu] 2Required: false+.SS --sftp-http-proxy+.PP+URL for HTTP CONNECT proxy+.PP+Set this to a URL for an HTTP proxy which supports the HTTP CONNECT+verb.+.PP+Properties:+.IP \[bu] 2+Config: http_proxy+.IP \[bu] 2+Env Var: RCLONE_SFTP_HTTP_PROXY+.IP \[bu] 2+Type: string+.IP \[bu] 2+Required: false.SS --sftp-copy-is-hardlink.PPSet to enable server side copies using hardlinks.@@ -69984,7 +73243,8 @@ Required: falseOn some SFTP servers (e.g.Synology) the paths are different for SSH and SFTP so the hashescan\[aq]t be calculated properly.-For them using \f[C]disable_hashcheck\f[R] is a good idea.+You can either use \f[C]--sftp-path-override\f[R] or+\f[C]disable_hashcheck\f[R]..PPThe only ssh agent supported under Windows is Putty\[aq]s pageant..PP@@ -70236,6 +73496,24 @@ Env Var: RCLONE_SMB_SPNType: string.IP \[bu] 2Required: false+.SS --smb-use-kerberos+.PP+Use Kerberos authentication.+.PP+If set, rclone will use Kerberos authentication instead of NTLM.+This requires a valid Kerberos configuration and credentials cache to be+available, either in the default locations or as specified by the+KRB5_CONFIG and KRB5CCNAME environment variables.+.PP+Properties:+.IP \[bu] 2+Config: use_kerberos+.IP \[bu] 2+Env Var: RCLONE_SMB_USE_KERBEROS+.IP \[bu] 2+Type: bool+.IP \[bu] 2+Default: false.SS Advanced options.PPHere are the Advanced options specific to smb (SMB / CIFS).@@ -72449,13 +75727,13 @@ rclone copy /home/source remote:backup.SS Modification times and hashes.PPPlain WebDAV does not support modified times.-However when used with Fastmail Files, Owncloud or Nextcloud rclone will+However when used with Fastmail Files, ownCloud or Nextcloud rclone willsupport modified times..PPLikewise plain WebDAV does not support hashes, however when used with-Fastmail Files, Owncloud or Nextcloud rclone will support SHA1 and MD5+Fastmail Files, ownCloud or Nextcloud rclone will support SHA1 and MD5hashes.-Depending on the exact version of Owncloud or Nextcloud hashes may+Depending on the exact version of ownCloud or Nextcloud hashes mayappear on all objects, or only on objects which had a hash uploaded withthem..SS Standard options@@ -72509,7 +75787,13 @@ Nextcloud\[dq]owncloud\[dq].RS 2.IP \[bu] 2-Owncloud+Owncloud 10 PHP based WebDAV server+.RE+.IP \[bu] 2+\[dq]infinitescale\[dq]+.RS 2+.IP \[bu] 2+ownCloud Infinite Scale.RE.IP \[bu] 2\[dq]sharepoint\[dq]@@ -72767,22 +76051,31 @@ to create an app password with access to \f[C]Files (WebDAV)\f[R] anduse this as the password..PPFastmail supports modified times using the \f[C]X-OC-Mtime\f[R] header.-.SS Owncloud+.SS ownCloud.PPClick on the settings cog in the bottom right of the page and this willshow the WebDAV URL that rclone needs in the config step.It will look something like\f[C]https://example.com/remote.php/webdav/\f[R]..PP-Owncloud supports modified times using the \f[C]X-OC-Mtime\f[R] header.+ownCloud supports modified times using the \f[C]X-OC-Mtime\f[R] header..SS Nextcloud.PP-This is configured in an identical way to Owncloud.+This is configured in an identical way to ownCloud.Note that Nextcloud initially did not support streaming of files-(\f[C]rcat\f[R]) whereas Owncloud did, but+(\f[C]rcat\f[R]) whereas ownCloud did, butthis (https://github.com/nextcloud/nextcloud-snap/issues/365) seems tobe fixed as of 2020-11-27 (tested with rclone v1.53.1 and NextcloudServer v19).+.SS ownCloud Infinite Scale+.PP+The WebDAV URL for Infinite Scale can be found in the details panel of+any space in Infinite Scale, if the display was enabled in the personal+settings of the user through a checkbox there.+.PP+Infinite Scale works with the chunking tus (https://tus.io) upload+protocol.+The chunk size is currently fixed 10 MB..SS Sharepoint Online.PPRclone can be used with Sharepoint provided by OneDrive for Business or@@ -74872,6 +78165,526 @@ Options:.IP \[bu] 2\[dq]error\[dq]: return an error based on option value.SH Changelog+.SS v1.70.0 - 2025-06-17+.PP+See commits (https://github.com/rclone/rclone/compare/v1.69.0...v1.70.0)+.IP \[bu] 2+New backends+.RS 2+.IP \[bu] 2+DOI (https://rclone.org/doi/) (Flora Thiebaut)+.IP \[bu] 2+FileLu (https://rclone.org/filelu/) (kingston125)+.IP \[bu] 2+New S3 providers:+.RS 2+.IP \[bu] 2+MEGA S4 (https://rclone.org/s3/#mega) (Nick Craig-Wood)+.IP \[bu] 2+Pure Storage FlashBlade (https://rclone.org/s3/#pure-storage-flashblade)+(Jeremy Daer)+.RE+.RE+.IP \[bu] 2+New commands+.RS 2+.IP \[bu] 2+convmv (https://rclone.org/commands/rclone_convmv/): for moving and+transforming files (nielash)+.RE+.IP \[bu] 2+New Features+.RS 2+.IP \[bu] 2+Add+\f[C]--max-connections\f[R] (https://rclone.org/docs/#max-connections-n)+to control maximum backend concurrency (Nick Craig-Wood)+.IP \[bu] 2+Add+\f[C]--max-buffer-memory\f[R] (https://rclone.org/docs/#max-buffer-memory)+to limit total buffer memory usage (Nick Craig-Wood)+.IP \[bu] 2+Add transform library and+\f[C]--name-transform\f[R] (https://rclone.org/docs/#name-transform-command-xxxx)+flag (nielash)+.IP \[bu] 2+sync: Implement+\f[C]--list-cutoff\f[R] (https://rclone.org/docs/#list-cutoff) to allow+on disk sorting for reduced memory use (Nick Craig-Wood)+.IP \[bu] 2+accounting: Add listed stat for number of directory entries listed (Nick+Craig-Wood)+.IP \[bu] 2+backend: Skip hash calculation when the hashType is None (Oleksiy+Stashok)+.IP \[bu] 2+build+.RS 2+.IP \[bu] 2+Update to go1.24 and make go1.22 the minimum required version (Nick+Craig-Wood)+.IP \[bu] 2+Disable docker builds on PRs & add missing dockerfile changes (Anagh+Kumar Baranwal)+.IP \[bu] 2+Modernize Go usage (Nick Craig-Wood)+.IP \[bu] 2+Update all dependencies (Nick Craig-Wood)+.RE+.IP \[bu] 2+cmd/authorize: Show required arguments in help text (simwai)+.IP \[bu] 2+cmd/config: add \f[C]--no-output\f[R] option (Jess)+.IP \[bu] 2+cmd/gitannex+.RS 2+.IP \[bu] 2+Tweak parsing of \[dq]rcloneremotename\[dq] config (Dan McArdle)+.IP \[bu] 2+Permit remotes with options (Dan McArdle)+.IP \[bu] 2+Reject unknown layout modes in INITREMOTE (Dan McArdle)+.RE+.IP \[bu] 2+docker image: Add label org.opencontainers.image.source for release+notes in Renovate dependency updates (Robin Schneider)+.IP \[bu] 2+doc fixes (albertony, Andrew Kreimer, Ben Boeckel, Christoph Berger,+Danny Garside, Dimitri Papadopoulos, eccoisle, Ed Craig-Wood, Fernando+Fern\['a]ndez, jack, Jeff Geerling, Jugal Kishore, kingston125, luzpaz,+Markus Gerstel, Matt Ickstadt, Michael Kebe, Nick Craig-Wood,+PrathameshLakawade, Ser-Bul, simonmcnair, Tim White, Zachary Vorhies)+.IP \[bu] 2+filter:+.RS 2+.IP \[bu] 2+Add \f[C]--hash-filter\f[R] to deterministically select a subset of+files (Nick Craig-Wood)+.IP \[bu] 2+Show \f[C]--min-size\f[R] and \f[C]--max-size\f[R] in \f[C]--dump\f[R]+filters (Nick Craig-Wood)+.RE+.IP \[bu] 2+hash: Add SHA512 support for file hashes (Enduriel)+.IP \[bu] 2+http servers: Add \f[C]--user-from-header\f[R] to use for authentication+(Moises Lima)+.IP \[bu] 2+lib/batcher: Deprecate unused option: batch_commit_timeout (Dan McArdle)+.IP \[bu] 2+log:+.RS 2+.IP \[bu] 2+Remove github.com/sirupsen/logrus and replace with log/slog (Nick+Craig-Wood)+.IP \[bu] 2+Add \f[C]--windows-event-log-level\f[R] to support Windows Event Log+(Nick Craig-Wood)+.RE+.IP \[bu] 2+rc+.RS 2+.IP \[bu] 2+Add add \f[C]short\f[R] parameter to \f[C]core/stats\f[R] to not return+transferring and checking (Nick Craig-Wood)+.IP \[bu] 2+In \f[C]options/info\f[R] make FieldName contain a \[dq].\[dq] if it+should be nested (Nick Craig-Wood)+.IP \[bu] 2+Add rc control for serve commands (Nick Craig-Wood)+.IP \[bu] 2+rcserver: Improve content-type check (Jonathan Giannuzzi)+.RE+.IP \[bu] 2+serve nfs+.RS 2+.IP \[bu] 2+Update docs to note Windows is not supported (Zachary Vorhies)+.IP \[bu] 2+Change the format of \f[C]--nfs-cache-type symlink\f[R] file handles+(Nick Craig-Wood)+.IP \[bu] 2+Make metadata files have special file handles (Nick Craig-Wood)+.RE+.IP \[bu] 2+touch: Make touch obey \f[C]--transfers\f[R] (Nick Craig-Wood)+.IP \[bu] 2+version: Add \f[C]--deps\f[R] flag to show dependencies and other build+info (Nick Craig-Wood)+.RE+.IP \[bu] 2+Bug Fixes+.RS 2+.IP \[bu] 2+serve s3:+.RS 2+.IP \[bu] 2+Fix ListObjectsV2 response (fhuber)+.IP \[bu] 2+Remove redundant handler initialization (Tho Neyugn)+.RE+.IP \[bu] 2+stats: Fix goroutine leak and improve stats accounting process+(Nathanael Demacon)+.RE+.IP \[bu] 2+VFS+.RS 2+.IP \[bu] 2+Add \f[C]--vfs-metadata-extension\f[R] to expose metadata sidecar files+(Nick Craig-Wood)+.RE+.IP \[bu] 2+Azure Blob+.RS 2+.IP \[bu] 2+Add support for \f[C]x-ms-tags\f[R] header (Trevor Starick)+.IP \[bu] 2+Cleanup uncommitted blocks on upload errors (Nick Craig-Wood)+.IP \[bu] 2+Speed up server side copies for small files (Nick Craig-Wood)+.IP \[bu] 2+Implement multipart server side copy (Nick Craig-Wood)+.IP \[bu] 2+Remove uncommitted blocks on InvalidBlobOrBlock error (Nick Craig-Wood)+.IP \[bu] 2+Fix handling of objects with // in (Nick Craig-Wood)+.IP \[bu] 2+Handle retry error codes more carefully (Nick Craig-Wood)+.IP \[bu] 2+Fix errors not being retried when doing single part copy (Nick+Craig-Wood)+.IP \[bu] 2+Fix multipart server side copies of 0 sized files (Nick Craig-Wood)+.RE+.IP \[bu] 2+Azurefiles+.RS 2+.IP \[bu] 2+Add \f[C]--azurefiles-use-az\f[R] and+\f[C]--azurefiles-disable-instance-discovery\f[R] (b-wimmer)+.RE+.IP \[bu] 2+B2+.RS 2+.IP \[bu] 2+Add SkipDestructive handling to backend commands (Pat Patterson)+.IP \[bu] 2+Use file id from listing when not presented in headers (ahxxm)+.RE+.IP \[bu] 2+Cloudinary+.RS 2+.IP \[bu] 2+Automatically add/remove known media files extensions (yuval-cloudinary)+.IP \[bu] 2+Var naming convention (yuval-cloudinary)+.RE+.IP \[bu] 2+Drive+.RS 2+.IP \[bu] 2+Added \f[C]backend moveid\f[R] command (Spencer McCullough)+.RE+.IP \[bu] 2+Dropbox+.RS 2+.IP \[bu] 2+Support Dropbox Paper (Dave Vasilevsky)+.RE+.IP \[bu] 2+FTP+.RS 2+.IP \[bu] 2+Add \f[C]--ftp-http-proxy\f[R] to connect via HTTP CONNECT proxy+.RE+.IP \[bu] 2+Gofile+.RS 2+.IP \[bu] 2+Update to use new direct upload endpoint (wbulot)+.RE+.IP \[bu] 2+Googlephotos+.RS 2+.IP \[bu] 2+Update read only and read write scopes to meet Google\[aq]s+requirements.+(Germ\['a]n Casares)+.RE+.IP \[bu] 2+Iclouddrive+.RS 2+.IP \[bu] 2+Fix panic and files potentially downloaded twice (Cl\['e]ment Wehrung)+.RE+.IP \[bu] 2+Internetarchive+.RS 2+.IP \[bu] 2+Add \f[C]--internetarchive-metadata=\[dq]key=value\[dq]\f[R] for setting+item metadata (Corentin Barreau)+.RE+.IP \[bu] 2+Onedrive+.RS 2+.IP \[bu] 2+Fix \[dq]The upload session was not found\[dq] errors (Nick Craig-Wood)+.IP \[bu] 2+Re-add \f[C]--onedrive-upload-cutoff\f[R] flag (Nick Craig-Wood)+.IP \[bu] 2+Fix crash if no metadata was updated (Nick Craig-Wood)+.RE+.IP \[bu] 2+Opendrive+.RS 2+.IP \[bu] 2+Added \f[C]--opendrive-access\f[R] flag to handle permissions (Joel K+Biju)+.RE+.IP \[bu] 2+Pcloud+.RS 2+.IP \[bu] 2+Fix \[dq]Access denied.+You do not have permissions to perform this operation\[dq] on large+uploads (Nick Craig-Wood)+.RE+.IP \[bu] 2+S3+.RS 2+.IP \[bu] 2+Fix handling of objects with // in (Nick Craig-Wood)+.IP \[bu] 2+Add IBM IAM signer (Alexander Minbaev)+.IP \[bu] 2+Split the GCS quirks into \f[C]--s3-use-x-id\f[R] and+\f[C]--s3-sign-accept-encoding\f[R] (Nick Craig-Wood)+.IP \[bu] 2+Implement paged listing interface ListP (Nick Craig-Wood)+.IP \[bu] 2+Add Pure Storage FlashBlade provider support (Jeremy Daer)+.IP \[bu] 2+Require custom endpoint for Lyve Cloud v2 support (PrathameshLakawade)+.IP \[bu] 2+MEGA S4 support (Nick Craig-Wood)+.RE+.IP \[bu] 2+SFTP+.RS 2+.IP \[bu] 2+Add \f[C]--sftp-http-proxy\f[R] to connect via HTTP CONNECT proxy (Nick+Craig-Wood)+.RE+.IP \[bu] 2+Smb+.RS 2+.IP \[bu] 2+Add support for kerberos authentication (Jonathan Giannuzzi)+.IP \[bu] 2+Improve connection pooling efficiency (Jonathan Giannuzzi)+.RE+.IP \[bu] 2+WebDAV+.RS 2+.IP \[bu] 2+Retry propfind on 425 status (J\[:o]rn Friedrich Dreyer)+.IP \[bu] 2+Add an ownCloud Infinite Scale vendor that enables tus chunked upload+support (Klaas Freitag)+.RE+.SS v1.69.3 - 2025-05-21+.PP+See commits (https://github.com/rclone/rclone/compare/v1.69.2...v1.69.3)+.IP \[bu] 2+Bug Fixes+.RS 2+.IP \[bu] 2+build: Reapply update github.com/golang-jwt/jwt/v5 from 5.2.1 to 5.2.2+to fix CVE-2025-30204 (dependabot[bot])+.IP \[bu] 2+build: Update github.com/ebitengine/purego to work around bug in+go1.24.3 (Nick Craig-Wood)+.RE+.SS v1.69.2 - 2025-05-01+.PP+See commits (https://github.com/rclone/rclone/compare/v1.69.1...v1.69.2)+.IP \[bu] 2+Bug fixes+.RS 2+.IP \[bu] 2+accounting: Fix percentDiff calculation -- (Anagh Kumar Baranwal)+.IP \[bu] 2+build+.RS 2+.IP \[bu] 2+Update github.com/golang-jwt/jwt/v4 from 4.5.1 to 4.5.2 to fix+CVE-2025-30204 (dependabot[bot])+.IP \[bu] 2+Update github.com/golang-jwt/jwt/v5 from 5.2.1 to 5.2.2 to fix+CVE-2025-30204 (dependabot[bot])+.IP \[bu] 2+Update golang.org/x/crypto to v0.35.0 to fix CVE-2025-22869 (Nick+Craig-Wood)+.IP \[bu] 2+Update golang.org/x/net from 0.36.0 to 0.38.0 to fix CVE-2025-22870+(dependabot[bot])+.IP \[bu] 2+Update golang.org/x/net to 0.36.0.+to fix CVE-2025-22869 (dependabot[bot])+.IP \[bu] 2+Stop building with go < go1.23 as security updates forbade it (Nick+Craig-Wood)+.IP \[bu] 2+Fix docker plugin build (Anagh Kumar Baranwal)+.RE+.IP \[bu] 2+cmd: Fix crash if rclone is invoked without any arguments (Janne+Hellsten)+.IP \[bu] 2+config: Read configuration passwords from stdin even when terminated+with EOF (Samantha Bowen)+.IP \[bu] 2+doc fixes (Andrew Kreimer, Danny Garside, eccoisle, Ed Craig-Wood,+emyarod, jack, Jugal Kishore, Markus Gerstel, Michael Kebe, Nick+Craig-Wood, simonmcnair, simwai, Zachary Vorhies)+.IP \[bu] 2+fs: Fix corruption of SizeSuffix with \[dq]B\[dq] suffix in config (eg+--min-size) (Nick Craig-Wood)+.IP \[bu] 2+lib/http: Fix race between Serve() and Shutdown() (Nick Craig-Wood)+.IP \[bu] 2+object: Fix memory object out of bounds Seek (Nick Craig-Wood)+.IP \[bu] 2+operations: Fix call fmt.Errorf with wrong err (alingse)+.IP \[bu] 2+rc+.RS 2+.IP \[bu] 2+Disable the metrics server when running \f[C]rclone rc\f[R]+(hiddenmarten)+.IP \[bu] 2+Fix debug/* commands not being available over unix sockets (Nick+Craig-Wood)+.RE+.IP \[bu] 2+serve nfs: Fix unlikely crash (Nick Craig-Wood)+.IP \[bu] 2+stats: Fix the speed not getting updated after a pause in the processing+(Anagh Kumar Baranwal)+.IP \[bu] 2+sync+.RS 2+.IP \[bu] 2+Fix cpu spinning when empty directory finding with leading slashes (Nick+Craig-Wood)+.IP \[bu] 2+Copy dir modtimes even when copyEmptySrcDirs is false (ll3006)+.RE+.RE+.IP \[bu] 2+VFS+.RS 2+.IP \[bu] 2+Fix directory cache serving stale data (Lorenz Brun)+.IP \[bu] 2+Fix inefficient directory caching when directory reads are slow+(huanghaojun)+.IP \[bu] 2+Fix integration test failures (Nick Craig-Wood)+.RE+.IP \[bu] 2+Drive+.RS 2+.IP \[bu] 2+Metadata: fix error when setting copy-requires-writer-permission on a+folder (Nick Craig-Wood)+.RE+.IP \[bu] 2+Dropbox+.RS 2+.IP \[bu] 2+Retry link without expiry (Dave Vasilevsky)+.RE+.IP \[bu] 2+HTTP+.RS 2+.IP \[bu] 2+Correct root if definitely pointing to a file (nielash)+.RE+.IP \[bu] 2+Iclouddrive+.RS 2+.IP \[bu] 2+Fix so created files are writable (Ben Alex)+.RE+.IP \[bu] 2+Onedrive+.RS 2+.IP \[bu] 2+Fix metadata ordering in permissions (Nick Craig-Wood)+.RE+.SS v1.69.1 - 2025-02-14+.PP+See commits (https://github.com/rclone/rclone/compare/v1.69.0...v1.69.1)+.IP \[bu] 2+Bug Fixes+.RS 2+.IP \[bu] 2+lib/oauthutil: Fix redirect URL mismatch errors (Nick Craig-Wood)+.IP \[bu] 2+bisync: Fix listings missing concurrent modifications (nielash)+.IP \[bu] 2+serve s3: Fix list objects encoding-type (Nick Craig-Wood)+.IP \[bu] 2+fs: Fix confusing \[dq]didn\[aq]t find section in config file\[dq] error+(Nick Craig-Wood)+.IP \[bu] 2+doc fixes (Christoph Berger, Dimitri Papadopoulos, Matt Ickstadt, Nick+Craig-Wood, Tim White, Zachary Vorhies)+.IP \[bu] 2+build: Added parallel docker builds and caching for go build in the+container (Anagh Kumar Baranwal)+.RE+.IP \[bu] 2+VFS+.RS 2+.IP \[bu] 2+Fix the cache failing to upload symlinks when \f[C]--links\f[R] was+specified (Nick Craig-Wood)+.IP \[bu] 2+Fix race detected by race detector (Nick Craig-Wood)+.IP \[bu] 2+Close the change notify channel on Shutdown (izouxv)+.RE+.IP \[bu] 2+B2+.RS 2+.IP \[bu] 2+Fix \[dq]fatal error: concurrent map writes\[dq] (Nick Craig-Wood)+.RE+.IP \[bu] 2+Iclouddrive+.RS 2+.IP \[bu] 2+Add notes on ADP and Missing PCS cookies (Nick Craig-Wood)+.RE+.IP \[bu] 2+Onedrive+.RS 2+.IP \[bu] 2+Mark German (de) region as deprecated (Nick Craig-Wood)+.RE+.IP \[bu] 2+S3+.RS 2+.IP \[bu] 2+Added new storage class to magalu provider (Bruno Fernandes)+.IP \[bu] 2+Add DigitalOcean regions SFO2, LON1, TOR1, BLR1 (jkpe)+.IP \[bu] 2+Add latest Linode Object Storage endpoints (jbagwell-akamai)+.RE.SS v1.69.0 - 2025-01-12.PPSee commits (https://github.com/rclone/rclone/compare/v1.68.0...v1.69.0)@@ -74955,7 +78768,7 @@ in http servers (Moises Lima).IP \[bu] 2This was making it impossible to use unix sockets with an proxy.IP \[bu] 2-This might now cause rclone to need authenticaton where it didn\[aq]t+This might now cause rclone to need authentication where it didn\[aq]tbefore.RE.IP \[bu] 2@@ -76881,8 +80694,8 @@ Refactor version info and icon resource handling on windows (albertony)doc updates (albertony, alfish2000, asdffdsazqqq, Dimitri Papadopoulos,Herby Gillot, Joda St\[:o]\[ss]er, Manoj Ghosh, Nick Craig-Wood).IP \[bu] 2-Implement \f[C]--metadata-mapper\f[R] to transform metatadata with a-user supplied program (Nick Craig-Wood)+Implement \f[C]--metadata-mapper\f[R] to transform metadata with a user+supplied program (Nick Craig-Wood).IP \[bu] 2Add \f[C]ChunkWriterDoesntSeek\f[R] feature flag and set it for b2 (NickCraig-Wood)@@ -77202,7 +81015,7 @@ B2Fix multipart upload: corrupted on transfer: sizes differ XXX vs 0 (NickCraig-Wood).IP \[bu] 2-Fix locking window when getting mutipart upload URL (Nick Craig-Wood)+Fix locking window when getting multipart upload URL (Nick Craig-Wood).IP \[bu] 2Fix server side copies greater than 4GB (Nick Craig-Wood).IP \[bu] 2@@ -89834,6 +93647,23 @@ info..PPThis has now been documented in its own remote setuppage (https://rclone.org/remote_setup/).+.SS How can I get rid of the \[dq]Config file not found\[dq] notice?+.PP+If you see a notice like \[aq]NOTICE: Config file \[dq]rclone.conf\[dq]+not found\[aq], this means you have not configured any remotes.+.PP+If you need to configure a remote, see the config help+docs (https://rclone.org/docs/#configure).+.PP+If you are using rclone entirely with on the fly+remotes (https://rclone.org/docs/#backend-path-to-dir), you can create+an empty config file to get rid of this notice, for example:+.IP+.nf+\f[C]+rclone config touch+\f[R]+.fi.SS Can rclone sync directly from drive to s3.PPRclone can sync between two remote cloud storage systems just fine.@@ -90090,11 +93920,23 @@ at the expense of CPU usage..PPThe most common cause of rclone using lots of memory is a singledirectory with millions of files in.-Rclone has to load this entirely into memory as rclone objects.+.PP+Before rclone v1.70 has to load this entirely into memory as rclone+objects.Each rclone object takes 0.5k-1k of memory.There is a workaround forthis (https://github.com/rclone/rclone/wiki/Big-syncs-with-millions-of-files)which involves a bit of scripting.+.PP+However with rclone v1.70 and later rclone will automatically save+directory entries to disk when a directory with more than+\f[C]--list-cutoff\f[R] (https://rclone.org/docs/#list-cutoff)+(1,000,000 by default) entries is detected.+.PP+From v1.70 rclone also has the+--max-buffer-memory (https://rclone.org/docs/#max-buffer-memory) flag+which helps particularly when multi-thread transfers are using too much+memory..SS Rclone changes fullwidth Unicode punctuation marks in file names.PPFor example: On a Windows system, you have a file with name@@ -91758,8 +95600,6 @@ Eli Orzitzer <[email protected]>.IP \[bu] 2Anthony Metzidis <[email protected]>.IP \[bu] 2-emyarod <[email protected]>-.IP \[bu] 2keongalvin <[email protected]>.IP \[bu] 2rarspace01 <[email protected]>@@ -91992,6 +95832,123 @@ TAKEI Yuya <[email protected]>.IP \[bu] 2Francesco Frassinelli <[email protected]>+.IP \[bu] 2+Matt Ickstadt <[email protected]> <[email protected]>+.IP \[bu] 2+Spencer McCullough <[email protected]>+.IP \[bu] 2+Jonathan Giannuzzi <[email protected]>+.IP \[bu] 2+Christoph Berger <[email protected]>+.IP \[bu] 2+Tim White <[email protected]>+.IP \[bu] 2+Robin Schneider <[email protected]>+.IP \[bu] 2+izouxv <[email protected]>+.IP \[bu] 2+Moises Lima <[email protected]>+.IP \[bu] 2+Bruno Fernandes <[email protected]>+.IP \[bu] 2+Corentin Barreau <[email protected]>+.IP \[bu] 2+hiddenmarten <[email protected]>+.IP \[bu] 2+Trevor Starick <[email protected]>+.IP \[bu] 2+b-wimmer <[email protected]>+.IP \[bu] 2+Jess <[email protected]>+.IP \[bu] 2+Zachary Vorhies <[email protected]>+.IP \[bu] 2+Alexander Minbaev <[email protected]>+.IP \[bu] 2+Joel K Biju <[email protected]>+.IP \[bu] 2+ll3006 <[email protected]>+.IP \[bu] 2+jbagwell-akamai <[email protected]>+.IP \[bu] 2+Michael Kebe <[email protected]>+.IP \[bu] 2+Lorenz Brun <[email protected]>+.IP \[bu] 2+Dave Vasilevsky <[email protected]> <[email protected]>+.IP \[bu] 2+luzpaz <[email protected]>+.IP \[bu] 2+jack <[email protected]>+.IP \[bu] 2+J\[:o]rn Friedrich Dreyer <[email protected]>+.IP \[bu] 2+alingse <[email protected]>+.IP \[bu] 2+Fernando Fern\['a]ndez <[email protected]>+.IP \[bu] 2+eccoisle <[email protected]>+.IP \[bu] 2+Klaas Freitag <[email protected]>+.IP \[bu] 2+Danny Garside <[email protected]>+.IP \[bu] 2+Samantha Bowen <[email protected]>+.IP \[bu] 2+simonmcnair <[email protected]>+.IP \[bu] 2+huanghaojun <[email protected]>+.IP \[bu] 2+Enduriel <[email protected]>+.IP \[bu] 2+Markus Gerstel <[email protected]>+.IP \[bu] 2+simwai <[email protected]>+.IP \[bu] 2+Ben Alex <[email protected]>+.IP \[bu] 2+Klaas Freitag <[email protected]> <[email protected]>+.IP \[bu] 2+Andrew Kreimer <[email protected]>+.IP \[bu] 2+Ed Craig-Wood <[email protected]>+.IP \[bu] 2+Christian Richter <[email protected]>+.IP \[bu] 2+Ralf Haferkamp <[email protected]>+.IP \[bu] 2+Jugal Kishore <[email protected]>+.IP \[bu] 2+Tho Neyugn <[email protected]>+.IP \[bu] 2+Ben Boeckel <[email protected]>+.IP \[bu] 2+Cl\['e]ment Wehrung <[email protected]>+.IP \[bu] 2+Jeff Geerling <[email protected]>+.IP \[bu] 2+Germ\['a]n Casares <[email protected]>+.IP \[bu] 2+fhuber <[email protected]>+.IP \[bu] 2+wbulot <[email protected]>+.IP \[bu] 2+Jeremy Daer <[email protected]>+.IP \[bu] 2+Oleksiy Stashok <[email protected]>+.IP \[bu] 2+PrathameshLakawade <[email protected]>+.IP \[bu] 2+Nathanael Demacon <[email protected]>+.IP \[bu] 2+ahxxm <[email protected]>+.IP \[bu] 2+Flora Thiebaut <[email protected]>+.IP \[bu] 2+kingston125 <[email protected]>+.IP \[bu] 2+Ser-Bul <[email protected]>.SH Contact the rclone project.SS Forum.PP