Skip to content

Bulk asynchronous downloader for multiple file hosts

docs: update changelog

NTFSvolume0d69a82a52ac
diff --git a/CHANGELOG.md b/CHANGELOG.md
index eb1c30f89..4b036ce3e 100644
--- a/CHANGELOG.md
+++ b/CHANGELOG.md
@@ -1,2192 +1,2192 @@
-<!-- Template
-## UNRELEASED
-
-### Added
-
-### Changed
-
-### Deprecated
-
-### Removed
-
-### Fixed
-
-### Security
-
--->
-
-# CHANGELOG
-
-All notable changes to this project will be documented here. For more details, visit the wiki: <https://script-ware.gitbook.io/cyberdrop-dl>
-
-The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.1.0/),
-and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
-
-## UNRELEASED
-
-⚠️**IMPORTANT**
-
+<!-- Template
+## UNRELEASED
+
+### Added
+
+### Changed
+
+### Deprecated
+
+### Removed
+
+### Fixed
+
+### Security
+
+-->
+
+# CHANGELOG
+
+All notable changes to this project will be documented here. For more details, visit the wiki: <https://script-ware.gitbook.io/cyberdrop-dl>
+
+The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.1.0/),
+and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
+
+## UNRELEASED
+
+⚠️**IMPORTANT**
+
> This version is incompatible with any previous release. Config file options need to be manually migrated by user.
->
+>
> CDL will refuse to start if the current database schema is older than `v9.15.0`. Run `cyberdrop-dl database transfer` to upgrade older databases
-
-### Added
-
-- New `--cookies` option to read cookies from a file/folder
-- New `--hashes` option to control which hashes CDL computes for new downloads
-
-### Changed
-
+
+### Added
+
+- New `--cookies` option to read cookies from a file/folder
+- New `--hashes` option to control which hashes CDL computes for new downloads
+
+### Changed
+
- The config file format has completely changed. All configs (`Auth`, `Global` and `Setttings`) are now a single file. Several options have new names, new defaults and new groups
- Do not create a config file by default
- Validate config in strict mode. If a config has an unknown entry, CDL will refuse to run instead of ignoring it
-- Apprise URLs are now part of the main config file instead of a dedicated `apprise.txt` file
+- Apprise URLs are now part of the main config file instead of a dedicated `apprise.txt` file
- Refuse to start if the current database schema is older than `v9.15.0`
-- Detect and report BasedFlare anti-bot protection
-- Cookies with not be automatically loaded from `AppData/cookies`. Path to cookies needs to be specified with `--cookies`
-- Always remove generated id from filenames (Cyberdrop)
-- Compute `xxh128`, `md5` and `sha256` hashes by default
-- `--deep-scrape` will no longer reset after a single run
+- Detect and report BasedFlare anti-bot protection
+- Cookies with not be automatically loaded from `AppData/cookies`. Path to cookies needs to be specified with `--cookies`
+- Always remove generated id from filenames (Cyberdrop)
+- Compute `xxh128`, `md5` and `sha256` hashes by default
+- `--deep-scrape` will no longer reset after a single run
- `--input-file` is now a CLI only arg
-- If supplied, `--input-file` needs to be a valid file that exists
+- If supplied, `--input-file` needs to be a valid file that exists
- Refuse to run if both URLs and `--input-file` are passed as arguments
-
+
The following options, which were CLI only arguments, now have dedicated config entries:
-
-- `--ui` (entry: `ui.mode`)
-- `--portrait` (entry: `ui.portrait`)
+
+- `--ui` (entry: `ui.mode`)
+- `--portrait` (entry: `ui.portrait`)
- `--stats`
-
-Several config options have new names:
-
-- `--disable-crawlers`-> `--crawlers.disabled`
-- `--disable-file-timestamps`-> `--mtime`
-- `--maximum-audio-duration` -> `--max-audio-duration`
-- `--maximum-image-size` -> `--max-image-size`
-- `--maximum-number-of-children` -> `--max-children`
-- `--maximum-other-size` -> `--max-non-media-size`
-- `--maximum-thread-depth` -> `--max-thread-depth`
-- `--maximum-thread-folder-depth` -> `--max-thread-folder-depth`
-- `--maximum-video-duration` -> `--max-video-duration`
-- `--maximum-video-size` -> `--max-video-size`
-- `--minimum-audio-duration` -> `--min-audio-duration`
-- `--minimum-image-size` -> `--min-image-size`
-- `--minimum-other-size` -> `--min-non-media-size`
-- `--minimum-video-duration` -> `--min-video-duration`
-- `--minimum-video-size` -> `--min-video-size`
-- `--required-free-space` -> `--min-free-space`
-- `--print-stats` -> `--stats` , `--no-stats`
-- `--send-deleted-to-trash` -> `--hashing.dedupe.use-trash-bin`
-
-#### Jdownloader
-
-- `--jdownloader-autostart` -> `--jdownloader.autostart`
-- `--jdownloader-download-dir` -> `--jdownloader.download-dir`
-- `--jdownloader-whitelist` -> `--jdownloader.whitelist`
-- `--send-unsupported-to-jdownloader`-> `--jdownloader` / `--no-jdownloader`
-
-#### Sorting
-
-- `--sort-downloads` -> `--sort` / `--no-sort`
-- `--scan-folder` -> `--sort.input-folder`
-- `--sort-folder` -> `--sort.output-folder`
-- `--sort-incrementer-format` -> `--sort.formats.incrementer`
-- `--sorted-audio` -> `--sort.formats.audio`
-- `--sorted-image` -> `--sort.formats.image`
-- `--sorted-other` -> `--sort.formats.non-media`
-- `--sorted-video` -> `--sort.formats.video`
-
-#### Ignore options (filters)
-
-The behavior of `--filename-regex` has been reversed (files that DO NOT match the regex will skipped)
-The behavior of `--before` and `--after` has been reversed and the `--exclude` prefix removed (they now **include** instead of excluding files)
-
-- `--exclude-audio` -> `--no-audio`
-- `--exclude-images` -> `--no-images`
-- `--exclude-other` -> `--no-non-media`
-- `--exclude-videos` -> `--no-videos`
-- `--exclude-before` -> `--before`
-- `--exclude-after` -> `--after`
-- `--exclude-files-with-no-extension` -> `--allow-files-with-no-extension`
-- `--filename-regex-filter` -> `--filename-regex`
-- `--ignore-coomer-ads` -> `--crawlers.coomer.ignore-ads`
-- `--ignore-coomer-post-content` -> `--crawlers.coomer.ignore-post-content`
-- `--download-tiktok-src-quality-videos` -> - `--crawlers.tiktok.original`
-
-#### Logs
-
-- `--log-level` -> `--logs.level`
-- `--console-log-level` -> `--logs.console-level`
-- `--log-folder` -> `--logs.folder`
-- `--logs-expire-after` -> `--logs.expire-after`
+
+Several config options have new names:
+
+- `--disable-crawlers`-> `--crawlers.disabled`
+- `--disable-file-timestamps`-> `--mtime`
+- `--maximum-audio-duration` -> `--max-audio-duration`
+- `--maximum-image-size` -> `--max-image-size`
+- `--maximum-number-of-children` -> `--max-children`
+- `--maximum-other-size` -> `--max-non-media-size`
+- `--maximum-thread-depth` -> `--max-thread-depth`
+- `--maximum-thread-folder-depth` -> `--max-thread-folder-depth`
+- `--maximum-video-duration` -> `--max-video-duration`
+- `--maximum-video-size` -> `--max-video-size`
+- `--minimum-audio-duration` -> `--min-audio-duration`
+- `--minimum-image-size` -> `--min-image-size`
+- `--minimum-other-size` -> `--min-non-media-size`
+- `--minimum-video-duration` -> `--min-video-duration`
+- `--minimum-video-size` -> `--min-video-size`
+- `--required-free-space` -> `--min-free-space`
+- `--print-stats` -> `--stats` , `--no-stats`
+- `--send-deleted-to-trash` -> `--hashing.dedupe.use-trash-bin`
+
+#### Jdownloader
+
+- `--jdownloader-autostart` -> `--jdownloader.autostart`
+- `--jdownloader-download-dir` -> `--jdownloader.download-dir`
+- `--jdownloader-whitelist` -> `--jdownloader.whitelist`
+- `--send-unsupported-to-jdownloader`-> `--jdownloader` / `--no-jdownloader`
+
+#### Sorting
+
+- `--sort-downloads` -> `--sort` / `--no-sort`
+- `--scan-folder` -> `--sort.input-folder`
+- `--sort-folder` -> `--sort.output-folder`
+- `--sort-incrementer-format` -> `--sort.formats.incrementer`
+- `--sorted-audio` -> `--sort.formats.audio`
+- `--sorted-image` -> `--sort.formats.image`
+- `--sorted-other` -> `--sort.formats.non-media`
+- `--sorted-video` -> `--sort.formats.video`
+
+#### Ignore options (filters)
+
+The behavior of `--filename-regex` has been reversed (files that DO NOT match the regex will skipped)
+The behavior of `--before` and `--after` has been reversed and the `--exclude` prefix removed (they now **include** instead of excluding files)
+
+- `--exclude-audio` -> `--no-audio`
+- `--exclude-images` -> `--no-images`
+- `--exclude-other` -> `--no-non-media`
+- `--exclude-videos` -> `--no-videos`
+- `--exclude-before` -> `--before`
+- `--exclude-after` -> `--after`
+- `--exclude-files-with-no-extension` -> `--allow-files-with-no-extension`
+- `--filename-regex-filter` -> `--filename-regex`
+- `--ignore-coomer-ads` -> `--crawlers.coomer.ignore-ads`
+- `--ignore-coomer-post-content` -> `--crawlers.coomer.ignore-post-content`
+- `--download-tiktok-src-quality-videos` -> - `--crawlers.tiktok.original`
+
+#### Logs
+
+- `--log-level` -> `--logs.level`
+- `--console-log-level` -> `--logs.console-level`
+- `--log-folder` -> `--logs.folder`
+- `--logs-expire-after` -> `--logs.expire-after`
- `--main-log` -> `--logs.files.main` with alias `--log-file`
-- `--download-error-urls` -> `--logs.files.download-errors`
-- `--rotate-logs` -> `--logs-rotate`
-- `--scrape-error-urls` -> `--logs.files.scrape-errors`
-- `--unsupported-urls` -> `--logs.files.unsupported`
-
-#### DownloadOptions
-
-`--block-download-sub-folders` -> `--subfolders`, `--no-subfolders`
-`--include-album-id-in-folder-name` -> `--subfolders.include.album-id`
-`--include-thread-id-in-folder-name` -> `--subfolders.include.thread-id`
-`--remove-domains-from-folder-names` -> `--subfolders.include.domain`
-`--separate-posts-format` -> `--subfolders.separate-posts-format`
-`--separate-posts` -> `--subfolders.separate-posts`
-`--skip-download-mark-completed` -> `--skip-and-mark-completed`
-`--max-simultaneous-downloads` -> `--downloads`
-`--max-simultaneous-downloads-per-domain` -> `--downloads.per-domain`
-`--slow-download-speed` -> `--slow-speed`
-`--download-attempts` -> `--attempts`
-`--download-delay` -> `--delay`
-`--download-speed-limit` -> `--speed-limit`
-
-### Removed
-
-- Support for python 3.11
-- All retry settings + menu option
+- `--download-error-urls` -> `--logs.files.download-errors`
+- `--rotate-logs` -> `--logs-rotate`
+- `--scrape-error-urls` -> `--logs.files.scrape-errors`
+- `--unsupported-urls` -> `--logs.files.unsupported`
+
+#### DownloadOptions
+
+- `--block-download-sub-folders` -> `--subfolders`, `--no-subfolders`
+- `--include-album-id-in-folder-name` -> `--subfolders.include.album-id`
+- `--include-thread-id-in-folder-name` -> `--subfolders.include.thread-id`
+- `--remove-domains-from-folder-names` -> `--subfolders.include.domain`
+- `--separate-posts-format` -> `--subfolders.separate-posts-format`
+- `--separate-posts` -> `--subfolders.separate-posts`
+- `--skip-download-mark-completed` -> `--skip-and-mark-completed`
+- `--max-simultaneous-downloads` -> `--downloads`
+- `--max-simultaneous-downloads-per-domain` -> `--downloads.per-domain`
+- `--slow-download-speed` -> `--slow-speed`
+- `--download-attempts` -> `--attempts`
+- `--download-delay` -> `--delay`
+- `--download-speed-limit` -> `--speed-limit`
+
+### Removed
+
+- Support for python 3.11
+- All retry settings + menu option
- `--log-level` and `--console-log-level` (`--logs.level` and `--logs.console-level`) no longer accept integers. Only log level names as valid, ex: `INFO`, `DEBUG`, `WARNING`
-- Posts filtering by URL params (Wordpress)
-- Auto cookie extraction support
-
-Several config options have been removed:
-
-- `--add-md5-hash`
-- `--add-sha256-hash`
-- `--auto-import`
-- `--browser`
-- `--completed-after`
-- `--completed-before`
-- `--disable-download-attempt-limit`
-- `--download-tiktok-audios`
-- `--last-forum-post`
-- `--max-items-retry`
-- `--remove-generated-id-from-filename`
-- `--retry-all`
-- `--retry-failed`
-- `--retry-maintenance`
-- `--save-pages-html`
-- `--scrape-single-forum-post`
-- `--sites`
-- `--skip-check-for-partial-files`
-- `--update-last-forum-post`
-
-The following authentication entries has been removed:
-
-- `Imgur.client_id`
-- `Kemono.session`
-- `Coomer.session`
-
-## [9.15.2] - 2026-06-16
-
-### Fixed
-
-- Update website salt (Gofile)
-- Free space check on network drives (Windows)
-
-## [9.15.1] - 2026-06-11
-
-### Fixed
-
-- Video metadata extraction (Spankbang)
-- Crashing when `--dump-json` option is used
-
-## [9.15.0] - 2026-06-10
-
-### Changed
-
-- Reject any download without a valid `Content-Length` header
-- Report any download with size < `Content-Length` as corrupted and delete them
-
-### Fixed
-
-- Channel downloads (Rumble)
-
-## [9.14.0] - 2026-06-03
-
-⚠️**IMPORTANT**
-
-> If you has ever used a Pixeldrain API key with `cyberdrop-dl-pacthed` version >=8.5.0, you should consider them compromised and disable them.
->
-> See: [GHSA-f5pf-q7c7-m3vv (CVE-2026-54254)](https://github.com/Cyberdrop-DL/cyberdrop-dl/security/advisories/GHSA-f5pf-q7c7-m3vv)
-
-### Added
-
-- Support password protected files/folders (Filester)
-
-### Changed
-
-- Hard fail if any config option requires `ffmpeg` but `ffmpeg` is not installed
-- Disable hardcoded max concurrent downloads (2) if an API key is provided by the user (PixelDrain)
-- Exclude main log file from empty files check
-
-### Removed
-
-- Support for download proxies. Proxy URLs with be rewritten as pixeldrain.com URLs (PixelDrain)
-
-### Fixed
-
-- Some false positive DDoS-Guard detections
-- URLs extraction from text files in a filesystem (PixelDrain)
-
-### Security
-
-- Reject any URL not matching an official domain (Pixeldrain)
-
-## [9.13.0] - 2026-05-29
-
-### Changed
-
-- Replace bunkr-albums.io with balbums.st
-- Switch to new downloads API (Bunkr)
-- `--deep-scrape` no longer has any effect on Bunkr
-- Exclude dot files from empty files check
-
-### Removed
-
-- Support for direct links (Bunkr)
-
-### Fixed
-
-- Do not crash on HTTP errors from individual photos (Flickr)
-- Do not crash on HTTP errors from individual files (Google Drive)
-
-### Security
-
-- Reject download with leading dots as filenames (dot files)
-- Reject downloads if the final download path is outside the root download folder (path traversal)
-- The following extensions have been hardcoded to always be rejected:
-
-1. `.bat`
-2. `.com`
-3. `.exe`
-4. `.hta`
-5. `.inf`
-6. `.jar`
-7. `.js`
-8. `.lnk`
-9. `.msc`
-10. `.msi`
-11. `.ps1`
-12. `.ps2`
-13. `.psc1`
-14. `.psc2`
-15. `.sh`
-16. `.scf`
-17. `.vb`
-18. `.vbs`
-19. `.wsc`
-20. `.wsh`
-
-## [9.12.0] - 2026-05-27
-
-### Added
-
-- 1fichier support
-- Archive.org support
-- YTboob support
-- Rutube support
-- Acast support
-- Whyp.it support
-- Soundgasm support
-- Clyp.it support
-- Livestreamfails support
-- Yurivan support
-- Fatbox proxy support (Catbox)
-
-### Fixed
-
-- Date extraction (Rule34vault)
-- `--json` output missing files skipped by host or filename regex
-- Update website salt (Gofile)
-- Episode parsing (OnePace)
-- Do not crash on HTTP errors from profiles/search (Spankbang)
-
-## [9.11.0] - 2026-05-20
-
-### Changed
-
-- Show the aggregate speed of all downloads
-
-### Deprecated
-
-- Posts filtering by URL params will be removed on the next major release (Wordpress)
-
-### Fixed
-
-- Crash trying to decode non https URLs from the database (jpg5)
-- Wordpress support
-
-## [9.10.3] - 2026-05-19
-
-### Fixed
-
-- Parsing of thread URLs (Xenforo)
-- Date extraction (efukt.com)
-
-## [9.10.2] - 2026-05-19
-
-### Changed
-
-- Replaced fapello.su with fapello.com. Existing database entries will be ignored
-- Updated domain to xbunker.cc (Xbunkr)
-- Updated domain to www.imagepond.net (Imagepond)
-- Updated domain to turbo.cr (TurboVid)
-
-### Removed
-
-- files.vc support (No longer exists)
-- incestflix.com support (No longer exists)
-
-### Fixed
-
-- Do not try to parse upload date (YouJizz)
-- Video extraction from embed URLs (YouJizz)
-- Date extraction (Sex.com)
-- Date extraction (Rule34.xxx)
-- Date extraction (Nsfw.xxx)
-- Date extraction (e621)
-- Chapter info extraction (OmegaScans)
-- 403 Forbidden when the input URL is a direct file (Turbo.cr)
-
-## [9.10.1] - 2026-05-16
-
-### Changed
-
-- Update supported domains (JPG5)
-- Log URLs without public key as password protected (mega.nz)
-
-### Fixed
-
-- `--impersonate` being ignored
-- Infinite redirects on albums (imgbb)
-- Handle URLs with redundant empty parts (Fileditch)
-
-## [9.10.0] - 2026-05-13
-
-### Added
-
-- New `cleanup` subcommand
-- New `--concurrent-segments` option for HLS downloads
-
-### Changed
-
-- Assume binary payload for downloads with missing `Content-Type`
-- Use proxy and ssl config settings for requests made with `ffprobe`
-- The default `--concurrent-segments` changed from 50 (audio and subtitle streams) and 20 (video streams) to 10 for all cases
-
-### Fixed
-
-- `Invalid Content Type - No content type in response headers` (turbo.cr)
-
-## [9.9.0] - 2026-05-12
-
-### Added
-
-- New `database transfer` subcommand to update a database file from an old CDL version to the newest schema
-
-### Fixed
-
-- All HTTP errors being reported as `generator didn't yield` errors
-- Do not override host of stream redirect URLs (Bunkr)
-
-## [9.8.1] - 2026-05-11
-
-### Changed
-
-- Do not probe duration of media files unless required by config
-
-### Fixed
-
-- `ffprobe not installed` error on non HLS downloads
-
-### Security
-
-- Force latest version of some transient dependencies to resolve CVE-2026-44431 and CVE-2026-44432
-
-## [9.8.0] - 2026-05-11
-
-### Added
-
-- New `--dump-responses` option to save non binary responses (text/HTML/JSON) to disk
-
-### Changed
-
-- Log downloads requests/responses
-- Log flaresolverr requests/responses
-- Prevent requests bursting at the start of a run
-
-### Deprecated
-
-- `--save-pages-html` will be removed on the next major release
-
-### Removed
-
-- Nekohouse support (No longer exists)
-
-### Fixed
-
-- Parsing of json responses from non Selenium forks of Flaresolverr
-- Flaresolverr session destruction always failing
-- Handle posts with deleted images (TikTok)
-- A single video download error canceling the entire scrape queue (LeakedZone/Hotleak)
-
-## [9.7.0] - 2026-05-07
-
-### Added
-
-- Coomerfans.com support
-
-### Removed
-
-- Using `--impersonate` without any value is no longer supported
-
-### Fixed
-
-- Typer error when using `--impersonate`
-- Do not crash on API errors (pCloud)
-
-## [9.6.0] - 2026-05-04
-
-### Changed
-
-- Show sorting stats again at the end of a run
-
-### Deprecated
-
-- Support for python 3.11 will be removed on the next major release
-
-### Fixed
-
-- CDL crashing cause it was trying to dedupe files outside the download folder
-
-## [9.5.1] - 2026-05-03
-
-### Fixed
-
-- Some previously downloaded URLs not being skipped
-
-## [9.5.0] - 2026-05-02
-
-### Changed
-
-- `--log-level` and `--console-log-level` now accept level names as valid values, ex: `INFO` or `WARNING`
-- An empty or null value for `--console-log-level` will use the same level as `--log-level`
-- For `--console-log-level`, values higger than 50 (`CRITICAL`) will be reset to `None`
-
-### Deprecated
-
-Several config options:
-
-CLI Only options:
-
-- `--completed-after`
-- `--completed-before`
-- `--download`, `--retry-all`, `--retry-failed`, `--retry-maintenance` options will be removed and replaced with dedicated subcommands
-
-Download Options:
-
-- `--disable-download-attempt-limit`
-- `--remove-generated-id-from-filenames`
-- `--scrape-single-forum-post`
-
-Logs
-
-- `--last-forum-post`
-
-RuntimeOptions:
-
-- `--update-last-forum-post`
-- Support for integers values with `--log-level` and `--console-log-level` will be removed on v10. They will only accept log level names
-
-Authentication entries for:
-
-- `Imgur.client_id` (no longer required)
-- `Kemono.session` (can be supplied by cookies)
-- `Coomer.session` (can be supplied by cookies)
-
-DupeCleanup:
-
-- `--add-md5-hash` and `--add-sha256-hash` will removed and merged into a single config option as a list of hashes to enable
-
-### Fixed
-
-- `--log-level` and `--console-log-level` being ignored
-- Skip empty files removal if the root folder no longer exists
-
-## [9.4.3] - 2026-05-01
-
-### Fixed
-
-- `CRITICAL` errors not being logged to the main log file
-
-## [9.4.2] - 2026-04-30
-
-### Changed
-
-- Send real referrer on reinforced downloads (Bunkr)
-- Improve performance of database lookups
-
-### Fixed
-
-- Location of `apprise.txt` (`AppData/Configs/Default/apprise.txt`)
-- Auto cookies extraction not creating any files
-
-## [9.4.1] - 2026-04-28
-
-### Changed
-
-- `--refresh-rate` now accepts fractions of a seconds as value (ex: 0.5)
-- Detect and bypass `AppData` virtualization when Python is installed from the Microsoft store
-
-### Fixed
-
-- `--refresh-rate` being ignored
-- `--ui` mode being ignored
-- Error decoding some filenames (bunkr)
-- Handle "server under maintenance" pages (Bunkr)
-- `bunkr.black` redirects always triggering DDosGuard (bunkr)
-- Parsing of API errors (RedGifs)
-- Bypass login check for 1080p+ videos (ePorner)
-- Empty name for some public files (MegaNZ)
-- Truncated errors on stats summary
-- Flaresolverr session destruction always failing
-
-## [9.4.0] - 2026-04-23
-
-### Added
-
-- ImageVenue support
-- Photo search support (Anysex)
-- Photo search and Tags support (ePorner)
-
-### Changed
-
-- Log CDL enviroment vars
-- Always use threads to resolve DNS queries on Windows
-
-### Removed
-
-- InfluencerBitches support (No longer exists)
-
-### Fixed
-
-- Ignore errors while checking for updates
-- `RuntimeError` when downloads reach 99% due to incorrect MAC integrity check (MegaNZ)
-
-## [9.3.1] - 2026-04-21
-
-### Fixed
-
-- Download errors showing as scrape errors
-
-## [9.3.0] - 2026-04-20
-
-### Added
-
-- Patreon support
-- OnePace support
-- Giphy support
-- XMegaDrive support
-- Search, tag and category support (ThotHub)
-
-### Changed
-
-- Hash multiple files (20) at once when using the UI menu option
-- Default to HLS downloads (xHamster)
-- Improve support for Flaresolverr forks using NoDriver/DrissionPage
-
-### Fixed
-
-- Downloads panel not showing up in vertical layout
-- Do no try to hash folders
-- Do not try to normalize usernames (RedGifs)
-- Search and user's pagination (Rule34Video, CamWhores)
-- Do not download random unrelated videos from profiles (Rule34Video)
-- Merging of m3u8 subtitles
-- Subtitles sometimes being deleted after download
-- Handle subdomains (Tranny.one)
-- `KeyError` trying to parse a response from Flaresolverr instance using Selenium as backend
-- Update query hashes (Twitch)
-
-## [9.2.0] - 2026-04-15
-
-### Added
-
-- Tabootube support
-
-### Changed
-
-- Check for DDoS-Guard even on successful responses
-- New hashing, dedupe and scraping UI
-- Show accurate download progress for HLS downloads
-
-### Removed
-
-- Flugel anime support (No longer exists)
-- Safe.soul support (No longer exists)
-- Xbunkr support (No longer exists)
-
-### Fixed
-
-- Switch to v2 API (nHentai)
-- Download URL extraction (MixDrop)
-- Do not try to parse relative dates (KVS)
-- Use impersonation for downloads (MissAV)
-
-## [9.1.0] - 2026-04-08
-
-⚠️**IMPORTANT**
-
-> This version logs raw HTTP requests and responses to the main log file. They may include credentials, IP, etc. Remove personal information before sharing them or just extract the relevant logs
->
-> Options to change log level are ignored. It will be fixed on a future version
-
-### Added
-
-- Gupload.xyz support
-- Vidara support
-- OwnCloud support
-- Support premium URLs (MediaFire)
-- Support subfolders (Filester)
-- Support for archives (.zip) files (ImagePond)
-
-### Changed
-
-- Adjust default rate limit (RedGifs)
-- Create crawlers only if they are going to be used
-- Webhook notifications will now be sent as plain text
-- Use original filenames (ImagePond)
-- New UI while sorting files
-- CDL is way more verbose now
-- Several performance improvents
-
-### Deprecated
-
-- Auto import cookies
-
-### Removed
-
-- All settings and UI options about changing configs have been removed. CDL will always use the default config at `AppData/Configs/Default/settings.yaml`. A different config can be specified only via CLI args (`--config-file`)
-- The UI Option to export cookies has been removed
-
-### Fixed
-
-- Download all videos on paginated playlists (50+ videos) (PMVHaven)
-- Handle deleted videos (TubeCorporate)
-- 404 downloads (Bunkr)
-- Update selectors for files with MD5 hashes instead of SHA256 (Filester)
-- Profile, albums and images crawling (ImagePond)
-- Android support (requires python 3.13)
-- Player info parsing (ashemaletube)
-
-## [9.0.2] - 2026-03-25
-
-### Changed
-
-- Support users with up to 20K posts (Redgifs)
-
-### Removed
-
-- UI option to check updates
-
-### Fixed
-
-- Database path (Filester)
-- Requote download redirects (ePorner)
-- Update website salt (Gofile)
-
-## [9.0.1] - 2026-03-17
-
-### Fixed
-
-- Update website salt (Gofile)
-
-## [9.0.0] - 2026-03-09
-
-⚠️**BREAKING CHANGES**
-
-> You can only upgrade to this version from v8.10.
-
-### Added
-
-- Upload.ee support
-- Filester support
-
-### Changed
-
-- Use original filename for turbo.cr
-- Apprise is now an optional dependency (required for notifications)
-
-### Removed
-
-- Reddit support
-
-Several config options:
-
-- `config`
-- `disable_cache`
-- `log_line_width`
-- `file_host_cache_expire_after`
-- `forum_cache_expire_after`
-- `downloading_item_limit`
-- `scraping_item_limit`
-- `vi_mode`
-
-### Fixed
-
-- Download of multipage profile albums (Chevereto)
-- Handle `redirect/to` links (Xenforo)
-- Download of files with broken thumbnails (bunkr)
-- Send custom one-time-use headers (GoFile)
-- Download subfolder from filesystem URLs (pixeldrain)
-
-## [8.10.0] - 2026-01-26
-
-### Added
-
-- Google photos support
-- Turbovid support
-- Fuckingfast support
-- Bandcamp support
-- Twitch.tv support
-- Nsfw.xxx support
-- Support for albums (xgroovy)
-- Support for tube-corporate sites (fuxxx, hclips, hdzog, hotmovs, inporn, pornzog, tubepornclassic, txxx, upornia, vjav, voyeurhit, vxxx, xmilf)
-
-### Changed
-
-- Get deterministic errors for deleted files (Cyberdrop)
-
-### Fixed
-
-- Ignore errors while deleting partial files
-- Ignore unknown timezones while parsing dates
-- Use the same origin as input URL for playlists (spankbang)
-- Filesystem downloads (PixelDrain)
-- Gallery downloads (PostImg)
-- Low resolution images being downloaded (PostImg)
-- Use original filename for photos (PostImg)
-- Password protected albums (Chevereto)
-- Always use impersonation (Toonily)
-- HLS downloads ignoring config for concurrent max downloads
-- Incorrect URL as first parent for files in `--json` output
-- Files being re-downloaded if their source uses a new CDN (Bunkr)
-
-## [8.9.0] - 2025-12-18
-
-### Added
-
-- Anysex support
-
-### Changed
-
-- Detect and report sites protected by Anubis
-
-### Fixed
-
-- `dict` has no attribute server (Kemono/Coomer/Nekohouse)
-- Decode new URL format (xhamster)
-- Update crawler to new site design (PMVHaven)
-- Impersonation always using the same user agent
-- Send token in headers (GoFile)
-
-## [8.8.0] - 2025-12-03
-
-### Added
-
-- Erome.fan support
-- Thothub support
-- Support for models filtered by site (girlsreleased)
-
-### Changed
-
-- Proving a client id is no longer required (Imgur)
-- URLs downloaded with RealDebrid will be saved as is to the DB. Existing DB entries will be ignored
-
-### Fixed
-
-- Individual videos download (Porntrex)
-- Random unrelated models being downloaded (girlsreleased)
-- Trailing dots on partial file names
-
-## [8.7.0] - 2025-11-21
-
-### Added
-
-- Transfer.it support
-- MasaHub.com support
-- Koofr.eu support
-- Desivideo.net support
-- Rumble.com support
-- Tnaflix support
-- Bunkr-albums.io support
-- Ranoz.gg support
-- Rootz.so support
-- FSIBlog.com support
-- Tranny.one supprt
-- Xgroovy support
-- Luxuretv support
-- Streamtape.com support
-- Anontransfer support
-- Xasiat support
-- GirlsReleased.com support
-- Support for albums (imx.to)
-- Support for search URLS (saint)
-- Support for direct images (pixhost)
-- Parse the embed URL of posts (Kemono/Coomer/Nekohouse)
-- New `--exclude-after` and `--exclude-before` options to filter file downloads by upload date
-- `--dump-json` output will now have a `metadata` field with site specific information (on some sites)
-
-### Changed
-
-- Check and skip media files duration before downloading the entire file
-- Update sites to their new domains (`postimages.org` -> `postimg.cc`, `cyberdrop.me` -> `cyberdrop.cr`)
-- `--delete-partial-files` will also delete partial HLS segments (`.cdl_hls`)
-- Skip free space check on file systems that do not support it (ex: `sshfs`). Check will also be skipped on any FUSE fs that reports `0B`. NOTE: Using these filesystems has a risk of getting downloads corrupted. On some filesystems like `gvfs`, HLS downloads will _always_ be corrupted
-
-### Deprecated
-
-- Running multiple configs on the same run or using `--config ALL` will be removed on the next major release
-- Reddit support will be removed on the next major release
-- The `--skip-referer-seen-before` option will be removed on the next major release
-- `apprise` will no longer be included by default. It will become an optional dependency
-- Next major release will not include any `ffprobe` binaries as they are several years out of date
-
-### Fixed
-
-- Upload date parsing (noodlemagazine)
-- Loose files getting downloaded into the root folder (gofile)
-- Downloads skipped by duration not being removed from the download queue
-- Handle redirects & direct link downloads (cyberdrop)
-- Handle not found & direct links (saint)
-- Video resolution parsing (Rule34Video)
-- Subtitles downloads
-- Invalid filename of HLS segments on Windows
-- Parsing of dates without a year
-- Best format selection of m3u8 streams with the same resolution but different bitrate
-
-## [8.6.0] - 2025-10-28
-
-### Added
-
-- Support hotleaks.tv
-- Support direct URLs (GoFile)
-
-### Fixed
-
-- Date parsing (Transflix)
-- Prevent duplicated extensions in custom filenames
-- Handle newer encryption formats in URLs (6,7) (xHamster)
-- Parsing of filenames with brackets (Mega.nz)
-
-## [8.5.0] - 2025-10-25
-
-### Added
-
-- Support for static images (RedGifs)
-- Support for JPG7 URLS (JPG5)
-- Support for Transflix
-- Support for individual files within folders (PixelDrain)
-- Support for subfolders in filesystem URLs (PixelDrain)
-- Support collections, tags and search URLs (MissAV)
-- Update supported domains and proxies (PixelDrain)
-
-### Changed
-
-- Improve hash query performance
-- Add rate limit back (Gofile)
-- New blocked domains: `twitter`, `x.com`
-
-### Fixed
-
-- Some `timeout` errors being reported as `Unknown`
-- Do not crash if webhook request failed
-- Date parsing (eHentai)
-- URL parsing (ImageBam)
-
-## [8.4.0] - 2025-10-18
-
-### Added
-
-- Support search URLs (erome)
-- Support direct image URLs (ashemaletube)
-
-### Changed
-
-- Remove hardcoded limiter (GoFile)
-- Remove hardcoded limiter, limit concurrent downloads to 1 file per unique server (Bunkr)
-- Retry client connector errors
-- Always override download URL with selti CDN (JPG5)
-
-### Fixed
-
-- Handle newer encryption formats in URLs (xHamster)
-- Do not crash processing images (PornHub)
-- Spankbang crawler
-
-## [8.3.0] - 2025-10-16
-
-### Added
-
-- New `--impersonate` cli option: <https://script-ware.gitbook.io/cyberdrop-dl/reference/cli-arguments#impersonate>
-
-### Removed
-
-- ImgAcid support (site no longer exists)
-
-### Fixed
-
-- MP4 downloads (ePorner)
-- HTTP errors crashing CDL (MediaFire)
-- Albums downloads (ImgBB)
-- Some exceptions not being logged if they happen during startup
-
-## [8.2.0] - 2025-10-06
-
-### Added
-
-- Candfans support (coomer)
-- Support user's albums URLs (Chevereto)
-- Support folders with 1000+ items (GoFile)
-
-### Changed
-
-- Use impersonation for all Chevereto sites
-
-### Fixed
-
-- Parsing of account's favorites URLs (Kemono, Coomer, Nekohouse)
-- Download of videos without an explicit resolution (ThisVid, CamwhoresTv)
-- Directory hashing from the main UI
-- Incorrect hash being logged when files are deleted
-- Do not try to fetch more pages if only 1 exists (KVS sites)
-- `TooManyRedirects` error trying to download images/albums with encoded characters in their URL (ImagePond, ImgLike)
-- Download of albums without a thumbnail (Chevereto)
-- Entire albums being skipped if the full res version of their thumbnail was downloaded before (Chevereto)
-
-## [8.1.0] - 2025-09-27
-
-### Added
-
-- imglike support
-- Support for channel photos (xVideos)
-
-### Changed
-
-- Remove SimpCity disclaimer on first time startup
-- Tiktok now has a hardcoded rate limit of 0.5 req/s
-
-### Fixed
-
-- `str object cannot be interpreted as an integer` error when using any retry option
-- Date parsing (pixeldrain)
-- Date parsing (bunkr)
-- Channel's pagination (xVideos)
-- Http errors being reported as `Not Implemented` (Pixeldrain, MediaFire, GoFile)
-- Http errors causing CDL to crash while downloading galleries (xVideos)
-- CDL getting stuck after 100 TCP connections
-
-## [8.0.0] - 2025-09-23
-
-### Added
-
-- Allow downloading google docs files with a custom format by using a `format` query param
-- Cloudflare stream support
-- pCloud support
-- MegaCloud support
-- PimpBunny support
-- HiAnime support
-- Safe.Soul support
-- Voe.sx support
-- Support for subfolders (MediaFire)
-- Support for short URL formats (MediaFire)
-- Support for subfolders (Dropbox)
-- Support for alternative pixeldrain domains: `pixeldrain.net`, `pixeldra.in`
-- Support for `pd.cybar.xyz` URLs to bypass pixeldrain daily limit
-- The `--separate-post` and `--separate-post-format` options now work for tiktok posts
-- CDL can now download private TikTok posts when using cookies
-- New config option to download tiktok videos in original quality: <https://script-ware.gitbook.io/cyberdrop-dl/reference/cli-arguments#download-tiktok-src-quality-videos>
-- New `--max-thread-folder-depth` config option: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/settings/download_options#maximum_thread_folder_depth>
-- New `--ignore-coomer-post-content` config option: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/settings/ignore_options#ignore_coomer_post_content>
-- The `--ignore-coomer-ads` config option now affects all Kemono based crawlers (Coomer, Kemono & Nekohouse)
-
-### Changed
-
-- The recommended python version is now python 3.12+, to take advandage of eager tasks
-- Start scripts will automatically install a compatible python version
-- Start scripts no longer support 32bit systems
-- Handle shared folders with single file as loose files (Yetishare)
-- Increase default rate limit, from 10req/s to 25req/s
-- Increase max concurrent bunkr downloads, from 1 to 3
-- Parse full spec cookies from Flaresolverr responses
-- CDL will no longer try to merge subtitles for HLS downloads. They will be downloaded as separate files
-- Make requests with the same domain as the original input URL (saint2.su)
-- Tiktok downloads use a new logic to create filenames and folders. Folder structure will be different from previous versions.
-- CDL will now iterate over each file and subfolder recursively, instead of downloading an entire folder as a zip (dropbox)
-- `--read-timeout` now accepts `None` as value. This will make CDL keep the socket connection open indefinitely, even if the server is not sending data anymore
-- `--read-timeout` and `--connection-timeout` now accept fractions of a seconds as value (ex: `0.3`)
-- `--read-timeout` and `--connection-timeout` now affect all requests CDL will make (flaresolverr requests, scrape requests and download requests)
-- General performance improvements
-
-### Deprecated
-
-- Support for v5 and v6 (config, database and auto-migration) is deprecated and will be removed on the next major release
-
-### Removed
-
-- `--download-dropbox-folders-as-zip` config option
-
-### Fixed
-
-- `--dump-json` output file missing some fields
-- CDL trying to download all HLS segments at once
-- Download retries always re-starting from zero
-- Global rate limiter being ignored while crawling
-- Crashing when using any value for `--download-speed-limit`
-- Handle b64 encoded URLs (MediaFire)
-- Previously downloaded HLS fragments not being detected
-- HLS subtitle downloads always failing
-- Parsing of 1440p, 2K, 4K and 8K videos (KVS sites)
-- Possible infinite loop when using the bunkrr.org domain (Bunkr)
-- Crashing if a single error happens while crawling a Discord channel (Kemono)
-- Nekohouse crawler
-- Thumbnails being downloaded as is instead of full resolution (Coomer, Kemono, Nekohouse)
-- Handle new rot13 encryption (xHamster)
-- Handle new hex encryption (xHamster)
-- Videos being skipped if the audio was downloaded before (TikTok)
-- Do not crash if the `URL.txt` file has ipv6 URLs or invalid URLs
-- `ConnectionError` after the first attempt of a DNS lookup failed, without trying any DNS fallbacks
-
-## [7.5.0] - 2025-09-02
-
-### Added
-
-- Support for subfolders URLs (Mega.nz)
-
-### Changed
-
-- Removed `is_segment` and `parent_media_item` from output jsonl file
-- The `hash` attribute of the jsonl file now has `xxh128:` as prefix
-
-### Fixed
-
-- API response parse (RealDebrid)
-- Nested folders for the same creator (TikTok)
-- Handle paginated albums (Bunkr)
-- Handle encrypted URLs (xhamster)
-- Incompatible dependencies declarations causing CDL to crash on startup
-
-## [7.4.1] - 2025-08-23
-
-### Changed
-
-- Try to download images in original quality (twitter images)
-- Ignore auto translated titles, always use original title (xhamster)
-- Detect and report captcha responses as `DDoS-Guard` Errors (iceyfile)
-- Better detection and error messages for geo blocked videos (PornHub)
-- Fallback to HLS source when MP4 sources are blocked (PornHub)
-
-### Fixed
-
-- Folder downloads always being skipped as duplicates (mega.nz)
-- Handle videos without http sources (xhamster)
-- User URL parsing and pagination (xhamster)
-- Shared folders always using `Shared Files Folders` as title instead of the actual folder name (cyberfile, iceyfile)
-- Handle files with malformed download URLs (emojis / special characters in name/URL slug) (cyberfile, iceyfile)
-- 404 when downloading from albums (PornHub)
-- Update API endpoints and parsing (Coomer, Kemono)
-- Files with mangled names if they had non english characters (Coomer, Kemono)
-
-## [7.4.0] - 2025-08-21
-
-### Added
-
-- xVideos support
-- odnoklassniki (ok.ru) support
-
-### Changed
-
-- Handle subalbum URLs as normal albums (chevereto)
-- Read cookie files asynchronously
-- Parse full spec cookies, including expire values
-- Downloading videos no longer requires an account (xxxbunkrr)
-- Subfolders created from the same site will no longer include the folder domain
-- Update cdns (bunkr)
-- Do not retry mega.nz downloads
-
-### Removed
-
-- PHPSESSID session auth option (xxxbunkrr)
-
-### Fixed
-
-- Password protected album downloads (chevereto)
-- Resolution parsing for videos (ashemaletube)
-- Some videos missing when downloading from a playlist (xxxbunkrr)
-- Playlist pagination (xxxbunkrr)
-- Profile downloads being abruptly terminated if a post has images (tiktok)
-- DDoSGuard error on every download (nHentai)
-- Handle videos with invalid character in description and title (ePorner)
-- Series and chapter downloads (toonily)
-- `--ui` options not working
-- Do not sort unjoined HSL files.
-
-## [7.3.1] - 2025-08-02
-
-### Changed
-
-- Update primary coomer domain to `coomer.st`. CDL will automatically change the host of any URL that uses the old domain
-- Update primary kemono domain to `kemono.cr`. CDL will automatically change the host of any URL that uses the old domain
-- Improve performance when writing CSV files
-- CDL will assume english as the language to parse any human date found on sites
-- The jsonl file generated by `--dump-json` will now include every file processed in the current run, even skipped ones. Files that were actually downloaded will have a value of `True` as the `downloaded` attribute
-- `--dump-json` will write new entries in real time instead of writing everything at the end of the run
-
-### Fixed
-
-- DDoS-Guard errors even when using cookies because CDL was using an old domain (Coomer, Kemono)
-- `ffprobe` version is always being logged as `None` if not available on path, even though it comes built-in with CDL
-- Catch and log any warnings while parsing dates
-- Albums downloads (pixhost)
-- Download of videos that are not part of a playlist (spankbang)
-- Jdownloader connection
-- CDL always timing out when downloading any file that takes longer than 5 minutes
-
-## [7.3.0] - 2025-07-21
-
-### Added
-
-- JPG6 support
-- File support (yandex.disk)
-
-### Changed
-
-- Make chevereto a generic crawler. See: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/global-settings/generic_crawlers_instances>
-- Make RealDebrid calls asynchronously
-
-### Fixed
-
-- Title creation on some edge cases (twpornstars)
-- `NotImplemented` error when CDL tries to use `ffmpeg` on Windows machines
-- Handle unicode escaped URLs (Bunkr)
-
-## [7.2.1] - 2025-07-18
-
-### Changed
-
-- Add back crawler name when logging posts stats (Xenforo)
-
-### Fixed
-
-- Messages being logged twice
-- Tag pagination (camwhores)
-- `Generator didn't yield` error when CDL finds an invalid URL
-
-## [7.2.0] - 2025-07-17
-
-### Added
-
-- Everia.club support
-- Mega.nz support
-- Handle direct links URLs (redgifs)
-- New `file_date` field for sorting options
-
-### Changed
-
-- Use canonical URL to skip duplicates faster (redgifs)
-- Try to resolve confirmation links without a request (xenforo)
-- Download m3u8 playlist without codec information
-
-### Fixed
-
-- Laggy playback and frozen start on hls downloads
-- Downloads from password protected albums (jpg5, imagepond)
-- Multiple nested attachments folders being created (forums)
-- `file_date_iso` and `file_date_us` not being parsed as valid format fields for sorting
-- Mangled fields names in errors messages from formatting options
-- Missav HLS downloads
-
-## [7.1.0] - 2025-07-14
-
-### Added
-
-- Hotleak.vip support
-- Leakedzone.com support
-- Support for galleries with multiple pages (imagebam)
-
-### Changed
-
-- CDL will automatically disable crawlers that have 10 `DDoS-Guard` errors in the current run. All URLs mapping to that crawler will be ignored.
-- URLs from forums will be processed as completely new items with their own subfolder (same behavior as v6)
-- Fallback to HLS for newer videos that do not have MP4 formats available (PornHub)
-
-### Fixed
-
-- Fallback to the old threaded DNS resolver if the async resolver does not work on the current platform (e.g: Android)
-- Do not download videos downloaded before (beeg.com)
-- Handle attachments without name (kemono)
-- Handle old and new URL formats (imagebam)
-- Private videos not being logged as private (tokyomotion)
-- Handling host with "www." prefix (redgifs)
-- Parsing HQ resolution (thisvid)
-
-## [7.0.1] - 2025-07-04
-
-### Changed
-
-- Do not try to download thumbnails (redgifs)
-
-### Fixed
-
-- Handle new player script format and HLS videos (ashemaletube)
-- Custom filename creation (4chan)
-- Usernames not being fetch at startup (coomer)
-- Handle file URLs with unknown filenames (dropbox)
-
-## [7.0.0] - 2025-07-02
-
-### Added
-
-- Camwhores.tv support
-- Flugel-anime support
-- Missav support
-- Beeg.com support
-- efukt support
-- Vipergirls support
-- Initial HLS support (requires ffmpeg)
-- Support for any WordPress media site. See: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/global-settings/generic_crawlers_instances>
-- Support for any Discourse site See: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/global-settings/generic_crawlers_instances>
-- Add a config option to disable specific crawlers: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/global-settings/general#disable_crawlers>
-- Add new `ssl_context` config option: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/global-settings/general#ssl_context>
-- Add a config option to map unknown URLs to generic crawlers: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/global-settings/generic_crawlers_instances>
-
-### Changed
-
-- Date parsing errors will be logged as warnings, not errors
-- Use an asynchronous DNS resolver
-- Use native system certificates by default, with fallback to `certifi`. See: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/global-settings/general#ssl_context>
-- Some crawlers have a new logic to create a filename. The name format for newly downloaded files may not match previous versions.
-- Config options that take format strings will be validated at startup
-- URLs will only be processed once, ignoring duplicates, even if they come from different crawlers. ex: If you have a dropbox URL in `URLs.txt` and CDL finds that same URL while crawling a forum, it will silently ignore the URL from the forum.
-- General performance improvements
-- New blocked domains:
-
-> gfycat
-> ko-fi.com
-> paypal.me
-> amazon.com
-> throne.com
-> youtu.be
-> youtube.com
-> linktr.ee
-> beacons.page
-> beacons.ai
-> allmylinks.com
-
-### Deprecated
-
-- Support for 32-bit Python and 32-bit operating systems in general is deprecated. On a future version, the start scripts will explicitly fail when trying to install on 32-bit systems. This deprecation only applies to the start scripts. 32-bit versions can still be installed manually via `pip`, but the user may need to compile any missing wheels.
-
-### Removed
-
-- `no-ui` option
-- `allow_insecure_connections` option
-- Importing cookies from multi browsers is no longer supported. CDL will only try to extract cookies from a single browser. The `browsers` option was renamed `browser`
-
-### Fixed
-
-- `ImportError: cannot import name 'MethodType'` on startup
-- Handle errors while processing confirmation links (Xenforo)
-- Redgifs not being downloaded (Xenforo)
-- Attachments not being downloaded (Xenforo)
-- Posts not being fully scraped if a single link in them failed (Xenforo)
-- Download from user profiles (xHamster)
-- Folder downloads (Cyberfile)
-- Do not crash when using the `Create file hashes` option from the main menu
-- Do not download "related" or "favorites" videos from a profile (PornHub)
-- `KeyError` when using the `--separate-posts` option
-- Using Real Debrid no longer causes CDL to crash
-- Image downloads (HotPic)
-- Do not try to download emojis (twitter_images)
-- Fix albums downloads (saint)
-- Handle all possible response errors (reddit)
-- Do not use reddit's `user-agent` for every site
-- Fix `unclose client session` error at the end of a run
-- Fix parsing of dropbox folders URLS
-- Handle embedded URLS (box.com)
-- [Regression] Fixed free space check when using network drives (windows)
-
-## [6.10.1] - 2025-06-15
-
-### Changed
-
-- CDL will try to parse upload dates from human expressions. ex: "Last friday at 10:55", "3 hours, 50 minutes ago",
-- Scrape errors from the generic crawler will be logged as "Unsupported" instead of "Unknown"
-- Normalize posix paths
-
-### Fixed
-
-- Download individual posts (Kemono, Coomer, Nekohouse)
-- Pagination (Kemono, Coomer, Nekohouse)
-- Handling of redirects (Xenforo)
-- Date parsing (Cyberfile)
-- Remove invalid characters from filenames (Cyberfile)
-- Discord server name (Kemono)
-
-## [6.10.0] - 2025-05-30
-
-### Added
-
-- 4chan support
-- AcidImg support
-- Archivebate support (individual videos only)
-- Box.com support
-- Buzzheavier support
-- Files.vc support
-- Imx.to support
-- Mixdrop support
-- NoodleMagazine support
-- Pkmncards.com support
-- Pornhub support
-- Influencerbitches.com support
-- IncestFlix support
-- Porntrex support
-- Twpornstars.com support
-- Vipr.im support
-- Albums support (ThisVid)
-- Parse upload date of files (rule34xxx)
-- Support for albums and searches (ashemaletube)
-- Add a config option to disable the generic crawler: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/global-settings/general#enable_generic_crawler>
-- Auto switch primary host if the default host is blocked on the current network (bunkr)
-- Download entire discord server (Kemono)
-- Download favorites (Kemono)
-- `jitter` option to wait a random extra number of seconds in between downloads: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/global-settings/rate-limiting-options#jitter>
-
-### Changed
-
-- Coomer/Kemono caching support has been temporarily removed
-- Cookies are only extracted once per browser
-- Prioritize Real-Debrid and Jdownloader over the generic crawler
-- Improve DDosGuard detection
-- Try to set creation time of files in macOS
-- Check DDoS-Guard even on successful pages
-- Try to use original server (kemono, coomer, nekohouse)
-- Improve cloudflare captcha detection
-- General performance improvements
-- CDL will remove symbols and emojis from filenames in Windows and macOS
-
-### Removed
-
-- Support for img.kiwi (site no longer exists)
-
-### Fixed
-
-- Individual file downloads (Google Drive)
-- Filename parsing (BestPrettyGirls)
-- Images downloads (Erome)
-- Use canonical URL to check previously downloaded files (Ashemaletube)
-- Only 1 file being downloaded from chevereto profiles (Imagepond, JPG5.su)
-- Playlists and tags support (Rule34xyz , Rule34vault)
-- `NoExtensionError` even when `--exclude-files-with-no-extension` was `false` (bunkr)
-- Parsing of filenames with `@` in it (bunkr)
-- Do not crash if a mountpoint is not available (Windows BitLocker)
-- Handle videos with unknown resolution (ThisVid)
-- Discord channel download (Kemono)
-- Gif downloads (reddit)
-
-## [6.9.1] - 2025-04-18
-
-### Fixes
-
-- Do not crash if `ffmpeg` is not installed
-
-## [6.9.0] - 2025-04-18
-
-### Added
-
-- aShemaleTube.com support
-- Thisvid.com support
-- ePorner.com profile, photo, and gallery support
-- New `--show-supported-sites` option: <https://script-ware.gitbook.io/cyberdrop-dl/reference/cli-arguments#show-supported-sites>
-
-### Changed
-
-- The `import cookies` menu will only display the browsers supported by the user's OS
-
-### Fixed
-
-- Choosing 'All Supported Websites' in cookie extraction will no longer extract all cookies from the browser
-- Fixed free space check when using network drives (windows)
-- Fixed embed parsing on XenForo
-- Fix titsintops.com crawler
-- Cyberdrop-DL will no longer freeze when trying to open terminal text editors
-- `TypeError: Incoming markup is of an invalid type` error
-- `CachedResponse' object has no attribute 'status_code` error
-- `404` responses when downloading albums (bunkr)
-- Save canonical URL to database to prevent downloading the same file twice (tiktok)
-
-### Deprecated
-
-- Importing cookies from multiple browsers at the same time is deprecated and will be removed in a future version
-
-## [6.8.0] - 2025-04-07
-
-### Added
-
-- Support share links from accounts using a SharePoint backend (OneDrive)
-- nHentai support
-- Doodstream (AKA Vidply) support
-- BestPrettyGirl.com support
-- Catbox and Litterbox support
-- Send.now support
-- PMVHaven.com support
-- Motherless support
-- xHamster support
-- Auto detect orientation
-- `generic crawler` to scrape pages from sites that are not supported. This replaces the basic `no crawler` logic
-- Save scraped pages as html with the new `--save-pages-html` option: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/settings/files#save_pages_html>
-
-### Changed
-
-- Flaresolverr is no longer required for Spankbang
-- Reduce rate limits (JPG5)
-- Config is revalidated after the user edits it from the UI
-- Warn about expired cookie files
-- Use server's `Last-Modified` header value as the file datetime if CDL could not parse a date while scraping.
-- Try to download images from any URL (twing)
-- CDL will start by default in portrait mode when running inside termux. You can override it by using `--no-portrait`
-
-### Fixed
-
-- Handle deleted videos (SpankBang)
-- `JsonDecodeError` in some videos (SpankBang)
-- Slow downloads from burger servers (Bunkr)
-- Handle single file share links (YandexDisk)
-- URL parsing (`tuple index out of range` #1) (Sex.com)
-- Handle invalid URLs (`tuple index out of range` #2) (Google Drive)
-- Handle paths with special characters (stats hyperlinks)
-- Do not crash if pages have no title (DDoS Guard check)
-- Fixed tags and category downloads (DirtyShip)
-- `Invalid Content Type` from some URLs (Bunkr)
-- jsonl timestamp serializer (`'str' object cannot be interpreted as an integer`)
-- Download profiles with more than 1k posts (RedGifs)
-- Reduce the number of requests needed (jpg5, img.kiwi, imagepond)
-- CDL filling up storage if multiple concurrent downloads where larger that `required_free_space`
-- Handle confirmation links as input URL (forums)
-- General performance improvements
-
-## [6.7.0] - 2025-03-10
-
-### Added
-
-- Show activity messages at the bottom of the UI (waiting on Flaresolverr connections, reading input file, etc..)
-- WeTransfer support
-- Google Drive support
-- DirtyShip support
-- OneDrive support
-- Yandex Disk support (files and folders, but no support for nested folders)
-- Dropbox support (files and folders, but folders are disabled by default because they will be downloaded as a single zip file. Enable them with `--download-dropbox-folders-as-zip`)
-- FileDitch support
-- Sex.com support (shorts and images from profiles only)
-- Option to import cookies from all supported websites in the main UI
-- Get information about all the downloaded files with the new `--dump-json` option: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/settings/files#dump_json>
-- Run CDL with a portrait layout using the `--portrait` option: <https://script-ware.gitbook.io/cyberdrop-dl/reference/cli-arguments#portrait>
-- Disable requests caching (reading and writing) with the `--disable-cache` option: <https://script-ware.gitbook.io/cyberdrop-dl/reference/cli-arguments#disable-cache>
-
-### Changed
-
-- Speed up checking for empty files & folders by up to 2x
-- Speed up sorting files by up to 1.5x
-- Remove browsers that aren't supported by the user's OS from the list of available browsers
-- Flaresolverr timeout will be the same as the config timeout
-- Input URLs will be processed lazily instead of waiting for all of them to be parsed
-
-### Fixed
-
-- Get URL from encrypted link (new logic)(jpg5)
-- 400/403/404 on some files (bunkr)
-- Add error handle at post level and individual item level (forums)
-- Fixed an error when trying to select done after choosing to import cookies
-- Flaresolverr integration
-- Long UI messages for unknown errors
-
-### Removed
-
-- Deprecated forums authentication settings (username, password and `xf_cookie`). Use cookie files for forums that require login
-
-## [6.6.1] - 2025-02-28
-
-### Fixed
-
-- Parse videos with no date (YouJizz)
-- Detect and ignore invalid responses from forums
-- `File is being used by another process` error when running multiple configs
-- Handle or ignore any errors when checking for updates
-- [regression] Do not remove trailing slash from URLs (jpg5, img.kiwi, imagepond.net)
-- Messages being logged to the console with `--ui` values other than `disabled`
-- Lines in the main log file being cutoff if they were longer than `log_line_width`
-- Handle permission errors while creating logs files
-- TikTok crawler returning 403 on all downloads
-- Use new API to download files (bunkr)
-- Download encrypted URLs (jpg5)
-- Do not overwrite user provided regex (`--filename-regex-filter`)
-
-### Changed
-
-- Log downloads with no content type as `InvalidContentType` instead of `418 IM_A_TEAPOT`
-- Only make 1 request at a time to Flaresolverr
-- Show log folder in stats
-- Show `--links (CLI args)` as input (if they were used)
-- Paths printed to the stats will have hyperlinks to their location (when supported by the terminal)
-
-## [6.6.0] - 2025-02-24
-
-### Added
-
-- Skip download of video and audio files by duration: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/settings/media_duration_limits>
-- Show simplified progress bar with new `--ui simple` option: <https://script-ware.gitbook.io/cyberdrop-dl/reference/cli-arguments#ui>
-- e621.net support (pools, posts, and tags)
-- Streamable.com support
-- Youjizz.com support
-- ePorner.com support
-- SpankBang.com support
-- Rule34video.com support
-- CDL will try to download files from unsupported forums
-- Support for direct URLs as input (hotpic)
-- Support for 2385290.xyz as an alternative domain (hotpic)
-- Support for videos (hotpic)
-
-### Changed
-
-- Log invalid URL paths as scrape errors
-- Increase verbosity of some processes
-- Re-enable sorting option on the main UI
-- Show queued files in progress stats
-- Vacuum requests database after cleaning old request entries
-- Remove double spaces from created folders
-- Show input file path, input URLs count and input URLs group count in stats
-- Unsupported sites in `browser_cookies.sites` will be ignored instead of raising an error
-- Download errors now have the referer information. The CSV file will also have a referer column
-- Log files will no longer be padded with white space to the right
-- Better error messages for invalid configs
-- `--filename-regex-filter` will be validated at startup instead of being silently disabled (if invalid)
-- Use canonical URL for database (hotpic)
-
-### Fixed
-
-- Forum attachments extension parsing (xenforo)
-- Download full resolution images instead of thumbnails (celebforum, pixhost, hotpic)
-- Handling of URLs with "%" (U+0025) in it (bunkr)
-- Pagination of chevereto profiles and albums (jpg5, img.kiwi and imagepond.net)
-- Duplicated entries in database for previously unsupported domains
-- `403 Forbidden` errors from some downloads (bunkr)
-- Handling of deleted videos (saint.to)
-- Handling of deleted files (cyberfile, iceyfile)
-- Loose files detection (gofile)
-- Filename not being sanitized in some cases (bunkr)
-- Handling of malformed responses from flaresolverr
-- URL serialization error (`yarl.URL` json) when passing links via CLI
-- LeakedModels crawler
-- Handle deleted files (mediafire)
-- Handle URLs with another URL as filename (kemono, coomer, nekohouse)
-- Handle invalid URLs and log them instead of crashing
-- Incorrect URL being logged in errors (reddit)
-- Handle redirect URLs (reddit)
-- Empty download_filename in database
-- Handling of streaming URLs (bunkr)
-
-### Deprecated
-
-- `--no-ui` is deprecated and will be removed in a future version. Use `--ui disabled`
-
-### Removed
-
-- v4 support (config option names and UI file import options)
-
-## [6.5.0] - 2025-02-14
-
-### Added
-
-- Iceyfile.com support
-- Support cookie extraction from Arc Browser, Lynx and W3M
-- `--exclude-files-with-no-extension` option: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/settings/ignore_options#exclude_files_with_no_extension>
-- `--print-stats` CLI only option
-- Scrape nested threads with `--maximum-thread-depth`: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/settings/download_options#maximum-thread-depth>
-
-### Removed
-
-- Cookie extraction support from Chrome and Chromium based browsers on Windows
-
-### Changed
-
-- Improve database insertion performance
-- Improve shutdown process
-
-### Fixed
-
-- Automatic v4 to v6 transition
-- Reset hash progress on multiple directory scans
-- Delete old database entries of previously unsupported URLs
-- Nudostar.tv crawler
-- In-memory cache and first time startup cache not being in sync
-
-## [6.4.0] - 2025-01-31
-
-### Added
-
-- Add support for TikTok profiles, videos, and photos
-- Add new CLI argument `--download-tiktok-audios` to download audio files from TikTok posts
-- Add support for <https://www.imagebam.com>
-- Add support for <https://comics.8muses.com>
-- Pornpics.com support
-- Twitter images (twimg) support
-- Members.luscious.net search support
-- Skip slow downloads with `--slow-download-speed`: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/settings/runtime_options#slow_download_speed>
-- Support for forums redirect URLs (`/goto/...`, `/posts/...`)
-
-### Changed
-
-- Files in the download queue are saved to the database and can be retried with `--retry-failed`
-- CLI `--skip-hosts` and `--only-hosts` values will be added to / removed from config values when passing `+` or `-` as the first argument, respectively. See: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/special_setting_types#additiveargs>
-- CLI arguments that accept multiple values can now be used multiple times in the same command
-- Forum posts are now processed asynchronously instead of sequentially
-- Prettify failures messages
-- Stats format
-
-### Removed
-
-- Support for ImageBan (website no longer exists)
-
-### Fixed
-
-- ImgBB crawler
-- Download path structure (Tokyomotion)
-- Empty `download_filename` on database
-- Missing thread id on `Last_Scraped_Forum_Post.csv` URLs
-- Nudostar Crawler
-- Invalid URL parsing (imgur)
-- Invalid link confirmation URL parsing (forums)
-
-## [6.3.0] - 2025-01-23
-
-### Added
-
-- Members.luscious.net support
-- Coomer and Kemono search results support
-- SendVid.com support
-- Support for forum direct link URLs (attachments) as input URLs
-- `--logs-expire-after` option: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/settings/logs#logs_expire_after>
-- `--filename-regex-filter` option: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/settings/ignore_options#filename_regex_filter>
-
-### Changed
-
-- `--rotate-logs` now creates a subfolder by date
-
-### Fixed
-
-- Bunkr reinforced link handling
-- Handle encoded URLS found while scraping (every crawler)
-- Imgur crawler
-- MediaFire Crawler
-- JPG5 rate limit
-
-### Deprecated
-
-- Forums authentication settings (username, password and `xf_cookie`) will be removed in a future version
-
-## [6.2.0] - 2025-01-10
-
-### Added
-
-- PixHost.to support
-- Forum.AllPornComix.com support (forum)
-- Bellazon.com support (forum)
-- TitsInTops.com support (forum)
-- Video support for chevereto sites (`imagepond.net`, `img.kiwi` and `jpg5.su`)
-- Filesystem URLs support for images and videos (pixeldrain)
-- Indirect links support (saint)
-
-### Changed
-
-- Better MediaFire errors handling
-- Better RealDebrid errors handling
-- Do not overload 403 and 404 errors
-- Use canonical URLs for files in database (chevereto)
-
-### Fixed
-
-- Files being hashed twice when using `Hashing.IN_PLACE`
-- Post information parsing (reddit)
-- Sub-path parsing, ex: submitted, comments (reddit)
-- "Loose Files" folder not being created (all crawlers)
-- Delete startup log file if empty
-- Make a single GoFile token acquisition request
-- Make a single login request try per forum
-- DDoS-Guard detection
-
-## [6.1.1] - 2025-01-05
-
-### Changed
-
-- Remove crawlers scrape lock
-
-### Fixed
-
-- v5 to v6 transfer [database] (`hash` table missing on second startup)
-- v4 to v6 transfer [logs] ('downloader.log' being used by another process)
-
-## [6.1.0] - 2025-01-04
-
-### Fixed
-
-- Fallback to old file password check (cyberfile)
-- Handle stream redirects (bunkr)
-- Files being saved with the current date instead of the upload date
-- Sanitize filenames before downloading
-- Apprise notifications integration
-- Log startup errors to a file (validation, YAML, database and unknown errors)
-- Miscalculation of download and scrape queue length
-- Sorting videos with invalid or missing fps metadata
-- e-Hentai crawler
-
-### Changed
-
-- Set 512MB as the minimum required free space
-- `--console-log-level` will have no effect unless `--no-ui` was used
-- OS notification are enabled by default on Windows
-
-### Deprecated
-
-- `--output-folder` is deprecated. Use `--download-folder`
-- v4 support (importing v4 config and files) will be removed in a future version
-
-### Added
-
-- `--deep-scrape` option: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/settings/runtime_options#deep_scrape>
-- `--separate-posts-format` option: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/settings/download_options#separate_posts_format>
-- Allow any file name for cookie files
-- Redact username from log tracebacks
-
-## [6.0.1] - 2024-12-24
-
-### Fixed
-
-- Database v5 to v6 transfer
-
-## [6.0.0] - 2024-12-23
-
-⚠️**BREAKING CHANGES**
-
-1. Stricter config validation logic. CDL will verify that every config value and CLI argument is valid before running
-
-2. All dedupe and hashing functions has been replaced.
- - `xxh128` is now the default hashing algorithm, replacing `md5`
- - By default, all v5 hashes will be ignored for deduplication matches. You can re-enable md5 with `--add-md5-hash`
- - It's no longer possible to keep the newest file while deduplicating.
- - Every file previously downloaded is taken into account for deduplication. Files no longer need to currently exists on disk
-
-3. Removed `--sort-cdl-only` option
-
-4. The following arguments are deprecated and will be removed in a future version:
- - `--output-folder`
- - `--download-all-configs`
- - `--sort-all-configs`
- - `--sort-all-downloads`
- - `--main-log-filename`
- - `--last-forum-post-filename`
- - `--unsupported-urls-filename`
- - `--download-error-urls-filename`
- - `--scrape-error-urls-filename`
-
-This update introduces the following changes:
-
-- Add Python 3.13 support
-- Add requests caching to speed up future download sessions for forums, Coomer, and Kemono.
-- Update Kemono & Coomer crawlers to use API calls
-- Update GoFile crawler to the new site design
-- Update Bunkr crawler to handle new UUID filename format
-- Rework entire deduplication and hashing logic. Now multiple hashing algorithms are supported
-- Use Pydantic for config and CLI values validation
-- Allow downloading duplicate files on the same run with `--ignore-history`
-- Fix sorting functionality
-- Allow running all configs sequentially using `--config ALL`
-- Better cookies management system
-- Added option to clear cookies for selected websites
-- General improvements and bug fixes
-
-## [5.7.2] - 2024-11-20
-
-This update introduces the following changes:
-
-1. Add option to use cookies from any supported site
-2. Apply cookies from flaresolverr when possible, even if the response is invalid
-3. Add option to automatically import cookies at startup
-4. Better validation of config values
-5. Rework entire TUI user input options
-6. General logging improvements and bug fixes
-
-### Details
-
-- User can import cookies from their browser. CDL will use these cookies to login to websites and pass Cloudflare DDoS challenges. For more information on cookies extraction and configuration, visit: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/settings/browser_cookies>
-- When using flaresolverr, CDL will try to apply the cookies from the response and make a new request if necessary.
-- User can set CDL to automatically import cookies at startup. User must specify browser and domains to export cookies from
-- Add logic validation for config path values
-- Remove integrated config edit options. Modifications to the config must be done directly on the config file.
-
-## [5.7.1] - 2024-11-05
-
-⚠️**BREAKING CHANGES**
-
-> All output files (except for the main log file) are now CSV files with headers for each column (`Scrape_Errors`, `Download_Errors`, `Unsupported_URLs` and `Last_Forum_Post`). A custom filename for each file can still be set via config, but the extensions will always be `.csv`
-
-This update introduces the following changes:
-
-1. Adds the option to limit how many items are scraped
-2. Add support for scraping a users' coomer favorites
-3. Add integration to handle downloads supported by <https://real-debrid.com>
-4. Add support for <https://nekohouse.su> profiles and posts
-5. Add support for <https://imagepond.net> URLs
-6. Add support for password protected albums from Chevereto sites (`jpg5`, `Img.kiwi` and `Imagepond`)
-7. Show `total runtime` and `total downloaded data` on final report
-8. Add support to send the main log file as an attachment to the `webhook_url` report
-9. Add support to sent CDL report via email, telegram and many other services via Apprise
-10. Add support for `%` encoded URLs in the input file
-11. General logging improvements and bug fixes
-
-### Details
-
-- Users can limit the number of items to scrape by type, using the `--maximum-number-of-children` parameter. For more details on how to use this feature, visit the wiki: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/settings/download_options>
-- Add support for scraping a users' coomer favorites by allowing the user to pass the coomer favorites page URL as an input URL (<https://coomer.su/favorites>). This requires them to have their coomer session token in the `authentication.yaml` file.
-- Add real-debrid integration to download from any site that they support (`mega.nz`,`rapidgator`, `google drive`, `k2s`, etc). User needs to provide their API key in the `authentication.yaml` file in order to allow downloads
-- Nekohouse URLs can now be scraped and downloaded by CDL
-- Users can now get the stats report of the run via multiple services and include the main log as an attachment. For more information on how to setup notifications, visit: <https://script-ware.gitbook.io/cyberdrop-dl/reference/notifications>
-- Fix parsing of bunkr file extensions when `--remove-generated-id` is enabled
-- Remove console markdown data from log files
-- Fix `only_hosts` skip logic
-- Better handling of some unknown errors
-
-## [5.7.0] - 2024-10-25
-
-This update introduces the following changes:
-
-1. Rotating log files
-2. Overhaul hashing functions
-3. Add support for <https://tokyomotion.net> URLs
-4. Add support for <https://xxxbunker.com> URLs
-5. Add support for <https://saint2.su> albums
-6. Add support for password protected Cyberfile URLs
-7. Simplify some UI elements
-8. Improve jdownloader integration
-9. Implement rich logger
-10. Add a "Check for Updates" UI option
-11. General bug fixes
-
-### Details
-
-- Add option to rotate log file names. If enabled, current `date-time` will be used as a suffix for each log file, in the format `YYMMDD_HHMMSS`. This will prevent overriding old log files
-- Refactor hashing functions and logic
-- Add support for videos, photos, albums, playlist, profiles and search results of tokyomotion.net
-- Add support for playlists, search results and video downloads on xxxbunker.com
-- Add support for saint2.su album URLs
-- Add support for both password protected files and folders on Cyberfile. Users can include the password as a query parameter in the input URL, adding `?password=<URL_PASSWORD>` to it. Example: `https://cyberfile.me/folder/xUGg?password=1234`
-- Replace built-in log file handler with rich handler for better error reports
-- UI changes: remove redundant 'X of Y files' from every progress bar, sort scrape and download error by reverse frequency, use equal height for top row UI, fix padding issues, show unsupported URLs stats at the end
-- Add `whitelist` filter, `autostart` and custom `download_dir` options for jdownloader. For more details, visit the wiki: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/settings/runtime_options>
-- Added a "Check for Updates" UI option and improved the update check logic to check for new testing versions.
-- Fix error during program exit when referrer table no longer exists
-- Prevents crashes when there are insufficient permissions to move a file
-- Fix an issue where CDL would delete URLs input file
-- Move functions for after download to `post_runtime`
-- Fix handling of deleted Imgbox albums if they return `HTTP 200`
-- Fix Cyberfile deleted folders not being correctly scraped
-- Update logging to include when a file is being downloaded with no crawler
-
-## [5.6.54] - 2024-10-21
-
-This update introduces the following changes:
-
-1. Fix error on some bunkr videos
-
-### Details
-
-- Fix error when downloading videos with no thumbnail (bunkr)
-- Update possible CDNs (bunkr)
-- Better error handling (bunkr)
-
-## [5.6.53] - 2024-10-20
-
-This update introduces the following changes:
-
-1. Update bunkr crawler
-
-### Details
-
-- Update bunkr crawler to work on the new site design
-
-## [5.6.52] - 2024-10-10
-
-This update introduces the following changes:
-
-1. Fix scan_folder saved as invalid value
-
-### Details
-
-- Fixes issue that causes the config file to be corrupted with an invalid scan_folder value.
-
-## [5.6.51] - 2024-10-10
-
-This update introduces the following changes:
-
-1. Skip file download by referer
-2. Fixes album_id not been saved to database
-
-### Details
-
-- Using the flag `--skip-referer-seen-before` will skip downloading files from any referer that have been scraped before. The file (s) will always be skipped regardless of whether the referer was successfully scraped or not
-- Fixes album_id property not being saved to database on supported crawlers
-
-## [5.6.50] - 2024-10-07
-
-This update introduces the following changes:
-
-1. Support for password protected GoFile links
-
-### Details
-
-1. Users can include the password as a query parameter in the input URL, adding `?password=<URL_PASSWORD>` to it.
- Example: <https://gofile.io/d/xUprGg?password=1234>
-
-## [5.6.43] - 2024-10-03
-
-This update introduces the following changes:
-
-1. Update True/False CLI arguments to integrate better with the config file.
-
-### Details
-
-- CLI arguments that toggle settings to `True` or `False` can now be passed as either `--arg` or `--no-arg` to set the value to `True` or `False` respectively.
-- This also solves an issue where CLI arguments that toggle settings would override config file settings even if the CLI argument was never passed.
-
-## [5.6.42] - 2024-10-03
-
-This update introduces the following changes:
-
-1. Filter final URL with `--skip-hosts` and `--only-hosts` arguments
-
-### Details
-
-- This allows the user to skip or only download from specific bunkr hosts
-
-## [5.6.41] - 2024-10-01
-
-This update introduces the following changes:
-
-1. Fixes crash when unsupported URLs have no parents
-2. Display new changelog if an update is available
-3. Updated supported sites in Wiki
-
-### Details
-
-- Fixes crash if an unsupported url have no parents
-- Always display an updated changelog if a new version has been released on pypi
-- Remove SimpCity from supported websites on Wiki
-
-## [5.6.40] - 2024-10-01
-
-This update introduces the following changes:
-
-1. Fixes empty folder cleanup
-
-### Details
-
-- Fix incorrect path objects on post-runtime folder cleanup
-
-## [5.6.39] - 2024-09-30
-
-This update introduces the following changes:
-
-1. Add external CHANGELOG file
-
-### Details
-
-- Project changes will documented on <https://github.com/Cyberdrop-DL/cyberdrop-dl/blob/main/CHANGELOG.md> for better tracking
-- Built-in viewer will fetch CHANGELOG history on first use
-
-## [5.6.38] - 2024-09-30
-
-This update introduces the following changes:
-
-1. Fix `scrape_items` creation for Kemono and coomer links
-
-### Details
-
-- Fixes parents tracking for Kemono and coomer links
-
-## [5.6.37] - 2024-09-30
-
-This update introduces the following changes:
-
-1. Fixes empty folder cleanup on python 3.11
-
-### Details
-
-- Fixes logic by walking the directory tree using `os.walk` to remain compatibility with python 3.11
-
-## [5.6.36] - 2024-09-30
-
-This update introduces the following changes:
-
-1. Delete empty files after a successful run.
-2. Added a feature to save the origin of unsupported URLs
-
-### Details
-
-- Empty files (0 bytes) inside download_dir will be deleted alongside empty folders after a successful run
-- Each unsupported URL will now be saved alongside the URL of the original item they came from (`Unsupported_URLs.txt`)
-- Origin is also saved for password protected links, allowing the user to visit the URL (ex. forum post) and retrieve the password if available
-
-## [5.6.35] - 2024-09-30
-
-This update introduces the following changes:
-
-1. Small fixes for sorting system
-
-### Details
-
-- Fixes `scan_dir` selection logic
-
-## [5.6.34] - 2024-09-30
-
-This update introduces the following changes:
-
-1. Added a feature to fix the names of multipart archives.
-
-### Details
-
-- Multipart archives will be renamed to have the proper naming format when the `--remove-generated-id-from-filenames` argument is passed.
-
-## [5.6.33] - 2024-09-25
-
-This update introduces the following changes:
-
-1. Fix issues with checking how much free space is available on the disk.
-2. Skip clearing the console when running with the `--no-ui` flag.
-
-### Details
-
-- Fixed an issue with free space not being properly checked when running with the `--retry-failed` flag.
-- Made error output more clear when there is not enough free space to download a file.
-- Skip clearing the console when running with the `--no-ui` flag to allow users to see the output of all runs done with `--no-ui`.
-
-## [5.6.32] - 2024-09-22
-
-This update introduces the following changes:
-
-1. Add new URLs categorization feature for the URLs.txt file.
-
-### Details
-
-- You can now group links under one download folder by adding a category name above the links in the `URLs.txt` file.
-- The category name must be prefixed by three dashes (`---`) and must be on a new line.
-- The category name will be used as the folder name for the links that follow it.
-- To end a category, add three dashes (`---`) on a new line after the links.
-- You can have multiple categories in the URLs.txt file, and the links will be grouped accordingly.
-
-For more details, visit the wiki: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/settings/sorting>
-
-## [5.6.30] - 2024-09-21
-
-**SIMPCITY HAS BEEN REMOVED FROM THE SUPPORTED WEBSITES LIST.**
-
-**TO SEE WHY, VISIT THE WIKI:** <https://script-ware.gitbook.io/cyberdrop-dl/simpcity-support-dropped>
-
-## [5.6.20] - 2024-09-19
-
-This update introduces the following changes:
-
-1. Ability to scrape URLs from PixelDrain text post
-
-### Details
-
-- Cyberdrop-DL will now scrape URLs from PixelDrain text posts and make a folder for all the URLs within the post, reducing clutter.
-
-## [5.6.13] - 2024-09-19
-
-This update introduces the following changes:
-
-1. Per-config authentication settings
-
-### Details
-
-- If an `authentication.yaml` file is placed within your config directory, it will be used instead of the global authentication values.
-
-## [5.6.12] - 2024-09-19
-
-This update introduces the following changes:
-
-1. Reformat code and organize imports
-
-### Details
-
-- Reformatted code to be more readable and removed unused imports.
-
-## [5.6.11] - 2024-09-16
-
-This update introduces the following changes:
-
-1. Detect and raise an error for private GoFile folders
-
-### Details
-
-- Private GoFile folders will now raise an error when attempting to download them instead of crashing CDL
-
-## [5.6.1] - 2024-09-13
-
-This update introduces the following changes:
-
-1. Fixes issue with `--sort-all-downloads`
-2. Improves sort status visibility
-
-### Details
-
-- The sort status is now display under hash, along with other statuses
-- `--sort-all-downloads` is disabled by default, thus only cdl downloads are sorted without the flag
-- `sort_folder` can not be the same as the `scan_dir`
-
-## [5.6.0] - 2024-09-13
-
-This update introduces the following changes:
-
-1. Updated the sorting progress UI to display more information.
-2. Removed unused functions from progress bars.
-
-### Details
-
-- The sorting UI now displays the progress of each folder as it is being processed, including the number of files that have been sorted and the percentage of the folder that has been processed.
-- The sorting UI now also shows what folders are in the queue to be sorted.
-
-## [5.5.1] - 2024-09-12
-
-This update introduces the following changes:
-
-1. Small fixes for sorting system
-
-### Details
-
-- use `-` instead of `_` for new arguments
-- fix bug where `purge_dir` is called for each file, instead of each directory when done
-
-## [5.5.0] - 2024-09-12
-
-This update introduces the following changes:
-
-1. Finalizes new sorting feature
-2. add scanning directory for sorting
-3. adds progress bar for sorting
-
-### Details
-
-- skips need to scan database if `sort_cdl_only` is false
-- progress bar for current progress of sorting files, incremented for each folder
-- allow for setting a different folder to scan that is independent of the download folder
+- Posts filtering by URL params (Wordpress)
+- Auto cookie extraction support
+
+Several config options have been removed:
+
+- `--add-md5-hash`
+- `--add-sha256-hash`
+- `--auto-import`
+- `--browser`
+- `--completed-after`
+- `--completed-before`
+- `--disable-download-attempt-limit`
+- `--download-tiktok-audios`
+- `--last-forum-post`
+- `--max-items-retry`
+- `--remove-generated-id-from-filename`
+- `--retry-all`
+- `--retry-failed`
+- `--retry-maintenance`
+- `--save-pages-html`
+- `--scrape-single-forum-post`
+- `--sites`
+- `--skip-check-for-partial-files`
+- `--update-last-forum-post`
+
+The following authentication entries has been removed:
+
+- `Imgur.client_id`
+- `Kemono.session`
+- `Coomer.session`
+
+## [9.15.2] - 2026-06-16
+
+### Fixed
+
+- Update website salt (Gofile)
+- Free space check on network drives (Windows)
+
+## [9.15.1] - 2026-06-11
+
+### Fixed
+
+- Video metadata extraction (Spankbang)
+- Crashing when `--dump-json` option is used
+
+## [9.15.0] - 2026-06-10
+
+### Changed
+
+- Reject any download without a valid `Content-Length` header
+- Report any download with size < `Content-Length` as corrupted and delete them
+
+### Fixed
+
+- Channel downloads (Rumble)
+
+## [9.14.0] - 2026-06-03
+
+⚠️**IMPORTANT**
+
+> If you has ever used a Pixeldrain API key with `cyberdrop-dl-pacthed` version >=8.5.0, you should consider them compromised and disable them.
+>
+> See: [GHSA-f5pf-q7c7-m3vv (CVE-2026-54254)](https://github.com/Cyberdrop-DL/cyberdrop-dl/security/advisories/GHSA-f5pf-q7c7-m3vv)
+
+### Added
+
+- Support password protected files/folders (Filester)
+
+### Changed
+
+- Hard fail if any config option requires `ffmpeg` but `ffmpeg` is not installed
+- Disable hardcoded max concurrent downloads (2) if an API key is provided by the user (PixelDrain)
+- Exclude main log file from empty files check
+
+### Removed
+
+- Support for download proxies. Proxy URLs with be rewritten as pixeldrain.com URLs (PixelDrain)
+
+### Fixed
+
+- Some false positive DDoS-Guard detections
+- URLs extraction from text files in a filesystem (PixelDrain)
+
+### Security
+
+- Reject any URL not matching an official domain (Pixeldrain)
+
+## [9.13.0] - 2026-05-29
+
+### Changed
+
+- Replace bunkr-albums.io with balbums.st
+- Switch to new downloads API (Bunkr)
+- `--deep-scrape` no longer has any effect on Bunkr
+- Exclude dot files from empty files check
+
+### Removed
+
+- Support for direct links (Bunkr)
+
+### Fixed
+
+- Do not crash on HTTP errors from individual photos (Flickr)
+- Do not crash on HTTP errors from individual files (Google Drive)
+
+### Security
+
+- Reject download with leading dots as filenames (dot files)
+- Reject downloads if the final download path is outside the root download folder (path traversal)
+- The following extensions have been hardcoded to always be rejected:
+
+1. `.bat`
+2. `.com`
+3. `.exe`
+4. `.hta`
+5. `.inf`
+6. `.jar`
+7. `.js`
+8. `.lnk`
+9. `.msc`
+10. `.msi`
+11. `.ps1`
+12. `.ps2`
+13. `.psc1`
+14. `.psc2`
+15. `.sh`
+16. `.scf`
+17. `.vb`
+18. `.vbs`
+19. `.wsc`
+20. `.wsh`
+
+## [9.12.0] - 2026-05-27
+
+### Added
+
+- 1fichier support
+- Archive.org support
+- YTboob support
+- Rutube support
+- Acast support
+- Whyp.it support
+- Soundgasm support
+- Clyp.it support
+- Livestreamfails support
+- Yurivan support
+- Fatbox proxy support (Catbox)
+
+### Fixed
+
+- Date extraction (Rule34vault)
+- `--json` output missing files skipped by host or filename regex
+- Update website salt (Gofile)
+- Episode parsing (OnePace)
+- Do not crash on HTTP errors from profiles/search (Spankbang)
+
+## [9.11.0] - 2026-05-20
+
+### Changed
+
+- Show the aggregate speed of all downloads
+
+### Deprecated
+
+- Posts filtering by URL params will be removed on the next major release (Wordpress)
+
+### Fixed
+
+- Crash trying to decode non https URLs from the database (jpg5)
+- Wordpress support
+
+## [9.10.3] - 2026-05-19
+
+### Fixed
+
+- Parsing of thread URLs (Xenforo)
+- Date extraction (efukt.com)
+
+## [9.10.2] - 2026-05-19
+
+### Changed
+
+- Replaced fapello.su with fapello.com. Existing database entries will be ignored
+- Updated domain to xbunker.cc (Xbunkr)
+- Updated domain to www.imagepond.net (Imagepond)
+- Updated domain to turbo.cr (TurboVid)
+
+### Removed
+
+- files.vc support (No longer exists)
+- incestflix.com support (No longer exists)
+
+### Fixed
+
+- Do not try to parse upload date (YouJizz)
+- Video extraction from embed URLs (YouJizz)
+- Date extraction (Sex.com)
+- Date extraction (Rule34.xxx)
+- Date extraction (Nsfw.xxx)
+- Date extraction (e621)
+- Chapter info extraction (OmegaScans)
+- 403 Forbidden when the input URL is a direct file (Turbo.cr)
+
+## [9.10.1] - 2026-05-16
+
+### Changed
+
+- Update supported domains (JPG5)
+- Log URLs without public key as password protected (mega.nz)
+
+### Fixed
+
+- `--impersonate` being ignored
+- Infinite redirects on albums (imgbb)
+- Handle URLs with redundant empty parts (Fileditch)
+
+## [9.10.0] - 2026-05-13
+
+### Added
+
+- New `cleanup` subcommand
+- New `--concurrent-segments` option for HLS downloads
+
+### Changed
+
+- Assume binary payload for downloads with missing `Content-Type`
+- Use proxy and ssl config settings for requests made with `ffprobe`
+- The default `--concurrent-segments` changed from 50 (audio and subtitle streams) and 20 (video streams) to 10 for all cases
+
+### Fixed
+
+- `Invalid Content Type - No content type in response headers` (turbo.cr)
+
+## [9.9.0] - 2026-05-12
+
+### Added
+
+- New `database transfer` subcommand to update a database file from an old CDL version to the newest schema
+
+### Fixed
+
+- All HTTP errors being reported as `generator didn't yield` errors
+- Do not override host of stream redirect URLs (Bunkr)
+
+## [9.8.1] - 2026-05-11
+
+### Changed
+
+- Do not probe duration of media files unless required by config
+
+### Fixed
+
+- `ffprobe not installed` error on non HLS downloads
+
+### Security
+
+- Force latest version of some transient dependencies to resolve CVE-2026-44431 and CVE-2026-44432
+
+## [9.8.0] - 2026-05-11
+
+### Added
+
+- New `--dump-responses` option to save non binary responses (text/HTML/JSON) to disk
+
+### Changed
+
+- Log downloads requests/responses
+- Log flaresolverr requests/responses
+- Prevent requests bursting at the start of a run
+
+### Deprecated
+
+- `--save-pages-html` will be removed on the next major release
+
+### Removed
+
+- Nekohouse support (No longer exists)
+
+### Fixed
+
+- Parsing of json responses from non Selenium forks of Flaresolverr
+- Flaresolverr session destruction always failing
+- Handle posts with deleted images (TikTok)
+- A single video download error canceling the entire scrape queue (LeakedZone/Hotleak)
+
+## [9.7.0] - 2026-05-07
+
+### Added
+
+- Coomerfans.com support
+
+### Removed
+
+- Using `--impersonate` without any value is no longer supported
+
+### Fixed
+
+- Typer error when using `--impersonate`
+- Do not crash on API errors (pCloud)
+
+## [9.6.0] - 2026-05-04
+
+### Changed
+
+- Show sorting stats again at the end of a run
+
+### Deprecated
+
+- Support for python 3.11 will be removed on the next major release
+
+### Fixed
+
+- CDL crashing cause it was trying to dedupe files outside the download folder
+
+## [9.5.1] - 2026-05-03
+
+### Fixed
+
+- Some previously downloaded URLs not being skipped
+
+## [9.5.0] - 2026-05-02
+
+### Changed
+
+- `--log-level` and `--console-log-level` now accept level names as valid values, ex: `INFO` or `WARNING`
+- An empty or null value for `--console-log-level` will use the same level as `--log-level`
+- For `--console-log-level`, values higger than 50 (`CRITICAL`) will be reset to `None`
+
+### Deprecated
+
+Several config options:
+
+CLI Only options:
+
+- `--completed-after`
+- `--completed-before`
+- `--download`, `--retry-all`, `--retry-failed`, `--retry-maintenance` options will be removed and replaced with dedicated subcommands
+
+Download Options:
+
+- `--disable-download-attempt-limit`
+- `--remove-generated-id-from-filenames`
+- `--scrape-single-forum-post`
+
+Logs
+
+- `--last-forum-post`
+
+RuntimeOptions:
+
+- `--update-last-forum-post`
+- Support for integers values with `--log-level` and `--console-log-level` will be removed on v10. They will only accept log level names
+
+Authentication entries for:
+
+- `Imgur.client_id` (no longer required)
+- `Kemono.session` (can be supplied by cookies)
+- `Coomer.session` (can be supplied by cookies)
+
+DupeCleanup:
+
+- `--add-md5-hash` and `--add-sha256-hash` will removed and merged into a single config option as a list of hashes to enable
+
+### Fixed
+
+- `--log-level` and `--console-log-level` being ignored
+- Skip empty files removal if the root folder no longer exists
+
+## [9.4.3] - 2026-05-01
+
+### Fixed
+
+- `CRITICAL` errors not being logged to the main log file
+
+## [9.4.2] - 2026-04-30
+
+### Changed
+
+- Send real referrer on reinforced downloads (Bunkr)
+- Improve performance of database lookups
+
+### Fixed
+
+- Location of `apprise.txt` (`AppData/Configs/Default/apprise.txt`)
+- Auto cookies extraction not creating any files
+
+## [9.4.1] - 2026-04-28
+
+### Changed
+
+- `--refresh-rate` now accepts fractions of a seconds as value (ex: 0.5)
+- Detect and bypass `AppData` virtualization when Python is installed from the Microsoft store
+
+### Fixed
+
+- `--refresh-rate` being ignored
+- `--ui` mode being ignored
+- Error decoding some filenames (bunkr)
+- Handle "server under maintenance" pages (Bunkr)
+- `bunkr.black` redirects always triggering DDosGuard (bunkr)
+- Parsing of API errors (RedGifs)
+- Bypass login check for 1080p+ videos (ePorner)
+- Empty name for some public files (MegaNZ)
+- Truncated errors on stats summary
+- Flaresolverr session destruction always failing
+
+## [9.4.0] - 2026-04-23
+
+### Added
+
+- ImageVenue support
+- Photo search support (Anysex)
+- Photo search and Tags support (ePorner)
+
+### Changed
+
+- Log CDL enviroment vars
+- Always use threads to resolve DNS queries on Windows
+
+### Removed
+
+- InfluencerBitches support (No longer exists)
+
+### Fixed
+
+- Ignore errors while checking for updates
+- `RuntimeError` when downloads reach 99% due to incorrect MAC integrity check (MegaNZ)
+
+## [9.3.1] - 2026-04-21
+
+### Fixed
+
+- Download errors showing as scrape errors
+
+## [9.3.0] - 2026-04-20
+
+### Added
+
+- Patreon support
+- OnePace support
+- Giphy support
+- XMegaDrive support
+- Search, tag and category support (ThotHub)
+
+### Changed
+
+- Hash multiple files (20) at once when using the UI menu option
+- Default to HLS downloads (xHamster)
+- Improve support for Flaresolverr forks using NoDriver/DrissionPage
+
+### Fixed
+
+- Downloads panel not showing up in vertical layout
+- Do no try to hash folders
+- Do not try to normalize usernames (RedGifs)
+- Search and user's pagination (Rule34Video, CamWhores)
+- Do not download random unrelated videos from profiles (Rule34Video)
+- Merging of m3u8 subtitles
+- Subtitles sometimes being deleted after download
+- Handle subdomains (Tranny.one)
+- `KeyError` trying to parse a response from Flaresolverr instance using Selenium as backend
+- Update query hashes (Twitch)
+
+## [9.2.0] - 2026-04-15
+
+### Added
+
+- Tabootube support
+
+### Changed
+
+- Check for DDoS-Guard even on successful responses
+- New hashing, dedupe and scraping UI
+- Show accurate download progress for HLS downloads
+
+### Removed
+
+- Flugel anime support (No longer exists)
+- Safe.soul support (No longer exists)
+- Xbunkr support (No longer exists)
+
+### Fixed
+
+- Switch to v2 API (nHentai)
+- Download URL extraction (MixDrop)
+- Do not try to parse relative dates (KVS)
+- Use impersonation for downloads (MissAV)
+
+## [9.1.0] - 2026-04-08
+
+⚠️**IMPORTANT**
+
+> This version logs raw HTTP requests and responses to the main log file. They may include credentials, IP, etc. Remove personal information before sharing them or just extract the relevant logs
+>
+> Options to change log level are ignored. It will be fixed on a future version
+
+### Added
+
+- Gupload.xyz support
+- Vidara support
+- OwnCloud support
+- Support premium URLs (MediaFire)
+- Support subfolders (Filester)
+- Support for archives (.zip) files (ImagePond)
+
+### Changed
+
+- Adjust default rate limit (RedGifs)
+- Create crawlers only if they are going to be used
+- Webhook notifications will now be sent as plain text
+- Use original filenames (ImagePond)
+- New UI while sorting files
+- CDL is way more verbose now
+- Several performance improvents
+
+### Deprecated
+
+- Auto import cookies
+
+### Removed
+
+- All settings and UI options about changing configs have been removed. CDL will always use the default config at `AppData/Configs/Default/settings.yaml`. A different config can be specified only via CLI args (`--config-file`)
+- The UI Option to export cookies has been removed
+
+### Fixed
+
+- Download all videos on paginated playlists (50+ videos) (PMVHaven)
+- Handle deleted videos (TubeCorporate)
+- 404 downloads (Bunkr)
+- Update selectors for files with MD5 hashes instead of SHA256 (Filester)
+- Profile, albums and images crawling (ImagePond)
+- Android support (requires python 3.13)
+- Player info parsing (ashemaletube)
+
+## [9.0.2] - 2026-03-25
+
+### Changed
+
+- Support users with up to 20K posts (Redgifs)
+
+### Removed
+
+- UI option to check updates
+
+### Fixed
+
+- Database path (Filester)
+- Requote download redirects (ePorner)
+- Update website salt (Gofile)
+
+## [9.0.1] - 2026-03-17
+
+### Fixed
+
+- Update website salt (Gofile)
+
+## [9.0.0] - 2026-03-09
+
+⚠️**BREAKING CHANGES**
+
+> You can only upgrade to this version from v8.10.
+
+### Added
+
+- Upload.ee support
+- Filester support
+
+### Changed
+
+- Use original filename for turbo.cr
+- Apprise is now an optional dependency (required for notifications)
+
+### Removed
+
+- Reddit support
+
+Several config options:
+
+- `config`
+- `disable_cache`
+- `log_line_width`
+- `file_host_cache_expire_after`
+- `forum_cache_expire_after`
+- `downloading_item_limit`
+- `scraping_item_limit`
+- `vi_mode`
+
+### Fixed
+
+- Download of multipage profile albums (Chevereto)
+- Handle `redirect/to` links (Xenforo)
+- Download of files with broken thumbnails (bunkr)
+- Send custom one-time-use headers (GoFile)
+- Download subfolder from filesystem URLs (pixeldrain)
+
+## [8.10.0] - 2026-01-26
+
+### Added
+
+- Google photos support
+- Turbovid support
+- Fuckingfast support
+- Bandcamp support
+- Twitch.tv support
+- Nsfw.xxx support
+- Support for albums (xgroovy)
+- Support for tube-corporate sites (fuxxx, hclips, hdzog, hotmovs, inporn, pornzog, tubepornclassic, txxx, upornia, vjav, voyeurhit, vxxx, xmilf)
+
+### Changed
+
+- Get deterministic errors for deleted files (Cyberdrop)
+
+### Fixed
+
+- Ignore errors while deleting partial files
+- Ignore unknown timezones while parsing dates
+- Use the same origin as input URL for playlists (spankbang)
+- Filesystem downloads (PixelDrain)
+- Gallery downloads (PostImg)
+- Low resolution images being downloaded (PostImg)
+- Use original filename for photos (PostImg)
+- Password protected albums (Chevereto)
+- Always use impersonation (Toonily)
+- HLS downloads ignoring config for concurrent max downloads
+- Incorrect URL as first parent for files in `--json` output
+- Files being re-downloaded if their source uses a new CDN (Bunkr)
+
+## [8.9.0] - 2025-12-18
+
+### Added
+
+- Anysex support
+
+### Changed
+
+- Detect and report sites protected by Anubis
+
+### Fixed
+
+- `dict` has no attribute server (Kemono/Coomer/Nekohouse)
+- Decode new URL format (xhamster)
+- Update crawler to new site design (PMVHaven)
+- Impersonation always using the same user agent
+- Send token in headers (GoFile)
+
+## [8.8.0] - 2025-12-03
+
+### Added
+
+- Erome.fan support
+- Thothub support
+- Support for models filtered by site (girlsreleased)
+
+### Changed
+
+- Proving a client id is no longer required (Imgur)
+- URLs downloaded with RealDebrid will be saved as is to the DB. Existing DB entries will be ignored
+
+### Fixed
+
+- Individual videos download (Porntrex)
+- Random unrelated models being downloaded (girlsreleased)
+- Trailing dots on partial file names
+
+## [8.7.0] - 2025-11-21
+
+### Added
+
+- Transfer.it support
+- MasaHub.com support
+- Koofr.eu support
+- Desivideo.net support
+- Rumble.com support
+- Tnaflix support
+- Bunkr-albums.io support
+- Ranoz.gg support
+- Rootz.so support
+- FSIBlog.com support
+- Tranny.one supprt
+- Xgroovy support
+- Luxuretv support
+- Streamtape.com support
+- Anontransfer support
+- Xasiat support
+- GirlsReleased.com support
+- Support for albums (imx.to)
+- Support for search URLS (saint)
+- Support for direct images (pixhost)
+- Parse the embed URL of posts (Kemono/Coomer/Nekohouse)
+- New `--exclude-after` and `--exclude-before` options to filter file downloads by upload date
+- `--dump-json` output will now have a `metadata` field with site specific information (on some sites)
+
+### Changed
+
+- Check and skip media files duration before downloading the entire file
+- Update sites to their new domains (`postimages.org` -> `postimg.cc`, `cyberdrop.me` -> `cyberdrop.cr`)
+- `--delete-partial-files` will also delete partial HLS segments (`.cdl_hls`)
+- Skip free space check on file systems that do not support it (ex: `sshfs`). Check will also be skipped on any FUSE fs that reports `0B`. NOTE: Using these filesystems has a risk of getting downloads corrupted. On some filesystems like `gvfs`, HLS downloads will _always_ be corrupted
+
+### Deprecated
+
+- Running multiple configs on the same run or using `--config ALL` will be removed on the next major release
+- Reddit support will be removed on the next major release
+- The `--skip-referer-seen-before` option will be removed on the next major release
+- `apprise` will no longer be included by default. It will become an optional dependency
+- Next major release will not include any `ffprobe` binaries as they are several years out of date
+
+### Fixed
+
+- Upload date parsing (noodlemagazine)
+- Loose files getting downloaded into the root folder (gofile)
+- Downloads skipped by duration not being removed from the download queue
+- Handle redirects & direct link downloads (cyberdrop)
+- Handle not found & direct links (saint)
+- Video resolution parsing (Rule34Video)
+- Subtitles downloads
+- Invalid filename of HLS segments on Windows
+- Parsing of dates without a year
+- Best format selection of m3u8 streams with the same resolution but different bitrate
+
+## [8.6.0] - 2025-10-28
+
+### Added
+
+- Support hotleaks.tv
+- Support direct URLs (GoFile)
+
+### Fixed
+
+- Date parsing (Transflix)
+- Prevent duplicated extensions in custom filenames
+- Handle newer encryption formats in URLs (6,7) (xHamster)
+- Parsing of filenames with brackets (Mega.nz)
+
+## [8.5.0] - 2025-10-25
+
+### Added
+
+- Support for static images (RedGifs)
+- Support for JPG7 URLS (JPG5)
+- Support for Transflix
+- Support for individual files within folders (PixelDrain)
+- Support for subfolders in filesystem URLs (PixelDrain)
+- Support collections, tags and search URLs (MissAV)
+- Update supported domains and proxies (PixelDrain)
+
+### Changed
+
+- Improve hash query performance
+- Add rate limit back (Gofile)
+- New blocked domains: `twitter`, `x.com`
+
+### Fixed
+
+- Some `timeout` errors being reported as `Unknown`
+- Do not crash if webhook request failed
+- Date parsing (eHentai)
+- URL parsing (ImageBam)
+
+## [8.4.0] - 2025-10-18
+
+### Added
+
+- Support search URLs (erome)
+- Support direct image URLs (ashemaletube)
+
+### Changed
+
+- Remove hardcoded limiter (GoFile)
+- Remove hardcoded limiter, limit concurrent downloads to 1 file per unique server (Bunkr)
+- Retry client connector errors
+- Always override download URL with selti CDN (JPG5)
+
+### Fixed
+
+- Handle newer encryption formats in URLs (xHamster)
+- Do not crash processing images (PornHub)
+- Spankbang crawler
+
+## [8.3.0] - 2025-10-16
+
+### Added
+
+- New `--impersonate` cli option: <https://script-ware.gitbook.io/cyberdrop-dl/reference/cli-arguments#impersonate>
+
+### Removed
+
+- ImgAcid support (site no longer exists)
+
+### Fixed
+
+- MP4 downloads (ePorner)
+- HTTP errors crashing CDL (MediaFire)
+- Albums downloads (ImgBB)
+- Some exceptions not being logged if they happen during startup
+
+## [8.2.0] - 2025-10-06
+
+### Added
+
+- Candfans support (coomer)
+- Support user's albums URLs (Chevereto)
+- Support folders with 1000+ items (GoFile)
+
+### Changed
+
+- Use impersonation for all Chevereto sites
+
+### Fixed
+
+- Parsing of account's favorites URLs (Kemono, Coomer, Nekohouse)
+- Download of videos without an explicit resolution (ThisVid, CamwhoresTv)
+- Directory hashing from the main UI
+- Incorrect hash being logged when files are deleted
+- Do not try to fetch more pages if only 1 exists (KVS sites)
+- `TooManyRedirects` error trying to download images/albums with encoded characters in their URL (ImagePond, ImgLike)
+- Download of albums without a thumbnail (Chevereto)
+- Entire albums being skipped if the full res version of their thumbnail was downloaded before (Chevereto)
+
+## [8.1.0] - 2025-09-27
+
+### Added
+
+- imglike support
+- Support for channel photos (xVideos)
+
+### Changed
+
+- Remove SimpCity disclaimer on first time startup
+- Tiktok now has a hardcoded rate limit of 0.5 req/s
+
+### Fixed
+
+- `str object cannot be interpreted as an integer` error when using any retry option
+- Date parsing (pixeldrain)
+- Date parsing (bunkr)
+- Channel's pagination (xVideos)
+- Http errors being reported as `Not Implemented` (Pixeldrain, MediaFire, GoFile)
+- Http errors causing CDL to crash while downloading galleries (xVideos)
+- CDL getting stuck after 100 TCP connections
+
+## [8.0.0] - 2025-09-23
+
+### Added
+
+- Allow downloading google docs files with a custom format by using a `format` query param
+- Cloudflare stream support
+- pCloud support
+- MegaCloud support
+- PimpBunny support
+- HiAnime support
+- Safe.Soul support
+- Voe.sx support
+- Support for subfolders (MediaFire)
+- Support for short URL formats (MediaFire)
+- Support for subfolders (Dropbox)
+- Support for alternative pixeldrain domains: `pixeldrain.net`, `pixeldra.in`
+- Support for `pd.cybar.xyz` URLs to bypass pixeldrain daily limit
+- The `--separate-post` and `--separate-post-format` options now work for tiktok posts
+- CDL can now download private TikTok posts when using cookies
+- New config option to download tiktok videos in original quality: <https://script-ware.gitbook.io/cyberdrop-dl/reference/cli-arguments#download-tiktok-src-quality-videos>
+- New `--max-thread-folder-depth` config option: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/settings/download_options#maximum_thread_folder_depth>
+- New `--ignore-coomer-post-content` config option: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/settings/ignore_options#ignore_coomer_post_content>
+- The `--ignore-coomer-ads` config option now affects all Kemono based crawlers (Coomer, Kemono & Nekohouse)
+
+### Changed
+
+- The recommended python version is now python 3.12+, to take advandage of eager tasks
+- Start scripts will automatically install a compatible python version
+- Start scripts no longer support 32bit systems
+- Handle shared folders with single file as loose files (Yetishare)
+- Increase default rate limit, from 10req/s to 25req/s
+- Increase max concurrent bunkr downloads, from 1 to 3
+- Parse full spec cookies from Flaresolverr responses
+- CDL will no longer try to merge subtitles for HLS downloads. They will be downloaded as separate files
+- Make requests with the same domain as the original input URL (saint2.su)
+- Tiktok downloads use a new logic to create filenames and folders. Folder structure will be different from previous versions.
+- CDL will now iterate over each file and subfolder recursively, instead of downloading an entire folder as a zip (dropbox)
+- `--read-timeout` now accepts `None` as value. This will make CDL keep the socket connection open indefinitely, even if the server is not sending data anymore
+- `--read-timeout` and `--connection-timeout` now accept fractions of a seconds as value (ex: `0.3`)
+- `--read-timeout` and `--connection-timeout` now affect all requests CDL will make (flaresolverr requests, scrape requests and download requests)
+- General performance improvements
+
+### Deprecated
+
+- Support for v5 and v6 (config, database and auto-migration) is deprecated and will be removed on the next major release
+
+### Removed
+
+- `--download-dropbox-folders-as-zip` config option
+
+### Fixed
+
+- `--dump-json` output file missing some fields
+- CDL trying to download all HLS segments at once
+- Download retries always re-starting from zero
+- Global rate limiter being ignored while crawling
+- Crashing when using any value for `--download-speed-limit`
+- Handle b64 encoded URLs (MediaFire)
+- Previously downloaded HLS fragments not being detected
+- HLS subtitle downloads always failing
+- Parsing of 1440p, 2K, 4K and 8K videos (KVS sites)
+- Possible infinite loop when using the bunkrr.org domain (Bunkr)
+- Crashing if a single error happens while crawling a Discord channel (Kemono)
+- Nekohouse crawler
+- Thumbnails being downloaded as is instead of full resolution (Coomer, Kemono, Nekohouse)
+- Handle new rot13 encryption (xHamster)
+- Handle new hex encryption (xHamster)
+- Videos being skipped if the audio was downloaded before (TikTok)
+- Do not crash if the `URL.txt` file has ipv6 URLs or invalid URLs
+- `ConnectionError` after the first attempt of a DNS lookup failed, without trying any DNS fallbacks
+
+## [7.5.0] - 2025-09-02
+
+### Added
+
+- Support for subfolders URLs (Mega.nz)
+
+### Changed
+
+- Removed `is_segment` and `parent_media_item` from output jsonl file
+- The `hash` attribute of the jsonl file now has `xxh128:` as prefix
+
+### Fixed
+
+- API response parse (RealDebrid)
+- Nested folders for the same creator (TikTok)
+- Handle paginated albums (Bunkr)
+- Handle encrypted URLs (xhamster)
+- Incompatible dependencies declarations causing CDL to crash on startup
+
+## [7.4.1] - 2025-08-23
+
+### Changed
+
+- Try to download images in original quality (twitter images)
+- Ignore auto translated titles, always use original title (xhamster)
+- Detect and report captcha responses as `DDoS-Guard` Errors (iceyfile)
+- Better detection and error messages for geo blocked videos (PornHub)
+- Fallback to HLS source when MP4 sources are blocked (PornHub)
+
+### Fixed
+
+- Folder downloads always being skipped as duplicates (mega.nz)
+- Handle videos without http sources (xhamster)
+- User URL parsing and pagination (xhamster)
+- Shared folders always using `Shared Files Folders` as title instead of the actual folder name (cyberfile, iceyfile)
+- Handle files with malformed download URLs (emojis / special characters in name/URL slug) (cyberfile, iceyfile)
+- 404 when downloading from albums (PornHub)
+- Update API endpoints and parsing (Coomer, Kemono)
+- Files with mangled names if they had non english characters (Coomer, Kemono)
+
+## [7.4.0] - 2025-08-21
+
+### Added
+
+- xVideos support
+- odnoklassniki (ok.ru) support
+
+### Changed
+
+- Handle subalbum URLs as normal albums (chevereto)
+- Read cookie files asynchronously
+- Parse full spec cookies, including expire values
+- Downloading videos no longer requires an account (xxxbunkrr)
+- Subfolders created from the same site will no longer include the folder domain
+- Update cdns (bunkr)
+- Do not retry mega.nz downloads
+
+### Removed
+
+- PHPSESSID session auth option (xxxbunkrr)
+
+### Fixed
+
+- Password protected album downloads (chevereto)
+- Resolution parsing for videos (ashemaletube)
+- Some videos missing when downloading from a playlist (xxxbunkrr)
+- Playlist pagination (xxxbunkrr)
+- Profile downloads being abruptly terminated if a post has images (tiktok)
+- DDoSGuard error on every download (nHentai)
+- Handle videos with invalid character in description and title (ePorner)
+- Series and chapter downloads (toonily)
+- `--ui` options not working
+- Do not sort unjoined HSL files.
+
+## [7.3.1] - 2025-08-02
+
+### Changed
+
+- Update primary coomer domain to `coomer.st`. CDL will automatically change the host of any URL that uses the old domain
+- Update primary kemono domain to `kemono.cr`. CDL will automatically change the host of any URL that uses the old domain
+- Improve performance when writing CSV files
+- CDL will assume english as the language to parse any human date found on sites
+- The jsonl file generated by `--dump-json` will now include every file processed in the current run, even skipped ones. Files that were actually downloaded will have a value of `True` as the `downloaded` attribute
+- `--dump-json` will write new entries in real time instead of writing everything at the end of the run
+
+### Fixed
+
+- DDoS-Guard errors even when using cookies because CDL was using an old domain (Coomer, Kemono)
+- `ffprobe` version is always being logged as `None` if not available on path, even though it comes built-in with CDL
+- Catch and log any warnings while parsing dates
+- Albums downloads (pixhost)
+- Download of videos that are not part of a playlist (spankbang)
+- Jdownloader connection
+- CDL always timing out when downloading any file that takes longer than 5 minutes
+
+## [7.3.0] - 2025-07-21
+
+### Added
+
+- JPG6 support
+- File support (yandex.disk)
+
+### Changed
+
+- Make chevereto a generic crawler. See: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/global-settings/generic_crawlers_instances>
+- Make RealDebrid calls asynchronously
+
+### Fixed
+
+- Title creation on some edge cases (twpornstars)
+- `NotImplemented` error when CDL tries to use `ffmpeg` on Windows machines
+- Handle unicode escaped URLs (Bunkr)
+
+## [7.2.1] - 2025-07-18
+
+### Changed
+
+- Add back crawler name when logging posts stats (Xenforo)
+
+### Fixed
+
+- Messages being logged twice
+- Tag pagination (camwhores)
+- `Generator didn't yield` error when CDL finds an invalid URL
+
+## [7.2.0] - 2025-07-17
+
+### Added
+
+- Everia.club support
+- Mega.nz support
+- Handle direct links URLs (redgifs)
+- New `file_date` field for sorting options
+
+### Changed
+
+- Use canonical URL to skip duplicates faster (redgifs)
+- Try to resolve confirmation links without a request (xenforo)
+- Download m3u8 playlist without codec information
+
+### Fixed
+
+- Laggy playback and frozen start on hls downloads
+- Downloads from password protected albums (jpg5, imagepond)
+- Multiple nested attachments folders being created (forums)
+- `file_date_iso` and `file_date_us` not being parsed as valid format fields for sorting
+- Mangled fields names in errors messages from formatting options
+- Missav HLS downloads
+
+## [7.1.0] - 2025-07-14
+
+### Added
+
+- Hotleak.vip support
+- Leakedzone.com support
+- Support for galleries with multiple pages (imagebam)
+
+### Changed
+
+- CDL will automatically disable crawlers that have 10 `DDoS-Guard` errors in the current run. All URLs mapping to that crawler will be ignored.
+- URLs from forums will be processed as completely new items with their own subfolder (same behavior as v6)
+- Fallback to HLS for newer videos that do not have MP4 formats available (PornHub)
+
+### Fixed
+
+- Fallback to the old threaded DNS resolver if the async resolver does not work on the current platform (e.g: Android)
+- Do not download videos downloaded before (beeg.com)
+- Handle attachments without name (kemono)
+- Handle old and new URL formats (imagebam)
+- Private videos not being logged as private (tokyomotion)
+- Handling host with "www." prefix (redgifs)
+- Parsing HQ resolution (thisvid)
+
+## [7.0.1] - 2025-07-04
+
+### Changed
+
+- Do not try to download thumbnails (redgifs)
+
+### Fixed
+
+- Handle new player script format and HLS videos (ashemaletube)
+- Custom filename creation (4chan)
+- Usernames not being fetch at startup (coomer)
+- Handle file URLs with unknown filenames (dropbox)
+
+## [7.0.0] - 2025-07-02
+
+### Added
+
+- Camwhores.tv support
+- Flugel-anime support
+- Missav support
+- Beeg.com support
+- efukt support
+- Vipergirls support
+- Initial HLS support (requires ffmpeg)
+- Support for any WordPress media site. See: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/global-settings/generic_crawlers_instances>
+- Support for any Discourse site See: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/global-settings/generic_crawlers_instances>
+- Add a config option to disable specific crawlers: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/global-settings/general#disable_crawlers>
+- Add new `ssl_context` config option: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/global-settings/general#ssl_context>
+- Add a config option to map unknown URLs to generic crawlers: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/global-settings/generic_crawlers_instances>
+
+### Changed
+
+- Date parsing errors will be logged as warnings, not errors
+- Use an asynchronous DNS resolver
+- Use native system certificates by default, with fallback to `certifi`. See: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/global-settings/general#ssl_context>
+- Some crawlers have a new logic to create a filename. The name format for newly downloaded files may not match previous versions.
+- Config options that take format strings will be validated at startup
+- URLs will only be processed once, ignoring duplicates, even if they come from different crawlers. ex: If you have a dropbox URL in `URLs.txt` and CDL finds that same URL while crawling a forum, it will silently ignore the URL from the forum.
+- General performance improvements
+- New blocked domains:
+
+> gfycat
+> ko-fi.com
+> paypal.me
+> amazon.com
+> throne.com
+> youtu.be
+> youtube.com
+> linktr.ee
+> beacons.page
+> beacons.ai
+> allmylinks.com
+
+### Deprecated
+
+- Support for 32-bit Python and 32-bit operating systems in general is deprecated. On a future version, the start scripts will explicitly fail when trying to install on 32-bit systems. This deprecation only applies to the start scripts. 32-bit versions can still be installed manually via `pip`, but the user may need to compile any missing wheels.
+
+### Removed
+
+- `no-ui` option
+- `allow_insecure_connections` option
+- Importing cookies from multi browsers is no longer supported. CDL will only try to extract cookies from a single browser. The `browsers` option was renamed `browser`
+
+### Fixed
+
+- `ImportError: cannot import name 'MethodType'` on startup
+- Handle errors while processing confirmation links (Xenforo)
+- Redgifs not being downloaded (Xenforo)
+- Attachments not being downloaded (Xenforo)
+- Posts not being fully scraped if a single link in them failed (Xenforo)
+- Download from user profiles (xHamster)
+- Folder downloads (Cyberfile)
+- Do not crash when using the `Create file hashes` option from the main menu
+- Do not download "related" or "favorites" videos from a profile (PornHub)
+- `KeyError` when using the `--separate-posts` option
+- Using Real Debrid no longer causes CDL to crash
+- Image downloads (HotPic)
+- Do not try to download emojis (twitter_images)
+- Fix albums downloads (saint)
+- Handle all possible response errors (reddit)
+- Do not use reddit's `user-agent` for every site
+- Fix `unclose client session` error at the end of a run
+- Fix parsing of dropbox folders URLS
+- Handle embedded URLS (box.com)
+- [Regression] Fixed free space check when using network drives (windows)
+
+## [6.10.1] - 2025-06-15
+
+### Changed
+
+- CDL will try to parse upload dates from human expressions. ex: "Last friday at 10:55", "3 hours, 50 minutes ago",
+- Scrape errors from the generic crawler will be logged as "Unsupported" instead of "Unknown"
+- Normalize posix paths
+
+### Fixed
+
+- Download individual posts (Kemono, Coomer, Nekohouse)
+- Pagination (Kemono, Coomer, Nekohouse)
+- Handling of redirects (Xenforo)
+- Date parsing (Cyberfile)
+- Remove invalid characters from filenames (Cyberfile)
+- Discord server name (Kemono)
+
+## [6.10.0] - 2025-05-30
+
+### Added
+
+- 4chan support
+- AcidImg support
+- Archivebate support (individual videos only)
+- Box.com support
+- Buzzheavier support
+- Files.vc support
+- Imx.to support
+- Mixdrop support
+- NoodleMagazine support
+- Pkmncards.com support
+- Pornhub support
+- Influencerbitches.com support
+- IncestFlix support
+- Porntrex support
+- Twpornstars.com support
+- Vipr.im support
+- Albums support (ThisVid)
+- Parse upload date of files (rule34xxx)
+- Support for albums and searches (ashemaletube)
+- Add a config option to disable the generic crawler: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/global-settings/general#enable_generic_crawler>
+- Auto switch primary host if the default host is blocked on the current network (bunkr)
+- Download entire discord server (Kemono)
+- Download favorites (Kemono)
+- `jitter` option to wait a random extra number of seconds in between downloads: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/global-settings/rate-limiting-options#jitter>
+
+### Changed
+
+- Coomer/Kemono caching support has been temporarily removed
+- Cookies are only extracted once per browser
+- Prioritize Real-Debrid and Jdownloader over the generic crawler
+- Improve DDosGuard detection
+- Try to set creation time of files in macOS
+- Check DDoS-Guard even on successful pages
+- Try to use original server (kemono, coomer, nekohouse)
+- Improve cloudflare captcha detection
+- General performance improvements
+- CDL will remove symbols and emojis from filenames in Windows and macOS
+
+### Removed
+
+- Support for img.kiwi (site no longer exists)
+
+### Fixed
+
+- Individual file downloads (Google Drive)
+- Filename parsing (BestPrettyGirls)
+- Images downloads (Erome)
+- Use canonical URL to check previously downloaded files (Ashemaletube)
+- Only 1 file being downloaded from chevereto profiles (Imagepond, JPG5.su)
+- Playlists and tags support (Rule34xyz , Rule34vault)
+- `NoExtensionError` even when `--exclude-files-with-no-extension` was `false` (bunkr)
+- Parsing of filenames with `@` in it (bunkr)
+- Do not crash if a mountpoint is not available (Windows BitLocker)
+- Handle videos with unknown resolution (ThisVid)
+- Discord channel download (Kemono)
+- Gif downloads (reddit)
+
+## [6.9.1] - 2025-04-18
+
+### Fixes
+
+- Do not crash if `ffmpeg` is not installed
+
+## [6.9.0] - 2025-04-18
+
+### Added
+
+- aShemaleTube.com support
+- Thisvid.com support
+- ePorner.com profile, photo, and gallery support
+- New `--show-supported-sites` option: <https://script-ware.gitbook.io/cyberdrop-dl/reference/cli-arguments#show-supported-sites>
+
+### Changed
+
+- The `import cookies` menu will only display the browsers supported by the user's OS
+
+### Fixed
+
+- Choosing 'All Supported Websites' in cookie extraction will no longer extract all cookies from the browser
+- Fixed free space check when using network drives (windows)
+- Fixed embed parsing on XenForo
+- Fix titsintops.com crawler
+- Cyberdrop-DL will no longer freeze when trying to open terminal text editors
+- `TypeError: Incoming markup is of an invalid type` error
+- `CachedResponse' object has no attribute 'status_code` error
+- `404` responses when downloading albums (bunkr)
+- Save canonical URL to database to prevent downloading the same file twice (tiktok)
+
+### Deprecated
+
+- Importing cookies from multiple browsers at the same time is deprecated and will be removed in a future version
+
+## [6.8.0] - 2025-04-07
+
+### Added
+
+- Support share links from accounts using a SharePoint backend (OneDrive)
+- nHentai support
+- Doodstream (AKA Vidply) support
+- BestPrettyGirl.com support
+- Catbox and Litterbox support
+- Send.now support
+- PMVHaven.com support
+- Motherless support
+- xHamster support
+- Auto detect orientation
+- `generic crawler` to scrape pages from sites that are not supported. This replaces the basic `no crawler` logic
+- Save scraped pages as html with the new `--save-pages-html` option: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/settings/files#save_pages_html>
+
+### Changed
+
+- Flaresolverr is no longer required for Spankbang
+- Reduce rate limits (JPG5)
+- Config is revalidated after the user edits it from the UI
+- Warn about expired cookie files
+- Use server's `Last-Modified` header value as the file datetime if CDL could not parse a date while scraping.
+- Try to download images from any URL (twing)
+- CDL will start by default in portrait mode when running inside termux. You can override it by using `--no-portrait`
+
+### Fixed
+
+- Handle deleted videos (SpankBang)
+- `JsonDecodeError` in some videos (SpankBang)
+- Slow downloads from burger servers (Bunkr)
+- Handle single file share links (YandexDisk)
+- URL parsing (`tuple index out of range` #1) (Sex.com)
+- Handle invalid URLs (`tuple index out of range` #2) (Google Drive)
+- Handle paths with special characters (stats hyperlinks)
+- Do not crash if pages have no title (DDoS Guard check)
+- Fixed tags and category downloads (DirtyShip)
+- `Invalid Content Type` from some URLs (Bunkr)
+- jsonl timestamp serializer (`'str' object cannot be interpreted as an integer`)
+- Download profiles with more than 1k posts (RedGifs)
+- Reduce the number of requests needed (jpg5, img.kiwi, imagepond)
+- CDL filling up storage if multiple concurrent downloads where larger that `required_free_space`
+- Handle confirmation links as input URL (forums)
+- General performance improvements
+
+## [6.7.0] - 2025-03-10
+
+### Added
+
+- Show activity messages at the bottom of the UI (waiting on Flaresolverr connections, reading input file, etc..)
+- WeTransfer support
+- Google Drive support
+- DirtyShip support
+- OneDrive support
+- Yandex Disk support (files and folders, but no support for nested folders)
+- Dropbox support (files and folders, but folders are disabled by default because they will be downloaded as a single zip file. Enable them with `--download-dropbox-folders-as-zip`)
+- FileDitch support
+- Sex.com support (shorts and images from profiles only)
+- Option to import cookies from all supported websites in the main UI
+- Get information about all the downloaded files with the new `--dump-json` option: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/settings/files#dump_json>
+- Run CDL with a portrait layout using the `--portrait` option: <https://script-ware.gitbook.io/cyberdrop-dl/reference/cli-arguments#portrait>
+- Disable requests caching (reading and writing) with the `--disable-cache` option: <https://script-ware.gitbook.io/cyberdrop-dl/reference/cli-arguments#disable-cache>
+
+### Changed
+
+- Speed up checking for empty files & folders by up to 2x
+- Speed up sorting files by up to 1.5x
+- Remove browsers that aren't supported by the user's OS from the list of available browsers
+- Flaresolverr timeout will be the same as the config timeout
+- Input URLs will be processed lazily instead of waiting for all of them to be parsed
+
+### Fixed
+
+- Get URL from encrypted link (new logic)(jpg5)
+- 400/403/404 on some files (bunkr)
+- Add error handle at post level and individual item level (forums)
+- Fixed an error when trying to select done after choosing to import cookies
+- Flaresolverr integration
+- Long UI messages for unknown errors
+
+### Removed
+
+- Deprecated forums authentication settings (username, password and `xf_cookie`). Use cookie files for forums that require login
+
+## [6.6.1] - 2025-02-28
+
+### Fixed
+
+- Parse videos with no date (YouJizz)
+- Detect and ignore invalid responses from forums
+- `File is being used by another process` error when running multiple configs
+- Handle or ignore any errors when checking for updates
+- [regression] Do not remove trailing slash from URLs (jpg5, img.kiwi, imagepond.net)
+- Messages being logged to the console with `--ui` values other than `disabled`
+- Lines in the main log file being cutoff if they were longer than `log_line_width`
+- Handle permission errors while creating logs files
+- TikTok crawler returning 403 on all downloads
+- Use new API to download files (bunkr)
+- Download encrypted URLs (jpg5)
+- Do not overwrite user provided regex (`--filename-regex-filter`)
+
+### Changed
+
+- Log downloads with no content type as `InvalidContentType` instead of `418 IM_A_TEAPOT`
+- Only make 1 request at a time to Flaresolverr
+- Show log folder in stats
+- Show `--links (CLI args)` as input (if they were used)
+- Paths printed to the stats will have hyperlinks to their location (when supported by the terminal)
+
+## [6.6.0] - 2025-02-24
+
+### Added
+
+- Skip download of video and audio files by duration: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/settings/media_duration_limits>
+- Show simplified progress bar with new `--ui simple` option: <https://script-ware.gitbook.io/cyberdrop-dl/reference/cli-arguments#ui>
+- e621.net support (pools, posts, and tags)
+- Streamable.com support
+- Youjizz.com support
+- ePorner.com support
+- SpankBang.com support
+- Rule34video.com support
+- CDL will try to download files from unsupported forums
+- Support for direct URLs as input (hotpic)
+- Support for 2385290.xyz as an alternative domain (hotpic)
+- Support for videos (hotpic)
+
+### Changed
+
+- Log invalid URL paths as scrape errors
+- Increase verbosity of some processes
+- Re-enable sorting option on the main UI
+- Show queued files in progress stats
+- Vacuum requests database after cleaning old request entries
+- Remove double spaces from created folders
+- Show input file path, input URLs count and input URLs group count in stats
+- Unsupported sites in `browser_cookies.sites` will be ignored instead of raising an error
+- Download errors now have the referer information. The CSV file will also have a referer column
+- Log files will no longer be padded with white space to the right
+- Better error messages for invalid configs
+- `--filename-regex-filter` will be validated at startup instead of being silently disabled (if invalid)
+- Use canonical URL for database (hotpic)
+
+### Fixed
+
+- Forum attachments extension parsing (xenforo)
+- Download full resolution images instead of thumbnails (celebforum, pixhost, hotpic)
+- Handling of URLs with "%" (U+0025) in it (bunkr)
+- Pagination of chevereto profiles and albums (jpg5, img.kiwi and imagepond.net)
+- Duplicated entries in database for previously unsupported domains
+- `403 Forbidden` errors from some downloads (bunkr)
+- Handling of deleted videos (saint.to)
+- Handling of deleted files (cyberfile, iceyfile)
+- Loose files detection (gofile)
+- Filename not being sanitized in some cases (bunkr)
+- Handling of malformed responses from flaresolverr
+- URL serialization error (`yarl.URL` json) when passing links via CLI
+- LeakedModels crawler
+- Handle deleted files (mediafire)
+- Handle URLs with another URL as filename (kemono, coomer, nekohouse)
+- Handle invalid URLs and log them instead of crashing
+- Incorrect URL being logged in errors (reddit)
+- Handle redirect URLs (reddit)
+- Empty download_filename in database
+- Handling of streaming URLs (bunkr)
+
+### Deprecated
+
+- `--no-ui` is deprecated and will be removed in a future version. Use `--ui disabled`
+
+### Removed
+
+- v4 support (config option names and UI file import options)
+
+## [6.5.0] - 2025-02-14
+
+### Added
+
+- Iceyfile.com support
+- Support cookie extraction from Arc Browser, Lynx and W3M
+- `--exclude-files-with-no-extension` option: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/settings/ignore_options#exclude_files_with_no_extension>
+- `--print-stats` CLI only option
+- Scrape nested threads with `--maximum-thread-depth`: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/settings/download_options#maximum-thread-depth>
+
+### Removed
+
+- Cookie extraction support from Chrome and Chromium based browsers on Windows
+
+### Changed
+
+- Improve database insertion performance
+- Improve shutdown process
+
+### Fixed
+
+- Automatic v4 to v6 transition
+- Reset hash progress on multiple directory scans
+- Delete old database entries of previously unsupported URLs
+- Nudostar.tv crawler
+- In-memory cache and first time startup cache not being in sync
+
+## [6.4.0] - 2025-01-31
+
+### Added
+
+- Add support for TikTok profiles, videos, and photos
+- Add new CLI argument `--download-tiktok-audios` to download audio files from TikTok posts
+- Add support for <https://www.imagebam.com>
+- Add support for <https://comics.8muses.com>
+- Pornpics.com support
+- Twitter images (twimg) support
+- Members.luscious.net search support
+- Skip slow downloads with `--slow-download-speed`: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/settings/runtime_options#slow_download_speed>
+- Support for forums redirect URLs (`/goto/...`, `/posts/...`)
+
+### Changed
+
+- Files in the download queue are saved to the database and can be retried with `--retry-failed`
+- CLI `--skip-hosts` and `--only-hosts` values will be added to / removed from config values when passing `+` or `-` as the first argument, respectively. See: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/special_setting_types#additiveargs>
+- CLI arguments that accept multiple values can now be used multiple times in the same command
+- Forum posts are now processed asynchronously instead of sequentially
+- Prettify failures messages
+- Stats format
+
+### Removed
+
+- Support for ImageBan (website no longer exists)
+
+### Fixed
+
+- ImgBB crawler
+- Download path structure (Tokyomotion)
+- Empty `download_filename` on database
+- Missing thread id on `Last_Scraped_Forum_Post.csv` URLs
+- Nudostar Crawler
+- Invalid URL parsing (imgur)
+- Invalid link confirmation URL parsing (forums)
+
+## [6.3.0] - 2025-01-23
+
+### Added
+
+- Members.luscious.net support
+- Coomer and Kemono search results support
+- SendVid.com support
+- Support for forum direct link URLs (attachments) as input URLs
+- `--logs-expire-after` option: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/settings/logs#logs_expire_after>
+- `--filename-regex-filter` option: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/settings/ignore_options#filename_regex_filter>
+
+### Changed
+
+- `--rotate-logs` now creates a subfolder by date
+
+### Fixed
+
+- Bunkr reinforced link handling
+- Handle encoded URLS found while scraping (every crawler)
+- Imgur crawler
+- MediaFire Crawler
+- JPG5 rate limit
+
+### Deprecated
+
+- Forums authentication settings (username, password and `xf_cookie`) will be removed in a future version
+
+## [6.2.0] - 2025-01-10
+
+### Added
+
+- PixHost.to support
+- Forum.AllPornComix.com support (forum)
+- Bellazon.com support (forum)
+- TitsInTops.com support (forum)
+- Video support for chevereto sites (`imagepond.net`, `img.kiwi` and `jpg5.su`)
+- Filesystem URLs support for images and videos (pixeldrain)
+- Indirect links support (saint)
+
+### Changed
+
+- Better MediaFire errors handling
+- Better RealDebrid errors handling
+- Do not overload 403 and 404 errors
+- Use canonical URLs for files in database (chevereto)
+
+### Fixed
+
+- Files being hashed twice when using `Hashing.IN_PLACE`
+- Post information parsing (reddit)
+- Sub-path parsing, ex: submitted, comments (reddit)
+- "Loose Files" folder not being created (all crawlers)
+- Delete startup log file if empty
+- Make a single GoFile token acquisition request
+- Make a single login request try per forum
+- DDoS-Guard detection
+
+## [6.1.1] - 2025-01-05
+
+### Changed
+
+- Remove crawlers scrape lock
+
+### Fixed
+
+- v5 to v6 transfer [database] (`hash` table missing on second startup)
+- v4 to v6 transfer [logs] ('downloader.log' being used by another process)
+
+## [6.1.0] - 2025-01-04
+
+### Fixed
+
+- Fallback to old file password check (cyberfile)
+- Handle stream redirects (bunkr)
+- Files being saved with the current date instead of the upload date
+- Sanitize filenames before downloading
+- Apprise notifications integration
+- Log startup errors to a file (validation, YAML, database and unknown errors)
+- Miscalculation of download and scrape queue length
+- Sorting videos with invalid or missing fps metadata
+- e-Hentai crawler
+
+### Changed
+
+- Set 512MB as the minimum required free space
+- `--console-log-level` will have no effect unless `--no-ui` was used
+- OS notification are enabled by default on Windows
+
+### Deprecated
+
+- `--output-folder` is deprecated. Use `--download-folder`
+- v4 support (importing v4 config and files) will be removed in a future version
+
+### Added
+
+- `--deep-scrape` option: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/settings/runtime_options#deep_scrape>
+- `--separate-posts-format` option: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/settings/download_options#separate_posts_format>
+- Allow any file name for cookie files
+- Redact username from log tracebacks
+
+## [6.0.1] - 2024-12-24
+
+### Fixed
+
+- Database v5 to v6 transfer
+
+## [6.0.0] - 2024-12-23
+
+⚠️**BREAKING CHANGES**
+
+1. Stricter config validation logic. CDL will verify that every config value and CLI argument is valid before running
+
+2. All dedupe and hashing functions has been replaced.
+ - `xxh128` is now the default hashing algorithm, replacing `md5`
+ - By default, all v5 hashes will be ignored for deduplication matches. You can re-enable md5 with `--add-md5-hash`
+ - It's no longer possible to keep the newest file while deduplicating.
+ - Every file previously downloaded is taken into account for deduplication. Files no longer need to currently exists on disk
+
+3. Removed `--sort-cdl-only` option
+
+4. The following arguments are deprecated and will be removed in a future version:
+ - `--output-folder`
+ - `--download-all-configs`
+ - `--sort-all-configs`
+ - `--sort-all-downloads`
+ - `--main-log-filename`
+ - `--last-forum-post-filename`
+ - `--unsupported-urls-filename`
+ - `--download-error-urls-filename`
+ - `--scrape-error-urls-filename`
+
+This update introduces the following changes:
+
+- Add Python 3.13 support
+- Add requests caching to speed up future download sessions for forums, Coomer, and Kemono.
+- Update Kemono & Coomer crawlers to use API calls
+- Update GoFile crawler to the new site design
+- Update Bunkr crawler to handle new UUID filename format
+- Rework entire deduplication and hashing logic. Now multiple hashing algorithms are supported
+- Use Pydantic for config and CLI values validation
+- Allow downloading duplicate files on the same run with `--ignore-history`
+- Fix sorting functionality
+- Allow running all configs sequentially using `--config ALL`
+- Better cookies management system
+- Added option to clear cookies for selected websites
+- General improvements and bug fixes
+
+## [5.7.2] - 2024-11-20
+
+This update introduces the following changes:
+
+1. Add option to use cookies from any supported site
+2. Apply cookies from flaresolverr when possible, even if the response is invalid
+3. Add option to automatically import cookies at startup
+4. Better validation of config values
+5. Rework entire TUI user input options
+6. General logging improvements and bug fixes
+
+### Details
+
+- User can import cookies from their browser. CDL will use these cookies to login to websites and pass Cloudflare DDoS challenges. For more information on cookies extraction and configuration, visit: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/settings/browser_cookies>
+- When using flaresolverr, CDL will try to apply the cookies from the response and make a new request if necessary.
+- User can set CDL to automatically import cookies at startup. User must specify browser and domains to export cookies from
+- Add logic validation for config path values
+- Remove integrated config edit options. Modifications to the config must be done directly on the config file.
+
+## [5.7.1] - 2024-11-05
+
+⚠️**BREAKING CHANGES**
+
+> All output files (except for the main log file) are now CSV files with headers for each column (`Scrape_Errors`, `Download_Errors`, `Unsupported_URLs` and `Last_Forum_Post`). A custom filename for each file can still be set via config, but the extensions will always be `.csv`
+
+This update introduces the following changes:
+
+1. Adds the option to limit how many items are scraped
+2. Add support for scraping a users' coomer favorites
+3. Add integration to handle downloads supported by <https://real-debrid.com>
+4. Add support for <https://nekohouse.su> profiles and posts
+5. Add support for <https://imagepond.net> URLs
+6. Add support for password protected albums from Chevereto sites (`jpg5`, `Img.kiwi` and `Imagepond`)
+7. Show `total runtime` and `total downloaded data` on final report
+8. Add support to send the main log file as an attachment to the `webhook_url` report
+9. Add support to sent CDL report via email, telegram and many other services via Apprise
+10. Add support for `%` encoded URLs in the input file
+11. General logging improvements and bug fixes
+
+### Details
+
+- Users can limit the number of items to scrape by type, using the `--maximum-number-of-children` parameter. For more details on how to use this feature, visit the wiki: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/settings/download_options>
+- Add support for scraping a users' coomer favorites by allowing the user to pass the coomer favorites page URL as an input URL (<https://coomer.su/favorites>). This requires them to have their coomer session token in the `authentication.yaml` file.
+- Add real-debrid integration to download from any site that they support (`mega.nz`,`rapidgator`, `google drive`, `k2s`, etc). User needs to provide their API key in the `authentication.yaml` file in order to allow downloads
+- Nekohouse URLs can now be scraped and downloaded by CDL
+- Users can now get the stats report of the run via multiple services and include the main log as an attachment. For more information on how to setup notifications, visit: <https://script-ware.gitbook.io/cyberdrop-dl/reference/notifications>
+- Fix parsing of bunkr file extensions when `--remove-generated-id` is enabled
+- Remove console markdown data from log files
+- Fix `only_hosts` skip logic
+- Better handling of some unknown errors
+
+## [5.7.0] - 2024-10-25
+
+This update introduces the following changes:
+
+1. Rotating log files
+2. Overhaul hashing functions
+3. Add support for <https://tokyomotion.net> URLs
+4. Add support for <https://xxxbunker.com> URLs
+5. Add support for <https://saint2.su> albums
+6. Add support for password protected Cyberfile URLs
+7. Simplify some UI elements
+8. Improve jdownloader integration
+9. Implement rich logger
+10. Add a "Check for Updates" UI option
+11. General bug fixes
+
+### Details
+
+- Add option to rotate log file names. If enabled, current `date-time` will be used as a suffix for each log file, in the format `YYMMDD_HHMMSS`. This will prevent overriding old log files
+- Refactor hashing functions and logic
+- Add support for videos, photos, albums, playlist, profiles and search results of tokyomotion.net
+- Add support for playlists, search results and video downloads on xxxbunker.com
+- Add support for saint2.su album URLs
+- Add support for both password protected files and folders on Cyberfile. Users can include the password as a query parameter in the input URL, adding `?password=<URL_PASSWORD>` to it. Example: `https://cyberfile.me/folder/xUGg?password=1234`
+- Replace built-in log file handler with rich handler for better error reports
+- UI changes: remove redundant 'X of Y files' from every progress bar, sort scrape and download error by reverse frequency, use equal height for top row UI, fix padding issues, show unsupported URLs stats at the end
+- Add `whitelist` filter, `autostart` and custom `download_dir` options for jdownloader. For more details, visit the wiki: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/settings/runtime_options>
+- Added a "Check for Updates" UI option and improved the update check logic to check for new testing versions.
+- Fix error during program exit when referrer table no longer exists
+- Prevents crashes when there are insufficient permissions to move a file
+- Fix an issue where CDL would delete URLs input file
+- Move functions for after download to `post_runtime`
+- Fix handling of deleted Imgbox albums if they return `HTTP 200`
+- Fix Cyberfile deleted folders not being correctly scraped
+- Update logging to include when a file is being downloaded with no crawler
+
+## [5.6.54] - 2024-10-21
+
+This update introduces the following changes:
+
+1. Fix error on some bunkr videos
+
+### Details
+
+- Fix error when downloading videos with no thumbnail (bunkr)
+- Update possible CDNs (bunkr)
+- Better error handling (bunkr)
+
+## [5.6.53] - 2024-10-20
+
+This update introduces the following changes:
+
+1. Update bunkr crawler
+
+### Details
+
+- Update bunkr crawler to work on the new site design
+
+## [5.6.52] - 2024-10-10
+
+This update introduces the following changes:
+
+1. Fix scan_folder saved as invalid value
+
+### Details
+
+- Fixes issue that causes the config file to be corrupted with an invalid scan_folder value.
+
+## [5.6.51] - 2024-10-10
+
+This update introduces the following changes:
+
+1. Skip file download by referer
+2. Fixes album_id not been saved to database
+
+### Details
+
+- Using the flag `--skip-referer-seen-before` will skip downloading files from any referer that have been scraped before. The file (s) will always be skipped regardless of whether the referer was successfully scraped or not
+- Fixes album_id property not being saved to database on supported crawlers
+
+## [5.6.50] - 2024-10-07
+
+This update introduces the following changes:
+
+1. Support for password protected GoFile links
+
+### Details
+
+1. Users can include the password as a query parameter in the input URL, adding `?password=<URL_PASSWORD>` to it.
+ Example: <https://gofile.io/d/xUprGg?password=1234>
+
+## [5.6.43] - 2024-10-03
+
+This update introduces the following changes:
+
+1. Update True/False CLI arguments to integrate better with the config file.
+
+### Details
+
+- CLI arguments that toggle settings to `True` or `False` can now be passed as either `--arg` or `--no-arg` to set the value to `True` or `False` respectively.
+- This also solves an issue where CLI arguments that toggle settings would override config file settings even if the CLI argument was never passed.
+
+## [5.6.42] - 2024-10-03
+
+This update introduces the following changes:
+
+1. Filter final URL with `--skip-hosts` and `--only-hosts` arguments
+
+### Details
+
+- This allows the user to skip or only download from specific bunkr hosts
+
+## [5.6.41] - 2024-10-01
+
+This update introduces the following changes:
+
+1. Fixes crash when unsupported URLs have no parents
+2. Display new changelog if an update is available
+3. Updated supported sites in Wiki
+
+### Details
+
+- Fixes crash if an unsupported url have no parents
+- Always display an updated changelog if a new version has been released on pypi
+- Remove SimpCity from supported websites on Wiki
+
+## [5.6.40] - 2024-10-01
+
+This update introduces the following changes:
+
+1. Fixes empty folder cleanup
+
+### Details
+
+- Fix incorrect path objects on post-runtime folder cleanup
+
+## [5.6.39] - 2024-09-30
+
+This update introduces the following changes:
+
+1. Add external CHANGELOG file
+
+### Details
+
+- Project changes will documented on <https://github.com/Cyberdrop-DL/cyberdrop-dl/blob/main/CHANGELOG.md> for better tracking
+- Built-in viewer will fetch CHANGELOG history on first use
+
+## [5.6.38] - 2024-09-30
+
+This update introduces the following changes:
+
+1. Fix `scrape_items` creation for Kemono and coomer links
+
+### Details
+
+- Fixes parents tracking for Kemono and coomer links
+
+## [5.6.37] - 2024-09-30
+
+This update introduces the following changes:
+
+1. Fixes empty folder cleanup on python 3.11
+
+### Details
+
+- Fixes logic by walking the directory tree using `os.walk` to remain compatibility with python 3.11
+
+## [5.6.36] - 2024-09-30
+
+This update introduces the following changes:
+
+1. Delete empty files after a successful run.
+2. Added a feature to save the origin of unsupported URLs
+
+### Details
+
+- Empty files (0 bytes) inside download_dir will be deleted alongside empty folders after a successful run
+- Each unsupported URL will now be saved alongside the URL of the original item they came from (`Unsupported_URLs.txt`)
+- Origin is also saved for password protected links, allowing the user to visit the URL (ex. forum post) and retrieve the password if available
+
+## [5.6.35] - 2024-09-30
+
+This update introduces the following changes:
+
+1. Small fixes for sorting system
+
+### Details
+
+- Fixes `scan_dir` selection logic
+
+## [5.6.34] - 2024-09-30
+
+This update introduces the following changes:
+
+1. Added a feature to fix the names of multipart archives.
+
+### Details
+
+- Multipart archives will be renamed to have the proper naming format when the `--remove-generated-id-from-filenames` argument is passed.
+
+## [5.6.33] - 2024-09-25
+
+This update introduces the following changes:
+
+1. Fix issues with checking how much free space is available on the disk.
+2. Skip clearing the console when running with the `--no-ui` flag.
+
+### Details
+
+- Fixed an issue with free space not being properly checked when running with the `--retry-failed` flag.
+- Made error output more clear when there is not enough free space to download a file.
+- Skip clearing the console when running with the `--no-ui` flag to allow users to see the output of all runs done with `--no-ui`.
+
+## [5.6.32] - 2024-09-22
+
+This update introduces the following changes:
+
+1. Add new URLs categorization feature for the URLs.txt file.
+
+### Details
+
+- You can now group links under one download folder by adding a category name above the links in the `URLs.txt` file.
+- The category name must be prefixed by three dashes (`---`) and must be on a new line.
+- The category name will be used as the folder name for the links that follow it.
+- To end a category, add three dashes (`---`) on a new line after the links.
+- You can have multiple categories in the URLs.txt file, and the links will be grouped accordingly.
+
+For more details, visit the wiki: <https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/settings/sorting>
+
+## [5.6.30] - 2024-09-21
+
+**SIMPCITY HAS BEEN REMOVED FROM THE SUPPORTED WEBSITES LIST.**
+
+**TO SEE WHY, VISIT THE WIKI:** <https://script-ware.gitbook.io/cyberdrop-dl/simpcity-support-dropped>
+
+## [5.6.20] - 2024-09-19
+
+This update introduces the following changes:
+
+1. Ability to scrape URLs from PixelDrain text post
+
+### Details
+
+- Cyberdrop-DL will now scrape URLs from PixelDrain text posts and make a folder for all the URLs within the post, reducing clutter.
+
+## [5.6.13] - 2024-09-19
+
+This update introduces the following changes:
+
+1. Per-config authentication settings
+
+### Details
+
+- If an `authentication.yaml` file is placed within your config directory, it will be used instead of the global authentication values.
+
+## [5.6.12] - 2024-09-19
+
+This update introduces the following changes:
+
+1. Reformat code and organize imports
+
+### Details
+
+- Reformatted code to be more readable and removed unused imports.
+
+## [5.6.11] - 2024-09-16
+
+This update introduces the following changes:
+
+1. Detect and raise an error for private GoFile folders
+
+### Details
+
+- Private GoFile folders will now raise an error when attempting to download them instead of crashing CDL
+
+## [5.6.1] - 2024-09-13
+
+This update introduces the following changes:
+
+1. Fixes issue with `--sort-all-downloads`
+2. Improves sort status visibility
+
+### Details
+
+- The sort status is now display under hash, along with other statuses
+- `--sort-all-downloads` is disabled by default, thus only cdl downloads are sorted without the flag
+- `sort_folder` can not be the same as the `scan_dir`
+
+## [5.6.0] - 2024-09-13
+
+This update introduces the following changes:
+
+1. Updated the sorting progress UI to display more information.
+2. Removed unused functions from progress bars.
+
+### Details
+
+- The sorting UI now displays the progress of each folder as it is being processed, including the number of files that have been sorted and the percentage of the folder that has been processed.
+- The sorting UI now also shows what folders are in the queue to be sorted.
+
+## [5.5.1] - 2024-09-12
+
+This update introduces the following changes:
+
+1. Small fixes for sorting system
+
+### Details
+
+- use `-` instead of `_` for new arguments
+- fix bug where `purge_dir` is called for each file, instead of each directory when done
+
+## [5.5.0] - 2024-09-12
+
+This update introduces the following changes:
+
+1. Finalizes new sorting feature
+2. add scanning directory for sorting
+3. adds progress bar for sorting
+
+### Details
+
+- skips need to scan database if `sort_cdl_only` is false
+- progress bar for current progress of sorting files, incremented for each folder
+- allow for setting a different folder to scan that is independent of the download folder