SeaweedFS is a distributed storage system for object storage (S3), file systems, Iceberg table buckets, and Lance vector buckets, designed to handle billions of files with O(1) disk access and effortless horizontal scaling.
Go blob-storagecloud-drivedistributed-file-systemdistributed-storageerasure-codingfusehadoop-hdfshdfskuberneteslancelancedbobject-storageposixs3s3-storageseaweedfstiered-file-systemvector-search
Commits on master
test: EC lifecycle chaos harness, with four fixes it found (#10763)
602746f Chris Lu committed 3 months ago
refactor: extract EC orchestration into a shared weed/ec package (#10760)
944d967 Chris Lu committed 3 months ago
s3: option to disable bucket auto-creation on upload (#10759)
f66d6ff Chris Lu committed 3 months ago
skiplist: fix TestFindGreaterOrEqual flake (compare against largest key, not value) (#10757)
c2ea452 Chris Lu committed 3 months ago
volume: validate replica targets and restrict gcs credentials in FetchAndWriteNeedle (#10755)
d713ab4 Chris Lu committed 3 months ago
volume: extend the remote-endpoint guard to the azure backend (#10754)
9125b9c Chris Lu committed 3 months ago
EC: handle zero-sized shard files uniformly (moves, rebuilds, startup cleanup) (#10753)
94f8e2c Chris Lu committed 3 months ago
feat(shell): parallelize volume balance moves (#10737)
9386a25 Konstantin Lebedev committed 3 months ago
redis2: orphan cleanup existence checks must not read replicas (#10745)
0481f71 Chris Lu committed 3 months ago
rust volume: mirror the VolumeConsolidateIndex RPC from Go (#10752)
ae2cc82 Chris Lu committed 3 months ago
log_buffer: end bounded reads that find the buffer empty (#10750)
7f27c57 Chris Lu committed 3 months ago
feat: throughput limits for replicate, EC shard, and worker-driven moves (#10749)
4f50c5b Chris Lu committed 3 months ago
redis2: expire entries without destroying a concurrent recreate (#10744)
7d0fff3 Chris Lu committed 3 months ago
rust volume: mirror Go volume server logic to gate the admin RPCs (#10748)
c0f33d5 Chris Lu committed 3 months ago
iceberg: accept lowercase parquet file format when planning compaction (#10751)
4500bdf Chris Lu committed 3 months ago
grpc: optional client_cert/client_key for outgoing mTLS connections (#10747)
76d3fd0 Chris Lu committed 3 months ago
redis: remove orphaned directory index members on listing (#10742)
4fb5d15 Chris Lu committed 3 months ago
fix(redis2): remove orphaned directory index members on listing (#10735)
f7ae2d4 Peter Dodd committed 3 months ago
erasure_coding: share the EC shard teardown primitive (#10740)
8714f42 Chris Lu committed 3 months ago
EC worker: clear stale/interrupted shards at task start and on failure (#10738)
6408f32 Chris Lu committed 3 months ago
shell: roll back a failed ec.encode instead of leaving readonly volumes and orphan shards (#10741)
fa48ce2 Chris Lu committed 3 months ago
read cold remote objects straight from the origin while caching (#10731)
db5a086 Chris Lu committed 3 months ago
test: assert EC shard identity and empty-view in multi-disk lifecycle tests (#10723)
a0347ca Chris Lu committed 3 months ago
plugin scheduler: drain started jobs past the window close instead of killing them (#10728)
78e7e04 Chris Lu committed 3 months ago
refactor: share volume and EC shard move logic between shell and workers (#10727)
0799084 Chris Lu committed 3 months ago
test: drive ec.encode/balance/rebuild E2E with a byte-identical payload check (#10722)
2a513e7 Chris Lu committed 3 months ago