Dropbox shrinks wasted space in Magic Pocket after placement change caused fragmentation spike

The problem

It has been reported that a placement change rolled out last year to reduce write amplification in Magic Pocket — Dropbox’s exabyte-scale immutable blob store — had an unintended side effect: fragmentation rose and storage overhead climbed. At Dropbox scale, “a little” waste quickly becomes a big bill. The company says most of the overhead came from a small number of severely under-filled volumes that were hoarding raw capacity, and their existing compaction strategy couldn’t reclaim space fast enough.

Why it’s tricky

How do you free space when you can’t modify what’s already written? Magic Pocket is immutable: blobs are written once and never altered in place. Deletes mark data as dead but don’t immediately free disk space. Garbage collection identifies unreferenced blobs, but compaction must physically move live blobs into new volumes and retire the old ones. Add erasure coding for durability (less redundancy than full replication, but still distributed fragments), and the math gets tight — especially when millions of deletes and trillions of blobs are involved.

The fix and the payoff

It has been reported that Dropbox deployed a multi‑strategy approach to attack the worst offenders — more focused compaction on under‑filled volumes, smarter donor selection, and tuned background policies to reclaim space faster. The result: overhead fell back down, reportedly even below the previous baseline. In plain terms, they did a targeted spring cleaning at petabyte-plus scale.

Why care? Because behind the dry engineering language is an emotional pivot: efficiency directly cuts costs and carbon, and at exabyte scale those savings matter. It’s a reminder that infrastructure tweaks can ripple into money and sustainability — and that sometimes the path to better performance requires cleaning up the attic.

Sources: dropbox.tech, Hacker News