Skip to content

Commit 587df10

Browse files
committed
Move ChunkId hashing from producer into rayon pool for parallel computation
The producer thread was bottlenecked on sequential BLAKE2b-256 hashing (~1 GB/s/core), limiting throughput while rayon workers sat mostly idle. Now all per-byte CPU work (hash + compress + encrypt) runs in the rayon pool, letting the producer focus on I/O + FastCDC only.
1 parent b083678 commit 587df10

2 files changed

Lines changed: 78 additions & 230 deletions

File tree

0 commit comments

Comments
 (0)