SIGN IN SIGN UP

ZSTD Support for Streaming Compression (#3798)

Built on top #3531, #4075, #3853

Zstd is great for compression ratio and would be useful for both
replication compression and rdb compression. The save time worse as
compared to LZ4 because it tries to compress much harder. The load time
is faster because since it compressed harder, it has much lesser data to
load from the disk.

Zstd is specially useful for replication compression across regions
where network costs are quite significant as compared to compute. We
want to save as much data as possible while transferring data over the
regions.

<img width="3134" height="1034" alt="zstd157_v4_on"
src="https://github.com/user-attachments/assets/1ebb21f7-dc98-4c22-9d71-120a14f30391"
/>

<img width="3134" height="1034" alt="zstd157_v4_off"
src="https://github.com/user-attachments/assets/6aa6e20d-1c8b-45ff-b7f4-657ed3e55d5f"
/>

<img width="2235" height="741" alt="zstd157_blockmesh_bars"
src="https://github.com/user-attachments/assets/f96458be-b5e2-4ecd-baea-7aae506a6971"
/>

---------

Signed-off-by: Sarthak Aggarwal <sarthagg@amazon.com>
S
Sarthak Aggarwal committed
f2bcd083dc5efb83a3aff1d155261c031440b448
Parent: 27c68f1
Committed by GitHub <noreply@github.com> on 9/22/2026, 3:08:32 AM