ZSTD Support for Streaming Compression (#3798)
Built on top #3531, #4075, #3853 Zstd is great for compression ratio and would be useful for both replication compression and rdb compression. The save time worse as compared to LZ4 because it tries to compress much harder. The load time is faster because since it compressed harder, it has much lesser data to load from the disk. Zstd is specially useful for replication compression across regions where network costs are quite significant as compared to compute. We want to save as much data as possible while transferring data over the regions. <img width="3134" height="1034" alt="zstd157_v4_on" src="https://github.com/user-attachments/assets/1ebb21f7-dc98-4c22-9d71-120a14f30391" /> <img width="3134" height="1034" alt="zstd157_v4_off" src="https://github.com/user-attachments/assets/6aa6e20d-1c8b-45ff-b7f4-657ed3e55d5f" /> <img width="2235" height="741" alt="zstd157_blockmesh_bars" src="https://github.com/user-attachments/assets/f96458be-b5e2-4ecd-baea-7aae506a6971" /> --------- Signed-off-by: Sarthak Aggarwal <sarthagg@amazon.com>
S
Sarthak Aggarwal committed
f2bcd083dc5efb83a3aff1d155261c031440b448
Parent: 27c68f1
Committed by GitHub <noreply@github.com>
on 9/22/2026, 3:08:32 AM