Skip to content

[client] Add support of column value compression - #4183

Draft
zuston wants to merge 1 commit into
apache:mainfrom
zuston:clientColumnCompression
Draft

[client] Add support of column value compression#4183
zuston wants to merge 1 commit into
apache:mainfrom
zuston:clientColumnCompression

Conversation

@zuston

@zuston zuston commented Sep 1, 2026

Copy link
Copy Markdown
Member

Purpose

Primary-key tables can contain large BYTES columns that are transferred and stored without compression, increasing network bandwidth, storage usage, and write costs, especially for the multi-model columns.

This change adds per-column LZ4 or ZSTD compression on the client side. Each compressed value uses a self-contained envelope containing a magic number, version, codec, original length, and payload. Readers detect and decode it transparently by default, while legacy uncompressed values remain compatible.

Brief change log

Tests

API and Format

Documentation

@zuston
zuston marked this pull request as draft September 1, 2026 10:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant