Skip to content

fsst decompress optimize try 2 #7001

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
joseph-isaacs wants to merge 17 commits into
base: develop
Choose a base branch
from
Draft

fsst decompress optimize try 2 #7001

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
17 commits
Select commit Hold shift + click to select a range
6c8f682
Optimize FSST decompression with packed symbol table and targeted ben…
claude Mar 17, 2026
25daa1b
Improve FSST decompressor: separate arrays, unrolled escape match, fa…
claude Mar 17, 2026
f77835d
Add 32-code block fast path to FSST decompressor for 10-15% speedup
claude Mar 17, 2026
3d7ec81
Add experimental AVX-512 and combined-table FSST decompressor variants
claude Mar 17, 2026
656f87d
Optimize FSST decompressor: re-entering 32-code fast path after escapes
claude Mar 17, 2026
dd9421d
Add FSST decompressor optimization exploration document
claude Mar 17, 2026
4dced35
Improve FSST decompressor: N=1 re-entry + runtime BMI1/BMI2 dispatch
claude Mar 17, 2026
7840d81
Simplify FSST decompressor: keep match, clean up bounds and escape_mask
claude Mar 17, 2026
481fd7f
Add cold() branch hints to FSST decompressor escape paths
claude Mar 17, 2026
6cc9130
Inline view construction in FSST canonicalize path for 26-47% end-to-…
claude Mar 17, 2026
e280ff5
Update optimization doc with inlined build_views results
claude Mar 17, 2026
eb9c144
Eliminate Vec<usize> allocation in FSST view building
claude Mar 17, 2026
64a85fe
Update Cargo.lock and fix comment
claude Mar 17, 2026
5ba61de
Add isolated view-building and raw URL benchmarks
claude Mar 17, 2026
36b2c32
Replace synthetic benchmarks with real-world datasets and add short-s…
claude Mar 17, 2026
ecdc86f
Simplify emit_before_escape macro and remove optimization doc
claude Mar 17, 2026
7fd4e7c
Optimize FSST inline view construction and escape handling
claude Mar 17, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions Cargo.lock
View file
Open in desktop

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

6 changes: 6 additions & 0 deletions encodings/fsst/Cargo.toml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,7 @@ workspace = true

[dependencies]
fsst-rs = { workspace = true }
num-traits.workspace = true
prost = { workspace = true }
rand = { workspace = true, optional = true }
vortex-array = { workspace = true }
Expand Down Expand Up @@ -55,5 +56,10 @@ name = "chunked_dict_fsst_builder"
harness = false
required-features = ["_test-harness"]

[[bench]]
name = "fsst_decompress"
harness = false
required-features = ["_test-harness"]

[package.metadata.cargo-machete]
ignored = ["fsst-rs"]
Loading
Loading