GitShow/facebook/openzl
facebook

openzl

A novel data compression framework

by facebook
Star on GitHubForkWebsite

C

3.1k stars152 forks51 contributorsActive · 16h agoSince 2025v0.2.0

Meet the team

See all 51 on GitHub →
terrelln
terrelln174 contributions
Victor-C-Zhang
Victor-C-Zhang130 contributions
daniellerozenblit
daniellerozenblit104 contributions
kevinjzhang
kevinjzhang58 contributions
Cyan4973
Cyan497353 contributions
jlee303
jlee30344 contributions
felixhandte
felixhandte25 contributions
mmandina
mmandina19 contributions

Languages

View on GitHub →
C50.8%
C++44.9%
Python1.7%
TypeScript1%
Starlark0.7%
CMake0.4%
Other0.4%

Commit activity

Last 12 weeks · 221 commits

Full graph →

Community health

5 of 6 standards met

Community profile →
87
✓README✓License✓Contributing✓Code of Conduct○Issue Template✓PR Template

Recent PRs & issues

Active · Last activity 16h ago
See all on GitHub →
terrelln
Add AVX-512 kernels (#850)OpenPR

Summary: Adds the AVX-512 implementations of the PivCo-Huffman encode and decode kernels and their lookup tables, and registers them with , the header externs, and the kernel test suite. Differential Revision: D109893567

terrelln · 1d ago
terrelln
Wire PivCo-Huffman into OpenZL as a codecOpenPR

Summary: Binds the PivCo-Huffman kernel into OpenZL as a codec and registers it. Defines the header format, and wraps the kernel code added in prior diffs. Spec is written into . It is just hooked up as a private , a stacked diff will add it to . Differential Revision: D109893484

terrelln · 1d ago
terrelln
Add the SIMD table generator scriptOpenPR

Summary: Adds , which renders the generated lookup-table headers consumed by the architecture-specific kernels (x86, neon, avx512). It is checked in ahead of the per-architecture kernels that include its output. Differential Revision: D109893569

terrelln · 1d ago

Recent fixes

View closed PRs →
mmandina
Test utils (testkit) + frame-minting skillMergedPR

Summary: mints real OpenZL frames and chunks for GPU-decoder tests by driving the actual encoder (so frame/chunk headers and checksums are correct by construction): (single-graph frames), (multi-chunk frames + ), and (reflection-based codec verification). Also adds a Claude skill, , documenting how to mint single-codec and multi-chunk frames. This can be considered scratch code to unblock things temporarily. Reviewed By: terrelln Differential Revision: D110231769

mmandina · 16h ago
terrelln
Add aligned-bit helpers to ff_bitstream (#847)MergedPR

Summary: Adds byte-aligned bit reservation and pop primitives to the FF bitstream, needed by the upcoming PivCo-Huffman kernels: / on the write side. on the read side, plus a cursor in so the reader can compute byte offsets. now returns the number of bytes consumed. Hardens // against small buffers by avoiding pointer arithmetic that could underflow. Differential Revision: D109878843

terrelln · 1d ago
Structured data for AI agents

Repository: facebook/openzl. Description: A novel data compression framework Stars: 3123, Forks: 152. Primary language: C. Languages: C (50.8%), C++ (44.9%), Python (1.7%), TypeScript (1%), Starlark (0.7%). Homepage: https://openzl.org Latest release: v0.2.0 (1mo ago). Open PRs: 35, open issues: 28. Last activity: 16h ago. Community health: 87%. Top contributors: terrelln, Victor-C-Zhang, daniellerozenblit, kevinjzhang, Cyan4973, jlee303, felixhandte, mmandina, zhiningli, facebook-github-bot and others.

·@ofershap

Replace github.com with gitshow.dev