In-Memory Compression, Columnar Compression Techniques: Difference between revisions
Jump to navigation
Jump to search
(Created page with "The following compression techniques are implemented: * Sparse Storage for columns with lots of NULL values * Float Storage for scientific data * Integer Compression with a bit-size approach * Sequence Compression for sequences of integers like IDs (1, 2, 3, 4, 5 ...) * Dictionary Compression for short strings * BLOB Zipping and Deduplication for strings longer than 1KiB") |
No edit summary |
||
| Line 1: | Line 1: | ||
The following compression techniques are implemented: | The following columnar compression techniques are implemented: | ||
* [[Sparse Storage]] for columns with lots of NULL values | * [[Sparse Storage]] for columns with lots of NULL values | ||
| Line 7: | Line 7: | ||
* [[Dictionary Compression]] for short strings | * [[Dictionary Compression]] for short strings | ||
* [[BLOB Zipping and Deduplication]] for strings longer than 1KiB | * [[BLOB Zipping and Deduplication]] for strings longer than 1KiB | ||
Also, MemCP is able to [[Index Compression|compress indexes]]. | |||
Revision as of 18:04, 17 May 2024
The following columnar compression techniques are implemented:
- Sparse Storage for columns with lots of NULL values
- Float Storage for scientific data
- Integer Compression with a bit-size approach
- Sequence Compression for sequences of integers like IDs (1, 2, 3, 4, 5 ...)
- Dictionary Compression for short strings
- BLOB Zipping and Deduplication for strings longer than 1KiB
Also, MemCP is able to compress indexes.