Simple array compression
Action summary
Simple array compression
Reduce the size of an array by 60% to 70%
On average the size of any array of objects (non nested) will be reduced by 60% to 70%
The Columnar Compression Algorithm restructures an array of objects by transforming it from a row-oriented structure (where each object repeats its keys) to a column-oriented format, where the values corresponding to each key are grouped together. This transformation reduces metadata overhead, improves data access efficiency, and can lead to space savings, especially when the array contains many records with the same set of keys.
The compressed array can then be transmitted and reconstructed at it´s destination.
Example:
[
{
"first_name": "Emma",
"last_name": "Rodriguez",
"email": "emma.rodriguez@mail.com",
"phone": "555-454-7896"
},
{
"first_name": "Chris",
"last_name": "Garcia",
"email": "chris.garcia@test.com",
"phone": "666-800-2436"
},
{
"first_name": "Jane",
"last_name": "Martinez",
"email": "jane.martinez@domain.com",
"phone": "555-331-4091"
}
// ... more objects
]
Will be compressed into:
{
"first_name": ["Emma", "Chris", "Jane"],
"last_name": ["Rodriguez", "Garcia", "Martinez"],
"email": ["emma.rodriguez@mail.com", "chris.garcia@test.com", "jane.martinez@domain.com"],
"phone": ["555-454-7896", "666-800-2436", "555-331-4091"],
"keys": ["first_name", "last_name", "email", "phone"]
}
Version notes
Initial version
Current