Xbitinfo: Compress datasets based on their information content
| Title: | Xbitinfo: Compress datasets based on their information content |
|---|---|
| Authors: | Schulz, Hauke; Spring, Aaron; Klöwer, Milan |
| Publisher Information: | Zenodo |
| Publication Year: | 2022 |
| Collection: | Zenodo |
| Description: | Xbitinfo provides additional compression capabilities to the Pangeo Python workflow. Building on top of the Julia package BitInformation.jl, Xbitinfo is able to compress xarray datasets based on their information content. With compression rates out-performing traditionally for compression used formats like GRIB, Xbitinfo allows to save datasets in cloud-ready formats like Zarr without sacrificing compression rates or performance. |
| Document Type: | text |
| Language: | English |
| Relation: | https://zenodo.org/communities/pangeo/; https://zenodo.org/records/7259092; oai:zenodo.org:7259092; https://doi.org/10.5281/zenodo.7259092 |
| DOI: | 10.5281/zenodo.7259092 |
| Availability: | https://doi.org/10.5281/zenodo.7259092; https://zenodo.org/records/7259092 |
| Rights: | Creative Commons Attribution 4.0 International ; cc-by-4.0 ; https://creativecommons.org/licenses/by/4.0/legalcode |
| Accession Number: | edsbas.72FF850F |
| Database: | BASE |