Lossy Compression Challenge / Research

​

https://preview.redd.it/ebu3jtuckbra1.png?width=493&format=png&auto=webp&v=enabled&s=7c2d5d8f0653029bab1dd8ea79888762846cbbb6

I developed a method for compressing 1D waveforms and want to know what other options are out there, and how they fair for a certain use case. In this scenario, a low sampled (64pts) sinusoid of varying frequencies at various phase offsets is used. The task is to compress it lossy as much as possible with as little data loss as possible.

  • If you have a suggested method let me know in comments
  • If you have a method you want to share, download the float32 binary file at the link and try to get a similar PSNR reconstruction value
    • Ideally methods should still represent normal data if it were ever present, so no losing low frequency or high frequency content if present (such as a single point spike or magnitude drift)

I am really interested what methods people can share with me, lossy compression is pretty under represented and the only methods I have used so far is mine, SZ3, and ZFP (both of which failed greatly at this specific case). I will gladly include any methods that can get more than 2x compression in my publication(s) and research, since my benchmark is pretty hard to beat at 124 bits.

​

Data: https://sourceb.in/RKtfbBUg63

​

Posted Apr 1, 2023, 6:50 PM UTC

511
Loading comments…