Friday, December 16, 2016

[nfypbdyk] Multicore compression

Two ways to parallelize data compression:  Compress multiple different blocks in parallel, or have multiple different cores working on the same block, perhaps exploring different ways to compress the block.  The latter is not done too much, but could be and should be: there are some extremely slow but powerful compression algorithms out there that do significantly better than what is widely available.  Maybe parallelization will exhaust memory before exhausting number of processor cores.

No comments :