[Info-vax] MIPS vs. VUPS

[Paul Sture]

On 2015-08-05, terry+googleblog at tmk.com <terry+googleblog at tmk.com> wrote:
> On Wednesday, August 5, 2015 at 7:05:41 AM UTC-4, Paul Sture wrote:
>> FWIW there's another possibility here and that's to split up files to be
>> compressed and run n jobs where n = the number of cores you have
>> available.  In the case of a single large file, gzip files can be
>> concatenated (see the man entries for gzip and gunzip), so it could be
>> split, the components compressed in separate jobs so that they get their
>> own core, then the results concatenated.
>
> If you're not tied to the [PK]ZIP format, pbzip2 is a multithreaded
> implementation of the bzip2 compression format:
> http://compression.ca/pbzip2

Thanks, I'll have a look.

I'm unsure for the original task but bzip2 is a supported alternative
for other stuff in this area.


-- 
 If it jams - force it. If it breaks, it needed replacing anyway.