thanks Nania!! It's fantastic how you improve zcm compressor! Great project!
Thanks !
the previous version or the 0.60 d certainly was more powerful in some cases (TXT, XML) on single file but the mixer which corrected mistakes of probability was to limit and prediction of the paradoxes produced thereof in some cases!
Compression got a bit worse but is faster with less memory. http://mattmahoney.net/dc/text.html#1629
Pratical Archiver is faster naturally !Quote Originally Posted by Matt Mahoney View PostCompression got a bit worse but is faster with less memory. http://mattmahoney.net/dc/text.html#1629
Thanks Matt for all test !
Best Regards!
I tested zcm on the mingw benchmark. http://mattmahoney.net/dc/zpaq.html
Compression with -r -m6 -t2 seems unusually slow, compared to the same options with -s, or with default (-m4 -t1). I am testing with 2 cores and 3 GB memory.
I noticed that when I try to extract a single file from a solid (-s) archive, that it creates all of the other files in the archive but with a size of 0.
Thanks Matt I try to solve the problem as soon as possible.Quote Originally Posted by Matt Mahoney View PostI tested zcm on the mingw benchmark. http://mattmahoney.net/dc/zpaq.html
Compression with -r -m6 -t2 seems unusually slow, compared to the same options with -s, or with default (-m4 -t1). I am testing with 2 cores and 3 GB memory.
I noticed that when I try to extract a single file from a solid (-s) archive, that it creates all of the other files in the archive but with a size of 0.
Regarding the normal option (not -s) is natural it is slow because it starts all system of memory every time that compresses/decompresses a file as in all CM compressor.
FIXED the problem!
released version 0.70c full compatible with version 0.70b
Francesco, did you add specialised models for all the file types that you mention in the announcement or something more generic?
Quote Originally Posted by m^2 View PostFrancesco, did you add specialised models for all the file types that you mention in the announcement or something more generic?
ZCM currently has 6 different compression models whose main uses lots of memory and 4 mixer (TXT, XML, ISO etc) and is slower. The other five use little memory and 2 mixer and they are fast.
Of course I have improved in speed a little all models of compression.
Last edited by Nania Francesco; 15th October 2012 at 23:52.
Hello, I have a problem with v0.70c
Here is the commandline output :
As you can see, output is a 0 Byte file that disappears as soon as it is created.Code:E:\Bricolage\Desktop Temporary Dir>ZCM a -t4 RefRain.zcm RefRain\* ZCM Archiver v.0.70c Ultra copyright (C) 2011 By Nania Francesco Antonio Demo Version multiprocess compression use 4 task Archive is E:\Bricolage\Desktop Temporary Dir\RefRain.zcm close task's active Compressed 276745803 bytes to 0 bytes
I use win 7 64Bit, have 8Go ram, processor is Intel Core i5.
Last edited by eleria; 16th October 2012 at 16:40.
ZCM Archiver v.0.70c: Is there a problem with big files (11 Gbytes) ?
trying to compress the big file results to an archivefile with 23 Gbytes
because this i have stoped the compresssion process and i hit CTRL-C ...
the program flashzip compress this big file without problems to a resulting archivfile with < 3 Gbytes ...
best regards
1)
Fixed the problem with the new version ... ZCM Archiver v.0.70d (is online) ! Thanks joerg !Quote Originally Posted by joerg View PostZCM Archiver v.0.70c: Is there a problem with big files (11 Gbytes) ?
trying to compress the big file results to an archivefile with 23 Gbytes
because this i have stoped the compresssion process and i hit CTRL-C ...
the program flashzip compress this big file without problems to a resulting archivfile with < 3 Gbytes ...
best regards
2)
The problem is the space in the folder E:\Bricolage\Desktop Temporary Dir\RefRain.zcm ... renameE:\Bricolage\Desktop Temporary Dir>ZCM a -t4 RefRain.zcm RefRain\*
ZCM Archiver v.0.70c Ultra
copyright (C) 2011 By Nania Francesco Antonio
Demo Version
multiprocess compression use 4 task
Archive is E:\Bricolage\Desktop Temporary Dir\RefRain.zcm
close task's active
Compressed 276745803 bytes to 0 bytes
(-> E:\Bricolage\DesktopTemporaryDir\ ) and zcm work with -t4 option ! with the next version I will try to fix it!
Hi!
Last edited by Nania Francesco; 16th October 2012 at 19:07.
Thanks Nania Francesco your trick with removing the space worked, but I have another problem. ZCM is stuck in task 4 (RefRain.zcm4).
I used the following command parameters :So I tried using CTRL + C to close the last task.Code:ZCM a -t4 -m7 RefRain.zcm RefRain\*
(Oh and the files I'm trying to compress are :)
When I list the archive contents I get the following instead of those two files :Code:RefRain_1000.bin RefRain_1000.cue
If you need the file that seems to pose a problem (RefRain_1000.bin) I can upload it to a file host, around 260 Mo uncompressed.Code:E:\Bricolage\DesktopTemporaryDir>ZCM l RefRain.zcm Archive List ... E:\Bricolage\DesktopTemporaryDir\RefRain.zcm RefRain/RefRain_1000.bin RefRain/RefRain_1000.bin RefRain/RefRain_1000.cue RefRain/RefRain_1000.bin RefRain/RefRain_1000.bin n.5 files in archive E:\Bricolage\DesktopTemporaryDir\RefRain.zcm
Edit : Every time I try it's another task that's stuck.
Last edited by eleria; 16th October 2012 at 20:45.
@Eleria
As I told you I don't understand why you go directly in the folder you want to compress when you collapse it directly from "c:\" where to put Zcm.exe. It gives you problems with task 4 test with one and see if it works. Failing here directly the program can't figure out quite what happens.
Thanks for the answer.
Put long filename with spaces between quotes and it will work.Quote Originally Posted by Nania Francesco View Post@Eleria
As I told you I don't understand why you go directly in the folder you want to compress when you collapse it directly from "c:\" where to put Zcm.exe. It gives you problems with task 4 test with one and see if it works. Failing here directly the program can't figure out quite what happens.
"E:\Bricolage\Desktop Temporary Dir\ZCM" a -t4 "E:\Bricolage\Desktop Temporary Dir\RefRain.zcm" RefRain\*
Thanks Jimbow for the solution !Quote Originally Posted by jimbow View PostPut long filename with spaces between quotes and it will work.
"E:\Bricolage\Desktop Temporary Dir\ZCM" a -t4 "E:\Bricolage\Desktop Temporary Dir\RefRain.zcm" RefRain\*
I ran a few tests and ...
With 1-2-3 task and method 7 it works without any problem.
With 4 tasks and method 4 it works without any problem.
But with 4 tasks and method 7 it gets stuck. (I left it running during the night and still it didn't complete)
Quote Originally Posted by eleria View PostI ran a few tests and ...
With 1-2-3 task and method 7 it works without any problem.
With 4 tasks and method 4 it works without any problem.
But with 4 tasks and method 7 it gets stuck. (I left it running during the night and still it didn't complete)[1 tasks and method 7] = 1.7GB (normal)I use win 7 64Bit, have 8Go ram, (not 8Go free!) processor is Intel Core i5.
[2 tasks and method 7] = 2*1.7GB = 3,4GB of memory free ! (fast)
[3 tasks and method 7] = 3*1.7GB = 5,1GB of memory free ! (fast ?)
[4 tasks and method 7] = 4*1.7GB = 6,8GB of memory free ! (very slow)
for me the best option with 8GB of memory :
-t4 -m6 !
Last edited by Nania Francesco; 17th October 2012 at 13:12.
Okay I may not have 6.8 GB of free memory but then wouldn't it be best if you implemented a memory check to see if enough memory is available, and if not you return an error. Because as of now, there is simply no way to tell it's a memory problem, the compression task simply goes on forever, It just looks like a bug.
Last edited by eleria; 18th October 2012 at 11:56.
@nania
ZCM 070D works well now
- and compresses better then flashzip
what about to implement the very fast compression algorithm from "rings 1.3" / "rings 1.5" into within ZCM ?
for now (for me) ZCM is THE best NEW COMPRESSOR 2012
best regards
Hello Nania,
I really like your ZCM :), but I have to report a bug in the latest ZCM 0.70d :
First is maybe not a bug, but a feature : it seems that ZCM is case sensitive when handling files.
See below : apparently "win.7z" is not handled the same as "Win.7z" ?
Why is that ? I think if ZCM runs under Windows, it should follow the behaviour from the OS, which is case insensitive.
Second is the reporting at the end from the uncompressed size of the file(s) that has been compressed.
As you can see below Win.7z is 4.328.441.959 bytes, not 33.474.663 bytes as reported by ZCM.
Code:K:\VMImages>timer zcm7 a -m7 -t6 win_zcm7__m7_t6.zcm win.7z Timer 9.01 : Igor Pavlov : Public domain : 2009年05月31日 ZCM Archiver v.0.70d Ultra copyright (C) 2011 By Nania Francesco Antonio Demo Version multiprocess compression use 6 task Archive is K:\VMImages\win_zcm7__m7_t6.zcm WARNING: No files close task's active Compressed 0 bytes to 0 bytes Kernel Time = 0.000 = 0% User Time = 0.015 = 49% Process Time = 0.015 = 49% Global Time = 0.031 = 100% K:\VMImages>timer zcm7 a -m7 -t6 win_zcm7__m7_t6.zcm Win.7z Timer 9.01 : Igor Pavlov : Public domain : 2009年05月31日 ZCM Archiver v.0.70d Ultra copyright (C) 2011 By Nania Francesco Antonio Demo Version multiprocess compression use 6 task Archive is K:\VMImages\win_zcm7__m7_t6.zcm close task's active Compressed 33474663 bytes to 1097381732 bytes Kernel Time = 229.711 = 67% User Time = 110.074 = 32% Process Time = 339.785 = 99% Global Time = 340.009 = 100% K:\VMImages>dir win.7z Volume in drive K is Raid 6 Volume Serial Number is CA19-B985 Directory of K:\VMImages 20/04/2012 21:54 4.328.441.959 Win.7z 1 File(s) 4.328.441.959 bytes 0 Dir(s) 18.490.705.346.560 bytes free
ZCM 0.80 released!
For extreme compression !
News:
- More faster in compression/decompression!
- More stable !
- Improved better compression for BMP/PPM/PNG/MP3/WMA/JPG/MOV/AVI/WMV/TXT/DOC etc. etc.!
Only from:
http://heartofcomp.altervista.org/
Last edited by Nania Francesco; 15th May 2013 at 22:50.
Black_Fox (16th May 2013),Matt Mahoney (16th May 2013),samsat1024 (16th May 2013),Stephan Busch (16th May 2013)
Input ramdisk:
299,627,772 bytes - html file
Output ramdisk:
40,644,114 bytes, 43.005 sec. - 43.777, zcm7 - 0
40,066,758 bytes, 44.618 sec. - 45.579, zcm8 - 0
30,037,304 bytes, 46.683 sec. - 47.167, zcm7 - 7
29,747,525 bytes, 48.521 sec. - 49.082, zcm8 - 7
1 thread
Output ramdisk:
41,105,392 bytes, 10.500 sec. - 9.996, zcm7 - 0
40,698,109 bytes, 10.129 sec. - 10.282, zcm8 - 0
33,738,319 bytes, 11.630 sec. - 11.438, zcm7 - 7
33,475,527 bytes, 12.352 sec. - 11.602, zcm8 - 7
8 threads
Tested 8 threads via winzpaq benchmark and sorted by bytes:
41,105,392 bytes, 9.881 sec. - 10.080 sec., ZCM7 - 0
40,698,109 bytes, 10.337 sec. - 10.310 sec., ZCM8 - 0
39,027,759 bytes, 10.065 sec. - 10.274 sec., ZCM7 - 1
38,652,471 bytes, 10.552 sec. - 10.294 sec., ZCM8 - 1
37,306,256 bytes, 10.279 sec. - 10.206 sec., ZCM7 - 2
37,029,442 bytes, 10.657 sec. - 10.475 sec., ZCM8 - 2
36,053,711 bytes, 10.399 sec. - 10.174 sec., ZCM7 - 3
35,799,807 bytes, 10.213 sec. - 10.424 sec., ZCM8 - 3
35,028,838 bytes, 9.932 sec. - 10.245 sec., ZCM7 - 4
34,782,812 bytes, 10.394 sec. - 10.424 sec., ZCM8 - 4
34,318,775 bytes, 10.512 sec. - 10.239 sec., ZCM7 - 5
34,073,594 bytes, 10.673 sec. - 10.735 sec., ZCM8 - 5
33,914,376 bytes, 10.991 sec. - 10.785 sec., ZCM7 - 6
33,738,319 bytes, 11.618 sec. - 11.185 sec., ZCM7 - 7
33,660,498 bytes, 11.448 sec. - 10.705 sec., ZCM8 - 6
33,475,527 bytes, 11.985 sec. - 11.872 sec., ZCM8 - 7
Last edited by Sportman; 16th May 2013 at 02:17.
TEST Maximum comression option -m7 -s
ZCM Archiver v.0.60d Ultra
compress.. c:/test/MSO97.DLL 3782416 to 1519363
compress.. c:/test/FP.LOG 20617071 to 369372
compress.. c:/test/rafale.bmp 4149414 to 719094
compress.. c:/test/english.dic 4067439 to 532786
compress.. c:/test/ohs.doc 4168192 to 743233
compress.. c:/test/AcroRd32.exe 3870784 to 1124011
compress.. c:/test/vcfiu.hlp 4121418 to 504327
compress.. c:/test/A10.jpg 842468 to 828322
compress.. c:/test/FlashMX.pdf 4526946 to 3662161
compress.. c:/test/world95.txt 2988578 to 440305
Compressed 53134726 bytes to 10442974 bytes
Kernel Time = 0.421 = 00:00:00.421 = 2%
User Time = 15.350 = 00:00:15.350 = 97%
Process Time = 15.771 = 00:00:15.771 = 100%
Global Time = 15.771 = 00:00:15.771 = 100%
ZCM Archiver v.0.70d Ultra
compress.. c:/test/MSO97.DLL 3782416 to 1521055
compress.. c:/test/FP.LOG 20617071 to 381773
compress.. c:/test/rafale.bmp 4149414 to 723859
compress.. c:/test/english.dic 4067439 to 537835
compress.. c:/test/ohs.doc 4168192 to 743375
compress.. c:/test/AcroRd32.exe 3870784 to 1126931
compress.. c:/test/vcfiu.hlp 4121418 to 504828
compress.. c:/test/A10.jpg 842468 to 825680
compress.. c:/test/FlashMX.pdf 4526946 to 3662739
compress.. c:/test/world95.txt 2988578 to 441060
Compressed 53134726 bytes to 10469135 bytes
Kernel Time = 0.390 = 00:00:00.390 = 2%
User Time = 15.537 = 00:00:15.537 = 97%
Process Time = 15.927 = 00:00:15.927 = 99%
Global Time = 15.928 = 00:00:15.928 = 100%
ZCM Archiver v.0.80, Extreme.
compress.. c:/test/MSO97.DLL 3782416 to 1512807
compress.. c:/test/FP.LOG 20617071 to 369235
compress.. c:/test/rafale.bmp 4149414 to 712185
compress.. c:/test/english.dic 4067439 to 531629
compress.. c:/test/ohs.doc 4168192 to 741504
compress.. c:/test/AcroRd32.exe 3870784 to 1118344
compress.. c:/test/vcfiu.hlp 4121418 to 500889
compress.. c:/test/A10.jpg 842468 to 821699
compress.. c:/test/FlashMX.pdf 4526946 to 3658691
compress.. c:/test/world95.txt 2988578 to 441206
Compressed 53134726 bytes to 10408189 bytes
Kernel Time = 0.327 = 00:00:00.327 = 2%
User Time = 15.818 = 00:00:15.818 = 97%
Process Time = 16.146 = 00:00:16.146 = 99%
Global Time = 16.162 = 00:00:16.162 = 100%
I tested zcm 0.80 on LTCB and the mingw benchmark. On LTCB, I ran under Wine on a 4 hyperthread Linux machine. I found that -t2 (2 threads) is faster than -t1 but compresses worse. It also decompresses faster if you specify -t2 during decompression. Compression is improved over v0.70 but still not as good as v0.60. http://mattmahoney.net/dc/text.html#1629
However I found when testing mingw on a 2 core Windows machine that -t2 is slower than -t1 for both compression and decompression (besides compressing worse). Also, solid mode (-s) not only compresses better but is faster, even for incremental updates. I did not think to test -t1 with 0.70 but you can compare the -t2 results to see some improvement with 0.80.
It looks like with -t2 that there are 3 processes running. 2 of these use lots of memory (I guess to compress or decompress), but there is one that uses very little memory but that reads many GB of input and uses a large amount of kernel time. 0.70 also did this.Code:Archiver Create mingw44 Time Add mingw45 Time Extract (CPU) Free Open Spec ------- -------------- ----- ----------- ---- ------- ----- ---- ---- ---- uncompressed 116,655,760 276,348,369 zcm 0.70b zcm -r (Win32) 45,023,374 295.6 119,406,152 333.5 296.8 Yes No No zcm -r -m6 -t2 45,016,499 848.5 119,468,648 937.6 356.5 zcm -r -m6 -t2 -s 38,185,975 86.5 77,156,914 98.0 153.4 zcm 0.80 zcm -r (Win32) 45,004,528 276.8 119,374,717 313.3 298.4 Yes No No zcm -r -m6 -t2 -s 38,021,034 94.2 78,026,436 118.2 175.3 zcm -r -m6 -t1 -s 36,174,231 68.5 73,968,725 93.2 161.0 zcm -r -m7 -t1 -s 36,115,632 86.0 73,846,883 101.6 176.9
Thanks Matt for all the tests that he played. With this version I wanted to try the limits of ZCM compression which is still immature and not very stable with certain types or groups of files. I'm working on a compact, fast and stable. Hopefully happen soon!
I suggest using threads instead of processes (and I guess polling) to get better performance. In zpaq.cpp you can see some code that is portable between Windows threads and Linux pthreads.
ZCM 0.88 released!
For unreal compression !
News:
- New CM core!
- More faster in compression/decompression!
- More stable !
- Improved better compression for BMP/PPM/PNG/MP3/WMA/JPG/MOV/AVI/WMV/(TXT?)/(WAV?)/DOC etc. etc.!
Only from:
http://heartofcomp.altervista.org/
Jan Ondrus (22nd June 2013),load (22nd June 2013),Mat Chartier (22nd June 2013),samsat1024 (22nd June 2013),Stephan Busch (22nd June 2013),Surfer (23rd June 2013),ZGish (25th June 2013)