Benchmark Results for <I>matrix.sa</I>

Benchmark Results for matrix.sa

(For questions about these benchmarks send eMail to Claudio Fleiner)

This is the "real" Matrix Multiplaktion program matrix.sa. It multiplies two 300x300 matrices. Note that the equivalent C (matrix.c) and C++ (matrix.cc) are nearly an order of magnitude slower, unless they are optimized by hand (opt_matrix.c and opt_matrix.cc).

Program non optimized compiler optimized hand optimized
Sather 96.9 12.3 n/a
C 87.5 58.3 9.9
C++ 91.2 57.6 12.7

Program	non optimized	compiler optimized	hand optimized
Sather	96.9	12.3	n/a
C	87.5	58.3	9.9
C++	91.2	57.6	12.7

The C and C++ version were compiled with GCC 2.7.1 and -O3.

Note that GCC cannot do much better without inter procedural analysis, as it has to prove that each write to one of the elements of the matrix does not change the size of any of the matrices involed, which could happen if the memory region of the three matrices overlap.

General Results
Impact of the option "Inlining"
Impact of the option "Moving while! and until!"
Impact of the option "Hoisting Iter Initialization"
Impact of the option "Hoisting Loop Invariants"
Impact of the option "Common Subexpression Elimination"

General Results:

# [#] Compiler Options Best Run Size of Executable Compile Time Memory Usage
Inline Move
while! Once
Args. Hoist
Invar. CSE sec. % of
std KB Shorter
in % sec. % of
std KB % of
std
1. Standard Compiler with no options 237.90 100.0% 185 0.0% 11.22 100.0% 6328.95 100.0%
2. [23] 11.80 5.0% 109 41.3% 20.15 179.6% 9970.05 157.5%
3. [22] 11.90 5.0% 109 41.3% 20.21 180.1% 9985.23 157.8%
4. [31] 12.30 5.2% 109 41.0% 20.98 187.0% 9910.83 156.6%
5. [30] 12.40 5.2% 109 41.0% 20.65 184.0% 10635.95 168.1%
6. [27] 12.80 5.4% 110 40.7% 21.04 187.5% 10253.04 162.0%
7. [19] 12.80 5.4% 109 41.0% 20.43 182.1% 10077.00 159.2%
8. [26] 12.90 5.4% 110 40.7% 20.76 185.0% 10221.57 161.5%
9. [18] 12.90 5.4% 109 41.0% 20.33 181.2% 9848.42 155.6%
10. [29] 63.30 26.6% 109 41.1% 17.00 151.5% 9975.40 157.6%
11. [24] 63.40 26.6% 109 40.8% 16.91 150.7% 9897.57 156.4%
12. [25] 63.40 26.6% 109 40.8% 16.90 150.6% 9583.00 151.4%
13. [21] 63.40 26.6% 108 41.4% 16.29 145.2% 10004.07 158.1%
14. [28] 63.40 26.6% 109 41.1% 16.93 150.9% 10016.77 158.3%
15. [16] 63.90 26.9% 109 41.1% 16.33 145.5% 9888.56 156.2%
16. [17] 63.90 26.9% 109 41.1% 16.35 145.7% 9966.39 157.5%
17. [20] 64.40 27.1% 108 41.4% 16.28 145.1% 9556.79 151.0%
18. [05] 96.40 40.5% 109 40.9% 14.20 126.6% 7774.21 122.8%
19. [15] 96.40 40.5% 110 40.6% 15.76 140.5% 7941.32 125.5%
20. [04] 96.40 40.5% 109 40.9% 14.26 127.1% 7786.50 123.0%
21. [14] 96.50 40.6% 110 40.6% 15.76 140.5% 7915.93 125.1%
22. [06] 96.50 40.6% 109 40.9% 15.60 139.0% 7778.30 122.9%
23. [12] 96.80 40.7% 110 40.6% 14.75 131.5% 7808.34 123.4%
24. [07] 96.90 40.7% 109 40.9% 15.41 137.3% 7876.29 124.4%
25. [00] 96.90 40.7% 110 40.6% 14.30 127.5% 7752.09 122.5%
26. [13] 96.90 40.7% 110 40.6% 14.84 132.3% 7889.72 124.7%
27. [09] 97.00 40.8% 110 40.3% 14.86 132.4% 7825.41 123.6%
28. [08] 97.10 40.8% 110 40.3% 14.73 131.3% 7815.17 123.5%
29. [01] 97.40 40.9% 110 40.6% 14.52 129.4% 7834.01 123.8%
30. [03] 97.80 41.1% 110 40.6% 15.66 139.6% 7818.58 123.5%
31. [02] 97.80 41.1% 110 40.6% 15.61 139.1% 7777.48 122.9%
32. [10] 97.90 41.2% 110 40.3% 16.42 146.3% 7788.13 123.1%
33. [11] 98.00 41.2% 110 40.3% 16.04 143.0% 7960.99 125.8%

# [#]	Compiler Options	Best Run	Size of Executable	Compile Time	Memory Usage
Inline	Move while!	Once Args.	Hoist Invar.	CSE	*sec. *	% of std	KB	Shorter in %	sec.	% of std	KB	% of std
1.	Standard Compiler with no options	237.90	100.0%	185	0.0%	11.22	100.0%	6328.95	100.0%
2. [23]						11.80	5.0%	109	41.3%	20.15	179.6%	9970.05	157.5%
3. [22]						11.90	5.0%	109	41.3%	20.21	180.1%	9985.23	157.8%
4. [31]						12.30	5.2%	109	41.0%	20.98	187.0%	9910.83	156.6%
5. [30]						12.40	5.2%	109	41.0%	20.65	184.0%	10635.95	168.1%
6. [27]						12.80	5.4%	110	40.7%	21.04	187.5%	10253.04	162.0%
7. [19]						12.80	5.4%	109	41.0%	20.43	182.1%	10077.00	159.2%
8. [26]						12.90	5.4%	110	40.7%	20.76	185.0%	10221.57	161.5%
9. [18]						12.90	5.4%	109	41.0%	20.33	181.2%	9848.42	155.6%
10. [29]						63.30	26.6%	109	41.1%	17.00	151.5%	9975.40	157.6%
11. [24]						63.40	26.6%	109	40.8%	16.91	150.7%	9897.57	156.4%
12. [25]						63.40	26.6%	109	40.8%	16.90	150.6%	9583.00	151.4%
13. [21]						63.40	26.6%	108	41.4%	16.29	145.2%	10004.07	158.1%
14. [28]						63.40	26.6%	109	41.1%	16.93	150.9%	10016.77	158.3%
15. [16]						63.90	26.9%	109	41.1%	16.33	145.5%	9888.56	156.2%
16. [17]						63.90	26.9%	109	41.1%	16.35	145.7%	9966.39	157.5%
17. [20]						64.40	27.1%	108	41.4%	16.28	145.1%	9556.79	151.0%
18. [05]						96.40	40.5%	109	40.9%	14.20	126.6%	7774.21	122.8%
19. [15]						96.40	40.5%	110	40.6%	15.76	140.5%	7941.32	125.5%
20. [04]						96.40	40.5%	109	40.9%	14.26	127.1%	7786.50	123.0%
21. [14]						96.50	40.6%	110	40.6%	15.76	140.5%	7915.93	125.1%
22. [06]						96.50	40.6%	109	40.9%	15.60	139.0%	7778.30	122.9%
23. [12]						96.80	40.7%	110	40.6%	14.75	131.5%	7808.34	123.4%
24. [07]						96.90	40.7%	109	40.9%	15.41	137.3%	7876.29	124.4%
25. [00]						96.90	40.7%	110	40.6%	14.30	127.5%	7752.09	122.5%
26. [13]						96.90	40.7%	110	40.6%	14.84	132.3%	7889.72	124.7%
27. [09]						97.00	40.8%	110	40.3%	14.86	132.4%	7825.41	123.6%
28. [08]						97.10	40.8%	110	40.3%	14.73	131.3%	7815.17	123.5%
29. [01]						97.40	40.9%	110	40.6%	14.52	129.4%	7834.01	123.8%
30. [03]						97.80	41.1%	110	40.6%	15.66	139.6%	7818.58	123.5%
31. [02]						97.80	41.1%	110	40.6%	15.61	139.1%	7777.48	122.9%
32. [10]						97.90	41.2%	110	40.3%	16.42	146.3%	7788.13	123.1%
33. [11]						98.00	41.2%	110	40.3%	16.04	143.0%	7960.99	125.8%

Impact of the option "Inlining":

# [# / #] Compiler Options Best Run Size of Executable Compile Time Memory Usage
Inline Move
while! Once
Args. Hoist
Invar. CSE Faster
in sec. Faster
in % Shorter
in KB Shorter
in % Slower
in sec. Slower
in % change
in KB change
in %
1. [07/23] 85.10 87.82% 0 0.69% 4.74 30.76% -2093761 -26.58%
2. [06/22] 84.60 87.67% 0 0.68% 4.61 29.55% -2206924 -28.37%
3. [15/31] 84.10 87.24% 0 0.62% 5.22 33.12% -1969505 -24.80%
4. [14/30] 84.10 87.15% 0 0.62% 4.89 31.03% -2720017 -34.36%
5. [11/27] 85.20 86.94% 0 0.59% 5.00 31.17% -2292056 -28.79%
6. [03/19] 85.00 86.91% 0 0.65% 4.77 30.46% -2258421 -28.89%
7. [10/26] 85.00 86.82% 0 0.58% 4.34 26.43% -2433433 -31.25%
8. [02/18] 84.90 86.81% 0 0.66% 4.72 30.24% -2070937 -26.63%
9. [08/24] 33.70 34.71% 0 0.79% 2.18 14.80% -2082406 -26.65%
10. [13/29] 33.60 34.67% 0 0.81% 2.16 14.56% -2085683 -26.44%
11. [09/25] 33.60 34.64% 0 0.78% 2.04 13.73% -1757593 -22.46%
12. [12/28] 33.40 34.50% 0 0.79% 2.18 14.78% -2208426 -28.28%
13. [01/17] 33.50 34.39% 0 0.80% 1.83 12.60% -2132377 -27.22%
14. [05/21] 33.00 34.23% 0 0.82% 2.09 14.72% -2229862 -28.68%
15. [00/16] 33.00 34.06% 0 0.81% 2.03 14.20% -2136473 -27.56%
16. [04/20] 32.00 33.20% 0 0.82% 2.02 14.17% -1770291 -22.74%

# [# / #]	Compiler Options	Best Run	Size of Executable	Compile Time	Memory Usage
Inline	Move while!	Once Args.	Hoist Invar.	CSE	Faster in sec.	Faster in %	Shorter in KB	Shorter in %	Slower in sec.	Slower in %	change in KB	change in %
1. [07/23]						85.10	87.82%	0	0.69%	4.74	30.76%	-2093761	-26.58%
2. [06/22]						84.60	87.67%	0	0.68%	4.61	29.55%	-2206924	-28.37%
3. [15/31]						84.10	87.24%	0	0.62%	5.22	33.12%	-1969505	-24.80%
4. [14/30]						84.10	87.15%	0	0.62%	4.89	31.03%	-2720017	-34.36%
5. [11/27]						85.20	86.94%	0	0.59%	5.00	31.17%	-2292056	-28.79%
6. [03/19]						85.00	86.91%	0	0.65%	4.77	30.46%	-2258421	-28.89%
7. [10/26]						85.00	86.82%	0	0.58%	4.34	26.43%	-2433433	-31.25%
8. [02/18]						84.90	86.81%	0	0.66%	4.72	30.24%	-2070937	-26.63%
9. [08/24]						33.70	34.71%	0	0.79%	2.18	14.80%	-2082406	-26.65%
10. [13/29]						33.60	34.67%	0	0.81%	2.16	14.56%	-2085683	-26.44%
11. [09/25]						33.60	34.64%	0	0.78%	2.04	13.73%	-1757593	-22.46%
12. [12/28]						33.40	34.50%	0	0.79%	2.18	14.78%	-2208426	-28.28%
13. [01/17]						33.50	34.39%	0	0.80%	1.83	12.60%	-2132377	-27.22%
14. [05/21]						33.00	34.23%	0	0.82%	2.09	14.72%	-2229862	-28.68%
15. [00/16]						33.00	34.06%	0	0.81%	2.03	14.20%	-2136473	-27.56%
16. [04/20]						32.00	33.20%	0	0.82%	2.02	14.17%	-1770291	-22.74%

Impact of the option "Moving while! and until!":

# [# / #] Compiler Options Best Run Size of Executable Compile Time Memory Usage
Inline Move
while! Once
Args. Hoist
Invar. CSE Faster
in sec. Faster
in % Shorter
in KB Shorter
in % Slower
in sec. Slower
in % change
in KB change
in %
1. [20/28] 1.00 1.55% 0 -0.47% 0.65 3.99% -459980 -4.81%
2. [17/25] 0.50 0.78% 0 -0.46% 0.55 3.36% 383385 3.85%
3. [16/24] 0.50 0.78% 0 -0.45% 0.58 3.55% -9011 -0.09%
4. [07/15] 0.50 0.52% 0 -0.42% 0.35 2.27% -65031 -0.83%
5. [01/09] 0.40 0.41% 0 -0.44% 0.34 2.34% 8601 0.11%
6. [21/29] 0.10 0.16% 0 -0.46% 0.71 4.36% 28672 0.29%
7. [19/27] 0.00 0.00% 0 -0.48% 0.61 2.99% -176039 -1.75%
8. [06/14] 0.00 0.00% 0 -0.42% 0.16 1.03% -137625 -1.77%
9. [18/26] 0.00 0.00% 0 -0.49% 0.43 2.12% -373145 -3.79%
10. [02/10] -0.10 -0.10% 0 -0.41% 0.81 5.19% -10649 -0.14%
11. [03/11] -0.20 -0.20% 0 -0.42% 0.38 2.43% -142404 -1.82%
12. [00/08] -0.20 -0.21% 0 -0.43% 0.43 3.01% -63078 -0.81%
13. [04/12] -0.40 -0.41% 0 -0.44% 0.49 3.44% -21845 -0.28%
14. [05/13] -0.50 -0.52% 0 -0.44% 0.64 4.51% -115507 -1.49%
15. [22/30] -0.50 -4.20% 0 -0.48% 0.44 2.18% -650717 -6.52%
16. [23/31] -0.50 -4.24% 0 -0.48% 0.83 4.12% 59223 0.59%

# [# / #]	Compiler Options	Best Run	Size of Executable	Compile Time	Memory Usage
Inline	Move while!	Once Args.	Hoist Invar.	CSE	Faster in sec.	Faster in %	Shorter in KB	Shorter in %	Slower in sec.	Slower in %	change in KB	change in %
1. [20/28]						1.00	1.55%	0	-0.47%	0.65	3.99%	-459980	-4.81%
2. [17/25]						0.50	0.78%	0	-0.46%	0.55	3.36%	383385	3.85%
3. [16/24]						0.50	0.78%	0	-0.45%	0.58	3.55%	-9011	-0.09%
4. [07/15]						0.50	0.52%	0	-0.42%	0.35	2.27%	-65031	-0.83%
5. [01/09]						0.40	0.41%	0	-0.44%	0.34	2.34%	8601	0.11%
6. [21/29]						0.10	0.16%	0	-0.46%	0.71	4.36%	28672	0.29%
7. [19/27]						0.00	0.00%	0	-0.48%	0.61	2.99%	-176039	-1.75%
8. [06/14]						0.00	0.00%	0	-0.42%	0.16	1.03%	-137625	-1.77%
9. [18/26]						0.00	0.00%	0	-0.49%	0.43	2.12%	-373145	-3.79%
10. [02/10]						-0.10	-0.10%	0	-0.41%	0.81	5.19%	-10649	-0.14%
11. [03/11]						-0.20	-0.20%	0	-0.42%	0.38	2.43%	-142404	-1.82%
12. [00/08]						-0.20	-0.21%	0	-0.43%	0.43	3.01%	-63078	-0.81%
13. [04/12]						-0.40	-0.41%	0	-0.44%	0.49	3.44%	-21845	-0.28%
14. [05/13]						-0.50	-0.52%	0	-0.44%	0.64	4.51%	-115507	-1.49%
15. [22/30]						-0.50	-4.20%	0	-0.48%	0.44	2.18%	-650717	-6.52%
16. [23/31]						-0.50	-4.24%	0	-0.48%	0.83	4.12%	59223	0.59%

Impact of the option "Hoisting Iter Initialization":

# [# / #] Compiler Options Best Run Size of Executable Compile Time Memory Usage
Inline Move
while! Once
Args. Hoist
Invar. CSE Faster
in sec. Faster
in % Shorter
in KB Shorter
in % Slower
in sec. Slower
in % change
in KB change
in %
1. [19/23] 1.00 7.81% 0 0.54% -0.28 -1.37% 106949 1.06%
2. [18/22] 1.00 7.75% 0 0.53% -0.12 -0.59% -136806 -1.39%
3. [27/31] 0.50 3.91% 0 0.54% -0.06 -0.29% 342211 3.34%
4. [26/30] 0.50 3.88% 0 0.54% -0.11 -0.53% -414378 -4.05%
5. [11/15] 1.60 1.63% 0 0.51% -0.28 -1.75% 19660 0.25%
6. [10/14] 1.40 1.43% 0 0.51% -0.66 -4.02% -127795 -1.64%
7. [02/06] 1.30 1.33% 0 0.51% -0.01 -0.06% -819 -0.01%
8. [01/05] 1.00 1.03% 0 0.50% -0.32 -2.20% 59801 0.76%
9. [03/07] 0.90 0.92% 0 0.51% -0.25 -1.60% -57711 -0.74%
10. [17/21] 0.50 0.78% 0 0.52% -0.06 -0.37% -37683 -0.38%
11. [00/04] 0.50 0.52% 0 0.52% -0.04 -0.28% -34406 -0.44%
12. [08/12] 0.30 0.31% 0 0.51% 0.02 0.14% 6826 0.09%
13. [25/29] 0.10 0.16% 0 0.52% 0.10 0.59% -392396 -4.09%
14. [09/13] 0.10 0.10% 0 0.50% -0.02 -0.13% -64307 -0.82%
15. [24/28] 0.00 0.00% 0 0.52% 0.02 0.12% -119193 -1.20%
16. [16/20] -0.50 -0.78% 0 0.53% -0.05 -0.31% 331776 3.36%

# [# / #]	Compiler Options	Best Run	Size of Executable	Compile Time	Memory Usage
Inline	Move while!	Once Args.	Hoist Invar.	CSE	Faster in sec.	Faster in %	Shorter in KB	Shorter in %	Slower in sec.	Slower in %	change in KB	change in %
1. [19/23]						1.00	7.81%	0	0.54%	-0.28	-1.37%	106949	1.06%
2. [18/22]						1.00	7.75%	0	0.53%	-0.12	-0.59%	-136806	-1.39%
3. [27/31]						0.50	3.91%	0	0.54%	-0.06	-0.29%	342211	3.34%
4. [26/30]						0.50	3.88%	0	0.54%	-0.11	-0.53%	-414378	-4.05%
5. [11/15]						1.60	1.63%	0	0.51%	-0.28	-1.75%	19660	0.25%
6. [10/14]						1.40	1.43%	0	0.51%	-0.66	-4.02%	-127795	-1.64%
7. [02/06]						1.30	1.33%	0	0.51%	-0.01	-0.06%	-819	-0.01%
8. [01/05]						1.00	1.03%	0	0.50%	-0.32	-2.20%	59801	0.76%
9. [03/07]						0.90	0.92%	0	0.51%	-0.25	-1.60%	-57711	-0.74%
10. [17/21]						0.50	0.78%	0	0.52%	-0.06	-0.37%	-37683	-0.38%
11. [00/04]						0.50	0.52%	0	0.52%	-0.04	-0.28%	-34406	-0.44%
12. [08/12]						0.30	0.31%	0	0.51%	0.02	0.14%	6826	0.09%
13. [25/29]						0.10	0.16%	0	0.52%	0.10	0.59%	-392396	-4.09%
14. [09/13]						0.10	0.10%	0	0.50%	-0.02	-0.13%	-64307	-0.82%
15. [24/28]						0.00	0.00%	0	0.52%	0.02	0.12%	-119193	-1.20%
16. [16/20]						-0.50	-0.78%	0	0.53%	-0.05	-0.31%	331776	3.36%

Impact of the option "Hoisting Loop Invariants":

# [# / #] Compiler Options Best Run Size of Executable Compile Time Memory Usage
Inline Move
while! Once
Args. Hoist
Invar. CSE Faster
in sec. Faster
in % Shorter
in KB Shorter
in % Slower
in sec. Slower
in % change
in KB change
in %
1. [20/22] 52.50 81.52% 0 -0.19% 3.93 24.14% -428441 -4.48%
2. [21/23] 51.60 81.39% 0 -0.18% 3.86 23.70% 34016 0.34%
3. [29/31] 51.00 80.57% 0 -0.20% 3.98 23.41% 64567 0.65%
4. [28/30] 51.00 80.44% 0 -0.20% 3.72 21.97% -619178 -6.18%
5. [17/19] 51.10 79.97% 0 -0.20% 4.08 24.95% -110616 -1.11%
6. [16/18] 51.00 79.81% 0 -0.19% 4.00 24.49% 40140 0.41%
7. [25/27] 50.60 79.81% 0 -0.22% 4.14 24.50% -670040 -6.99%
8. [24/26] 50.50 79.65% 0 -0.23% 3.85 22.77% -323993 -3.27%
9. [13/15] 0.50 0.52% 0 -0.01% 0.92 6.20% -51609 -0.65%
10. [12/14] 0.30 0.31% 0 -0.03% 1.01 6.85% -107588 -1.38%
11. [04/06] -0.10 -0.10% 0 -0.04% 1.34 9.40% 8192 0.11%
12. [01/03] -0.40 -0.41% 0 -0.05% 1.14 7.85% 15428 0.20%
13. [05/07] -0.50 -0.52% 0 -0.04% 1.21 8.52% -102084 -1.31%
14. [08/10] -0.80 -0.82% 0 -0.02% 1.69 11.47% 27033 0.35%
15. [00/02] -0.90 -0.93% 0 -0.04% 1.31 9.16% -25395 -0.33%
16. [09/11] -1.00 -1.03% 0 -0.03% 1.18 7.94% -135577 -1.73%

# [# / #]	Compiler Options	Best Run	Size of Executable	Compile Time	Memory Usage
Inline	Move while!	Once Args.	Hoist Invar.	CSE	Faster in sec.	Faster in %	Shorter in KB	Shorter in %	Slower in sec.	Slower in %	change in KB	change in %
1. [20/22]						52.50	81.52%	0	-0.19%	3.93	24.14%	-428441	-4.48%
2. [21/23]						51.60	81.39%	0	-0.18%	3.86	23.70%	34016	0.34%
3. [29/31]						51.00	80.57%	0	-0.20%	3.98	23.41%	64567	0.65%
4. [28/30]						51.00	80.44%	0	-0.20%	3.72	21.97%	-619178	-6.18%
5. [17/19]						51.10	79.97%	0	-0.20%	4.08	24.95%	-110616	-1.11%
6. [16/18]						51.00	79.81%	0	-0.19%	4.00	24.49%	40140	0.41%
7. [25/27]						50.60	79.81%	0	-0.22%	4.14	24.50%	-670040	-6.99%
8. [24/26]						50.50	79.65%	0	-0.23%	3.85	22.77%	-323993	-3.27%
9. [13/15]						0.50	0.52%	0	-0.01%	0.92	6.20%	-51609	-0.65%
10. [12/14]						0.30	0.31%	0	-0.03%	1.01	6.85%	-107588	-1.38%
11. [04/06]						-0.10	-0.10%	0	-0.04%	1.34	9.40%	8192	0.11%
12. [01/03]						-0.40	-0.41%	0	-0.05%	1.14	7.85%	15428	0.20%
13. [05/07]						-0.50	-0.52%	0	-0.04%	1.21	8.52%	-102084	-1.31%
14. [08/10]						-0.80	-0.82%	0	-0.02%	1.69	11.47%	27033	0.35%
15. [00/02]						-0.90	-0.93%	0	-0.04%	1.31	9.16%	-25395	-0.33%
16. [09/11]						-1.00	-1.03%	0	-0.03%	1.18	7.94%	-135577	-1.73%

Impact of the option "Common Subexpression Elimination":

# [# / #] Compiler Options Best Run Size of Executable Compile Time Memory Usage
Inline Move
while! Once
Args. Hoist
Invar. CSE Faster
in sec. Faster
in % Shorter
in KB Shorter
in % Slower
in sec. Slower
in % change
in KB change
in %
1. [20/21] 1.00 1.55% 0 -0.01% 0.01 0.06% -447283 -4.68%
2. [22/23] 0.10 0.84% 0 0.00% -0.06 -0.30% 15174 0.15%
3. [30/31] 0.10 0.81% 0 0.00% 0.33 1.60% 725116 6.82%
4. [26/27] 0.10 0.78% 0 0.00% 0.28 1.35% -31474 -0.31%
5. [18/19] 0.10 0.78% 0 -0.01% 0.10 0.49% -228580 -2.32%
6. [28/29] 0.10 0.16% 0 0.00% 0.07 0.41% 41369 0.41%
7. [14/15] 0.10 0.10% 0 0.00% 0.00 0.00% -25395 -0.32%
8. [08/09] 0.10 0.10% 0 0.00% 0.13 0.88% -10240 -0.13%
9. [02/03] 0.00 0.00% 0 0.00% 0.05 0.32% -41096 -0.53%
10. [24/25] 0.00 0.00% 0 -0.01% -0.01 -0.06% 314572 3.18%
11. [04/05] 0.00 0.00% 0 -0.01% -0.06 -0.42% 12288 0.16%
12. [16/17] 0.00 0.00% 0 0.00% 0.02 0.12% -77824 -0.79%
13. [10/11] -0.10 -0.10% 0 -0.01% -0.38 -2.31% -172851 -2.22%
14. [12/13] -0.10 -0.10% 0 -0.01% 0.09 0.61% -81373 -1.04%
15. [06/07] -0.40 -0.41% 0 -0.01% -0.19 -1.22% -97988 -1.26%
16. [00/01] -0.50 -0.52% 0 0.01% 0.22 1.54% -81920 -1.06%

Benchmark Results for matrix.sa

Table of Contents