Benchmark Results for <I>poly.sa</I>

Benchmark Results for poly.sa

(For questions about these benchmarks send eMail to Claudio Fleiner)

This program tries to find a polynom of degree 8 such that it fits inside the two red lines in the following figure:

The program actually searches for a the Chebychev Polinomial of degree 8. Check out http://www.icsi.berkeley.edu/~storn/code.html for more information about the Differential Evolution Algorithm and the Technical Report TR-95-012, ICSI, March 1995

The same Benchmark was also run with a parallel version on a 4 processor Sparc running Solaris 2.5. Select "Parallel Differential Evolution" in the Form Based Interface or the the standard result table.

The serial versions of the program ran for 100 iterations and used 600 points between -1 and 1 to calculate the error of the polynom, while the parallel version uses 2400 points.

Programnon optimizedoptimizedSpeedup
Sather110.715.4
pSather199.918.73.29
C36.014.4

The pSather program had to execute 4 times as many checks as the C and Sather on a 4 processor Sparc. If the speedup would be linear the pSather program would run for the exact same time as the Sather Program.

Table of Contents

General Results:

# [#] Compiler Options *Best Run* Size of Executable Compile Time Memory Usage
Inline Move
while!
Once
Args.
Hoist
Invar.
CSE *sec. *% of
std
KB % of
std
sec. % of
std
KB % of
std
1. Standard Compiler with no options 110.70100.0%202100.0%12.86100.0%8305.87100.0%
2. [23] 15.2013.7%11456.7%21.10164.1%10090.50121.5%
3. [05] 15.3013.8%11557.1%16.42127.7%8168.7998.3%
4. [06] 15.3013.8%11557.2%18.31142.4%8577.84103.3%
5. [22] 15.3013.8%11456.7%21.11164.2%9990.49120.3%
6. [07] 15.4013.9%11557.2%18.22141.7%9732.42117.2%
7. [15] 15.4013.9%11657.4%18.50143.9%9921.19119.4%
8. [31]15.4013.9%11557.0%21.83169.8%10413.67125.4%
9. [30] 15.4013.9%11557.0%21.87170.1%9905.49119.3%
10. [29] 15.4013.9%11456.8%19.19149.2%10123.95121.9%
11. [13] 15.4013.9%11557.3%17.01132.3%10046.67121.0%
12. [21] 15.4013.9%11456.6%18.47143.6%10153.98122.3%
13. [04] 15.4013.9%11557.1%16.62129.2%9292.19111.9%
14. [12] 15.4013.9%11557.3%17.22133.9%8546.71102.9%
15. [20] 15.4013.9%11456.6%18.76145.9%10097.46121.6%
16. [28] 15.4013.9%11456.8%19.11148.6%10010.62120.5%
17. [14] 15.4013.9%11657.4%18.88146.8%9914.37119.4%
18. [03] 17.3015.6%11657.6%18.33142.5%10196.90122.8%
19. [26] 17.3015.6%11657.4%22.20172.6%10461.18125.9%
20. [27] 17.3015.6%11657.4%21.88170.1%9915.83119.4%
21. [11] 17.4015.7%11657.8%18.73145.6%9882.48119.0%
22. [25] 18.2016.4%11557.2%19.66152.9%9981.27120.2%
23. [24] 18.2016.4%11557.2%19.08148.4%10110.98121.7%
24. [16] 18.3016.5%11556.9%18.70145.4%9278.61111.7%
25. [19] 18.3016.5%11557.1%21.24165.2%9994.24120.3%
26. [02] 18.4016.6%11657.6%18.56144.3%9281.54111.7%
27. [18] 18.4016.6%11557.1%21.23165.1%10073.95121.3%
28. [17] 18.4016.6%11556.9%18.43143.3%10141.11122.1%
29. [09] 18.5016.7%11657.7%17.20133.7%8159.2398.2%
30. [01] 18.5016.7%11657.4%16.54128.6%9273.34111.6%
31. [08] 18.5016.7%11657.7%17.50136.1%9303.65112.0%
32. [00] 18.5016.7%11657.4%16.37127.3%8417.28101.3%
33. [10] 18.8017.0%11657.8%19.09148.4%10170.37122.4%

Impact of the option "Inlining":

# [# / #] Compiler Options *Best Run* Size of Executable Compile Time Memory Usage
Inline Move
while!
Once
Args.
Hoist
Invar.
CSE Faster
in sec.
*Faster
in % *
Shorter
in KB
Shorter
in %
Slower
in sec.
Slower
in %
change
in KB
change
in %
1. [10/26] 1.507.98%00.83%3.1116.29%-290816-2.86%
2. [09/25] 0.301.62%10.86%2.4614.30%-1822037-22.33%
3. [08/24] 0.301.62%10.87%1.589.03%-807321-8.68%
4. [07/23] 0.201.30%10.89%2.8815.81%-358073-3.68%
5. [00/16] 0.201.08%10.87%2.3314.23%-861330-10.23%
6. [11/27] 0.100.57%00.82%3.1516.82%-33353-0.34%
7. [01/17] 0.100.54%10.87%1.8911.43%-867766-9.36%
8. [15/31]0.000.00%00.85%3.3318.00%-492475-4.96%
9. [13/29] 0.000.00%10.89%2.1812.82%-77277-0.77%
10. [14/30] 0.000.00%00.85%2.9915.84%88740.09%
11. [06/22] 0.000.00%10.90%2.8015.29%-1412642-16.47%
12. [02/18] 0.000.00%10.87%2.6714.39%-792418-8.54%
13. [12/28] 0.000.00%10.90%1.8910.98%-1463910-17.13%
14. [04/20] 0.000.00%10.90%2.1412.88%-805273-8.67%
15. [05/21] -0.10-0.65%10.90%2.0512.48%-1985194-24.30%
16. [03/19] -1.00-5.78%10.87%2.9115.88%2026621.99%

Impact of the option "Moving while! and until!":

# [# / #] Compiler Options *Best Run* Size of Executable Compile Time Memory Usage
Inline Move
while!
Once
Args.
Hoist
Invar.
CSE Faster
in sec.
*Faster
in % *
Shorter
in KB
Shorter
in %
Slower
in sec.
Slower
in %
change
in KB
change
in %
1. [18/26] 1.105.98%0-0.45%0.974.57%-387229-3.84%
2. [19/27] 1.005.46%0-0.46%0.643.01%784090.78%
3. [17/25] 0.201.09%0-0.42%1.236.67%1598411.58%
4. [16/24] 0.100.55%0-0.43%0.382.03%-832365-8.97%
5. [07/15] 0.000.00%0-0.41%0.281.54%-188772-1.94%
6. [21/29] 0.000.00%0-0.43%0.723.90%300370.30%
7. [01/09] 0.000.00%0-0.41%0.663.99%111411212.01%
8. [00/08] 0.000.00%0-0.43%1.136.90%-886374-10.53%
9. [20/28] 0.000.00%0-0.42%0.351.87%868350.86%
10. [04/12] 0.000.00%0-0.42%0.603.61%7454728.02%
11. [03/11] -0.10-0.58%0-0.41%0.402.18%3144253.08%
12. [05/13] -0.10-0.65%0-0.42%0.593.59%-1877879-22.99%
13. [22/30] -0.10-0.65%0-0.45%0.763.60%849920.85%
14. [06/14] -0.10-0.65%0-0.40%0.573.11%-1336524-15.58%
15. [23/31]-0.20-1.32%0-0.45%0.733.46%-323174-3.20%
16. [02/10] -0.40-2.17%0-0.41%0.532.86%-888832-9.58%

Impact of the option "Hoisting Iter Initialization":

# [# / #] Compiler Options *Best Run* Size of Executable Compile Time Memory Usage
Inline Move
while!
Once
Args.
Hoist
Invar.
CSE Faster
in sec.
*Faster
in % *
Shorter
in KB
Shorter
in %
Slower
in sec.
Slower
in %
change
in KB
change
in %
1. [10/14] 3.4018.09%00.70%-0.21-1.10%2560002.52%
2. [01/05] 3.2017.30%00.61%-0.12-0.73%110455411.91%
3. [19/23] 3.1016.94%00.72%-0.14-0.66%-96256-0.96%
4. [02/06] 3.1016.85%00.70%-0.25-1.35%7036927.58%
5. [18/22] 3.1016.85%00.73%-0.12-0.57%834690.83%
6. [08/12] 3.1016.76%00.60%-0.28-1.60%7569408.14%
7. [00/04] 3.1016.76%00.59%0.251.53%-874905-10.39%
8. [09/13] 3.1016.76%00.60%-0.19-1.10%-1887436-23.13%
9. [17/21] 3.0016.30%00.63%0.040.22%-12873-0.13%
10. [16/20] 2.9015.85%00.62%0.060.32%-818848-8.83%
11. [25/29] 2.8015.38%00.62%-0.47-2.39%-142677-1.43%
12. [24/28] 2.8015.38%00.63%0.030.16%1003520.99%
13. [11/15] 2.0011.49%00.70%-0.23-1.23%-38716-0.39%
14. [03/07] 1.9010.98%00.70%-0.11-0.60%4644804.56%
15. [26/30] 1.9010.98%00.72%-0.33-1.49%5556905.31%
16. [27/31]1.9010.98%00.72%-0.05-0.23%-497839-5.02%

Impact of the option "Hoisting Loop Invariants":

# [# / #] Compiler Options *Best Run* Size of Executable Compile Time Memory Usage
Inline Move
while!
Once
Args.
Hoist
Invar.
CSE Faster
in sec.
*Faster
in % *
Shorter
in KB
Shorter
in %
Slower
in sec.
Slower
in %
change
in KB
change
in %
1. [01/03] 1.206.49%0-0.30%1.7910.82%-923558-9.96%
2. [09/11] 1.105.95%0-0.29%1.538.90%-1723245-21.12%
3. [25/27] 0.904.95%0-0.33%2.2211.29%654380.66%
4. [24/26] 0.904.95%0-0.33%3.1216.35%-350208-3.46%
5. [21/23] 0.201.30%0-0.21%2.6314.24%634880.63%
6. [20/22] 0.100.65%0-0.20%2.3512.53%1069731.06%
7. [04/06] 0.100.65%0-0.19%1.6910.17%7143427.69%
8. [17/19] 0.100.54%0-0.30%2.8115.25%1468701.45%
9. [00/02] 0.100.54%0-0.30%2.1913.38%-864256-10.27%
10. [29/31]0.000.00%0-0.23%2.6413.76%-289723-2.86%
11. [13/15] 0.000.00%0-0.19%1.498.76%1254741.25%
12. [28/30] 0.000.00%0-0.23%2.7614.44%1051301.05%
13. [12/14] 0.000.00%0-0.18%1.669.64%-1367654-16.00%
14. [16/18] -0.10-0.55%0-0.31%2.5313.53%-795344-8.57%
15. [05/07] -0.10-0.65%0-0.20%1.8010.96%-1563632-19.14%
16. [08/10] -0.30-1.62%0-0.28%1.599.09%-866713-9.32%

Impact of the option "Common Subexpression Elimination":

# [# / #] Compiler Options *Best Run* Size of Executable Compile Time Memory Usage
Inline Move
while!
Once
Args.
Hoist
Invar.
CSE Faster
in sec.
*Faster
in % *
Shorter
in KB
Shorter
in %
Slower
in sec.
Slower
in %
change
in KB
change
in %
1. [10/11] 1.407.45%00.01%-0.36-1.89%2878902.83%
2. [02/03] 1.105.98%00.01%-0.23-1.24%-915366-9.86%
3. [22/23] 0.100.65%00.00%-0.01-0.05%-100010-1.00%
4. [04/05] 0.100.65%00.01%-0.20-1.20%112339612.09%
5. [18/19] 0.100.54%00.01%0.010.05%797140.79%
6. [14/15] 0.000.00%0-0.00%-0.38-2.01%-6826-0.07%
7. [26/27] 0.000.00%00.00%-0.32-1.44%5453535.21%
8. [30/31]0.000.00%00.00%-0.04-0.18%-508177-5.13%
9. [28/29] 0.000.00%00.00%0.080.42%-113322-1.13%
10. [12/13] 0.000.00%00.01%-0.21-1.22%-1499955-17.55%
11. [20/21] 0.000.00%00.01%-0.29-1.55%-56524-0.56%
12. [24/25] 0.000.00%00.01%0.583.04%1297061.28%
13. [00/01] 0.000.00%0-0.00%0.171.04%-856064-10.17%
14. [08/09] 0.000.00%00.01%-0.30-1.71%114442212.30%
15. [16/17] -0.10-0.55%00.00%-0.27-1.44%-862500-9.30%
16. [06/07] -0.10-0.65%00.01%-0.09-0.49%-1154579-13.46%