Difference between revisions of "Version benchmarking"

From Heureka Wiki
Jump to: navigation, search
Line 23: Line 23:
 
| style="background:#f0f0f0;width:10%;;"|'''Release notes'''
 
| style="background:#f0f0f0;width:10%;;"|'''Release notes'''
 
|-style = "vertical-align: top; text-align: center;"
 
|-style = "vertical-align: top; text-align: center;"
|[[Version 2.15|2.15.4]]||2961s <br>(49m 21s)<sup>a</sup>||1247 s<sup>a</sup>||20 114 643||37 515||2 612||2 607||6.92||765||302||13.7||6.31||||[[Version 2.15]]
+
|[[Version 2.15|2.15.4]]||2961 <br>(49m 21s)<sup>a</sup>||1247<sup>a</sup>||20 114 643||37 515||2 612||2 607||6.92||765||302||13.7||6.31||||[[Version 2.15]]
 
|-style = "vertical-align: top; text-align: center;"
 
|-style = "vertical-align: top; text-align: center;"
|[[Version 2.14|2.14]]||2861s <br>(48m 41s)<sup>a</sup>||1132 s<sup>a</sup>||20 060 196||37 412||2 685||2 633||7.33||748||340||13.7||6.25||||[[Version 2.14]]
+
|[[Version 2.14|2.14]]||2861 <br>(48m 41s)<sup>a</sup>||1132<sup>a</sup>||20 060 196||37 412||2 685||2 633||7.33||748||340||13.7||6.25||||[[Version 2.14]]
 
|-style = "vertical-align: top; text-align: center;"
 
|-style = "vertical-align: top; text-align: center;"
|[[Version 2.13|2.13]]||2894s <br>(48m 14s)<sup>a</sup>||1038 s<sup>a</sup>||19 997 049||37 365||2 685||2 633||7.33||748||340||13.7||6.25||||[[Version 2.13]]
+
|[[Version 2.13|2.13]]||2894 <br>(48m 14s)<sup>a</sup>||1038<sup>a</sup>||19 997 049||37 365||2 685||2 633||7.33||748||340||13.7||6.25||||[[Version 2.13]]
 
|-style = "vertical-align: top; text-align: center;"
 
|-style = "vertical-align: top; text-align: center;"
|[[Version 2.12|2.12.3]]            || ||1010 s<sup>a</sup>||20 081 186||37 527||2 681||2 622||7.35||748||331||13.6||6.23||Increased npv: New bucking algorithm, bug fixed ||[[Version 2.12]]
+
|[[Version 2.12|2.12.3]]            || ||1010<sup>a</sup>||20 081 186||37 527||2 681||2 622||7.35||748||331||13.6||6.23||Increased npv: New bucking algorithm, bug fixed ||[[Version 2.12]]
 
|-style = "vertical-align: top; text-align: center;"
 
|-style = "vertical-align: top; text-align: center;"
|[[Version 2.12|2.12.3<sup>c</sup>]]|| ||983s<sup>a</sup>||19 915 687||37 207||2 713||2 637||7.36||718||376||13.3||6.25||Understorey cleaning inactivated||[[Version 2.12]]
+
|[[Version 2.12|2.12.3<sup>c</sup>]]|| ||983<sup>a</sup>||19 915 687||37 207||2 713||2 637||7.36||718||376||13.3||6.25||Understorey cleaning inactivated||[[Version 2.12]]
 
<!--
 
<!--
 
|-style = "vertical-align: top; text-align: center;"
 
|-style = "vertical-align: top; text-align: center;"
|[[Version 2.12|2.12.0]]||2729s <br>(45m 29s)<sup>a</sup>|| ||19 592 678||36 614||2 694||2 622||7.35||745||331||13.6||6.24||||[[Version 2.12]]
+
|[[Version 2.12|2.12.0]]||2729 <br>(45m 29s)<sup>a</sup>|| ||19 592 678||36 614||2 694||2 622||7.35||745||331||13.6||6.24||||[[Version 2.12]]
 
-->
 
-->
<!--||[[Version 2.11|2.11<sup>b</sup>]]||2654s <br>(44m 14s)<sup>a</sup>||1674<sup>a</sup>||19 704 953||36 821||2 684||2 610||7.35||754||320||13.8||6.23||[[Version 2.11]]-->
+
<!--||[[Version 2.11|2.11<sup>b</sup>]]||2654 <br>(44m 14s)<sup>a</sup>||1674<sup>a</sup>||19 704 953||36 821||2 684||2 610||7.35||754||320||13.8||6.23||[[Version 2.11]]-->
<!--|[[Version 2.11|2.11<sup>b</sup>]]||983s <br>(43m 25s)<sup>a</sup>||<sup>a</sup>||19 719 149||36 849||2 675||2 648||7.36||744||331||12.6||6.23||[[Version 2.11]]-->
+
<!--|[[Version 2.11|2.11<sup>b</sup>]]||983 <br>(43m 25s)<sup>a</sup>||<sup>a</sup>||19 719 149||36 849||2 675||2 648||7.36||744||331||12.6||6.23||[[Version 2.11]]-->
<!--|[[Version 2.11|2.11<sup>b</sup>]]||2287s <br>(38m 7s)<sup>a</sup>||<sup>a</sup>||19 600 016||36 623||2 705||2 688||7.44||719||859||12.9||6.22||[[Version 2.11]]-->
+
<!--|[[Version 2.11|2.11<sup>b</sup>]]||2287 <br>(38m 7s)<sup>a</sup>||<sup>a</sup>||19 600 016||36 623||2 705||2 688||7.44||719||859||12.9||6.22||[[Version 2.11]]-->
 
|-style = "vertical-align: top; text-align: center;"
 
|-style = "vertical-align: top; text-align: center;"
 
|[[Version 2.11|2.11.1<sup>b</sup>]]||2483s <br>(41m 23s)<sup>a</sup>|| ||19 707 063||36 824||2 680||2 610||7.34||756||326||13.8||6.24||||[[Version 2.11]]
 
|[[Version 2.11|2.11.1<sup>b</sup>]]||2483s <br>(41m 23s)<sup>a</sup>|| ||19 707 063||36 824||2 680||2 610||7.34||756||326||13.8||6.24||||[[Version 2.11]]

Revision as of 13:29, 8 June 2020


Here we present a comparison between different versions for a benchmark problem run in PlanWise. We call this problem Hexagons1000, it can be downloaded from here. The problem consists of one thousand simulated treatment units. The results refer to an optimization with simple even-flow constraints. The TPG-simulation includes nine forest domains and the somewhat time-consuming breeding model is activated. For each treatment unit managed with even-aged management a nature conservation retention patch is created resulting in a total of ? units. The forest is a simulated but realistic landscape with respect to age classes, site fertilities and tree species distribution.

The comparison is intended to present to users a simple form of quality and status check and give some insigth into what can be expected. Net present value is an excellent indicator for whether there has been any model changes, since it basically depends on everything calculated by the growth-and-yield simulator.

This page was/is first published with version 2.11. We intend to run the benchmark problem for each major version released.

Version TPG-time, 1 CPU-core (s) TPG-time, 8 CPU-cores (s) Total NPV NPV/ha within managed area Final felling volume per year, all periods (m3sk/ha,yr) Final felling volume period 1 (m3sk/ha,yr) Final felling area per year, all periods (m3sk/ha,yr) Thinning volume per year, all periods (m3sk/ha,yr) Thinning volume per year, period 1 (m3sk/ha,yr) Thinning area per year, all periods (m3sk/ha,yr) Total production (m3sk/ha,yr) Comment Release notes
2.15.4 2961
(49m 21s)a
1247a 20 114 643 37 515 2 612 2 607 6.92 765 302 13.7 6.31 Version 2.15
2.14 2861
(48m 41s)a
1132a 20 060 196 37 412 2 685 2 633 7.33 748 340 13.7 6.25 Version 2.14
2.13 2894
(48m 14s)a
1038a 19 997 049 37 365 2 685 2 633 7.33 748 340 13.7 6.25 Version 2.13
2.12.3 1010a 20 081 186 37 527 2 681 2 622 7.35 748 331 13.6 6.23 Increased npv: New bucking algorithm, bug fixed Version 2.12
2.12.3c 983a 19 915 687 37 207 2 713 2 637 7.36 718 376 13.3 6.25 Understorey cleaning inactivated Version 2.12
2.11.1b 2483s
(41m 23s)a
19 707 063 36 824 2 680 2 610 7.34 756 326 13.8 6.24 Version 2.11
2.10 2532s
(42m 12s)a
- 19 606 195 36 624 2 711 2 652 7.40 697 403 11.5 6.20 Version 2.10
2.8.0 2360s
(39m 20s)a
- 19 652 164 36 712 2 724 2 652 7.40 713 389 11.7 6.29 Version 2.8.0
2.6.0 2370s
(40m 30s)a
- 19 634 926 36 679 2 724 2 652 7.40 713 389 11.7 6.29 Version 2.6.0

aWindows 7, Processor Intel I7-4770, 8-core, 32GB RAM. Samsung SSD 840 EVO. SQL Server 2012 Prof.
bWith Thinning Period Delay Max = 2 and 0 in generation 1 and 2, respectively.
cWith understorey cleaning inactivated.