miloignis/kraken
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Most things seem to be working now, with new benchmarks. Not sure if a small memory leak is now or was there before

Browse Source
This commit is contained in:
Nathan Braswell
2022-06-23 01:00:27 -04:00
parent 04f3b2dbd9
commit ae320ba31b
15 changed files with 177 additions and 92 deletions
Download Patch File Download Diff File Expand all files Collapse all files

62
koka_bench/benchmarks.md
View File

@@ -4,13 +4,13 @@
| Command | Mean [ms] | Min [ms] | Max [ms] | Relative |
|:---|---:|---:|---:|---:|
| `build/kraken/out/bench/kraken-cfold 5` | 24.5 ± 0.7 | 22.9 | 26.7 | 49.60 ± 32.45 |
| `build/java/out/bench/cfold 5` | 73.3 ± 7.0 | 59.0 | 84.9 | 148.58 ± 98.14 |
| `build/ocaml/ml-cfold 5` | 0.5 ± 0.3 | 0.2 | 2.2 | 1.00 |
| `build/swift/sw-cfold 5` | 2.2 ± 0.5 | 1.7 | 3.7 | 4.40 ± 3.04 |
| `build/cpp/cpp-cfold 5` | 0.9 ± 0.4 | 0.5 | 2.9 | 1.79 ± 1.46 |
| `build/haskell/hs-cfold 5` | 0.8 ± 0.4 | 0.5 | 2.6 | 1.53 ± 1.23 |
| `build/koka/out/bench/kk-cfold 5` | 0.5 ± 0.4 | 0.2 | 2.2 | 1.07 ± 1.06 |
| `build/kraken/out/bench/kraken-cfold 5` | 25.6 ± 1.0 | 24.1 | 28.2 | 55.79 ± 44.22 |
| `build/java/out/bench/cfold 5` | 73.8 ± 8.0 | 60.1 | 87.3 | 160.57 ± 128.30 |
| `build/ocaml/ml-cfold 5` | 0.6 ± 0.5 | 0.2 | 3.2 | 1.27 ± 1.43 |
| `build/swift/sw-cfold 5` | 2.0 ± 0.5 | 1.7 | 4.4 | 4.44 ± 3.67 |
| `build/cpp/cpp-cfold 5` | 0.9 ± 0.4 | 0.5 | 3.3 | 1.90 ± 1.76 |
| `build/haskell/hs-cfold 5` | 0.8 ± 0.4 | 0.5 | 3.8 | 1.77 ± 1.65 |
| `build/koka/out/bench/kk-cfold 5` | 0.5 ± 0.4 | 0.2 | 2.8 | 1.00 |
@@ -18,28 +18,28 @@
| Command | Mean [s] | Min [s] | Max [s] | Relative |
|:---|---:|---:|---:|---:|
| `build/kraken/out/bench/kraken-deriv 8` | 3.544 ± 0.007 | 3.537 | 3.559 | 243.49 ± 8.16 |
| `build/java/out/bench/deriv 8` | 0.117 ± 0.021 | 0.084 | 0.132 | 8.07 ± 1.44 |
| `build/ocaml/ml-deriv 8` | 0.015 ± 0.000 | 0.014 | 0.017 | 1.00 |
| `build/swift/sw-deriv 8` | 0.037 ± 0.001 | 0.036 | 0.039 | 2.54 ± 0.09 |
| `build/cpp/cpp-deriv 8` | 0.020 ± 0.001 | 0.020 | 0.024 | 1.41 ± 0.06 |
| `build/haskell/hs-deriv 8` | 0.036 ± 0.001 | 0.035 | 0.037 | 2.45 ± 0.09 |
| `build/koka/out/bench/kk-deriv 8` | 0.017 ± 0.001 | 0.016 | 0.019 | 1.16 ± 0.06 |
| `build/kraken/out/bench/kraken-deriv 8` | 3.228 ± 0.017 | 3.203 | 3.253 | 214.05 ± 14.08 |
| `build/java/out/bench/deriv 8` | 0.116 ± 0.019 | 0.087 | 0.130 | 7.68 ± 1.37 |
| `build/ocaml/ml-deriv 8` | 0.015 ± 0.001 | 0.014 | 0.018 | 1.00 |
| `build/swift/sw-deriv 8` | 0.038 ± 0.001 | 0.036 | 0.040 | 2.51 ± 0.18 |
| `build/cpp/cpp-deriv 8` | 0.021 ± 0.001 | 0.020 | 0.024 | 1.40 ± 0.11 |
| `build/haskell/hs-deriv 8` | 0.036 ± 0.001 | 0.035 | 0.039 | 2.41 ± 0.17 |
| `build/koka/out/bench/kk-deriv 8` | 0.017 ± 0.001 | 0.016 | 0.019 | 1.11 ± 0.08 |
## rbnqueens_table.md
## nqueens_table.md
| Command | Mean [s] | Min [s] | Max [s] | Relative |
|:---|---:|---:|---:|---:|
| `build/kraken/out/bench/kraken-nqueens 10` | 2.231 ± 0.020 | 2.196 | 2.262 | 519.42 ± 46.07 |
| `build/java/out/bench/nqueens 10` | 0.058 ± 0.006 | 0.053 | 0.068 | 13.51 ± 1.78 |
| `build/ocaml/ml-nqueens 10` | 0.005 ± 0.000 | 0.004 | 0.007 | 1.07 ± 0.15 |
| `build/swift/sw-nqueens 10` | 0.016 ± 0.001 | 0.015 | 0.018 | 3.76 ± 0.36 |
| `build/cpp/cpp-nqueens 10` | 0.006 ± 0.001 | 0.006 | 0.008 | 1.43 ± 0.18 |
| `build/haskell/hs-nqueens 10` | 0.035 ± 0.001 | 0.035 | 0.037 | 8.26 ± 0.74 |
| `build/koka/out/bench/kk-nqueens 10` | 0.004 ± 0.000 | 0.004 | 0.006 | 1.00 |
| `build/koka/out/bench/kk-nqueens-int 10` | 0.007 ± 0.001 | 0.006 | 0.008 | 1.55 ± 0.19 |
| `build/kraken/out/bench/kraken-nqueens 10` | 2.062 ± 0.010 | 2.052 | 2.083 | 469.37 ± 56.39 |
| `build/java/out/bench/nqueens 10` | 0.058 ± 0.005 | 0.054 | 0.071 | 13.29 ± 1.92 |
| `build/ocaml/ml-nqueens 10` | 0.005 ± 0.001 | 0.004 | 0.007 | 1.06 ± 0.18 |
| `build/swift/sw-nqueens 10` | 0.016 ± 0.001 | 0.015 | 0.018 | 3.63 ± 0.47 |
| `build/cpp/cpp-nqueens 10` | 0.006 ± 0.000 | 0.006 | 0.008 | 1.34 ± 0.19 |
| `build/haskell/hs-nqueens 10` | 0.036 ± 0.001 | 0.035 | 0.037 | 8.09 ± 0.98 |
| `build/koka/out/bench/kk-nqueens 10` | 0.004 ± 0.001 | 0.004 | 0.006 | 1.00 |
| `build/koka/out/bench/kk-nqueens-int 10` | 0.006 ± 0.000 | 0.006 | 0.008 | 1.47 ± 0.21 |
@@ -47,14 +47,14 @@
| Command | Mean [s] | Min [s] | Max [s] | Relative |
|:---|---:|---:|---:|---:|
| `build/kraken/out/bench/kraken-rbtree-opt 42000` | 3.806 ± 0.016 | 3.784 | 3.826 | 847.67 ± 62.79 |
| `build/kraken/out/bench/kraken-rbtree 42000` | 4.092 ± 0.010 | 4.071 | 4.107 | 911.31 ± 67.43 |
| `build/java/out/bench/rbtree 42000` | 0.089 ± 0.017 | 0.076 | 0.131 | 19.78 ± 4.04 |
| `build/ocaml/ml-rbtree 42000` | 0.008 ± 0.000 | 0.008 | 0.010 | 1.81 ± 0.15 |
| `build/swift/sw-rbtree 42000` | 0.040 ± 0.000 | 0.039 | 0.041 | 8.80 ± 0.66 |
| `build/cpp/cpp-rbtree 42000` | 0.005 ± 0.000 | 0.005 | 0.007 | 1.20 ± 0.12 |
| `build/haskell/hs-rbtree 42000` | 0.016 ± 0.000 | 0.016 | 0.018 | 3.55 ± 0.27 |
| `build/koka/out/bench/kk-rbtree 42000` | 0.004 ± 0.000 | 0.004 | 0.007 | 1.00 |
| `build/kraken/out/bench/kraken-rbtree-opt 42000` | 3.469 ± 0.019 | 3.448 | 3.506 | 734.95 ± 106.54 |
| `build/kraken/out/bench/kraken-rbtree 42000` | 3.693 ± 0.008 | 3.680 | 3.706 | 782.55 ± 113.38 |
| `build/java/out/bench/rbtree 42000` | 0.084 ± 0.006 | 0.078 | 0.096 | 17.89 ± 2.90 |
| `build/ocaml/ml-rbtree 42000` | 0.008 ± 0.001 | 0.008 | 0.010 | 1.72 ± 0.27 |
| `build/swift/sw-rbtree 42000` | 0.040 ± 0.001 | 0.039 | 0.041 | 8.42 ± 1.23 |
| `build/cpp/cpp-rbtree 42000` | 0.006 ± 0.000 | 0.005 | 0.007 | 1.22 ± 0.20 |
| `build/haskell/hs-rbtree 42000` | 0.016 ± 0.001 | 0.016 | 0.018 | 3.42 ± 0.51 |
| `build/koka/out/bench/kk-rbtree 42000` | 0.005 ± 0.001 | 0.004 | 0.008 | 1.00 |

8
koka_bench/cfold_table.csv Normal file
View File

@@ -0,0 +1,8 @@
command,mean,stddev,median,user,system,min,max
build/kraken/out/bench/kraken-cfold 5,0.02562897340388349,0.0009520618410776399,0.0255029492,0.014165720388349514,0.011792151067961163,0.0240603252,0.0282042272
build/java/out/bench/cfold 5,0.07375791849411763,0.008007022200894338,0.0723335942,0.048192811764705884,0.026958049411764697,0.060136039200000005,0.0872864162
build/ocaml/ml-cfold 5,0.0005854921554655877,0.00046821988456268994,0.0004509592000000004,0.00034780809716599196,0.000501115587044535,0.0002351412000000004,0.0031937252
build/swift/sw-cfold 5,0.002040977496671491,0.000484474036468368,0.0018989612000000007,0.001081040520984081,0.000974334008683068,0.0016933402000000003,0.004358859200000001
build/cpp/cpp-cfold 5,0.0008722757410497984,0.0004229790434446341,0.0007600172000000005,0.0005614333781965008,0.0004325299596231499,0.0005491592000000005,0.0032984202000000003
build/haskell/hs-cfold 5,0.0008136906898236097,0.0003997243854159998,0.0007139912000000003,0.00042144314789687945,0.0005508697964721847,0.0004976152000000004,0.0038017152000000003
build/koka/out/bench/kk-cfold 5,0.00045934301538461597,0.0003636110244086866,0.00036470120000000033,0.00029318721893491125,0.000447628023668639,0.00017556420000000052,0.0027541282000000003
1 command mean stddev median user system min max
2 build/kraken/out/bench/kraken-cfold 5 0.02562897340388349 0.0009520618410776399 0.0255029492 0.014165720388349514 0.011792151067961163 0.0240603252 0.0282042272
3 build/java/out/bench/cfold 5 0.07375791849411763 0.008007022200894338 0.0723335942 0.048192811764705884 0.026958049411764697 0.060136039200000005 0.0872864162
4 build/ocaml/ml-cfold 5 0.0005854921554655877 0.00046821988456268994 0.0004509592000000004 0.00034780809716599196 0.000501115587044535 0.0002351412000000004 0.0031937252
5 build/swift/sw-cfold 5 0.002040977496671491 0.000484474036468368 0.0018989612000000007 0.001081040520984081 0.000974334008683068 0.0016933402000000003 0.004358859200000001
6 build/cpp/cpp-cfold 5 0.0008722757410497984 0.0004229790434446341 0.0007600172000000005 0.0005614333781965008 0.0004325299596231499 0.0005491592000000005 0.0032984202000000003
7 build/haskell/hs-cfold 5 0.0008136906898236097 0.0003997243854159998 0.0007139912000000003 0.00042144314789687945 0.0005508697964721847 0.0004976152000000004 0.0038017152000000003
8 build/koka/out/bench/kk-cfold 5 0.00045934301538461597 0.0003636110244086866 0.00036470120000000033 0.00029318721893491125 0.000447628023668639 0.00017556420000000052 0.0027541282000000003

14
koka_bench/cfold_table.md
View File

@@ -1,9 +1,9 @@
| Command | Mean [ms] | Min [ms] | Max [ms] | Relative |
|:---|---:|---:|---:|---:|
| `build/kraken/out/bench/kraken-cfold 5` | 24.5 ± 0.7 | 22.9 | 26.7 | 49.60 ± 32.45 |
| `build/java/out/bench/cfold 5` | 73.3 ± 7.0 | 59.0 | 84.9 | 148.58 ± 98.14 |
| `build/ocaml/ml-cfold 5` | 0.5 ± 0.3 | 0.2 | 2.2 | 1.00 |
| `build/swift/sw-cfold 5` | 2.2 ± 0.5 | 1.7 | 3.7 | 4.40 ± 3.04 |
| `build/cpp/cpp-cfold 5` | 0.9 ± 0.4 | 0.5 | 2.9 | 1.79 ± 1.46 |
| `build/haskell/hs-cfold 5` | 0.8 ± 0.4 | 0.5 | 2.6 | 1.53 ± 1.23 |
| `build/koka/out/bench/kk-cfold 5` | 0.5 ± 0.4 | 0.2 | 2.2 | 1.07 ± 1.06 |
| `build/kraken/out/bench/kraken-cfold 5` | 25.6 ± 1.0 | 24.1 | 28.2 | 55.79 ± 44.22 |
| `build/java/out/bench/cfold 5` | 73.8 ± 8.0 | 60.1 | 87.3 | 160.57 ± 128.30 |
| `build/ocaml/ml-cfold 5` | 0.6 ± 0.5 | 0.2 | 3.2 | 1.27 ± 1.43 |
| `build/swift/sw-cfold 5` | 2.0 ± 0.5 | 1.7 | 4.4 | 4.44 ± 3.67 |
| `build/cpp/cpp-cfold 5` | 0.9 ± 0.4 | 0.5 | 3.3 | 1.90 ± 1.76 |
| `build/haskell/hs-cfold 5` | 0.8 ± 0.4 | 0.5 | 3.8 | 1.77 ± 1.65 |
| `build/koka/out/bench/kk-cfold 5` | 0.5 ± 0.4 | 0.2 | 2.8 | 1.00 |

8
koka_bench/deriv_table.csv Normal file
View File

@@ -0,0 +1,8 @@
command,mean,stddev,median,user,system,min,max
build/kraken/out/bench/kraken-deriv 8,3.2278413210000005,0.01740767902347089,3.2292905841,3.1933452399999998,0.034257739999999995,3.2032992866,3.2526236876
build/java/out/bench/deriv 8,0.11575835400909094,0.019273262978641733,0.1296745351,0.1085655309090909,0.0349266309090909,0.0865353106,0.1304724306
build/ocaml/ml-deriv 8,0.015079505629761902,0.000988614891785227,0.014482082600000001,0.011475791190476191,0.003446659047619047,0.014101573600000002,0.017913019600000003
build/swift/sw-deriv 8,0.03784740196986301,0.001178346124819509,0.0380796456,0.03128894684931507,0.006363245479452052,0.0362137686,0.0399911296
build/cpp/cpp-deriv 8,0.021125210100000003,0.0009919750766619636,0.020724476600000003,0.014509170158730164,0.006452071746031745,0.020067840600000005,0.023549971600000004
build/haskell/hs-deriv 8,0.03628143836315791,0.0010901249926841099,0.0362098916,0.030539703157894737,0.0055724873684210524,0.0349043376,0.0387515426
build/koka/out/bench/kk-deriv 8,0.016795120068085104,0.0006510275545281206,0.016391751600000004,0.013538170496453896,0.003110167659574467,0.016115728600000004,0.019036247600000004
1 command mean stddev median user system min max
2 build/kraken/out/bench/kraken-deriv 8 3.2278413210000005 0.01740767902347089 3.2292905841 3.1933452399999998 0.034257739999999995 3.2032992866 3.2526236876
3 build/java/out/bench/deriv 8 0.11575835400909094 0.019273262978641733 0.1296745351 0.1085655309090909 0.0349266309090909 0.0865353106 0.1304724306
4 build/ocaml/ml-deriv 8 0.015079505629761902 0.000988614891785227 0.014482082600000001 0.011475791190476191 0.003446659047619047 0.014101573600000002 0.017913019600000003
5 build/swift/sw-deriv 8 0.03784740196986301 0.001178346124819509 0.0380796456 0.03128894684931507 0.006363245479452052 0.0362137686 0.0399911296
6 build/cpp/cpp-deriv 8 0.021125210100000003 0.0009919750766619636 0.020724476600000003 0.014509170158730164 0.006452071746031745 0.020067840600000005 0.023549971600000004
7 build/haskell/hs-deriv 8 0.03628143836315791 0.0010901249926841099 0.0362098916 0.030539703157894737 0.0055724873684210524 0.0349043376 0.0387515426
8 build/koka/out/bench/kk-deriv 8 0.016795120068085104 0.0006510275545281206 0.016391751600000004 0.013538170496453896 0.003110167659574467 0.016115728600000004 0.019036247600000004

14
koka_bench/deriv_table.md
View File

@@ -1,9 +1,9 @@
| Command | Mean [s] | Min [s] | Max [s] | Relative |
|:---|---:|---:|---:|---:|
| `build/kraken/out/bench/kraken-deriv 8` | 3.544 ± 0.007 | 3.537 | 3.559 | 243.49 ± 8.16 |
| `build/java/out/bench/deriv 8` | 0.117 ± 0.021 | 0.084 | 0.132 | 8.07 ± 1.44 |
| `build/ocaml/ml-deriv 8` | 0.015 ± 0.000 | 0.014 | 0.017 | 1.00 |
| `build/swift/sw-deriv 8` | 0.037 ± 0.001 | 0.036 | 0.039 | 2.54 ± 0.09 |
| `build/cpp/cpp-deriv 8` | 0.020 ± 0.001 | 0.020 | 0.024 | 1.41 ± 0.06 |
| `build/haskell/hs-deriv 8` | 0.036 ± 0.001 | 0.035 | 0.037 | 2.45 ± 0.09 |
| `build/koka/out/bench/kk-deriv 8` | 0.017 ± 0.001 | 0.016 | 0.019 | 1.16 ± 0.06 |
| `build/kraken/out/bench/kraken-deriv 8` | 3.228 ± 0.017 | 3.203 | 3.253 | 214.05 ± 14.08 |
| `build/java/out/bench/deriv 8` | 0.116 ± 0.019 | 0.087 | 0.130 | 7.68 ± 1.37 |
| `build/ocaml/ml-deriv 8` | 0.015 ± 0.001 | 0.014 | 0.018 | 1.00 |
| `build/swift/sw-deriv 8` | 0.038 ± 0.001 | 0.036 | 0.040 | 2.51 ± 0.18 |
| `build/cpp/cpp-deriv 8` | 0.021 ± 0.001 | 0.020 | 0.024 | 1.40 ± 0.11 |
| `build/haskell/hs-deriv 8` | 0.036 ± 0.001 | 0.035 | 0.039 | 2.41 ± 0.17 |
| `build/koka/out/bench/kk-deriv 8` | 0.017 ± 0.001 | 0.016 | 0.019 | 1.11 ± 0.08 |

9
koka_bench/nqueens_table.csv Normal file
View File

@@ -0,0 +1,9 @@
command,mean,stddev,median,user,system,min,max
build/kraken/out/bench/kraken-nqueens 10,2.0623166218,0.009551074111895983,2.0593069393,2.0404727799999995,0.021842060000000003,2.0515997523,2.0832831273
build/java/out/bench/nqueens 10,0.058406372299999995,0.004717987460124654,0.056508992800000005,0.03985344,0.024372280000000007,0.0536264703,0.07064719330000001
build/ocaml/ml-nqueens 10,0.004651871207268172,0.0005441691344424572,0.0043773043,0.003691592030075187,0.0009462040601503759,0.0041315253,0.006795576300000001
build/swift/sw-nqueens 10,0.015954871960130724,0.0007302157757725501,0.015489802300000001,0.01415315908496732,0.0017036146405228763,0.0152392023,0.0184143013
build/cpp/cpp-nqueens 10,0.005883382779999997,0.00042399086689207344,0.005727175300000001,0.004907110666666666,0.0009156344000000003,0.0055121963,0.0079183153
build/haskell/hs-nqueens 10,0.03554869054358973,0.000685377529651524,0.035671864799999994,0.03316656205128205,0.0022590276923076928,0.0345012133,0.0373905103
build/koka/out/bench/kk-nqueens 10,0.004393838511538464,0.0005274648606533349,0.0041541883,0.00371527519230769,0.0007151098557692308,0.0039706043000000005,0.006415905300000001
build/koka/out/bench/kk-nqueens-int 10,0.006443239216666666,0.0004909501447786628,0.0062072118,0.005793044880952378,0.0006946066071428573,0.0060473403,0.0080550003
1 command mean stddev median user system min max
2 build/kraken/out/bench/kraken-nqueens 10 2.0623166218 0.009551074111895983 2.0593069393 2.0404727799999995 0.021842060000000003 2.0515997523 2.0832831273
3 build/java/out/bench/nqueens 10 0.058406372299999995 0.004717987460124654 0.056508992800000005 0.03985344 0.024372280000000007 0.0536264703 0.07064719330000001
4 build/ocaml/ml-nqueens 10 0.004651871207268172 0.0005441691344424572 0.0043773043 0.003691592030075187 0.0009462040601503759 0.0041315253 0.006795576300000001
5 build/swift/sw-nqueens 10 0.015954871960130724 0.0007302157757725501 0.015489802300000001 0.01415315908496732 0.0017036146405228763 0.0152392023 0.0184143013
6 build/cpp/cpp-nqueens 10 0.005883382779999997 0.00042399086689207344 0.005727175300000001 0.004907110666666666 0.0009156344000000003 0.0055121963 0.0079183153
7 build/haskell/hs-nqueens 10 0.03554869054358973 0.000685377529651524 0.035671864799999994 0.03316656205128205 0.0022590276923076928 0.0345012133 0.0373905103
8 build/koka/out/bench/kk-nqueens 10 0.004393838511538464 0.0005274648606533349 0.0041541883 0.00371527519230769 0.0007151098557692308 0.0039706043000000005 0.006415905300000001
9 build/koka/out/bench/kk-nqueens-int 10 0.006443239216666666 0.0004909501447786628 0.0062072118 0.005793044880952378 0.0006946066071428573 0.0060473403 0.0080550003

10
koka_bench/nqueens_table.md Normal file
View File

@@ -0,0 +1,10 @@
| Command | Mean [s] | Min [s] | Max [s] | Relative |
|:---|---:|---:|---:|---:|
| `build/kraken/out/bench/kraken-nqueens 10` | 2.062 ± 0.010 | 2.052 | 2.083 | 469.37 ± 56.39 |
| `build/java/out/bench/nqueens 10` | 0.058 ± 0.005 | 0.054 | 0.071 | 13.29 ± 1.92 |
| `build/ocaml/ml-nqueens 10` | 0.005 ± 0.001 | 0.004 | 0.007 | 1.06 ± 0.18 |
| `build/swift/sw-nqueens 10` | 0.016 ± 0.001 | 0.015 | 0.018 | 3.63 ± 0.47 |
| `build/cpp/cpp-nqueens 10` | 0.006 ± 0.000 | 0.006 | 0.008 | 1.34 ± 0.19 |
| `build/haskell/hs-nqueens 10` | 0.036 ± 0.001 | 0.035 | 0.037 | 8.09 ± 0.98 |
| `build/koka/out/bench/kk-nqueens 10` | 0.004 ± 0.001 | 0.004 | 0.006 | 1.00 |
| `build/koka/out/bench/kk-nqueens-int 10` | 0.006 ± 0.000 | 0.006 | 0.008 | 1.47 ± 0.21 |

10
koka_bench/rbnqueens_table.md
View File

@@ -1,10 +0,0 @@
| Command | Mean [s] | Min [s] | Max [s] | Relative |
|:---|---:|---:|---:|---:|
| `build/kraken/out/bench/kraken-nqueens 10` | 2.231 ± 0.020 | 2.196 | 2.262 | 519.42 ± 46.07 |
| `build/java/out/bench/nqueens 10` | 0.058 ± 0.006 | 0.053 | 0.068 | 13.51 ± 1.78 |
| `build/ocaml/ml-nqueens 10` | 0.005 ± 0.000 | 0.004 | 0.007 | 1.07 ± 0.15 |
| `build/swift/sw-nqueens 10` | 0.016 ± 0.001 | 0.015 | 0.018 | 3.76 ± 0.36 |
| `build/cpp/cpp-nqueens 10` | 0.006 ± 0.001 | 0.006 | 0.008 | 1.43 ± 0.18 |
| `build/haskell/hs-nqueens 10` | 0.035 ± 0.001 | 0.035 | 0.037 | 8.26 ± 0.74 |
| `build/koka/out/bench/kk-nqueens 10` | 0.004 ± 0.000 | 0.004 | 0.006 | 1.00 |
| `build/koka/out/bench/kk-nqueens-int 10` | 0.007 ± 0.001 | 0.006 | 0.008 | 1.55 ± 0.19 |

9
koka_bench/rbtree_table.csv Normal file
View File

@@ -0,0 +1,9 @@
command,mean,stddev,median,user,system,min,max
build/kraken/out/bench/kraken-rbtree-opt 42000,3.46882649514,0.01903535508844727,3.4655251397399995,3.4344475799999996,0.034409779999999994,3.44774203324,3.50553504124
build/kraken/out/bench/kraken-rbtree 42000,3.6934906713399998,0.008160826758533175,3.69500928224,3.6555425799999997,0.037479280000000004,3.68017488424,3.70586504524
build/java/out/bench/rbtree 42000,0.08445577785290326,0.006087159234810223,0.08117201724,0.06655999612903225,0.036940318709677414,0.07817578924,0.09571070124
build/ocaml/ml-rbtree 42000,0.00810715936903226,0.0005055780395698214,0.00790811624,0.006620512258064516,0.0013864070250896056,0.00766806324,0.00988651224
build/swift/sw-rbtree 42000,0.039756660878888905,0.0007294635125545566,0.03978995624000001,0.037933354999999995,0.0016813694444444448,0.03880163224,0.04143620924000001
build/cpp/cpp-rbtree 42000,0.005756671334972069,0.0004074329682226229,0.00561958024,0.004820312402234635,0.0009325445810055876,0.00537530124,0.00726848724
build/haskell/hs-rbtree 42000,0.016128212874615383,0.0005819832136555488,0.01581796024,0.01375046717948718,0.0022519930769230776,0.015538341240000001,0.017788777239999998
build/koka/out/bench/kk-rbtree 42000,0.00471984031901907,0.0006837380803021701,0.00438226224,0.003706155749318801,0.0010151543324250687,0.00409234024,0.00789442624
1 command mean stddev median user system min max
2 build/kraken/out/bench/kraken-rbtree-opt 42000 3.46882649514 0.01903535508844727 3.4655251397399995 3.4344475799999996 0.034409779999999994 3.44774203324 3.50553504124
3 build/kraken/out/bench/kraken-rbtree 42000 3.6934906713399998 0.008160826758533175 3.69500928224 3.6555425799999997 0.037479280000000004 3.68017488424 3.70586504524
4 build/java/out/bench/rbtree 42000 0.08445577785290326 0.006087159234810223 0.08117201724 0.06655999612903225 0.036940318709677414 0.07817578924 0.09571070124
5 build/ocaml/ml-rbtree 42000 0.00810715936903226 0.0005055780395698214 0.00790811624 0.006620512258064516 0.0013864070250896056 0.00766806324 0.00988651224
6 build/swift/sw-rbtree 42000 0.039756660878888905 0.0007294635125545566 0.03978995624000001 0.037933354999999995 0.0016813694444444448 0.03880163224 0.04143620924000001
7 build/cpp/cpp-rbtree 42000 0.005756671334972069 0.0004074329682226229 0.00561958024 0.004820312402234635 0.0009325445810055876 0.00537530124 0.00726848724
8 build/haskell/hs-rbtree 42000 0.016128212874615383 0.0005819832136555488 0.01581796024 0.01375046717948718 0.0022519930769230776 0.015538341240000001 0.017788777239999998
9 build/koka/out/bench/kk-rbtree 42000 0.00471984031901907 0.0006837380803021701 0.00438226224 0.003706155749318801 0.0010151543324250687 0.00409234024 0.00789442624

16
koka_bench/rbtree_table.md
View File

@@ -1,10 +1,10 @@
| Command | Mean [s] | Min [s] | Max [s] | Relative |
|:---|---:|---:|---:|---:|
| `build/kraken/out/bench/kraken-rbtree-opt 42000` | 3.806 ± 0.016 | 3.784 | 3.826 | 847.67 ± 62.79 |
| `build/kraken/out/bench/kraken-rbtree 42000` | 4.092 ± 0.010 | 4.071 | 4.107 | 911.31 ± 67.43 |
| `build/java/out/bench/rbtree 42000` | 0.089 ± 0.017 | 0.076 | 0.131 | 19.78 ± 4.04 |
| `build/ocaml/ml-rbtree 42000` | 0.008 ± 0.000 | 0.008 | 0.010 | 1.81 ± 0.15 |
| `build/swift/sw-rbtree 42000` | 0.040 ± 0.000 | 0.039 | 0.041 | 8.80 ± 0.66 |
| `build/cpp/cpp-rbtree 42000` | 0.005 ± 0.000 | 0.005 | 0.007 | 1.20 ± 0.12 |
| `build/haskell/hs-rbtree 42000` | 0.016 ± 0.000 | 0.016 | 0.018 | 3.55 ± 0.27 |
| `build/koka/out/bench/kk-rbtree 42000` | 0.004 ± 0.000 | 0.004 | 0.007 | 1.00 |
| `build/kraken/out/bench/kraken-rbtree-opt 42000` | 3.469 ± 0.019 | 3.448 | 3.506 | 734.95 ± 106.54 |
| `build/kraken/out/bench/kraken-rbtree 42000` | 3.693 ± 0.008 | 3.680 | 3.706 | 782.55 ± 113.38 |
| `build/java/out/bench/rbtree 42000` | 0.084 ± 0.006 | 0.078 | 0.096 | 17.89 ± 2.90 |
| `build/ocaml/ml-rbtree 42000` | 0.008 ± 0.001 | 0.008 | 0.010 | 1.72 ± 0.27 |
| `build/swift/sw-rbtree 42000` | 0.040 ± 0.001 | 0.039 | 0.041 | 8.42 ± 1.23 |
| `build/cpp/cpp-rbtree 42000` | 0.006 ± 0.000 | 0.005 | 0.007 | 1.22 ± 0.20 |
| `build/haskell/hs-rbtree 42000` | 0.016 ± 0.001 | 0.016 | 0.018 | 3.42 ± 0.51 |
| `build/koka/out/bench/kk-rbtree 42000` | 0.005 ± 0.001 | 0.004 | 0.008 | 1.00 |