Click here to see aggregated results for the CO track or go back to all results.
In the tables below we provide an overview of the solvers' performance for each problem. The column Solver, #Corr, #Cra, #Inc, #Fail, #Inv, #TO, #OOM, Time, Memory, Score corresponds to: name of the solver, number of correct answers, number of crashes, number of incorrect answers, number of failures, number of ivalid answers, number of timeouts, number of out of memory running time (total), used memory (max) and final score, respectively. In detail, #Cra refers to the number of times the solver crashed due to memory issues, #Fail are all those runs that did not produce an answer (e.g., because of timeouts), #Inc refers to syntactically correct, but wrong, answers, and #Inv is the number of syntactically incorrect answers.
| SE-CO |
| Solver |
#Corr |
#Cra |
#Inc |
#Fail |
#Inv |
#TO |
#OOM |
Time |
Memory |
Score |
| aspartix19 |
326 |
0 |
0 |
0 |
0 |
0 |
0 |
461.339 |
3076096 |
326 |
| coquiaas |
326 |
0 |
0 |
0 |
0 |
0 |
0 |
316.436 |
3055616 |
326 |
| eqargsolver |
290 |
0 |
0 |
0 |
0 |
36 |
0 |
25385.926 |
474550272 |
290 |
| mace4-prover9 |
326 |
0 |
0 |
0 |
0 |
0 |
0 |
6577.692 |
951246848 |
326 |
| mu-toksia |
326 |
0 |
0 |
0 |
0 |
0 |
0 |
118.654 |
3055616 |
326 |
| pyglaf |
326 |
0 |
0 |
0 |
0 |
0 |
0 |
1003.521 |
410021888 |
326 |
| taas-dredd |
181 |
0 |
145 |
0 |
0 |
0 |
0 |
110.365 |
3055616 |
-544 |
| yonas |
326 |
0 |
0 |
0 |
0 |
0 |
0 |
2863.496 |
3059712 |
326 |
SE-CO detailed results
| EE-CO |
| Solver |
#Corr |
#Cra |
#Inc |
#Fail |
#Inv |
#TO |
#OOM |
Time |
Memory |
Score |
| aspartix19 |
326 |
0 |
0 |
0 |
0 |
0 |
0 |
1073.619 |
94019584 |
326 |
| coquiaas |
324 |
0 |
0 |
0 |
0 |
2 |
0 |
4072.310 |
969428992 |
324 |
| eqargsolver |
290 |
0 |
0 |
0 |
0 |
36 |
0 |
25396.562 |
474533888 |
290 |
| mu-toksia |
326 |
0 |
0 |
0 |
0 |
0 |
0 |
926.960 |
90816512 |
326 |
| pyglaf |
326 |
0 |
0 |
0 |
0 |
0 |
0 |
1650.462 |
50774016 |
326 |
| taas-dredd |
224 |
9 |
3 |
0 |
0 |
90 |
0 |
64831.779 |
99794944 |
73.810 |
| yonas |
301 |
0 |
0 |
0 |
0 |
18 |
7 |
180793.654 |
9999351808 |
136.829 |
EE-CO detailed results
| DC-CO |
| Solver |
#Corr |
#Cra |
#Inc |
#Fail |
#Inv |
#TO |
#OOM |
Time |
Memory |
Score |
| aspartix19 |
326 |
0 |
0 |
0 |
0 |
0 |
0 |
880.143 |
3080192 |
326 |
| coquiaas |
326 |
0 |
0 |
0 |
0 |
0 |
0 |
354.369 |
3051520 |
326 |
| eqargsolver |
293 |
0 |
0 |
0 |
0 |
33 |
0 |
23226.084 |
3059712 |
293 |
| mace4-prover9 |
326 |
0 |
0 |
0 |
0 |
0 |
0 |
7203.730 |
962494464 |
326 |
| mu-toksia |
326 |
0 |
0 |
0 |
0 |
0 |
0 |
144.566 |
3059712 |
326 |
| pyglaf |
326 |
0 |
0 |
0 |
0 |
0 |
0 |
1011.861 |
408543232 |
326 |
| taas-dredd |
261 |
1 |
50 |
0 |
0 |
14 |
0 |
12412.259 |
38858752 |
11 |
| yonas |
247 |
0 |
0 |
0 |
0 |
68 |
11 |
52208.594 |
9919496192 |
247 |
DC-CO detailed results
| DS-CO |
| Solver |
#Corr |
#Cra |
#Inc |
#Fail |
#Inv |
#TO |
#OOM |
Time |
Memory |
Score |
| aspartix19 |
326 |
0 |
0 |
0 |
0 |
0 |
0 |
458.097 |
3084288 |
326 |
| coquiaas |
326 |
0 |
0 |
0 |
0 |
0 |
0 |
316.922 |
3051520 |
326 |
| eqargsolver |
293 |
0 |
0 |
0 |
0 |
33 |
0 |
23235.964 |
3055616 |
293 |
| mace4-prover9 |
326 |
0 |
0 |
0 |
0 |
0 |
0 |
6585.139 |
951640064 |
326 |
| mu-toksia |
326 |
0 |
0 |
0 |
0 |
0 |
0 |
119.092 |
3059712 |
326 |
| pyglaf |
326 |
0 |
0 |
0 |
0 |
0 |
0 |
994.879 |
408698880 |
326 |
| taas-dredd |
321 |
0 |
5 |
0 |
0 |
0 |
0 |
107.806 |
3055616 |
296 |
| yonas |
326 |
0 |
0 |
0 |
0 |
0 |
0 |
2858.978 |
3059712 |
326 |
DS-CO detailed results