Results for CO-D Track

Click here to see aggregated results for the CO-D track or go back to all results.

In the tables below we provide an overview of the solvers' performance for each problem. The column Solver, #Corr, #Cra, #Inc, #Fail, #Inv, #TO, #OOM, Time, Memory, Score corresponds to: name of the solver, number of correct answers, number of crashes, number of incorrect answers, number of failures, number of ivalid answers, number of timeouts, number of out of memory running time (total), used memory (max) and final score, respectively. In detail, #Cra refers to the number of times the solver crashed due to memory issues, #Fail are all those runs that did not produce an answer (e.g., because of timeouts), #Inc refers to syntactically correct, but wrong, answers, and #Inv is the number of syntactically incorrect answers.

SE-CO-D
Solver #Corr #Cra #Inc #Fail #Inv #TO #OOM Time Memory Score
coquiaas 326 0 0 0 0 0 0 415.898 3059712 326
mu-toksia 326 0 0 0 0 0 0 991.753 69242880 326
pyglaf 275 0 51 0 0 0 0 957.432 409698304 20

SE-CO-D detailed results

EE-CO-D
Solver #Corr #Cra #Inc #Fail #Inv #TO #OOM Time Memory Score
coquiaas 317 0 0 0 0 9 0 11245.699 97075200 317
mu-toksia 323 0 0 0 1 2 0 4014.100 75563008 323
pyglaf 219 0 105 0 0 2 0 4091.292 97349632 -306

EE-CO-D detailed results

DC-CO-D
Solver #Corr #Cra #Inc #Fail #Inv #TO #OOM Time Memory Score
coquiaas 326 0 0 0 0 0 0 556.403 3055616 326
mu-toksia 326 0 0 0 0 0 0 998.394 409604096 326
pyglaf 313 0 13 0 0 0 0 1016.120 409165824 248

DC-CO-D detailed results

DS-CO-D
Solver #Corr #Cra #Inc #Fail #Inv #TO #OOM Time Memory Score
coquiaas 326 0 0 0 0 0 0 416.792 3055616 326
mu-toksia 326 0 0 0 0 0 0 945.012 409493504 326
pyglaf 307 0 19 0 0 0 0 976.008 409300992 212

DS-CO-D detailed results