Results for ID Track

Click here to see aggregated results for the ID track or go back to all results.

In the tables below we provide an overview of the solvers' performance for each problem. The column Solver, #Corr, #Cra, #Inc, #Fail, #Inv, #TO, #OOM, Time, Memory, Score corresponds to: name of the solver, number of correct answers, number of crashes, number of incorrect answers, number of failures, number of invalid answers, number of timeouts, number of out of memory, running time (total), used memory (max) and final score, respectively. In detail, #Cra refers to the number of times the solver crashed due to memory issues, #Fail are all those runs that did not produce an answer (e.g., because of timeouts), #Inc refers to syntactically correct, but wrong, answers, and #Inv is the number of syntactically incorrect answers.

SE-ID
Solver #Corr #Cra #Inc #Fail #Inv #TO #OOM Time Memory Score
argpref 326 0 0 0 0 0 0 2123.678 46161920 326
aspartix19 323 0 0 0 0 3 0 3731.545 82718720 323
coquiaas 325 0 0 0 0 1 0 2495.888 86106112 325
mu-toksia 326 0 0 0 0 0 0 814.687 93466624 326
pyglaf 325 0 0 0 0 1 0 4215.493 82640896 325

SE-ID detailed results

DC-ID
Solver #Corr #Cra #Inc #Fail #Inv #TO #OOM Time Memory Score
argpref 326 0 0 0 0 0 0 2117.631 45895680 326
aspartix19 325 0 1 0 0 0 0 1500.707 823296000 320
coquiaas 326 0 0 0 0 0 0 1119.736 56238080 326
mu-toksia 326 0 0 0 0 0 0 779.923 93822976 326
pyglaf 325 0 0 0 0 1 0 3917.755 82391040 325

DC-ID detailed results