Results for ST-D Track

Click here to see aggregated results for the ST-D track or go back to all results.

In the tables below we provide an overview of the solvers' performance for each problem. The column Solver, #Corr, #Cra, #Inc, #Fail, #Inv, #TO, #OOM, Time, Memory, Score corresponds to: name of the solver, number of correct answers, number of crashes, number of incorrect answers, number of failures, number of invalid answers, number of timeouts, number of out of memory, running time (total), used memory (max) and final score, respectively. In detail, #Cra refers to the number of times the solver crashed due to memory issues, #Fail are all those runs that did not produce an answer (e.g., because of timeouts), #Inc refers to syntactically correct, but wrong, answers, and #Inv is the number of syntactically incorrect answers.

SE-ST-D
Solver #Corr #Cra #Inc #Fail #Inv #TO #OOM Time Memory Score
coquiaas 305 0 20 0 0 1 0 1392.604 91172864 205
mu-toksia 326 0 0 0 0 0 0 1103.307 67391488 326
pyglaf 265 0 61 0 0 0 0 1125.505 408903680 -40

SE-ST-D detailed results

EE-ST-D
Solver #Corr #Cra #Inc #Fail #Inv #TO #OOM Time Memory Score
coquiaas 324 0 0 0 0 2 0 2978.907 93192192 324
mu-toksia 324 0 0 0 0 2 0 3041.083 80138240 324
pyglaf 224 0 100 0 0 2 0 3118.970 99147776 -276

EE-ST-D detailed results

DC-ST-D
Solver #Corr #Cra #Inc #Fail #Inv #TO #OOM Time Memory Score
coquiaas 326 0 0 0 0 0 0 322.382 3059712 326
mu-toksia 326 0 0 0 0 0 0 1056.926 408182784 326
pyglaf 313 0 13 0 0 0 0 1064.172 85327872 248

DC-ST-D detailed results

DS-ST-D
Solver #Corr #Cra #Inc #Fail #Inv #TO #OOM Time Memory Score
coquiaas 325 0 0 0 0 1 0 1479.013 93065216 325
mu-toksia 326 0 0 0 0 0 0 1081.253 409522176 326
pyglaf 302 0 24 0 0 0 0 1185.033 85516288 182

DS-ST-D detailed results