Results for SST Track

Click here to see aggregated results for the SST track or go back to all results.

In the tables below we provide an overview of the solvers' performance for each problem. The column Solver, #Corr, #Cra, #Inc, #Fail, #Inv, #TO, #OOM, Time, Memory, Score corresponds to: name of the solver, number of correct answers, number of crashes, number of incorrect answers, number of failures, number of invalid answers, number of timeouts, number of out of memory, running time (total), used memory (max) and final score, respectively. In detail, #Cra refers to the number of times the solver crashed due to memory issues, #Fail are all those runs that did not produce an answer (e.g., because of timeouts), #Inc refers to syntactically correct, but wrong, answers, and #Inv is the number of syntactically incorrect answers.

SE-SST
Solver #Corr #Cra #Inc #Fail #Inv #TO #OOM Time Memory Score
aspartix19 326 0 0 0 0 0 0 833.221 57950208 326
coquiaas 325 0 0 0 0 1 0 1506.878 91082752 325
mu-toksia 326 0 0 0 0 0 0 352.503 62005248 326
pyglaf 326 0 0 0 0 0 0 1184.507 412131328 326

SE-SST detailed results

EE-SST
Solver #Corr #Cra #Inc #Fail #Inv #TO #OOM Time Memory Score
aspartix19 286 0 34 0 5 1 0 1743.688 47325184 101.699
coquiaas 324 0 0 0 0 2 0 2910.296 87916544 324
mu-toksia 325 0 0 0 0 1 0 2050.861 88989696 325
pyglaf 325 0 0 0 0 1 0 2857.294 92397568 325

EE-SST detailed results

DC-SST
Solver #Corr #Cra #Inc #Fail #Inv #TO #OOM Time Memory Score
aspartix19 230 21 75 0 0 0 0 1380.377 59871232 -145
coquiaas 324 0 0 1 0 1 0 2106.159 94203904 324
mu-toksia 326 0 0 0 0 0 0 382.811 61640704 326
pyglaf 326 0 0 0 0 0 0 1117.637 411615232 326

DC-SST detailed results

DS-SST
Solver #Corr #Cra #Inc #Fail #Inv #TO #OOM Time Memory Score
aspartix19 296 0 30 0 0 0 0 911.567 59879424 146
coquiaas 325 0 0 0 0 1 0 1614.005 88248320 325
mu-toksia 326 0 0 0 0 0 0 439.937 71610368 326
pyglaf 326 0 0 0 0 0 0 1158.068 411574272 326

DS-SST detailed results