Welcome to Pyomo's performance test results portal!
Please explore the expandable sections below for different categories of Pyomo's current performance. The numbers shown are standard deviations away from the running average (where a positive number is slower than average, negative faster than average).
Note: Alerts are generated based on repeated performance. The table represents only the most recent run of the performance test suite.
Last update: Aug-13-2026 16:17
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | 1.57σ | 1.32σ | 0.846σ | ||||
| TestMisc_test_bilinear_100 | 0.737σ | 0.152σ | 0.286σ | 0.505σ | 0.178σ | ||
| TestMisc_test_bilinear_100000 | 0.888σ | 0.606σ | 1.46σ | 0.382σ | 1.26σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 1.54σ | -6.73e-05σ | 0.303σ | -0.0865σ | 0.63σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | 1.52σ | 1.16σ | 1.86σ | 0.263σ | 0.753σ | ||
| TestMisc_test_diag_quicksum_100 | 1.34σ | 0.658σ | 0.779σ | 0.933σ | 0.339σ | ||
| TestMisc_test_diag_quicksum_100000 | 1.31σ | 0.68σ | 1.67σ | 0.73σ | 1.55σ | ||
| TestMisc_test_diag_sum_100 | 1.7σ | 0.0442σ | 0.159σ | 0.609σ | 0.21σ | ||
| TestMisc_test_diag_sum_100000 | 0.559σ | 1.02σ | 1.92σ | 0.22σ | 1.43σ | ||
| TestMisc_test_pmedian_quicksum_test4 | 0.426σ | 0.714σ | 1.12σ | 0.544σ | 1.67σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 2.17σ | 0.787σ | 1.27σ | 0.448σ | 1.9σ | ||
| TestMisc_test_pmedian_sum_test4 | 1.01σ | 0.64σ | 1.66σ | 0.43σ | 1.13σ | ||
| TestMisc_test_pmedian_sum_test8 | 0.7σ | 1.69σ | 2.13σ | 0.0624σ | 1.51σ | ||
| TestMisc_test_pmedian_tuple_test4 | 0.258σ | 0.711σ | 1.67σ | 0.762σ | 1.51σ | ||
| TestMisc_test_pmedian_tuple_test8 | 2.13σ | 0.777σ | 2.18σ | 1.03σ | 2.09σ | ||
| TestJump_test_clnlbean_5000 | 0.285σ | 0.917σ | 2.33σ | ||||
| TestJump_test_clnlbean_50000 | 0.738σ | 1.02σ | 2.31σ | ||||
| TestJump_test_facility_25 | 1.46σ | 0.548σ | 1.18σ | 1.26σ | 1.52σ | ||
| TestJump_test_facility_5 | 1.4σ | 1.09σ | 0.877σ | 1.42σ | 1.32σ | ||
| TestJump_test_facility_quicksum_25 | 1.58σ | 0.716σ | 0.802σ | 0.699σ | 1.65σ | ||
| TestJump_test_facility_quicksum_5 | 0.147σ | 1.53σ | 1.01σ | 1.39σ | 1.36σ | ||
| TestJump_test_lqcp_10 | 1.69σ | -0.282σ | 0.688σ | -0.168σ | 0.608σ | ||
| TestJump_test_lqcp_500 | 1.16σ | 0.801σ | 0.95σ | 0.878σ | 0.982σ | ||
| TestJump_test_lqcp_quicksum_10 | 1.69σ | 0.00341σ | 0.668σ | 0.569σ | -0.104σ | ||
| TestJump_test_lqcp_quicksum_500 | 0.591σ | 1.27σ | 1.5σ | 0.908σ | 1.04σ | ||
| TestJump_test_opf_662 | 0.175σ | 0.823σ | 0.978σ | ||||
| TestJump_test_opf_6620 | 0.797σ | 0.466σ | 0.812σ | ||||
| TestJump_test_opf_quicksum_662 | 0.0851σ | 0.941σ | 1.08σ | ||||
| TestJump_test_opf_quicksum_6620 | 0.415σ | 1.13σ | 0.753σ | ||||
| TestDevel_test_issue_691 | 0.243σ | -0.0964σ | 0.0958σ | 0.3σ | 0.361σ | ||
| TestModels_test_dcopf_case2383wp | 0.675σ | 0.251σ | 0.736σ | 0.188σ | 0.816σ | ||
| TestModels_test_uc_20140901_expected | 0.828σ | 0.227σ | 1.17σ | 0.288σ | 1.28σ |
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | 1.28σ | 1.08σ | 0.0746σ | ||||
| TestMisc_test_bilinear_100 | 1.07σ | 0.393σ | 0.476σ | 0.244σ | 0.527σ | ||
| TestMisc_test_bilinear_100000 | 0.525σ | 1.0σ | 1.79σ | 1.44σ | 0.793σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 1.34σ | 0.902σ | 0.693σ | 0.558σ | 0.157σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | 0.869σ | -0.194σ | 1.81σ | 1.54σ | 1.95σ | ||
| TestMisc_test_diag_quicksum_100 | 1.3σ | 0.675σ | -0.0611σ | 0.0453σ | 0.46σ | ||
| TestMisc_test_diag_quicksum_100000 | 0.528σ | 1.01σ | 1.84σ | 0.572σ | 1.6σ | ||
| TestMisc_test_diag_sum_100 | 1.52σ | 0.137σ | 0.876σ | 0.6σ | 0.296σ | ||
| TestMisc_test_diag_sum_100000 | 1.12σ | 0.982σ | 1.71σ | 1.28σ | 2.45σ | ||
| TestMisc_test_pmedian_quicksum_test4 | 2.43σ | 0.571σ | 1.55σ | 0.938σ | 2.01σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 2.16σ | 0.605σ | 1.85σ | 1.1σ | 1.9σ | ||
| TestMisc_test_pmedian_sum_test4 | 0.814σ | 0.86σ | 1.93σ | 1.37σ | 1.83σ | ||
| TestMisc_test_pmedian_sum_test8 | 0.273σ | 0.565σ | 1.86σ | 1.3σ | 2.06σ | ||
| TestMisc_test_pmedian_tuple_test4 | 0.0187σ | 1.43σ | 2.18σ | 0.717σ | 1.48σ | ||
| TestMisc_test_pmedian_tuple_test8 | 1.69σ | 2.04σ | 1.87σ | 1.09σ | 2.16σ | ||
| TestJump_test_clnlbean_5000 | 0.856σ | 0.42σ | 1.71σ | ||||
| TestJump_test_clnlbean_50000 | 0.521σ | 0.331σ | 1.47σ | ||||
| TestJump_test_facility_25 | 0.433σ | 0.182σ | 1.82σ | 0.44σ | 1.77σ | ||
| TestJump_test_facility_5 | 1.48σ | 0.154σ | 0.789σ | 0.0758σ | 1.49σ | ||
| TestJump_test_facility_quicksum_25 | 0.715σ | 0.372σ | 1.95σ | 1.05σ | 1.6σ | ||
| TestJump_test_facility_quicksum_5 | 0.728σ | 0.225σ | 1.71σ | 0.741σ | 1.97σ | ||
| TestJump_test_lqcp_10 | 0.954σ | 0.368σ | 0.674σ | 0.0682σ | 0.664σ | ||
| TestJump_test_lqcp_500 | -0.103σ | -0.00995σ | 0.742σ | 0.94σ | 2.3σ | ||
| TestJump_test_lqcp_quicksum_10 | 0.802σ | -0.00207σ | -0.124σ | -0.0276σ | 0.193σ | ||
| TestJump_test_lqcp_quicksum_500 | -0.0755σ | 0.298σ | 1.04σ | 0.902σ | 2.06σ | ||
| TestJump_test_opf_662 | 0.0422σ | 0.834σ | 0.443σ | ||||
| TestJump_test_opf_6620 | 0.703σ | 0.379σ | 1.5σ | ||||
| TestJump_test_opf_quicksum_662 | 0.0812σ | -0.295σ | 1.02σ | ||||
| TestJump_test_opf_quicksum_6620 | 0.298σ | 0.939σ | 1.13σ | ||||
| TestDevel_test_issue_691 | 0.631σ | 0.00844σ | 0.338σ | 1.43σ | 1.2σ | ||
| TestModels_test_dcopf_case2383wp | 0.555σ | 0.12σ | 0.998σ | 0.488σ | 1.9σ | ||
| TestModels_test_uc_20140901_expected | 0.556σ | 1.02σ | 1.71σ | 0.566σ | 1.83σ |
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | 1.84σ | 0.632σ | 0.451σ | ||||
| TestMisc_test_bilinear_100 | 0.672σ | 0.24σ | 0.51σ | 0.366σ | 0.54σ | ||
| TestMisc_test_bilinear_100000 | 0.533σ | 0.197σ | 0.368σ | 0.117σ | 0.254σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 0.818σ | 1.3σ | 0.354σ | 0.775σ | 0.761σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | 1.16σ | 0.199σ | 0.362σ | 0.0803σ | 0.197σ | ||
| TestMisc_test_diag_quicksum_100 | 0.0288σ | 1.3σ | 0.098σ | 0.431σ | 0.318σ | ||
| TestMisc_test_diag_quicksum_100000 | 0.799σ | 0.511σ | 0.392σ | 0.477σ | 0.254σ | ||
| TestMisc_test_diag_sum_100 | 0.477σ | 0.297σ | 0.26σ | 0.00572σ | 0.421σ | ||
| TestMisc_test_diag_sum_100000 | 0.359σ | 0.174σ | 0.351σ | 0.0961σ | 0.232σ | ||
| TestMisc_test_pmedian_quicksum_test4 | 0.775σ | 0.163σ | 0.439σ | 0.0803σ | 0.164σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 0.752σ | 0.354σ | 0.447σ | 0.109σ | 0.364σ | ||
| TestMisc_test_pmedian_sum_test4 | 0.291σ | 0.167σ | 0.515σ | 0.16σ | 0.193σ | ||
| TestMisc_test_pmedian_sum_test8 | 0.296σ | 0.112σ | 0.537σ | 0.125σ | 0.317σ | ||
| TestMisc_test_pmedian_tuple_test4 | 0.426σ | 0.194σ | 0.235σ | 0.0521σ | 0.181σ | ||
| TestMisc_test_pmedian_tuple_test8 | 1.18σ | 0.108σ | 0.45σ | 0.202σ | 0.314σ | ||
| TestJump_test_clnlbean_5000 | 0.396σ | 0.919σ | 0.316σ | ||||
| TestJump_test_clnlbean_50000 | 0.558σ | 0.167σ | 0.27σ | ||||
| TestJump_test_facility_25 | 0.353σ | 0.0793σ | 0.623σ | 0.236σ | 0.25σ | ||
| TestJump_test_facility_5 | 0.353σ | -0.0689σ | 0.673σ | 0.0352σ | 0.0795σ | ||
| TestJump_test_facility_quicksum_25 | 0.478σ | 0.129σ | 0.687σ | 0.303σ | 0.213σ | ||
| TestJump_test_facility_quicksum_5 | 0.282σ | -0.102σ | 0.729σ | 0.157σ | 0.179σ | ||
| TestJump_test_lqcp_10 | 0.745σ | -0.138σ | 0.28σ | 0.231σ | 0.168σ | ||
| TestJump_test_lqcp_500 | 0.624σ | 0.151σ | 0.707σ | 0.282σ | 0.402σ | ||
| TestJump_test_lqcp_quicksum_10 | 0.834σ | 0.00371σ | 0.331σ | 0.182σ | 0.198σ | ||
| TestJump_test_lqcp_quicksum_500 | 0.641σ | 0.325σ | 0.731σ | 0.219σ | 0.394σ | ||
| TestJump_test_opf_662 | 0.788σ | 0.735σ | 0.327σ | ||||
| TestJump_test_opf_6620 | 0.916σ | 0.217σ | 0.267σ | ||||
| TestJump_test_opf_quicksum_662 | 0.458σ | 0.281σ | 0.31σ | ||||
| TestJump_test_opf_quicksum_6620 | 0.454σ | 0.257σ | 0.296σ | ||||
| TestDevel_test_issue_691 | 0.449σ | 0.17σ | 0.285σ | 0.313σ | 0.152σ | ||
| TestModels_test_dcopf_case2383wp | 0.894σ | 0.183σ | 0.883σ | 0.329σ | 0.383σ | ||
| TestModels_test_uc_20140901_expected | 0.713σ | 0.26σ | 1.09σ | 0.217σ | 0.425σ |
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | 1.26σ | 0.277σ | 0.222σ | ||||
| TestMisc_test_bilinear_100 | 0.366σ | 0.424σ | -0.0664σ | -0.0612σ | 0.113σ | ||
| TestMisc_test_bilinear_100000 | 0.00266σ | 0.203σ | 0.387σ | 0.221σ | 0.561σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 0.489σ | 1.61σ | 0.161σ | 0.245σ | 0.313σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | 1.52σ | 0.288σ | 0.478σ | 0.313σ | 0.649σ | ||
| TestMisc_test_diag_quicksum_100 | 0.154σ | 1.25σ | 0.499σ | 0.776σ | 0.526σ | ||
| TestMisc_test_diag_quicksum_100000 | 1.31σ | 0.407σ | 0.916σ | 0.256σ | 0.339σ | ||
| TestMisc_test_diag_sum_100 | 0.825σ | 0.362σ | 0.523σ | 0.398σ | 0.302σ | ||
| TestMisc_test_diag_sum_100000 | 1.31σ | 0.242σ | 1.01σ | 0.378σ | 0.259σ | ||
| TestMisc_test_pmedian_quicksum_test4 | 1.1σ | 0.153σ | 1.14σ | 0.232σ | 0.437σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 1.62σ | 0.569σ | 1.29σ | 0.446σ | 0.335σ | ||
| TestMisc_test_pmedian_sum_test4 | 0.146σ | 0.42σ | 1.05σ | 0.449σ | 0.315σ | ||
| TestMisc_test_pmedian_sum_test8 | 0.354σ | 0.204σ | 1.03σ | 0.463σ | 0.252σ | ||
| TestMisc_test_pmedian_tuple_test4 | 0.9σ | 0.375σ | 1.09σ | 0.356σ | 0.236σ | ||
| TestMisc_test_pmedian_tuple_test8 | 1.32σ | 0.32σ | 0.942σ | 0.38σ | 0.32σ | ||
| TestJump_test_clnlbean_5000 | 0.114σ | 0.115σ | 0.32σ | ||||
| TestJump_test_clnlbean_50000 | 0.55σ | 0.236σ | 0.46σ | ||||
| TestJump_test_facility_25 | 0.252σ | 0.253σ | 0.666σ | 0.695σ | 0.438σ | ||
| TestJump_test_facility_5 | 0.273σ | 0.0881σ | 0.746σ | 0.266σ | 0.494σ | ||
| TestJump_test_facility_quicksum_25 | 0.471σ | 0.221σ | 0.656σ | 0.829σ | 0.568σ | ||
| TestJump_test_facility_quicksum_5 | 0.236σ | 0.0931σ | 0.988σ | 0.433σ | 0.378σ | ||
| TestJump_test_lqcp_10 | 0.55σ | 0.0141σ | 0.364σ | -0.13σ | 0.158σ | ||
| TestJump_test_lqcp_500 | 0.207σ | 0.154σ | 0.703σ | 0.47σ | 0.398σ | ||
| TestJump_test_lqcp_quicksum_10 | 0.504σ | -0.00295σ | 0.445σ | 0.228σ | 0.307σ | ||
| TestJump_test_lqcp_quicksum_500 | 0.648σ | 0.526σ | 0.883σ | 0.472σ | 0.414σ | ||
| TestJump_test_opf_662 | 0.796σ | 0.121σ | 0.366σ | ||||
| TestJump_test_opf_6620 | 1.01σ | 0.223σ | 0.348σ | ||||
| TestJump_test_opf_quicksum_662 | 0.302σ | 0.339σ | 0.304σ | ||||
| TestJump_test_opf_quicksum_6620 | 0.39σ | 0.172σ | 0.395σ | ||||
| TestDevel_test_issue_691 | 0.716σ | 0.132σ | 0.0817σ | 0.249σ | 0.284σ | ||
| TestModels_test_dcopf_case2383wp | 0.277σ | 0.147σ | 0.601σ | 0.3σ | 0.389σ | ||
| TestModels_test_uc_20140901_expected | 0.3σ | 0.219σ | 0.701σ | 0.365σ | 0.337σ |
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | 0.628σ | 0.0446σ | 0.135σ | ||||
| TestMisc_test_bilinear_100 | 0.272σ | 0.0223σ | -0.00374σ | 0.0801σ | 0.0652σ | ||
| TestMisc_test_bilinear_100000 | 0.147σ | 0.039σ | 0.0935σ | 0.0462σ | 0.0441σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 0.177σ | 0.112σ | 0.0389σ | 0.151σ | 0.108σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | 0.166σ | 0.00771σ | 0.0933σ | 0.0403σ | 0.0929σ | ||
| TestMisc_test_diag_quicksum_100 | 0.24σ | 1.3σ | 0.121σ | 0.0596σ | 0.064σ | ||
| TestMisc_test_diag_quicksum_100000 | 0.00815σ | 0.0262σ | 0.45σ | 0.15σ | 0.0856σ | ||
| TestMisc_test_diag_sum_100 | 0.934σ | -0.00151σ | 0.201σ | 0.136σ | 0.197σ | ||
| TestMisc_test_diag_sum_100000 | 0.412σ | 0.0648σ | 0.434σ | 0.11σ | 0.0744σ | ||
| TestMisc_test_pmedian_quicksum_test4 | 0.192σ | 0.0145σ | 0.114σ | 0.0457σ | 0.0117σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 0.711σ | 0.0702σ | 0.615σ | 0.243σ | 0.13σ | ||
| TestMisc_test_pmedian_sum_test4 | 0.000822σ | 0.0862σ | 0.327σ | 0.188σ | 0.0766σ | ||
| TestMisc_test_pmedian_sum_test8 | 0.0969σ | 0.115σ | 0.749σ | 0.145σ | 0.181σ | ||
| TestMisc_test_pmedian_tuple_test4 | 0.0231σ | -0.0164σ | 0.387σ | 0.244σ | 0.0721σ | ||
| TestMisc_test_pmedian_tuple_test8 | 0.901σ | 0.124σ | 0.612σ | 0.267σ | 0.125σ | ||
| TestJump_test_clnlbean_5000 | 0.24σ | 0.214σ | 0.377σ | ||||
| TestJump_test_clnlbean_50000 | 0.328σ | 0.2σ | 0.291σ | ||||
| TestJump_test_facility_25 | 0.0512σ | -0.0103σ | 0.471σ | 0.142σ | 0.245σ | ||
| TestJump_test_facility_5 | 0.126σ | -0.0553σ | 0.177σ | 0.0938σ | 0.0896σ | ||
| TestJump_test_facility_quicksum_25 | 0.0744σ | -0.0309σ | 0.448σ | 0.313σ | 0.0866σ | ||
| TestJump_test_facility_quicksum_5 | 0.135σ | -0.0547σ | 0.288σ | 0.0337σ | 0.0523σ | ||
| TestJump_test_lqcp_10 | 0.434σ | 0.0542σ | 0.317σ | 0.0734σ | -0.00776σ | ||
| TestJump_test_lqcp_500 | 0.212σ | 0.141σ | 0.53σ | 0.213σ | 0.049σ | ||
| TestJump_test_lqcp_quicksum_10 | 0.209σ | 0.0143σ | 0.206σ | -0.0526σ | -0.0898σ | ||
| TestJump_test_lqcp_quicksum_500 | 0.0755σ | 0.138σ | 0.545σ | 0.205σ | 0.109σ | ||
| TestJump_test_opf_662 | 0.143σ | 0.431σ | 0.371σ | ||||
| TestJump_test_opf_6620 | 0.232σ | 0.108σ | 0.279σ | ||||
| TestJump_test_opf_quicksum_662 | 0.253σ | 0.11σ | 0.287σ | ||||
| TestJump_test_opf_quicksum_6620 | 0.131σ | 0.262σ | 0.281σ | ||||
| TestDevel_test_issue_691 | 0.00359σ | 0.0739σ | 0.4σ | 0.259σ | 0.176σ | ||
| TestModels_test_dcopf_case2383wp | 0.137σ | 0.0691σ | 0.435σ | 0.191σ | 0.109σ | ||
| TestModels_test_uc_20140901_expected | 0.226σ | 0.0548σ | 0.648σ | 0.246σ | 0.198σ |
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | 0.145σ | 0.0233σ | 0.0546σ | ||||
| TestMisc_test_bilinear_100 | 0.389σ | -0.0537σ | 0.0685σ | 0.0514σ | 0.105σ | ||
| TestMisc_test_bilinear_100000 | 0.468σ | 0.198σ | 0.477σ | 0.468σ | 0.224σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 0.685σ | 1.16σ | 0.202σ | 0.0945σ | 0.222σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | 0.811σ | 0.152σ | 0.24σ | 0.145σ | 0.172σ | ||
| TestMisc_test_diag_quicksum_100 | 0.736σ | 1.66σ | 0.344σ | 0.267σ | 0.115σ | ||
| TestMisc_test_diag_quicksum_100000 | 0.0664σ | 0.222σ | 0.411σ | 0.197σ | 0.149σ | ||
| TestMisc_test_diag_sum_100 | 0.869σ | -0.0173σ | 0.22σ | 0.0214σ | 0.401σ | ||
| TestMisc_test_diag_sum_100000 | 0.26σ | 0.283σ | 0.476σ | 0.263σ | 0.183σ | ||
| TestMisc_test_pmedian_quicksum_test4 | 0.871σ | 0.438σ | 0.405σ | 0.562σ | 0.784σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 0.863σ | 0.089σ | 0.427σ | 0.229σ | 0.111σ | ||
| TestMisc_test_pmedian_sum_test4 | 0.0827σ | 0.555σ | 0.314σ | 0.441σ | 0.137σ | ||
| TestMisc_test_pmedian_sum_test8 | 0.106σ | 0.328σ | 0.451σ | 0.252σ | 0.238σ | ||
| TestMisc_test_pmedian_tuple_test4 | 0.772σ | 1.0σ | 0.189σ | 0.305σ | 0.185σ | ||
| TestMisc_test_pmedian_tuple_test8 | 0.565σ | 0.136σ | 0.419σ | 0.264σ | 0.242σ | ||
| TestJump_test_clnlbean_5000 | 0.175σ | 0.162σ | 0.21σ | ||||
| TestJump_test_clnlbean_50000 | 0.11σ | 0.197σ | 0.205σ | ||||
| TestJump_test_facility_25 | 0.177σ | 0.438σ | 0.341σ | 0.34σ | 0.301σ | ||
| TestJump_test_facility_5 | 0.483σ | 0.241σ | 0.128σ | 0.547σ | 0.128σ | ||
| TestJump_test_facility_quicksum_25 | 0.0591σ | 0.314σ | 0.339σ | 0.101σ | 0.295σ | ||
| TestJump_test_facility_quicksum_5 | 0.667σ | 0.448σ | 0.261σ | 0.229σ | 0.14σ | ||
| TestJump_test_lqcp_10 | 0.614σ | -0.183σ | 0.101σ | -0.0744σ | 0.159σ | ||
| TestJump_test_lqcp_500 | 0.103σ | 0.135σ | 0.23σ | 0.131σ | 0.201σ | ||
| TestJump_test_lqcp_quicksum_10 | 0.227σ | 0.00132σ | 0.098σ | 0.0763σ | 0.325σ | ||
| TestJump_test_lqcp_quicksum_500 | 0.255σ | 0.285σ | 0.369σ | 0.229σ | 0.231σ | ||
| TestJump_test_opf_662 | 0.0436σ | 0.0864σ | 0.255σ | ||||
| TestJump_test_opf_6620 | 0.164σ | 0.0618σ | 0.268σ | ||||
| TestJump_test_opf_quicksum_662 | 0.0854σ | 0.0332σ | 0.0805σ | ||||
| TestJump_test_opf_quicksum_6620 | 0.0843σ | 0.0247σ | 0.0615σ | ||||
| TestDevel_test_issue_691 | 0.877σ | 0.207σ | 0.0999σ | 0.143σ | 0.263σ | ||
| TestModels_test_dcopf_case2383wp | 0.56σ | 0.196σ | 0.413σ | 0.0727σ | 0.254σ | ||
| TestModels_test_uc_20140901_expected | 0.338σ | 0.109σ | 0.387σ | 0.185σ | 0.117σ |
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | 0.0293σ | 0.392σ | 0.344σ | ||||
| TestMisc_test_bilinear_100 | 1.07σ | 0.392σ | 0.206σ | -0.0775σ | 0.0603σ | ||
| TestMisc_test_bilinear_100000 | 1.19σ | 0.147σ | 0.529σ | 0.0653σ | 0.0171σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 0.132σ | 1.45σ | -0.00163σ | 0.125σ | 0.0425σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | 0.358σ | 0.181σ | 0.646σ | 0.061σ | 0.0759σ | ||
| TestMisc_test_diag_quicksum_100 | 1.47σ | 0.507σ | 0.105σ | 0.232σ | 0.0731σ | ||
| TestMisc_test_diag_quicksum_100000 | 0.181σ | 0.0621σ | 0.253σ | 0.0294σ | 0.119σ | ||
| TestMisc_test_diag_sum_100 | 1.21σ | -0.027σ | 0.0701σ | -0.0199σ | -0.237σ | ||
| TestMisc_test_diag_sum_100000 | 0.12σ | 0.116σ | 0.276σ | 0.241σ | 0.109σ | ||
| TestMisc_test_pmedian_quicksum_test4 | 0.964σ | 0.0496σ | 0.359σ | 0.115σ | 0.104σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 1.44σ | 0.234σ | 0.317σ | 0.379σ | 0.151σ | ||
| TestMisc_test_pmedian_sum_test4 | 0.105σ | 0.0744σ | 0.192σ | 1.02σ | 0.0906σ | ||
| TestMisc_test_pmedian_sum_test8 | 0.404σ | 0.124σ | 0.495σ | 0.338σ | 0.398σ | ||
| TestMisc_test_pmedian_tuple_test4 | 0.447σ | 0.0374σ | 0.881σ | 0.187σ | 0.264σ | ||
| TestMisc_test_pmedian_tuple_test8 | 1.41σ | 0.406σ | 0.582σ | 0.156σ | 0.254σ | ||
| TestJump_test_clnlbean_5000 | 1.32σ | 0.129σ | 0.105σ | ||||
| TestJump_test_clnlbean_50000 | 0.285σ | 0.178σ | 0.103σ | ||||
| TestJump_test_facility_25 | 0.104σ | 0.114σ | 0.545σ | 0.12σ | 0.18σ | ||
| TestJump_test_facility_5 | 0.375σ | 0.179σ | 0.494σ | 0.135σ | 0.0904σ | ||
| TestJump_test_facility_quicksum_25 | 0.198σ | 0.023σ | 0.789σ | -0.0381σ | 0.491σ | ||
| TestJump_test_facility_quicksum_5 | 0.165σ | 0.000505σ | 0.329σ | 0.0626σ | -0.0847σ | ||
| TestJump_test_lqcp_10 | 0.447σ | -0.129σ | 0.0126σ | -0.00369σ | -0.239σ | ||
| TestJump_test_lqcp_500 | 0.185σ | 0.148σ | 0.3σ | 0.247σ | 0.181σ | ||
| TestJump_test_lqcp_quicksum_10 | 0.262σ | -0.000913σ | -0.122σ | -0.0326σ | -0.0184σ | ||
| TestJump_test_lqcp_quicksum_500 | 0.264σ | 0.0713σ | 0.386σ | 0.235σ | 0.166σ | ||
| TestJump_test_opf_662 | 0.268σ | 0.123σ | 0.486σ | ||||
| TestJump_test_opf_6620 | 0.301σ | 0.0674σ | 0.0442σ | ||||
| TestJump_test_opf_quicksum_662 | 0.257σ | 0.0781σ | 0.0589σ | ||||
| TestJump_test_opf_quicksum_6620 | 0.297σ | 0.0449σ | 0.107σ | ||||
| TestDevel_test_issue_691 | 0.785σ | 0.202σ | 0.17σ | 0.236σ | 0.826σ | ||
| TestModels_test_dcopf_case2383wp | 0.751σ | 0.228σ | 0.449σ | 0.177σ | 0.0894σ | ||
| TestModels_test_uc_20140901_expected | 0.494σ | 0.238σ | 0.519σ | 0.127σ | 0.3σ |
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | 0.0476σ | 0.365σ | 0.115σ | ||||
| TestMisc_test_bilinear_100 | 0.857σ | -0.0204σ | 0.426σ | 0.395σ | 0.635σ | ||
| TestMisc_test_bilinear_100000 | 0.837σ | 0.376σ | 0.355σ | 0.0284σ | 0.0264σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 0.232σ | 1.31σ | 0.227σ | -0.18σ | 0.0732σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | 0.697σ | 0.191σ | 0.301σ | 0.0453σ | 0.0245σ | ||
| TestMisc_test_diag_quicksum_100 | 0.143σ | 0.975σ | 0.173σ | 0.111σ | 0.0909σ | ||
| TestMisc_test_diag_quicksum_100000 | 0.46σ | 0.277σ | 0.206σ | 0.262σ | 0.0795σ | ||
| TestMisc_test_diag_sum_100 | 0.596σ | -0.0156σ | -0.0212σ | 0.0158σ | -0.046σ | ||
| TestMisc_test_diag_sum_100000 | 0.548σ | 0.33σ | 0.232σ | 0.141σ | 0.103σ | ||
| TestMisc_test_pmedian_quicksum_test4 | 0.909σ | 0.162σ | 0.423σ | 0.11σ | 0.137σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 0.929σ | 0.488σ | 0.313σ | 0.183σ | 0.0752σ | ||
| TestMisc_test_pmedian_sum_test4 | 0.000778σ | 0.00711σ | 0.215σ | 0.0674σ | 0.184σ | ||
| TestMisc_test_pmedian_sum_test8 | 0.199σ | -0.00416σ | 0.331σ | 0.195σ | 0.165σ | ||
| TestMisc_test_pmedian_tuple_test4 | 0.549σ | 0.00492σ | 0.0885σ | 0.0851σ | 0.134σ | ||
| TestMisc_test_pmedian_tuple_test8 | 1.07σ | 0.215σ | 0.418σ | 0.154σ | 0.182σ | ||
| TestJump_test_clnlbean_5000 | 1.11σ | 0.0302σ | 0.0668σ | ||||
| TestJump_test_clnlbean_50000 | 0.312σ | 0.0614σ | 0.0866σ | ||||
| TestJump_test_facility_25 | 0.384σ | 0.0725σ | 0.336σ | 0.25σ | 0.146σ | ||
| TestJump_test_facility_5 | 0.37σ | -0.167σ | 0.199σ | -0.0236σ | 0.0882σ | ||
| TestJump_test_facility_quicksum_25 | 0.286σ | 0.0123σ | 0.708σ | 0.0668σ | 0.135σ | ||
| TestJump_test_facility_quicksum_5 | 0.189σ | -0.0582σ | 0.0895σ | 0.0487σ | 0.0749σ | ||
| TestJump_test_lqcp_10 | 0.462σ | -0.0668σ | 0.182σ | 0.00209σ | -0.121σ | ||
| TestJump_test_lqcp_500 | 0.242σ | 0.0973σ | 0.452σ | 0.0968σ | 0.139σ | ||
| TestJump_test_lqcp_quicksum_10 | 0.352σ | -0.103σ | 0.242σ | 0.0334σ | -0.000531σ | ||
| TestJump_test_lqcp_quicksum_500 | 0.294σ | 0.123σ | 0.424σ | 0.165σ | 0.16σ | ||
| TestJump_test_opf_662 | 0.405σ | -0.0123σ | 0.0829σ | ||||
| TestJump_test_opf_6620 | 0.479σ | 0.217σ | 0.244σ | ||||
| TestJump_test_opf_quicksum_662 | 0.5σ | -0.00491σ | 0.0736σ | ||||
| TestJump_test_opf_quicksum_6620 | 0.422σ | 0.0343σ | 0.0641σ | ||||
| TestDevel_test_issue_691 | 0.79σ | 0.177σ | 0.13σ | 0.266σ | 0.169σ | ||
| TestModels_test_dcopf_case2383wp | 0.396σ | 0.0646σ | 0.209σ | 0.113σ | 0.147σ | ||
| TestModels_test_uc_20140901_expected | 0.29σ | 0.0659σ | 0.693σ | 0.291σ | 0.201σ |
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | 0.059σ | 0.115σ | 0.194σ | ||||
| TestMisc_test_bilinear_100 | 0.191σ | 0.159σ | 0.176σ | 0.345σ | 0.253σ | ||
| TestMisc_test_bilinear_100000 | 0.0857σ | 0.36σ | 0.325σ | 0.182σ | 0.327σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 0.113σ | 1.15σ | 0.108σ | 0.182σ | 0.132σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | 0.0837σ | 0.193σ | 0.479σ | 0.149σ | 0.262σ | ||
| TestMisc_test_diag_quicksum_100 | 0.347σ | 0.899σ | 0.29σ | 0.13σ | 0.134σ | ||
| TestMisc_test_diag_quicksum_100000 | 0.919σ | 0.0949σ | 0.204σ | 0.119σ | 0.224σ | ||
| TestMisc_test_diag_sum_100 | 0.431σ | 0.184σ | 0.34σ | 0.229σ | -0.0477σ | ||
| TestMisc_test_diag_sum_100000 | 0.192σ | 0.053σ | 0.392σ | 0.124σ | 0.168σ | ||
| TestMisc_test_pmedian_quicksum_test4 | 0.753σ | 0.142σ | 0.445σ | 0.14σ | 0.222σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 1.09σ | 0.153σ | 0.329σ | 0.217σ | 0.215σ | ||
| TestMisc_test_pmedian_sum_test4 | 1.29σ | 0.081σ | 0.254σ | 0.135σ | 0.0232σ | ||
| TestMisc_test_pmedian_sum_test8 | 0.27σ | 0.0996σ | 0.591σ | 0.294σ | 0.262σ | ||
| TestMisc_test_pmedian_tuple_test4 | 0.922σ | 0.104σ | 0.574σ | 0.272σ | 0.212σ | ||
| TestMisc_test_pmedian_tuple_test8 | 1.11σ | 0.244σ | 0.57σ | 0.299σ | 0.197σ | ||
| TestJump_test_clnlbean_5000 | 0.169σ | 0.155σ | 0.23σ | ||||
| TestJump_test_clnlbean_50000 | 0.256σ | 0.187σ | 0.254σ | ||||
| TestJump_test_facility_25 | 0.185σ | 0.122σ | 0.376σ | 0.326σ | 0.194σ | ||
| TestJump_test_facility_5 | 0.135σ | 0.132σ | 0.265σ | 0.139σ | 0.132σ | ||
| TestJump_test_facility_quicksum_25 | 0.465σ | 0.42σ | 0.336σ | 0.192σ | 0.203σ | ||
| TestJump_test_facility_quicksum_5 | 0.164σ | 0.206σ | 0.242σ | 0.195σ | 0.14σ | ||
| TestJump_test_lqcp_10 | 0.212σ | 0.267σ | 0.141σ | 0.139σ | 0.173σ | ||
| TestJump_test_lqcp_500 | 0.197σ | 0.117σ | 0.178σ | 0.137σ | 0.213σ | ||
| TestJump_test_lqcp_quicksum_10 | 0.287σ | 0.278σ | 0.0634σ | 0.0894σ | 0.211σ | ||
| TestJump_test_lqcp_quicksum_500 | 0.23σ | 0.333σ | 0.528σ | 0.174σ | 0.21σ | ||
| TestJump_test_opf_662 | 0.192σ | 0.142σ | 0.189σ | ||||
| TestJump_test_opf_6620 | 0.2σ | 0.0931σ | 0.215σ | ||||
| TestJump_test_opf_quicksum_662 | 0.28σ | 0.121σ | 0.27σ | ||||
| TestJump_test_opf_quicksum_6620 | 0.299σ | 0.272σ | 0.276σ | ||||
| TestDevel_test_issue_691 | 1.01σ | 0.164σ | 0.322σ | 0.342σ | 0.393σ | ||
| TestModels_test_dcopf_case2383wp | 0.519σ | 0.232σ | 0.297σ | 0.238σ | 0.177σ | ||
| TestModels_test_uc_20140901_expected | 0.19σ | 0.203σ | 0.406σ | 0.179σ | 0.19σ |
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | 0.0161σ | 0.0794σ | 1.26σ | ||||
| TestMisc_test_bilinear_100 | 0.418σ | -0.0838σ | 0.117σ | 0.0531σ | 0.0331σ | ||
| TestMisc_test_bilinear_100000 | 0.257σ | 0.126σ | 0.738σ | 0.103σ | 0.133σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 0.564σ | -0.024σ | 0.329σ | -0.00405σ | 0.12σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | 0.00528σ | 0.0714σ | 0.437σ | 0.0584σ | 0.184σ | ||
| TestMisc_test_diag_quicksum_100 | 0.462σ | -0.0741σ | -0.0178σ | 0.148σ | 0.345σ | ||
| TestMisc_test_diag_quicksum_100000 | 0.316σ | 0.123σ | 0.447σ | 0.0792σ | 0.133σ | ||
| TestMisc_test_diag_sum_100 | 0.663σ | 0.0335σ | 0.338σ | 0.142σ | 0.29σ | ||
| TestMisc_test_diag_sum_100000 | 0.274σ | 0.2σ | 0.738σ | 0.146σ | 0.0912σ | ||
| TestMisc_test_pmedian_quicksum_test4 | 0.739σ | 0.0897σ | 0.508σ | 0.0866σ | 0.149σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 0.76σ | 0.196σ | 0.497σ | 0.148σ | 0.0924σ | ||
| TestMisc_test_pmedian_sum_test4 | 0.0981σ | 0.209σ | 0.469σ | 0.13σ | 0.114σ | ||
| TestMisc_test_pmedian_sum_test8 | 0.211σ | 0.0469σ | 0.375σ | 0.0828σ | 0.0909σ | ||
| TestMisc_test_pmedian_tuple_test4 | 0.755σ | 0.122σ | 0.528σ | 0.00646σ | 0.073σ | ||
| TestMisc_test_pmedian_tuple_test8 | 1.1σ | 0.0566σ | 0.364σ | 0.0731σ | 0.0984σ | ||
| TestJump_test_clnlbean_5000 | 0.0638σ | 0.0896σ | 0.201σ | ||||
| TestJump_test_clnlbean_50000 | 0.0767σ | 0.0347σ | 0.132σ | ||||
| TestJump_test_facility_25 | 0.235σ | 0.113σ | 0.555σ | 0.118σ | 0.125σ | ||
| TestJump_test_facility_5 | 0.405σ | 0.0103σ | 0.0499σ | 0.0451σ | 0.0869σ | ||
| TestJump_test_facility_quicksum_25 | 0.363σ | 0.245σ | 0.628σ | 0.378σ | 0.279σ | ||
| TestJump_test_facility_quicksum_5 | 0.244σ | 0.0143σ | 0.351σ | 0.114σ | 0.0493σ | ||
| TestJump_test_lqcp_10 | 0.234σ | 0.043σ | 0.0949σ | -0.0154σ | 0.0164σ | ||
| TestJump_test_lqcp_500 | 0.142σ | 0.241σ | 0.615σ | 0.0747σ | 0.136σ | ||
| TestJump_test_lqcp_quicksum_10 | 0.619σ | 1.3σ | 0.169σ | -0.0402σ | -0.0619σ | ||
| TestJump_test_lqcp_quicksum_500 | 0.366σ | 0.264σ | 0.629σ | 0.0812σ | 0.0577σ | ||
| TestJump_test_opf_662 | 0.156σ | 0.182σ | 0.15σ | ||||
| TestJump_test_opf_6620 | 0.224σ | 0.274σ | 0.143σ | ||||
| TestJump_test_opf_quicksum_662 | 0.351σ | 0.164σ | 0.134σ | ||||
| TestJump_test_opf_quicksum_6620 | 0.288σ | 0.347σ | 0.0851σ | ||||
| TestDevel_test_issue_691 | 0.347σ | -0.0216σ | 0.13σ | 0.109σ | 0.135σ | ||
| TestModels_test_dcopf_case2383wp | 0.208σ | 0.0919σ | 0.431σ | 0.138σ | 0.0569σ | ||
| TestModels_test_uc_20140901_expected | 0.145σ | 0.131σ | 0.491σ | 0.0812σ | 0.116σ |