Welcome to Pyomo's performance test results portal!
Please explore the expandable sections below for different categories of Pyomo's current performance. The numbers shown are standard deviations away from the running average (where a positive number is slower than average, negative faster than average).
Note: Alerts are generated based on repeated performance. The table represents only the most recent run of the performance test suite.
Last update: Oct-30-2026 15:59
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | -0.107σ | 0.217σ | 1.7σ | ||||
| TestMisc_test_bilinear_100 | 1.04σ | 0.0763σ | 0.195σ | 0.0815σ | 0.211σ | ||
| TestMisc_test_bilinear_100000 | 0.424σ | -0.00154σ | -0.0387σ | 0.0475σ | 0.0294σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 1.01σ | 0.00383σ | 0.235σ | 0.092σ | 0.13σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | 0.159σ | -0.0372σ | -0.0232σ | 0.0494σ | 0.0378σ | ||
| TestMisc_test_diag_quicksum_100 | 1.12σ | 0.0063σ | 1.08σ | 0.104σ | 0.841σ | ||
| TestMisc_test_diag_quicksum_100000 | 1.88σ | -0.0859σ | 0.127σ | -0.00825σ | 0.13σ | ||
| TestMisc_test_diag_sum_100 | 1.87σ | 0.745σ | 0.542σ | 0.231σ | 0.182σ | ||
| TestMisc_test_diag_sum_100000 | 2.0σ | -0.0183σ | 0.076σ | -0.0249σ | 0.138σ | ||
| TestMisc_test_pmedian_quicksum_test4 | -0.00106σ | 0.00244σ | 0.409σ | -0.0136σ | 0.125σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 0.684σ | -0.0338σ | 0.00567σ | -0.0189σ | 0.182σ | ||
| TestMisc_test_pmedian_sum_test4 | -0.00871σ | -0.0196σ | 0.442σ | -0.0103σ | 0.12σ | ||
| TestMisc_test_pmedian_sum_test8 | 0.375σ | -0.037σ | 0.132σ | -0.00568σ | 0.105σ | ||
| TestMisc_test_pmedian_tuple_test4 | -0.00246σ | -0.00768σ | 0.103σ | -0.0127σ | 0.0365σ | ||
| TestMisc_test_pmedian_tuple_test8 | 0.309σ | -0.0454σ | 0.0835σ | -0.0478σ | 0.206σ | ||
| TestJump_test_clnlbean_5000 | -0.0421σ | 0.0415σ | 0.171σ | ||||
| TestJump_test_clnlbean_50000 | 0.911σ | -0.0544σ | 0.164σ | ||||
| TestJump_test_facility_25 | 0.218σ | 0.147σ | 0.286σ | 0.621σ | 0.222σ | ||
| TestJump_test_facility_5 | -0.0071σ | -0.0125σ | 0.282σ | -0.00727σ | 0.075σ | ||
| TestJump_test_facility_quicksum_25 | 0.212σ | -0.0565σ | 0.26σ | 0.654σ | 0.101σ | ||
| TestJump_test_facility_quicksum_5 | -0.00383σ | -0.0136σ | 0.144σ | -0.012σ | 0.0514σ | ||
| TestJump_test_lqcp_10 | -0.00117σ | 0.356σ | 0.255σ | 0.0301σ | 0.0244σ | ||
| TestJump_test_lqcp_500 | 0.0165σ | -0.163σ | 0.012σ | -0.0924σ | 0.145σ | ||
| TestJump_test_lqcp_quicksum_10 | -0.00238σ | 0.0245σ | 0.296σ | 0.116σ | 0.0732σ | ||
| TestJump_test_lqcp_quicksum_500 | -0.0381σ | -0.106σ | 0.0558σ | -0.0276σ | 0.163σ | ||
| TestJump_test_opf_662 | -0.0943σ | -0.0823σ | 0.122σ | ||||
| TestJump_test_opf_6620 | 0.629σ | -0.0373σ | 0.101σ | ||||
| TestJump_test_opf_quicksum_662 | -0.0467σ | -0.0231σ | 0.0295σ | ||||
| TestJump_test_opf_quicksum_6620 | 0.375σ | -0.00184σ | 0.0938σ | ||||
| TestDevel_test_issue_691 | 0.662σ | -0.00775σ | 0.285σ | -0.128σ | 0.0512σ | ||
| TestModels_test_dcopf_case2383wp | -0.00631σ | 0.91σ | 0.39σ | -0.0447σ | 0.134σ | ||
| TestModels_test_uc_20140901_expected | -0.108σ | -0.0219σ | 0.0315σ | -0.0489σ | 0.166σ |
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | 1.43σ | 0.233σ | 2.17σ | ||||
| TestMisc_test_bilinear_100 | 1.8σ | 0.381σ | 0.512σ | 0.321σ | 0.307σ | ||
| TestMisc_test_bilinear_100000 | -0.32σ | 0.115σ | 0.0387σ | 0.0578σ | 0.234σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 1.7σ | 1.1σ | 0.837σ | 0.448σ | 0.435σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | -0.25σ | 0.285σ | 0.0556σ | 0.0476σ | 0.217σ | ||
| TestMisc_test_diag_quicksum_100 | 1.92σ | 2.69σ | 0.314σ | 0.168σ | 0.509σ | ||
| TestMisc_test_diag_quicksum_100000 | 0.078σ | 0.15σ | 0.116σ | 0.16σ | 0.305σ | ||
| TestMisc_test_diag_sum_100 | 1.72σ | 0.628σ | 0.559σ | 0.33σ | 0.518σ | ||
| TestMisc_test_diag_sum_100000 | -0.404σ | 0.14σ | 0.21σ | 0.0237σ | 0.246σ | ||
| TestMisc_test_pmedian_quicksum_test4 | 0.489σ | 0.292σ | 0.244σ | 0.0623σ | 0.312σ | ||
| TestMisc_test_pmedian_quicksum_test8 | -0.0358σ | 0.0279σ | 0.152σ | 0.0762σ | 0.36σ | ||
| TestMisc_test_pmedian_sum_test4 | 0.024σ | 0.196σ | 0.315σ | 0.0795σ | 0.322σ | ||
| TestMisc_test_pmedian_sum_test8 | -0.0504σ | 0.0771σ | 0.138σ | 0.1σ | 0.279σ | ||
| TestMisc_test_pmedian_tuple_test4 | 0.205σ | 0.461σ | 0.338σ | 0.0689σ | 0.411σ | ||
| TestMisc_test_pmedian_tuple_test8 | 0.0263σ | 0.194σ | 0.201σ | 0.196σ | 0.416σ | ||
| TestJump_test_clnlbean_5000 | 0.124σ | 0.211σ | 0.243σ | ||||
| TestJump_test_clnlbean_50000 | 0.0508σ | 0.14σ | 0.234σ | ||||
| TestJump_test_facility_25 | 0.224σ | 0.00272σ | 0.26σ | 0.598σ | 0.324σ | ||
| TestJump_test_facility_5 | 1.28σ | 0.365σ | 0.282σ | 0.27σ | 0.311σ | ||
| TestJump_test_facility_quicksum_25 | 0.506σ | 0.0972σ | 0.368σ | 0.529σ | 0.341σ | ||
| TestJump_test_facility_quicksum_5 | 1.35σ | 0.334σ | 0.267σ | 0.304σ | 0.313σ | ||
| TestJump_test_lqcp_10 | 1.66σ | 0.343σ | 0.404σ | 0.404σ | 0.068σ | ||
| TestJump_test_lqcp_500 | -0.12σ | 0.202σ | 0.139σ | 0.237σ | 0.175σ | ||
| TestJump_test_lqcp_quicksum_10 | 1.7σ | 0.0142σ | 0.211σ | 0.0771σ | 0.0877σ | ||
| TestJump_test_lqcp_quicksum_500 | -0.00899σ | 0.0959σ | 0.192σ | 0.185σ | 0.23σ | ||
| TestJump_test_opf_662 | 0.209σ | 0.0887σ | 0.0309σ | ||||
| TestJump_test_opf_6620 | -0.221σ | 0.00896σ | 0.0165σ | ||||
| TestJump_test_opf_quicksum_662 | 0.229σ | 0.0478σ | 0.0934σ | ||||
| TestJump_test_opf_quicksum_6620 | -0.23σ | 0.143σ | 0.12σ | ||||
| TestDevel_test_issue_691 | 0.319σ | 0.131σ | 0.182σ | 0.0655σ | 0.0306σ | ||
| TestModels_test_dcopf_case2383wp | 0.109σ | 0.0999σ | 0.109σ | 0.171σ | 0.297σ | ||
| TestModels_test_uc_20140901_expected | -0.109σ | 0.16σ | 0.177σ | 0.283σ | 0.299σ |
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | 1.82σ | -0.00297σ | 2.24σ | ||||
| TestMisc_test_bilinear_100 | 1.97σ | 0.826σ | 0.736σ | 0.633σ | 0.527σ | ||
| TestMisc_test_bilinear_100000 | -0.111σ | 0.16σ | 0.165σ | 0.143σ | 0.0353σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 1.82σ | 0.00901σ | 0.625σ | 0.423σ | 0.437σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | 0.00913σ | 0.183σ | 0.291σ | 0.11σ | 0.0175σ | ||
| TestMisc_test_diag_quicksum_100 | 1.95σ | 0.523σ | 0.495σ | 0.526σ | 0.668σ | ||
| TestMisc_test_diag_quicksum_100000 | 1.22σ | 0.063σ | -0.00889σ | 0.194σ | 0.157σ | ||
| TestMisc_test_diag_sum_100 | 1.92σ | 0.982σ | 0.584σ | 0.4σ | 0.513σ | ||
| TestMisc_test_diag_sum_100000 | 1.05σ | 0.267σ | 0.0802σ | 0.114σ | 0.068σ | ||
| TestMisc_test_pmedian_quicksum_test4 | 0.91σ | 0.152σ | 0.411σ | 0.289σ | 0.248σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 0.0893σ | 0.0185σ | 0.0498σ | 0.245σ | 0.263σ | ||
| TestMisc_test_pmedian_sum_test4 | 0.0353σ | 0.344σ | 0.242σ | 0.303σ | 0.263σ | ||
| TestMisc_test_pmedian_sum_test8 | 0.0797σ | -0.0134σ | 0.0134σ | 0.218σ | 0.282σ | ||
| TestMisc_test_pmedian_tuple_test4 | 0.019σ | 0.284σ | 0.0728σ | 0.216σ | 0.213σ | ||
| TestMisc_test_pmedian_tuple_test8 | 0.0639σ | 0.0086σ | 0.0796σ | 0.265σ | 0.24σ | ||
| TestJump_test_clnlbean_5000 | 0.111σ | 0.0326σ | 0.265σ | ||||
| TestJump_test_clnlbean_50000 | 0.166σ | 0.0504σ | 0.242σ | ||||
| TestJump_test_facility_25 | 0.187σ | 0.0299σ | 0.156σ | 0.438σ | 0.339σ | ||
| TestJump_test_facility_5 | 1.47σ | 0.457σ | 0.298σ | 0.201σ | 0.331σ | ||
| TestJump_test_facility_quicksum_25 | 0.364σ | 0.0294σ | 0.103σ | 0.0937σ | 0.483σ | ||
| TestJump_test_facility_quicksum_5 | 1.37σ | 0.0906σ | 0.292σ | 0.232σ | 0.335σ | ||
| TestJump_test_lqcp_10 | 1.86σ | 0.568σ | 0.472σ | 0.351σ | 0.372σ | ||
| TestJump_test_lqcp_500 | 0.74σ | 0.166σ | 0.104σ | 0.252σ | 0.303σ | ||
| TestJump_test_lqcp_quicksum_10 | 1.8σ | 0.0144σ | 0.278σ | 0.197σ | 0.145σ | ||
| TestJump_test_lqcp_quicksum_500 | 0.463σ | 0.114σ | 0.149σ | 0.282σ | 0.333σ | ||
| TestJump_test_opf_662 | -0.183σ | 0.159σ | 0.221σ | ||||
| TestJump_test_opf_6620 | -0.136σ | 0.175σ | 0.307σ | ||||
| TestJump_test_opf_quicksum_662 | -0.313σ | 0.182σ | 0.225σ | ||||
| TestJump_test_opf_quicksum_6620 | -0.236σ | 0.309σ | 0.266σ | ||||
| TestDevel_test_issue_691 | 0.395σ | 0.229σ | 0.181σ | 0.308σ | 0.256σ | ||
| TestModels_test_dcopf_case2383wp | 0.818σ | 0.0337σ | 0.122σ | 0.153σ | 0.205σ | ||
| TestModels_test_uc_20140901_expected | -0.123σ | 0.0308σ | 0.0118σ | 0.268σ | 0.29σ |
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | 1.22σ | -0.123σ | 2.14σ | ||||
| TestMisc_test_bilinear_100 | 1.84σ | 0.404σ | 0.698σ | 0.485σ | 0.237σ | ||
| TestMisc_test_bilinear_100000 | -0.0376σ | 0.163σ | 0.358σ | 0.103σ | 0.0399σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 1.85σ | 0.00338σ | 0.541σ | 0.594σ | 0.382σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | -0.66σ | 0.187σ | 0.0411σ | 0.173σ | 0.0424σ | ||
| TestMisc_test_diag_quicksum_100 | 1.75σ | 0.00111σ | 0.23σ | 0.207σ | 0.224σ | ||
| TestMisc_test_diag_quicksum_100000 | 1.36σ | 0.143σ | 0.0864σ | 0.271σ | -0.0654σ | ||
| TestMisc_test_diag_sum_100 | 1.66σ | 0.442σ | 0.328σ | 0.196σ | 0.128σ | ||
| TestMisc_test_diag_sum_100000 | 1.47σ | 0.323σ | 0.0876σ | 0.162σ | -0.0597σ | ||
| TestMisc_test_pmedian_quicksum_test4 | 0.658σ | 0.195σ | 0.207σ | 0.139σ | 0.0718σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 0.159σ | 0.468σ | 0.161σ | 0.135σ | 0.0452σ | ||
| TestMisc_test_pmedian_sum_test4 | 0.39σ | 0.195σ | 0.0758σ | 0.19σ | 0.0184σ | ||
| TestMisc_test_pmedian_sum_test8 | 0.0663σ | 0.0677σ | 0.143σ | 0.12σ | -0.0192σ | ||
| TestMisc_test_pmedian_tuple_test4 | 1.33σ | 0.174σ | 0.102σ | 0.13σ | 0.0729σ | ||
| TestMisc_test_pmedian_tuple_test8 | 0.0407σ | 0.104σ | 0.113σ | 0.278σ | 0.00541σ | ||
| TestJump_test_clnlbean_5000 | 0.0101σ | 0.0726σ | -0.0705σ | ||||
| TestJump_test_clnlbean_50000 | -0.0527σ | 0.142σ | -0.048σ | ||||
| TestJump_test_facility_25 | 0.229σ | -0.136σ | 0.143σ | 0.188σ | 0.222σ | ||
| TestJump_test_facility_5 | 1.32σ | 0.156σ | 0.345σ | 0.0975σ | 0.114σ | ||
| TestJump_test_facility_quicksum_25 | 0.251σ | -0.0506σ | 0.314σ | 0.116σ | 0.214σ | ||
| TestJump_test_facility_quicksum_5 | 1.28σ | 0.43σ | 0.244σ | 0.177σ | 0.25σ | ||
| TestJump_test_lqcp_10 | 1.65σ | 0.751σ | 0.61σ | 0.64σ | 0.215σ | ||
| TestJump_test_lqcp_500 | 0.479σ | -0.0422σ | 0.157σ | 0.058σ | 0.0737σ | ||
| TestJump_test_lqcp_quicksum_10 | 1.59σ | 0.0134σ | 0.735σ | 0.431σ | 0.25σ | ||
| TestJump_test_lqcp_quicksum_500 | 0.227σ | -0.00532σ | 0.217σ | 0.079σ | 0.0261σ | ||
| TestJump_test_opf_662 | -0.467σ | 0.0902σ | -0.0628σ | ||||
| TestJump_test_opf_6620 | -0.703σ | 0.106σ | -0.0827σ | ||||
| TestJump_test_opf_quicksum_662 | -0.0385σ | 0.862σ | -0.095σ | ||||
| TestJump_test_opf_quicksum_6620 | -0.218σ | 0.0544σ | -0.0609σ | ||||
| TestDevel_test_issue_691 | 0.00037σ | 0.0116σ | -0.0815σ | 0.346σ | 0.0205σ | ||
| TestModels_test_dcopf_case2383wp | -0.141σ | 0.0293σ | 0.199σ | -0.0272σ | 0.0521σ | ||
| TestModels_test_uc_20140901_expected | -0.331σ | 0.0524σ | 0.0574σ | 0.243σ | 0.0471σ |
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | 0.891σ | 0.393σ | 2.12σ | ||||
| TestMisc_test_bilinear_100 | 1.77σ | 0.4σ | 0.639σ | 0.359σ | 0.49σ | ||
| TestMisc_test_bilinear_100000 | 0.664σ | 0.313σ | 0.567σ | 0.228σ | 0.372σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 1.55σ | 0.488σ | 0.7σ | 0.34σ | 0.478σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | 0.594σ | 0.178σ | 0.417σ | 0.223σ | 0.213σ | ||
| TestMisc_test_diag_quicksum_100 | 1.75σ | 0.0201σ | 0.667σ | 0.177σ | 0.421σ | ||
| TestMisc_test_diag_quicksum_100000 | 0.514σ | 0.223σ | 0.398σ | 0.219σ | 0.449σ | ||
| TestMisc_test_diag_sum_100 | 1.7σ | 0.0141σ | 0.465σ | 0.207σ | 0.181σ | ||
| TestMisc_test_diag_sum_100000 | 0.832σ | 0.304σ | 0.428σ | 0.0643σ | 0.397σ | ||
| TestMisc_test_pmedian_quicksum_test4 | 0.207σ | 0.199σ | 0.563σ | 0.141σ | 0.333σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 0.104σ | 0.217σ | 0.302σ | 0.179σ | 0.414σ | ||
| TestMisc_test_pmedian_sum_test4 | 0.0592σ | 0.196σ | 0.215σ | 0.0452σ | 0.152σ | ||
| TestMisc_test_pmedian_sum_test8 | 0.0984σ | 0.255σ | 0.402σ | 0.103σ | 0.381σ | ||
| TestMisc_test_pmedian_tuple_test4 | 0.0358σ | 0.391σ | 0.634σ | 0.175σ | 0.361σ | ||
| TestMisc_test_pmedian_tuple_test8 | 0.197σ | 0.18σ | 0.49σ | 0.182σ | 0.477σ | ||
| TestJump_test_clnlbean_5000 | 0.299σ | 0.493σ | 0.401σ | ||||
| TestJump_test_clnlbean_50000 | 0.347σ | 0.44σ | 0.412σ | ||||
| TestJump_test_facility_25 | 0.0872σ | 0.334σ | 0.369σ | 0.136σ | 0.653σ | ||
| TestJump_test_facility_5 | 1.28σ | 0.487σ | 0.405σ | 0.312σ | 0.496σ | ||
| TestJump_test_facility_quicksum_25 | 0.173σ | 0.538σ | 0.178σ | 0.345σ | 0.505σ | ||
| TestJump_test_facility_quicksum_5 | 1.31σ | 0.43σ | 0.301σ | 0.249σ | 0.426σ | ||
| TestJump_test_lqcp_10 | 1.62σ | 0.446σ | 0.242σ | 0.13σ | 0.275σ | ||
| TestJump_test_lqcp_500 | 0.356σ | 0.39σ | 0.298σ | 0.185σ | 0.316σ | ||
| TestJump_test_lqcp_quicksum_10 | 1.52σ | 0.515σ | 0.585σ | 0.51σ | 0.403σ | ||
| TestJump_test_lqcp_quicksum_500 | 0.268σ | 0.477σ | 0.337σ | 0.136σ | 0.408σ | ||
| TestJump_test_opf_662 | 1.26σ | 0.384σ | 0.406σ | ||||
| TestJump_test_opf_6620 | 0.322σ | 0.418σ | 0.405σ | ||||
| TestJump_test_opf_quicksum_662 | 0.517σ | 0.406σ | 0.443σ | ||||
| TestJump_test_opf_quicksum_6620 | 0.344σ | 0.396σ | 0.346σ | ||||
| TestDevel_test_issue_691 | 0.00664σ | 0.0137σ | 0.0413σ | 0.0243σ | 0.151σ | ||
| TestModels_test_dcopf_case2383wp | 0.114σ | 0.186σ | 0.211σ | 0.0578σ | 0.403σ | ||
| TestModels_test_uc_20140901_expected | 0.0849σ | 0.351σ | 0.232σ | 0.0641σ | 0.158σ |
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | -0.0711σ | 0.602σ | 2.29σ | ||||
| TestMisc_test_bilinear_100 | 2.07σ | 0.642σ | 0.648σ | 0.348σ | 0.368σ | ||
| TestMisc_test_bilinear_100000 | 1.08σ | -0.0537σ | -0.0479σ | 0.295σ | 0.156σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 2.17σ | 0.00583σ | 0.913σ | 0.374σ | 0.147σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | 0.81σ | -0.127σ | -0.0725σ | 0.274σ | 0.12σ | ||
| TestMisc_test_diag_quicksum_100 | 2.12σ | 0.00811σ | 0.942σ | 0.289σ | 0.282σ | ||
| TestMisc_test_diag_quicksum_100000 | 2.24σ | -0.0905σ | 0.139σ | -0.0553σ | 0.367σ | ||
| TestMisc_test_diag_sum_100 | 2.08σ | 0.811σ | 0.589σ | 0.0406σ | 0.496σ | ||
| TestMisc_test_diag_sum_100000 | 2.23σ | -0.405σ | 0.0413σ | 0.145σ | 0.0588σ | ||
| TestMisc_test_pmedian_quicksum_test4 | -0.0083σ | -0.00458σ | 0.691σ | -0.022σ | 0.0764σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 1.03σ | -0.229σ | -0.0132σ | -0.0415σ | 0.199σ | ||
| TestMisc_test_pmedian_sum_test4 | -0.00146σ | -0.0215σ | 0.518σ | -0.00237σ | 0.0576σ | ||
| TestMisc_test_pmedian_sum_test8 | 0.573σ | 0.124σ | 0.311σ | -0.201σ | 0.142σ | ||
| TestMisc_test_pmedian_tuple_test4 | -0.00993σ | -0.0249σ | 0.192σ | -0.00905σ | 0.0789σ | ||
| TestMisc_test_pmedian_tuple_test8 | 0.707σ | -0.13σ | 0.13σ | -0.0821σ | 0.19σ | ||
| TestJump_test_clnlbean_5000 | -0.0543σ | -0.0314σ | 0.177σ | ||||
| TestJump_test_clnlbean_50000 | 1.27σ | -0.0276σ | 0.213σ | ||||
| TestJump_test_facility_25 | 0.452σ | -0.102σ | 0.382σ | 1.01σ | 0.208σ | ||
| TestJump_test_facility_5 | 9.81e-05σ | -0.00933σ | 0.172σ | -0.0176σ | 0.0923σ | ||
| TestJump_test_facility_quicksum_25 | 0.636σ | -0.0881σ | 0.447σ | 1.13σ | 0.21σ | ||
| TestJump_test_facility_quicksum_5 | -0.0062σ | 4.92e-05σ | 0.508σ | -0.0085σ | 0.136σ | ||
| TestJump_test_lqcp_10 | -0.00388σ | 0.805σ | 0.639σ | 0.27σ | 0.258σ | ||
| TestJump_test_lqcp_500 | -0.143σ | 0.0737σ | 0.0206σ | -0.0576σ | 0.259σ | ||
| TestJump_test_lqcp_quicksum_10 | -0.00229σ | 0.0178σ | 0.771σ | 0.355σ | 0.176σ | ||
| TestJump_test_lqcp_quicksum_500 | -0.0157σ | -0.0374σ | 0.00366σ | -0.0796σ | 0.186σ | ||
| TestJump_test_opf_662 | -0.0151σ | -0.0478σ | 0.0748σ | ||||
| TestJump_test_opf_6620 | 0.84σ | -0.023σ | 0.0886σ | ||||
| TestJump_test_opf_quicksum_662 | -0.0156σ | -0.00869σ | 0.0638σ | ||||
| TestJump_test_opf_quicksum_6620 | 0.739σ | -0.00264σ | 0.171σ | ||||
| TestDevel_test_issue_691 | 0.325σ | -0.315σ | 0.231σ | -0.257σ | 0.0654σ | ||
| TestModels_test_dcopf_case2383wp | 0.14σ | -0.0868σ | 0.418σ | -0.0529σ | 0.0568σ | ||
| TestModels_test_uc_20140901_expected | -0.359σ | -0.0459σ | 0.155σ | -0.0427σ | 0.126σ |
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | 0.381σ | 0.048σ | 1.9σ | ||||
| TestMisc_test_bilinear_100 | 0.927σ | 0.256σ | 0.253σ | 0.252σ | 0.264σ | ||
| TestMisc_test_bilinear_100000 | 0.0882σ | 0.0288σ | 0.0151σ | 0.063σ | 0.113σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 0.521σ | 2.83σ | 0.377σ | 0.26σ | 0.0529σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | -0.0688σ | 0.00806σ | 0.00163σ | 0.065σ | 0.128σ | ||
| TestMisc_test_diag_quicksum_100 | 1.09σ | 1.27σ | 0.321σ | 0.234σ | 0.241σ | ||
| TestMisc_test_diag_quicksum_100000 | -0.231σ | 0.0745σ | 0.205σ | 0.427σ | 0.232σ | ||
| TestMisc_test_diag_sum_100 | 1.75σ | 0.683σ | 0.697σ | 0.495σ | 0.512σ | ||
| TestMisc_test_diag_sum_100000 | -0.412σ | 0.346σ | 0.242σ | 0.417σ | 0.233σ | ||
| TestMisc_test_pmedian_quicksum_test4 | 0.12σ | 0.324σ | 0.325σ | 0.265σ | 0.246σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 0.0755σ | 0.0364σ | 0.127σ | 0.177σ | 0.336σ | ||
| TestMisc_test_pmedian_sum_test4 | 0.0448σ | 0.388σ | 0.149σ | 0.137σ | 1.13σ | ||
| TestMisc_test_pmedian_sum_test8 | 0.0734σ | 0.119σ | 0.0807σ | 0.228σ | 0.231σ | ||
| TestMisc_test_pmedian_tuple_test4 | 0.48σ | 0.126σ | 0.134σ | 0.134σ | 0.207σ | ||
| TestMisc_test_pmedian_tuple_test8 | 0.155σ | 0.239σ | 0.12σ | 0.17σ | 0.168σ | ||
| TestJump_test_clnlbean_5000 | 0.0608σ | 1.11σ | 0.29σ | ||||
| TestJump_test_clnlbean_50000 | -0.00331σ | 0.193σ | 0.321σ | ||||
| TestJump_test_facility_25 | 0.199σ | 0.014σ | 0.234σ | 0.26σ | 0.201σ | ||
| TestJump_test_facility_5 | 1.26σ | 0.00845σ | 0.192σ | 0.377σ | 0.258σ | ||
| TestJump_test_facility_quicksum_25 | 0.383σ | 0.0346σ | 0.354σ | 0.333σ | 0.221σ | ||
| TestJump_test_facility_quicksum_5 | 1.23σ | 0.0217σ | 0.265σ | 0.293σ | 0.21σ | ||
| TestJump_test_lqcp_10 | 1.66σ | 0.548σ | 0.551σ | 0.409σ | 0.333σ | ||
| TestJump_test_lqcp_500 | -0.108σ | 0.175σ | 0.0847σ | 0.321σ | 0.351σ | ||
| TestJump_test_lqcp_quicksum_10 | 1.71σ | 0.459σ | 0.373σ | 0.204σ | 0.147σ | ||
| TestJump_test_lqcp_quicksum_500 | -0.166σ | 0.14σ | 0.0928σ | 0.385σ | 0.395σ | ||
| TestJump_test_opf_662 | 0.0433σ | 0.0427σ | 0.266σ | ||||
| TestJump_test_opf_6620 | -0.421σ | -0.00772σ | 0.256σ | ||||
| TestJump_test_opf_quicksum_662 | 0.2σ | 0.0201σ | 0.243σ | ||||
| TestJump_test_opf_quicksum_6620 | -0.42σ | -0.00569σ | 0.235σ | ||||
| TestDevel_test_issue_691 | 0.241σ | 0.259σ | 0.207σ | 0.0683σ | 0.127σ | ||
| TestModels_test_dcopf_case2383wp | 0.611σ | 0.241σ | 0.223σ | 0.313σ | 0.3σ | ||
| TestModels_test_uc_20140901_expected | -0.172σ | 0.196σ | 0.136σ | 0.12σ | 0.333σ |
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | 0.477σ | -0.0492σ | 1.96σ | ||||
| TestMisc_test_bilinear_100 | 1.09σ | 0.296σ | 0.406σ | 0.171σ | 0.297σ | ||
| TestMisc_test_bilinear_100000 | -0.115σ | 0.375σ | 0.3σ | 0.243σ | 0.182σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 1.62σ | 0.00445σ | 0.557σ | 0.259σ | 0.255σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | -0.492σ | 0.449σ | 0.258σ | 0.111σ | 0.176σ | ||
| TestMisc_test_diag_quicksum_100 | 1.8σ | 0.393σ | 0.396σ | 0.328σ | 0.276σ | ||
| TestMisc_test_diag_quicksum_100000 | 1.42σ | 0.383σ | 0.15σ | 0.301σ | 0.0153σ | ||
| TestMisc_test_diag_sum_100 | 1.92σ | 0.935σ | 0.366σ | 0.258σ | 0.266σ | ||
| TestMisc_test_diag_sum_100000 | 1.42σ | 0.12σ | 0.0461σ | 0.0411σ | 0.0161σ | ||
| TestMisc_test_pmedian_quicksum_test4 | 0.365σ | 0.115σ | 0.114σ | 0.08σ | 0.0718σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 0.094σ | 0.0911σ | 0.137σ | 0.204σ | 0.0821σ | ||
| TestMisc_test_pmedian_sum_test4 | 0.569σ | 0.0246σ | 0.477σ | 0.0618σ | 0.0642σ | ||
| TestMisc_test_pmedian_sum_test8 | 0.108σ | 0.192σ | 0.148σ | 0.228σ | 0.122σ | ||
| TestMisc_test_pmedian_tuple_test4 | 0.948σ | 0.0846σ | 0.164σ | 0.0958σ | 0.0425σ | ||
| TestMisc_test_pmedian_tuple_test8 | 0.145σ | 0.243σ | 0.335σ | 0.267σ | 0.166σ | ||
| TestJump_test_clnlbean_5000 | 0.0196σ | 0.0454σ | 0.102σ | ||||
| TestJump_test_clnlbean_50000 | -0.00344σ | 0.13σ | 0.139σ | ||||
| TestJump_test_facility_25 | 0.3σ | 0.136σ | 0.459σ | 0.34σ | 0.126σ | ||
| TestJump_test_facility_5 | 1.31σ | 0.245σ | 0.217σ | 0.229σ | 0.227σ | ||
| TestJump_test_facility_quicksum_25 | 0.305σ | 0.144σ | 0.254σ | 0.213σ | 0.159σ | ||
| TestJump_test_facility_quicksum_5 | 1.24σ | 0.364σ | 0.167σ | 0.0831σ | 0.225σ | ||
| TestJump_test_lqcp_10 | 1.64σ | 0.317σ | 0.222σ | 0.107σ | 0.105σ | ||
| TestJump_test_lqcp_500 | 0.403σ | 0.224σ | 0.0984σ | 0.326σ | 0.107σ | ||
| TestJump_test_lqcp_quicksum_10 | 1.67σ | 0.554σ | 0.421σ | 0.18σ | 0.175σ | ||
| TestJump_test_lqcp_quicksum_500 | 0.356σ | 0.191σ | 0.169σ | 0.258σ | 0.0669σ | ||
| TestJump_test_opf_662 | -0.211σ | 0.0873σ | 0.262σ | ||||
| TestJump_test_opf_6620 | -0.0551σ | 0.224σ | 0.303σ | ||||
| TestJump_test_opf_quicksum_662 | -0.257σ | 0.236σ | 0.346σ | ||||
| TestJump_test_opf_quicksum_6620 | -0.282σ | 0.293σ | 0.432σ | ||||
| TestDevel_test_issue_691 | 0.0384σ | 0.0669σ | 0.0652σ | 0.0686σ | 0.0398σ | ||
| TestModels_test_dcopf_case2383wp | 0.0889σ | 0.0819σ | 0.191σ | 0.127σ | 0.137σ | ||
| TestModels_test_uc_20140901_expected | -0.23σ | 0.181σ | 0.0855σ | 0.226σ | 0.264σ |
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | 1.04σ | -0.276σ | 2.15σ | ||||
| TestMisc_test_bilinear_100 | 1.91σ | 0.688σ | 0.845σ | 0.428σ | 0.454σ | ||
| TestMisc_test_bilinear_100000 | 0.0227σ | 0.361σ | 0.15σ | 0.0809σ | 0.121σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 1.85σ | 1.6σ | 0.654σ | 0.422σ | 0.344σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | 0.104σ | 0.187σ | 0.113σ | 0.0779σ | 0.0715σ | ||
| TestMisc_test_diag_quicksum_100 | 1.93σ | 1.38σ | 0.307σ | 0.656σ | 0.583σ | ||
| TestMisc_test_diag_quicksum_100000 | 1.02σ | 0.207σ | -0.0389σ | -0.0262σ | 0.109σ | ||
| TestMisc_test_diag_sum_100 | 1.81σ | 0.859σ | 0.464σ | 0.354σ | 0.58σ | ||
| TestMisc_test_diag_sum_100000 | 1.27σ | 0.0939σ | -0.0581σ | 0.0458σ | -0.127σ | ||
| TestMisc_test_pmedian_quicksum_test4 | 0.789σ | 0.256σ | 0.0854σ | 0.0792σ | -0.043σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 0.225σ | 0.127σ | 0.166σ | 0.0455σ | 0.0457σ | ||
| TestMisc_test_pmedian_sum_test4 | 0.608σ | 0.264σ | 0.101σ | 0.0529σ | 0.00578σ | ||
| TestMisc_test_pmedian_sum_test8 | 0.0855σ | -0.013σ | 0.0142σ | 0.048σ | -0.051σ | ||
| TestMisc_test_pmedian_tuple_test4 | 0.105σ | 0.142σ | 0.111σ | 0.0608σ | 0.0231σ | ||
| TestMisc_test_pmedian_tuple_test8 | 0.179σ | 0.0638σ | 0.0682σ | 0.0691σ | -0.00932σ | ||
| TestJump_test_clnlbean_5000 | -0.00686σ | 0.148σ | -0.00771σ | ||||
| TestJump_test_clnlbean_50000 | 0.125σ | 0.137σ | 0.0417σ | ||||
| TestJump_test_facility_25 | -0.00377σ | 0.439σ | 0.107σ | 0.183σ | 0.12σ | ||
| TestJump_test_facility_5 | 1.42σ | 0.14σ | 0.125σ | 0.0459σ | 0.0922σ | ||
| TestJump_test_facility_quicksum_25 | -0.0156σ | -0.0152σ | 0.299σ | -0.0618σ | 0.087σ | ||
| TestJump_test_facility_quicksum_5 | 1.42σ | 0.107σ | 0.0801σ | -0.0617σ | 0.0822σ | ||
| TestJump_test_lqcp_10 | 1.71σ | 0.548σ | 0.401σ | 0.0397σ | 0.345σ | ||
| TestJump_test_lqcp_500 | 0.24σ | 0.148σ | 0.16σ | 0.0141σ | 0.175σ | ||
| TestJump_test_lqcp_quicksum_10 | 1.78σ | 0.43σ | 0.483σ | 0.267σ | 0.392σ | ||
| TestJump_test_lqcp_quicksum_500 | 0.496σ | 0.0654σ | 0.0189σ | 0.0124σ | 0.169σ | ||
| TestJump_test_opf_662 | 0.0211σ | 0.22σ | 0.00392σ | ||||
| TestJump_test_opf_6620 | -0.629σ | 0.346σ | 0.12σ | ||||
| TestJump_test_opf_quicksum_662 | -0.0862σ | 0.18σ | 0.188σ | ||||
| TestJump_test_opf_quicksum_6620 | -0.0902σ | 0.231σ | 0.207σ | ||||
| TestDevel_test_issue_691 | -0.00209σ | 0.011σ | -0.0502σ | 0.0629σ | 0.00938σ | ||
| TestModels_test_dcopf_case2383wp | -0.0107σ | 0.197σ | 0.128σ | 0.0959σ | 0.135σ | ||
| TestModels_test_uc_20140901_expected | -0.163σ | 0.117σ | 0.03σ | 0.0397σ | 0.0993σ |
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | 1.19σ | 0.574σ | 2.18σ | ||||
| TestMisc_test_bilinear_100 | 1.9σ | 0.996σ | 1.12σ | 0.573σ | 0.837σ | ||
| TestMisc_test_bilinear_100000 | 0.959σ | 0.597σ | 0.546σ | 0.338σ | 0.588σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 1.7σ | 1.18σ | 1.23σ | 1.06σ | 0.982σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | 0.768σ | 0.246σ | 0.599σ | 0.386σ | 0.537σ | ||
| TestMisc_test_diag_quicksum_100 | 2.0σ | 0.82σ | 1.14σ | 0.487σ | 0.712σ | ||
| TestMisc_test_diag_quicksum_100000 | 0.952σ | 0.291σ | 0.437σ | 0.296σ | 0.573σ | ||
| TestMisc_test_diag_sum_100 | 1.92σ | 0.982σ | 1.2σ | 0.662σ | 0.811σ | ||
| TestMisc_test_diag_sum_100000 | 0.597σ | 0.211σ | 0.459σ | 0.356σ | 0.526σ | ||
| TestMisc_test_pmedian_quicksum_test4 | 0.999σ | 0.428σ | 0.635σ | 0.352σ | 0.576σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 0.416σ | 0.201σ | 0.593σ | 0.36σ | 0.62σ | ||
| TestMisc_test_pmedian_sum_test4 | 0.0582σ | 0.413σ | 0.62σ | 0.429σ | 0.63σ | ||
| TestMisc_test_pmedian_sum_test8 | 0.284σ | 0.214σ | 0.555σ | 0.369σ | 0.668σ | ||
| TestMisc_test_pmedian_tuple_test4 | 0.884σ | 0.496σ | 0.806σ | 0.347σ | 0.634σ | ||
| TestMisc_test_pmedian_tuple_test8 | 0.315σ | 0.245σ | 0.505σ | 0.352σ | 0.601σ | ||
| TestJump_test_clnlbean_5000 | 0.462σ | 0.582σ | 0.68σ | ||||
| TestJump_test_clnlbean_50000 | 0.463σ | 0.688σ | 0.669σ | ||||
| TestJump_test_facility_25 | 0.0483σ | 0.347σ | 0.516σ | 0.726σ | 0.563σ | ||
| TestJump_test_facility_5 | 1.41σ | 0.4σ | 0.559σ | 0.572σ | 0.585σ | ||
| TestJump_test_facility_quicksum_25 | 0.125σ | 0.269σ | 0.398σ | 0.534σ | 0.641σ | ||
| TestJump_test_facility_quicksum_5 | 1.33σ | 0.601σ | 0.671σ | 0.626σ | 0.576σ | ||
| TestJump_test_lqcp_10 | 1.68σ | 1.04σ | 0.792σ | 0.588σ | 0.479σ | ||
| TestJump_test_lqcp_500 | 0.467σ | 0.605σ | 0.44σ | 0.454σ | 0.523σ | ||
| TestJump_test_lqcp_quicksum_10 | 1.71σ | 0.00988σ | 0.725σ | 0.654σ | 0.657σ | ||
| TestJump_test_lqcp_quicksum_500 | 0.414σ | 0.458σ | 0.356σ | 0.516σ | 0.53σ | ||
| TestJump_test_opf_662 | 0.378σ | 0.398σ | 0.641σ | ||||
| TestJump_test_opf_6620 | 0.394σ | 0.398σ | 0.67σ | ||||
| TestJump_test_opf_quicksum_662 | 0.444σ | 0.47σ | 0.714σ | ||||
| TestJump_test_opf_quicksum_6620 | 0.475σ | 0.629σ | 0.665σ | ||||
| TestDevel_test_issue_691 | 0.0128σ | 0.00293σ | 0.116σ | 1.09σ | 0.433σ | ||
| TestModels_test_dcopf_case2383wp | 0.277σ | 0.369σ | 0.595σ | 0.571σ | 0.526σ | ||
| TestModels_test_uc_20140901_expected | 0.0883σ | 0.372σ | 0.577σ | 0.556σ | 0.654σ |