Welcome to Pyomo's performance test results portal!
Please explore the expandable sections below for different categories of Pyomo's current performance. The numbers shown are standard deviations away from the running average (where a positive number is slower than average, negative faster than average).
Note: Alerts are generated based on repeated performance. The table represents only the most recent run of the performance test suite.
Last update: Oct-23-2026 10:19
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | -0.314σ | 1.59σ | 1.73σ | ||||
| TestMisc_test_bilinear_100 | 1.84σ | 1.35σ | 1.11σ | 1.36σ | 1.22σ | ||
| TestMisc_test_bilinear_100000 | 1.08σ | -0.0522σ | 1.36σ | 0.754σ | 0.769σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 1.47σ | 1.0σ | 1.33σ | 1.28σ | 0.834σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | 0.577σ | -0.097σ | 0.291σ | 0.661σ | 0.498σ | ||
| TestMisc_test_diag_quicksum_100 | 1.5σ | 0.82σ | 1.12σ | 1.38σ | 1.18σ | ||
| TestMisc_test_diag_quicksum_100000 | 1.3σ | 0.15σ | 1.42σ | 0.621σ | 1.39σ | ||
| TestMisc_test_diag_sum_100 | 1.43σ | 1.08σ | 1.07σ | 1.33σ | 1.15σ | ||
| TestMisc_test_diag_sum_100000 | 1.16σ | 0.687σ | 1.76σ | 0.474σ | 0.862σ | ||
| TestMisc_test_pmedian_quicksum_test4 | -0.653σ | -0.794σ | 1.39σ | -0.795σ | 0.447σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 1.56σ | -0.0271σ | 1.03σ | 0.646σ | 0.512σ | ||
| TestMisc_test_pmedian_sum_test4 | -0.604σ | -0.638σ | 2.22σ | -0.721σ | 0.214σ | ||
| TestMisc_test_pmedian_sum_test8 | 1.42σ | 1.22σ | 1.45σ | -0.678σ | 0.314σ | ||
| TestMisc_test_pmedian_tuple_test4 | -0.0872σ | -0.969σ | 1.24σ | -0.767σ | 0.318σ | ||
| TestMisc_test_pmedian_tuple_test8 | 1.89σ | 0.04σ | 0.732σ | 0.228σ | 0.763σ | ||
| TestJump_test_clnlbean_5000 | 0.221σ | -0.0527σ | -0.0548σ | ||||
| TestJump_test_clnlbean_50000 | 1.83σ | -0.38σ | 0.12σ | ||||
| TestJump_test_facility_25 | 0.573σ | -0.0905σ | 0.491σ | 1.94σ | 0.0749σ | ||
| TestJump_test_facility_5 | -0.931σ | -0.815σ | 1.39σ | -0.798σ | 0.0525σ | ||
| TestJump_test_facility_quicksum_25 | 0.824σ | -0.102σ | 0.566σ | 0.912σ | 0.00203σ | ||
| TestJump_test_facility_quicksum_5 | -0.9σ | -0.701σ | 1.07σ | -0.688σ | -0.0711σ | ||
| TestJump_test_lqcp_10 | -0.811σ | 1.17σ | 1.91σ | 0.558σ | 0.293σ | ||
| TestJump_test_lqcp_500 | 0.0229σ | -0.203σ | 0.976σ | -0.718σ | -0.0975σ | ||
| TestJump_test_lqcp_quicksum_10 | -1.18σ | 0.0175σ | 1.2σ | 1.76σ | 0.891σ | ||
| TestJump_test_lqcp_quicksum_500 | 0.172σ | -0.122σ | 1.04σ | -0.814σ | -0.0584σ | ||
| TestJump_test_opf_662 | 1.99σ | -0.74σ | 0.36σ | ||||
| TestJump_test_opf_6620 | 1.31σ | -0.972σ | 0.114σ | ||||
| TestJump_test_opf_quicksum_662 | -0.161σ | -0.836σ | 0.124σ | ||||
| TestJump_test_opf_quicksum_6620 | 1.38σ | -0.187σ | 0.37σ | ||||
| TestDevel_test_issue_691 | 0.724σ | 0.324σ | 1.19σ | -0.161σ | 0.0862σ | ||
| TestModels_test_dcopf_case2383wp | 1.12σ | -0.834σ | 1.98σ | -0.627σ | 0.157σ | ||
| TestModels_test_uc_20140901_expected | 0.935σ | 0.947σ | 1.01σ | -0.806σ | 0.243σ |
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | 1.42σ | 0.158σ | 0.937σ | ||||
| TestMisc_test_bilinear_100 | 1.99σ | 1.51σ | 1.37σ | 1.96σ | 2.07σ | ||
| TestMisc_test_bilinear_100000 | 0.378σ | 0.415σ | 0.545σ | 0.238σ | 0.186σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 1.53σ | 1.74σ | 1.31σ | 1.41σ | 1.29σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | 0.204σ | 0.309σ | 0.435σ | 0.225σ | 0.106σ | ||
| TestMisc_test_diag_quicksum_100 | 1.57σ | 1.34σ | 1.07σ | 1.07σ | 1.21σ | ||
| TestMisc_test_diag_quicksum_100000 | -0.103σ | 0.0866σ | 0.137σ | 0.0633σ | 0.11σ | ||
| TestMisc_test_diag_sum_100 | 1.77σ | 1.3σ | 1.2σ | 0.937σ | 0.99σ | ||
| TestMisc_test_diag_sum_100000 | 0.448σ | 0.528σ | 0.726σ | 0.393σ | 0.243σ | ||
| TestMisc_test_pmedian_quicksum_test4 | 2.09σ | 1.21σ | 1.1σ | 0.698σ | 0.432σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 1.03σ | 0.246σ | 0.676σ | 0.226σ | 0.226σ | ||
| TestMisc_test_pmedian_sum_test4 | 1.31σ | 0.181σ | 0.711σ | 0.431σ | 0.214σ | ||
| TestMisc_test_pmedian_sum_test8 | 0.481σ | 0.352σ | 0.225σ | 0.3σ | 0.215σ | ||
| TestMisc_test_pmedian_tuple_test4 | 0.0189σ | 1.51σ | 1.74σ | 0.611σ | 1.09σ | ||
| TestMisc_test_pmedian_tuple_test8 | 1.82σ | 1.67σ | 2.11σ | 1.01σ | 0.527σ | ||
| TestJump_test_clnlbean_5000 | 0.334σ | 1.45σ | 0.713σ | ||||
| TestJump_test_clnlbean_50000 | 1.21σ | 1.42σ | 0.769σ | ||||
| TestJump_test_facility_25 | 1.02σ | 0.951σ | 2.53σ | 0.753σ | 0.5σ | ||
| TestJump_test_facility_5 | 1.69σ | 1.44σ | 2.13σ | 0.975σ | 0.598σ | ||
| TestJump_test_facility_quicksum_25 | 0.946σ | 1.15σ | 2.39σ | 0.835σ | 0.486σ | ||
| TestJump_test_facility_quicksum_5 | 1.58σ | 1.42σ | 2.22σ | 1.48σ | 0.824σ | ||
| TestJump_test_lqcp_10 | 1.77σ | 1.57σ | 1.54σ | 1.17σ | 0.762σ | ||
| TestJump_test_lqcp_500 | 0.138σ | 1.12σ | 1.9σ | 0.725σ | 0.13σ | ||
| TestJump_test_lqcp_quicksum_10 | 1.62σ | 0.0152σ | 1.41σ | 1.55σ | 0.976σ | ||
| TestJump_test_lqcp_quicksum_500 | 1.68σ | 1.81σ | 1.52σ | 0.394σ | 0.428σ | ||
| TestJump_test_opf_662 | 0.448σ | 1.56σ | 0.152σ | ||||
| TestJump_test_opf_6620 | 0.068σ | 1.8σ | 0.388σ | ||||
| TestJump_test_opf_quicksum_662 | 0.816σ | 1.16σ | 0.396σ | ||||
| TestJump_test_opf_quicksum_6620 | 0.198σ | 0.845σ | 0.245σ | ||||
| TestDevel_test_issue_691 | 1.58σ | 0.596σ | 1.65σ | 1.31σ | 1.04σ | ||
| TestModels_test_dcopf_case2383wp | 0.561σ | 2.04σ | 2.2σ | 1.12σ | 0.953σ | ||
| TestModels_test_uc_20140901_expected | 1.53σ | 1.25σ | 1.86σ | 0.813σ | 0.987σ |
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | 2.88σ | 0.516σ | 1.81σ | ||||
| TestMisc_test_bilinear_100 | 1.36σ | 1.65σ | 1.5σ | 1.28σ | 1.51σ | ||
| TestMisc_test_bilinear_100000 | 0.872σ | 0.577σ | 2.1σ | 1.9σ | 1.35σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 1.71σ | 1.11σ | 1.75σ | 1.69σ | 1.58σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | 0.604σ | 1.37σ | 2.39σ | 2.03σ | 0.77σ | ||
| TestMisc_test_diag_quicksum_100 | 1.63σ | 0.747σ | 1.5σ | 1.61σ | 1.11σ | ||
| TestMisc_test_diag_quicksum_100000 | 0.804σ | 0.595σ | 1.16σ | 0.421σ | 0.772σ | ||
| TestMisc_test_diag_sum_100 | 2.02σ | 1.17σ | 1.48σ | 0.999σ | 1.19σ | ||
| TestMisc_test_diag_sum_100000 | 1.17σ | 0.604σ | 0.911σ | 0.692σ | 0.696σ | ||
| TestMisc_test_pmedian_quicksum_test4 | 2.17σ | 0.919σ | 1.52σ | 0.497σ | 0.7σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 1.47σ | 0.603σ | 1.28σ | 0.673σ | 0.708σ | ||
| TestMisc_test_pmedian_sum_test4 | 0.00927σ | 0.666σ | 1.54σ | 0.668σ | 0.868σ | ||
| TestMisc_test_pmedian_sum_test8 | 0.902σ | 0.6σ | 1.39σ | 0.717σ | 0.973σ | ||
| TestMisc_test_pmedian_tuple_test4 | 1.73σ | 1.34σ | 2.2σ | 0.68σ | 1.04σ | ||
| TestMisc_test_pmedian_tuple_test8 | 1.1σ | 0.561σ | 1.55σ | 0.579σ | 1.21σ | ||
| TestJump_test_clnlbean_5000 | 0.585σ | 0.0532σ | 0.496σ | ||||
| TestJump_test_clnlbean_50000 | 0.924σ | 1.48σ | 0.309σ | ||||
| TestJump_test_facility_25 | 1.98σ | 0.968σ | 0.956σ | 0.726σ | 0.64σ | ||
| TestJump_test_facility_5 | 1.18σ | 1.14σ | 1.59σ | 0.826σ | 0.456σ | ||
| TestJump_test_facility_quicksum_25 | 0.239σ | 0.111σ | 1.09σ | 0.435σ | 0.491σ | ||
| TestJump_test_facility_quicksum_5 | 1.82σ | 0.607σ | 1.48σ | 0.818σ | 0.645σ | ||
| TestJump_test_lqcp_10 | 1.37σ | 1.18σ | 0.874σ | 0.885σ | 1.66σ | ||
| TestJump_test_lqcp_500 | 0.871σ | 0.696σ | 0.408σ | 0.261σ | 0.416σ | ||
| TestJump_test_lqcp_quicksum_10 | 1.32σ | 1.31σ | 1.35σ | 1.06σ | 0.844σ | ||
| TestJump_test_lqcp_quicksum_500 | 0.182σ | 0.403σ | 0.711σ | 0.279σ | 0.394σ | ||
| TestJump_test_opf_662 | -0.119σ | 0.171σ | 0.172σ | ||||
| TestJump_test_opf_6620 | -0.0247σ | 0.233σ | 0.391σ | ||||
| TestJump_test_opf_quicksum_662 | -0.423σ | 0.399σ | 0.302σ | ||||
| TestJump_test_opf_quicksum_6620 | -0.238σ | 0.195σ | 0.264σ | ||||
| TestDevel_test_issue_691 | 0.184σ | 0.269σ | 0.215σ | 0.489σ | 0.233σ | ||
| TestModels_test_dcopf_case2383wp | 0.419σ | 0.109σ | 0.29σ | 0.21σ | 0.101σ | ||
| TestModels_test_uc_20140901_expected | 0.109σ | 0.279σ | 0.323σ | 0.638σ | 0.241σ |
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | 0.463σ | 0.0296σ | 1.51σ | ||||
| TestMisc_test_bilinear_100 | 1.31σ | 0.987σ | 0.738σ | 0.463σ | 1.12σ | ||
| TestMisc_test_bilinear_100000 | 0.218σ | 0.92σ | 0.626σ | 0.625σ | 0.375σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 1.68σ | 0.412σ | 1.28σ | 1.53σ | 0.943σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | 0.784σ | 0.624σ | 0.614σ | 0.365σ | 0.158σ | ||
| TestMisc_test_diag_quicksum_100 | 1.78σ | 0.803σ | 1.44σ | 1.29σ | 1.02σ | ||
| TestMisc_test_diag_quicksum_100000 | 1.09σ | 1.56σ | 0.551σ | 0.011σ | -0.199σ | ||
| TestMisc_test_diag_sum_100 | 1.63σ | 1.44σ | 1.62σ | 0.976σ | 1.43σ | ||
| TestMisc_test_diag_sum_100000 | 1.2σ | 0.723σ | 0.58σ | 0.24σ | 0.195σ | ||
| TestMisc_test_pmedian_quicksum_test4 | 2.17σ | 1.5σ | 1.21σ | 0.27σ | 0.947σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 1.78σ | 0.627σ | 1.3σ | 1.05σ | 0.649σ | ||
| TestMisc_test_pmedian_sum_test4 | 0.285σ | 1.48σ | 1.68σ | 0.529σ | 0.594σ | ||
| TestMisc_test_pmedian_sum_test8 | 0.926σ | 0.533σ | 0.689σ | 1.44σ | 0.508σ | ||
| TestMisc_test_pmedian_tuple_test4 | 2.38σ | 1.59σ | 2.26σ | 0.931σ | 1.23σ | ||
| TestMisc_test_pmedian_tuple_test8 | 1.84σ | 0.98σ | 1.05σ | 0.942σ | 0.428σ | ||
| TestJump_test_clnlbean_5000 | 0.297σ | 1.28σ | 0.589σ | ||||
| TestJump_test_clnlbean_50000 | 1.31σ | 0.926σ | 0.355σ | ||||
| TestJump_test_facility_25 | 0.965σ | 0.663σ | 1.3σ | 0.6σ | 1.39σ | ||
| TestJump_test_facility_5 | 1.7σ | 1.51σ | 2.14σ | 0.751σ | 1.08σ | ||
| TestJump_test_facility_quicksum_25 | 1.24σ | 0.714σ | 0.967σ | 0.689σ | 1.18σ | ||
| TestJump_test_facility_quicksum_5 | 1.76σ | 1.25σ | 1.41σ | 1.28σ | 1.3σ | ||
| TestJump_test_lqcp_10 | 1.73σ | 1.63σ | 1.96σ | 1.59σ | 1.52σ | ||
| TestJump_test_lqcp_500 | 0.804σ | 1.17σ | 1.4σ | 1.29σ | 0.749σ | ||
| TestJump_test_lqcp_quicksum_10 | 1.71σ | 0.00808σ | 1.99σ | 1.15σ | 0.873σ | ||
| TestJump_test_lqcp_quicksum_500 | 0.842σ | 1.73σ | 1.53σ | 1.49σ | 0.592σ | ||
| TestJump_test_opf_662 | 0.498σ | 0.559σ | 0.0512σ | ||||
| TestJump_test_opf_6620 | 0.697σ | 1.39σ | 0.194σ | ||||
| TestJump_test_opf_quicksum_662 | 0.567σ | 1.48σ | 0.581σ | ||||
| TestJump_test_opf_quicksum_6620 | 0.515σ | 1.52σ | 0.784σ | ||||
| TestDevel_test_issue_691 | 0.457σ | 0.508σ | 0.651σ | 0.893σ | 0.608σ | ||
| TestModels_test_dcopf_case2383wp | 0.373σ | 1.75σ | 2.07σ | 0.114σ | 1.04σ | ||
| TestModels_test_uc_20140901_expected | 1.02σ | 1.0σ | 0.961σ | 0.469σ | 0.708σ |
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | 0.553σ | 0.712σ | 1.1σ | ||||
| TestMisc_test_bilinear_100 | 1.46σ | 0.939σ | 1.02σ | 1.22σ | 0.806σ | ||
| TestMisc_test_bilinear_100000 | 0.663σ | 0.994σ | 1.27σ | 0.91σ | 0.696σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 1.58σ | 1.7σ | 1.87σ | 1.84σ | 1.97σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | 0.764σ | 0.187σ | 1.36σ | 0.81σ | 0.502σ | ||
| TestMisc_test_diag_quicksum_100 | 1.92σ | 0.0112σ | 0.848σ | 1.07σ | 1.18σ | ||
| TestMisc_test_diag_quicksum_100000 | 0.923σ | 0.72σ | 1.3σ | 0.836σ | 0.738σ | ||
| TestMisc_test_diag_sum_100 | 1.5σ | 1.85σ | 1.86σ | 1.65σ | 2.02σ | ||
| TestMisc_test_diag_sum_100000 | 1.42σ | 0.722σ | 1.37σ | 0.707σ | 0.789σ | ||
| TestMisc_test_pmedian_quicksum_test4 | 0.705σ | 1.77σ | 2.04σ | 1.24σ | 0.634σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 1.85σ | 0.88σ | 1.35σ | 1.14σ | 0.484σ | ||
| TestMisc_test_pmedian_sum_test4 | 0.305σ | 1.89σ | 2.2σ | 1.09σ | 0.825σ | ||
| TestMisc_test_pmedian_sum_test8 | 0.347σ | 1.33σ | 1.77σ | 1.24σ | 0.676σ | ||
| TestMisc_test_pmedian_tuple_test4 | 0.0372σ | 1.52σ | 1.63σ | 0.702σ | 0.678σ | ||
| TestMisc_test_pmedian_tuple_test8 | 1.59σ | 1.13σ | 1.9σ | 0.855σ | 0.549σ | ||
| TestJump_test_clnlbean_5000 | 0.199σ | 0.543σ | 0.311σ | ||||
| TestJump_test_clnlbean_50000 | 1.22σ | 0.459σ | 0.605σ | ||||
| TestJump_test_facility_25 | 0.656σ | 1.32σ | 1.33σ | 1.07σ | 0.638σ | ||
| TestJump_test_facility_5 | 1.48σ | 1.57σ | 1.82σ | 1.89σ | 1.03σ | ||
| TestJump_test_facility_quicksum_25 | 0.889σ | 0.834σ | 1.44σ | 0.722σ | 0.674σ | ||
| TestJump_test_facility_quicksum_5 | 1.55σ | 1.75σ | 2.15σ | 1.69σ | 1.27σ | ||
| TestJump_test_lqcp_10 | 1.46σ | 1.19σ | 1.07σ | 1.07σ | 1.5σ | ||
| TestJump_test_lqcp_500 | 0.471σ | 1.14σ | 1.41σ | 0.624σ | 0.676σ | ||
| TestJump_test_lqcp_quicksum_10 | 1.55σ | 0.814σ | 1.71σ | 1.39σ | 1.1σ | ||
| TestJump_test_lqcp_quicksum_500 | 0.929σ | 0.996σ | 1.46σ | 1.02σ | 0.623σ | ||
| TestJump_test_opf_662 | 1.63σ | 0.491σ | 0.527σ | ||||
| TestJump_test_opf_6620 | 1.62σ | 0.568σ | 0.604σ | ||||
| TestJump_test_opf_quicksum_662 | 1.16σ | 0.592σ | 0.585σ | ||||
| TestJump_test_opf_quicksum_6620 | 1.74σ | 0.869σ | 0.763σ | ||||
| TestDevel_test_issue_691 | 0.0475σ | 0.235σ | 0.664σ | 0.46σ | 0.244σ | ||
| TestModels_test_dcopf_case2383wp | 0.281σ | 0.771σ | 1.33σ | 0.7σ | 0.56σ | ||
| TestModels_test_uc_20140901_expected | 0.503σ | 0.949σ | 1.54σ | 0.875σ | 0.755σ |
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | -0.201σ | 1.26σ | 1.77σ | ||||
| TestMisc_test_bilinear_100 | 1.63σ | 1.84σ | 1.77σ | 1.18σ | 1.8σ | ||
| TestMisc_test_bilinear_100000 | 1.96σ | 0.453σ | 0.825σ | 0.383σ | 0.275σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 1.54σ | 0.207σ | 1.64σ | 1.07σ | 1.84σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | 0.981σ | 0.0614σ | 0.225σ | 0.647σ | 0.244σ | ||
| TestMisc_test_diag_quicksum_100 | 1.73σ | 0.27σ | 1.68σ | 1.21σ | 1.42σ | ||
| TestMisc_test_diag_quicksum_100000 | 1.72σ | 0.596σ | 1.21σ | 0.52σ | 1.59σ | ||
| TestMisc_test_diag_sum_100 | 2.15σ | 1.25σ | 2.17σ | 0.138σ | 1.31σ | ||
| TestMisc_test_diag_sum_100000 | 1.82σ | 0.259σ | 1.2σ | 0.165σ | 0.52σ | ||
| TestMisc_test_pmedian_quicksum_test4 | -0.676σ | -0.738σ | 2.15σ | -0.812σ | 0.24σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 2.03σ | 0.983σ | 0.599σ | -0.0374σ | 0.584σ | ||
| TestMisc_test_pmedian_sum_test4 | -0.083σ | -0.251σ | 2.42σ | -0.994σ | 0.612σ | ||
| TestMisc_test_pmedian_sum_test8 | 0.959σ | 0.457σ | 1.86σ | -0.207σ | 0.956σ | ||
| TestMisc_test_pmedian_tuple_test4 | 0.967σ | 0.0618σ | 0.219σ | 0.0285σ | 1.66σ | ||
| TestMisc_test_pmedian_tuple_test8 | 2.1σ | 0.317σ | 1.3σ | 0.633σ | 0.938σ | ||
| TestJump_test_clnlbean_5000 | 1.09σ | 0.678σ | 0.245σ | ||||
| TestJump_test_clnlbean_50000 | 1.54σ | 0.456σ | 0.832σ | ||||
| TestJump_test_facility_25 | 1.06σ | 0.109σ | 1.63σ | 1.63σ | 0.508σ | ||
| TestJump_test_facility_5 | -0.981σ | -0.562σ | 0.119σ | -0.78σ | 0.442σ | ||
| TestJump_test_facility_quicksum_25 | 1.75σ | 0.397σ | 1.65σ | 1.88σ | 0.525σ | ||
| TestJump_test_facility_quicksum_5 | -1.07σ | -0.959σ | 2.19σ | -0.501σ | 0.433σ | ||
| TestJump_test_lqcp_10 | -0.591σ | 1.49σ | 1.69σ | 1.22σ | 1.11σ | ||
| TestJump_test_lqcp_500 | 0.423σ | -0.0277σ | 1.69σ | -0.389σ | 0.542σ | ||
| TestJump_test_lqcp_quicksum_10 | -1.17σ | 0.0136σ | 2.37σ | 1.6σ | 1.28σ | ||
| TestJump_test_lqcp_quicksum_500 | 0.0182σ | -0.113σ | 0.692σ | -0.832σ | 0.679σ | ||
| TestJump_test_opf_662 | -0.347σ | -0.421σ | 0.416σ | ||||
| TestJump_test_opf_6620 | 0.721σ | -0.555σ | 0.228σ | ||||
| TestJump_test_opf_quicksum_662 | -0.265σ | -0.301σ | 0.308σ | ||||
| TestJump_test_opf_quicksum_6620 | 1.11σ | -0.587σ | 0.251σ | ||||
| TestDevel_test_issue_691 | 0.502σ | -0.0767σ | 0.436σ | -0.072σ | 0.601σ | ||
| TestModels_test_dcopf_case2383wp | 0.282σ | -0.77σ | 1.23σ | -0.227σ | 0.141σ | ||
| TestModels_test_uc_20140901_expected | 0.0151σ | -0.0686σ | 0.896σ | -0.636σ | 0.281σ |
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | 1.4σ | 0.253σ | 1.35σ | ||||
| TestMisc_test_bilinear_100 | 1.6σ | 1.06σ | 1.61σ | 1.23σ | 1.25σ | ||
| TestMisc_test_bilinear_100000 | 1.56σ | 1.16σ | 0.784σ | 0.965σ | 1.34σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 0.152σ | 1.53σ | 1.34σ | 1.4σ | 0.126σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | 0.559σ | 1.21σ | 0.62σ | 0.288σ | 0.613σ | ||
| TestMisc_test_diag_quicksum_100 | 1.57σ | 1.38σ | 1.03σ | 0.912σ | 0.98σ | ||
| TestMisc_test_diag_quicksum_100000 | 1.44σ | 1.8σ | 0.814σ | 0.945σ | 1.03σ | ||
| TestMisc_test_diag_sum_100 | 2.29σ | 0.939σ | 1.46σ | 1.25σ | 1.52σ | ||
| TestMisc_test_diag_sum_100000 | 0.734σ | 1.11σ | 1.29σ | 1.49σ | 0.834σ | ||
| TestMisc_test_pmedian_quicksum_test4 | 0.177σ | 1.72σ | 1.77σ | 1.44σ | 1.28σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 1.73σ | 0.739σ | 1.29σ | 0.543σ | 1.07σ | ||
| TestMisc_test_pmedian_sum_test4 | 0.0202σ | 0.159σ | 0.294σ | 0.132σ | 1.05σ | ||
| TestMisc_test_pmedian_sum_test8 | 1.06σ | 0.859σ | 1.3σ | 0.217σ | 0.594σ | ||
| TestMisc_test_pmedian_tuple_test4 | 1.72σ | 0.912σ | 0.156σ | 0.906σ | 1.31σ | ||
| TestMisc_test_pmedian_tuple_test8 | 0.658σ | 1.41σ | 0.915σ | 0.735σ | 0.696σ | ||
| TestJump_test_clnlbean_5000 | 1.14σ | 1.25σ | 1.52σ | ||||
| TestJump_test_clnlbean_50000 | 0.555σ | 1.33σ | 0.953σ | ||||
| TestJump_test_facility_25 | 0.17σ | 0.551σ | 1.92σ | 0.799σ | 1.15σ | ||
| TestJump_test_facility_5 | 1.52σ | 1.35σ | 1.77σ | 1.44σ | 1.09σ | ||
| TestJump_test_facility_quicksum_25 | 0.974σ | 0.659σ | 1.67σ | 0.275σ | 0.568σ | ||
| TestJump_test_facility_quicksum_5 | 1.25σ | 0.0705σ | 1.8σ | 0.906σ | 0.872σ | ||
| TestJump_test_lqcp_10 | 1.88σ | 0.625σ | 1.03σ | 0.555σ | 0.564σ | ||
| TestJump_test_lqcp_500 | -0.0959σ | 1.6σ | 1.9σ | 1.24σ | 0.916σ | ||
| TestJump_test_lqcp_quicksum_10 | 1.34σ | 1.43σ | 1.32σ | 0.782σ | 0.702σ | ||
| TestJump_test_lqcp_quicksum_500 | -0.0737σ | 1.59σ | 1.8σ | 0.861σ | 1.31σ | ||
| TestJump_test_opf_662 | 0.417σ | 1.71σ | 0.831σ | ||||
| TestJump_test_opf_6620 | 0.179σ | 1.05σ | 0.749σ | ||||
| TestJump_test_opf_quicksum_662 | 0.833σ | 1.5σ | 1.19σ | ||||
| TestJump_test_opf_quicksum_6620 | 0.415σ | 1.3σ | 1.14σ | ||||
| TestDevel_test_issue_691 | 0.727σ | 0.566σ | 0.503σ | 0.178σ | 0.08σ | ||
| TestModels_test_dcopf_case2383wp | 0.407σ | 1.19σ | 1.67σ | 1.59σ | 1.18σ | ||
| TestModels_test_uc_20140901_expected | 0.792σ | 1.37σ | 1.43σ | 0.964σ | 1.48σ |
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | 1.21σ | 0.402σ | 1.91σ | ||||
| TestMisc_test_bilinear_100 | 1.75σ | 1.15σ | 1.04σ | 1.02σ | 0.911σ | ||
| TestMisc_test_bilinear_100000 | 0.605σ | 1.07σ | 1.29σ | 0.0802σ | 0.295σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 2.02σ | 0.123σ | 1.73σ | 1.33σ | 1.38σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | 0.972σ | 1.77σ | 1.01σ | 0.462σ | 0.2σ | ||
| TestMisc_test_diag_quicksum_100 | 1.39σ | 0.486σ | 1.47σ | 0.727σ | 1.07σ | ||
| TestMisc_test_diag_quicksum_100000 | 0.953σ | 0.575σ | 1.1σ | 1.36σ | 0.762σ | ||
| TestMisc_test_diag_sum_100 | 1.74σ | 1.5σ | 1.25σ | 1.43σ | 1.26σ | ||
| TestMisc_test_diag_sum_100000 | 1.45σ | 1.05σ | 0.777σ | 1.31σ | 0.649σ | ||
| TestMisc_test_pmedian_quicksum_test4 | 2.07σ | 1.15σ | 2.28σ | 0.782σ | 0.546σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 1.83σ | 0.781σ | 2.0σ | 1.37σ | 0.401σ | ||
| TestMisc_test_pmedian_sum_test4 | 0.835σ | 0.0784σ | 0.28σ | 0.112σ | 0.796σ | ||
| TestMisc_test_pmedian_sum_test8 | 0.234σ | 0.531σ | 1.07σ | 0.589σ | 0.607σ | ||
| TestMisc_test_pmedian_tuple_test4 | 0.507σ | 0.0519σ | 1.57σ | 1.08σ | 1.1σ | ||
| TestMisc_test_pmedian_tuple_test8 | 1.71σ | 0.682σ | 0.828σ | 0.78σ | 0.116σ | ||
| TestJump_test_clnlbean_5000 | 0.0569σ | 0.685σ | 1.1σ | ||||
| TestJump_test_clnlbean_50000 | 0.584σ | 1.09σ | 1.18σ | ||||
| TestJump_test_facility_25 | 0.911σ | 1.93σ | 0.849σ | 1.04σ | 0.705σ | ||
| TestJump_test_facility_5 | 1.67σ | 0.327σ | 1.5σ | 0.45σ | 0.724σ | ||
| TestJump_test_facility_quicksum_25 | 1.54σ | 0.854σ | 0.956σ | 1.97σ | 0.93σ | ||
| TestJump_test_facility_quicksum_5 | 1.3σ | 1.06σ | 0.167σ | 0.524σ | 0.877σ | ||
| TestJump_test_lqcp_10 | 1.81σ | 0.976σ | 1.02σ | 1.37σ | 1.59σ | ||
| TestJump_test_lqcp_500 | 0.392σ | 0.703σ | 1.82σ | 0.965σ | 1.01σ | ||
| TestJump_test_lqcp_quicksum_10 | 1.46σ | 1.55σ | 1.74σ | 1.16σ | 0.0538σ | ||
| TestJump_test_lqcp_quicksum_500 | 1.15σ | 1.56σ | 1.55σ | 1.04σ | 0.621σ | ||
| TestJump_test_opf_662 | 0.258σ | 1.29σ | 0.818σ | ||||
| TestJump_test_opf_6620 | 0.392σ | 0.792σ | 0.793σ | ||||
| TestJump_test_opf_quicksum_662 | 0.32σ | 1.15σ | 0.934σ | ||||
| TestJump_test_opf_quicksum_6620 | 0.263σ | 0.576σ | 1.28σ | ||||
| TestDevel_test_issue_691 | 0.681σ | 0.953σ | 0.931σ | 0.26σ | 1.49σ | ||
| TestModels_test_dcopf_case2383wp | 0.742σ | 0.206σ | 1.36σ | 0.852σ | 0.945σ | ||
| TestModels_test_uc_20140901_expected | 0.919σ | 0.862σ | 1.96σ | 1.72σ | 1.11σ |
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | 1.84σ | 0.33σ | 2.04σ | ||||
| TestMisc_test_bilinear_100 | 1.82σ | 1.72σ | 1.62σ | 1.52σ | 1.43σ | ||
| TestMisc_test_bilinear_100000 | -0.205σ | 0.826σ | 0.448σ | 0.829σ | 0.417σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 1.86σ | 1.6σ | 1.19σ | 1.47σ | 0.78σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | 0.67σ | 1.28σ | 0.815σ | 0.645σ | 0.737σ | ||
| TestMisc_test_diag_quicksum_100 | 1.41σ | 0.829σ | 0.938σ | 0.991σ | 1.32σ | ||
| TestMisc_test_diag_quicksum_100000 | 0.712σ | 1.21σ | 1.84σ | 0.287σ | 0.357σ | ||
| TestMisc_test_diag_sum_100 | 1.56σ | 0.851σ | 1.29σ | 0.824σ | 1.09σ | ||
| TestMisc_test_diag_sum_100000 | 0.266σ | 0.824σ | 1.2σ | 0.13σ | 0.435σ | ||
| TestMisc_test_pmedian_quicksum_test4 | 1.76σ | 0.609σ | 1.88σ | 0.591σ | 1.61σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 1.34σ | 0.178σ | 1.25σ | 0.738σ | 0.324σ | ||
| TestMisc_test_pmedian_sum_test4 | 0.00689σ | 1.06σ | 1.49σ | 0.0333σ | 0.00847σ | ||
| TestMisc_test_pmedian_sum_test8 | 0.24σ | 0.741σ | 0.886σ | 0.728σ | 0.583σ | ||
| TestMisc_test_pmedian_tuple_test4 | 0.848σ | 1.74σ | 1.91σ | 0.529σ | 0.615σ | ||
| TestMisc_test_pmedian_tuple_test8 | 1.47σ | 0.521σ | 1.03σ | 0.325σ | 0.41σ | ||
| TestJump_test_clnlbean_5000 | 1.13σ | 1.05σ | 0.876σ | ||||
| TestJump_test_clnlbean_50000 | 0.609σ | 1.12σ | 0.511σ | ||||
| TestJump_test_facility_25 | 0.567σ | 0.996σ | 1.3σ | 0.893σ | 1.1σ | ||
| TestJump_test_facility_5 | 1.73σ | 1.31σ | 1.18σ | 1.27σ | 1.0σ | ||
| TestJump_test_facility_quicksum_25 | 1.41σ | 0.704σ | 1.57σ | 0.362σ | 1.06σ | ||
| TestJump_test_facility_quicksum_5 | 1.89σ | 1.05σ | 1.34σ | 1.53σ | 0.0821σ | ||
| TestJump_test_lqcp_10 | 1.39σ | 1.25σ | 2.0σ | 0.99σ | 0.714σ | ||
| TestJump_test_lqcp_500 | 0.445σ | 0.979σ | 0.788σ | 0.743σ | 0.654σ | ||
| TestJump_test_lqcp_quicksum_10 | 1.62σ | 1.56σ | 1.03σ | 0.518σ | 1.08σ | ||
| TestJump_test_lqcp_quicksum_500 | 0.417σ | 1.16σ | 1.17σ | 0.878σ | 1.09σ | ||
| TestJump_test_opf_662 | 0.0647σ | 1.25σ | 0.995σ | ||||
| TestJump_test_opf_6620 | -0.113σ | 1.13σ | 0.799σ | ||||
| TestJump_test_opf_quicksum_662 | 0.509σ | 0.853σ | 1.1σ | ||||
| TestJump_test_opf_quicksum_6620 | 0.24σ | 0.912σ | 0.808σ | ||||
| TestDevel_test_issue_691 | 0.983σ | 0.681σ | 0.96σ | 1.4σ | 1.48σ | ||
| TestModels_test_dcopf_case2383wp | 1.56σ | 1.42σ | 0.122σ | 1.26σ | 1.13σ | ||
| TestModels_test_uc_20140901_expected | 1.1σ | 1.03σ | 0.831σ | 1.09σ | 0.693σ |
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | 1.74σ | 1.37σ | 1.65σ | ||||
| TestMisc_test_bilinear_100 | 2.17σ | 1.9σ | 1.72σ | 2.15σ | 1.79σ | ||
| TestMisc_test_bilinear_100000 | 0.959σ | 1.02σ | 1.31σ | 1.68σ | 1.82σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 1.92σ | 1.7σ | 1.82σ | 1.77σ | 2.0σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | 1.56σ | 0.893σ | 1.68σ | 1.97σ | 2.22σ | ||
| TestMisc_test_diag_quicksum_100 | 1.66σ | 1.34σ | 1.54σ | 1.31σ | 1.81σ | ||
| TestMisc_test_diag_quicksum_100000 | 1.94σ | 1.29σ | 1.44σ | 1.19σ | 1.43σ | ||
| TestMisc_test_diag_sum_100 | 1.51σ | 1.19σ | 1.43σ | 1.44σ | 1.69σ | ||
| TestMisc_test_diag_sum_100000 | 1.32σ | 1.84σ | 1.49σ | 0.972σ | 1.6σ | ||
| TestMisc_test_pmedian_quicksum_test4 | 2.58σ | 2.04σ | 2.33σ | 1.19σ | 1.34σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 2.0σ | 1.1σ | 1.83σ | 1.94σ | 1.57σ | ||
| TestMisc_test_pmedian_sum_test4 | 0.028σ | 1.68σ | 2.39σ | 1.58σ | 1.93σ | ||
| TestMisc_test_pmedian_sum_test8 | 1.02σ | 0.894σ | 2.15σ | 1.54σ | 2.01σ | ||
| TestMisc_test_pmedian_tuple_test4 | 2.05σ | 1.85σ | 2.64σ | 1.82σ | 2.03σ | ||
| TestMisc_test_pmedian_tuple_test8 | 1.47σ | 1.98σ | 2.08σ | 1.73σ | 1.65σ | ||
| TestJump_test_clnlbean_5000 | 1.84σ | 1.86σ | 1.78σ | ||||
| TestJump_test_clnlbean_50000 | 1.24σ | 1.8σ | 1.51σ | ||||
| TestJump_test_facility_25 | 1.23σ | 0.583σ | 1.62σ | 1.58σ | 1.47σ | ||
| TestJump_test_facility_5 | 1.64σ | 1.36σ | 1.68σ | 1.35σ | 1.99σ | ||
| TestJump_test_facility_quicksum_25 | 0.733σ | 1.35σ | 1.43σ | 2.06σ | 1.65σ | ||
| TestJump_test_facility_quicksum_5 | 1.52σ | 1.2σ | 2.03σ | 1.59σ | 1.76σ | ||
| TestJump_test_lqcp_10 | 1.71σ | 0.945σ | 1.69σ | 1.89σ | 1.78σ | ||
| TestJump_test_lqcp_500 | 0.836σ | 1.25σ | 1.77σ | 1.62σ | 1.82σ | ||
| TestJump_test_lqcp_quicksum_10 | 1.75σ | 0.0113σ | 1.67σ | 1.35σ | 1.74σ | ||
| TestJump_test_lqcp_quicksum_500 | 1.34σ | 1.74σ | 2.23σ | 1.93σ | 2.12σ | ||
| TestJump_test_opf_662 | 0.547σ | 0.725σ | 2.05σ | ||||
| TestJump_test_opf_6620 | 1.63σ | 0.636σ | 1.94σ | ||||
| TestJump_test_opf_quicksum_662 | 1.58σ | 0.183σ | 1.79σ | ||||
| TestJump_test_opf_quicksum_6620 | 1.46σ | 0.754σ | 1.84σ | ||||
| TestDevel_test_issue_691 | 1.06σ | 0.938σ | 0.725σ | 1.84σ | 1.18σ | ||
| TestModels_test_dcopf_case2383wp | 1.29σ | 1.45σ | 1.77σ | 1.63σ | 1.48σ | ||
| TestModels_test_uc_20140901_expected | 1.03σ | 1.48σ | 1.97σ | 1.01σ | 1.71σ |