Welcome to Pyomo's performance test results portal!
Please explore the expandable sections below for different categories of Pyomo's current performance. The numbers shown are standard deviations away from the running average (where a positive number is slower than average, negative faster than average).
Note: Alerts are generated based on repeated performance. The table represents only the most recent run of the performance test suite.
Last update: Oct-27-2026 14:34
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | -0.211σ | 1.74σ | 1.77σ | ||||
| TestMisc_test_bilinear_100 | 2.27σ | 1.79σ | 1.88σ | 1.77σ | 1.81σ | ||
| TestMisc_test_bilinear_100000 | 1.76σ | 1.5σ | 1.6σ | 1.61σ | 1.58σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 2.23σ | 0.0258σ | 1.95σ | 1.9σ | 1.78σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | 1.65σ | 1.46σ | 1.55σ | 1.58σ | 1.59σ | ||
| TestMisc_test_diag_quicksum_100 | 2.3σ | 0.022σ | 2.19σ | 1.9σ | 2.39σ | ||
| TestMisc_test_diag_quicksum_100000 | 2.84σ | 1.63σ | 1.95σ | 1.66σ | 1.98σ | ||
| TestMisc_test_diag_sum_100 | 3.0σ | 2.29σ | 2.24σ | 2.11σ | 2.07σ | ||
| TestMisc_test_diag_sum_100000 | 2.9σ | 1.83σ | 1.83σ | 1.5σ | 1.94σ | ||
| TestMisc_test_pmedian_quicksum_test4 | -0.712σ | -0.762σ | 2.23σ | -1.19σ | 1.96σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 2.27σ | 1.71σ | 1.89σ | 1.64σ | 1.99σ | ||
| TestMisc_test_pmedian_sum_test4 | -0.564σ | -0.8σ | 2.19σ | -1.2σ | 2.0σ | ||
| TestMisc_test_pmedian_sum_test8 | 2.11σ | 1.83σ | 1.94σ | 0.827σ | 1.76σ | ||
| TestMisc_test_pmedian_tuple_test4 | -0.128σ | -0.801σ | 1.94σ | -0.46σ | 1.88σ | ||
| TestMisc_test_pmedian_tuple_test8 | 1.86σ | 1.7σ | 1.79σ | 1.49σ | 2.03σ | ||
| TestJump_test_clnlbean_5000 | 0.716σ | 1.35σ | 2.01σ | ||||
| TestJump_test_clnlbean_50000 | 2.47σ | 1.77σ | 2.02σ | ||||
| TestJump_test_facility_25 | 1.79σ | 1.75σ | 2.04σ | 2.29σ | 1.95σ | ||
| TestJump_test_facility_5 | -0.23σ | -0.611σ | 2.14σ | -0.657σ | 1.94σ | ||
| TestJump_test_facility_quicksum_25 | 1.82σ | 1.58σ | 2.01σ | 2.24σ | 1.98σ | ||
| TestJump_test_facility_quicksum_5 | -0.22σ | -2.23σ | 1.85σ | -0.787σ | 1.93σ | ||
| TestJump_test_lqcp_10 | -0.122σ | 2.14σ | 2.11σ | 1.9σ | 1.71σ | ||
| TestJump_test_lqcp_500 | 0.661σ | 1.69σ | 1.91σ | -0.605σ | 1.93σ | ||
| TestJump_test_lqcp_quicksum_10 | -0.107σ | 0.114σ | 2.13σ | 2.07σ | 1.97σ | ||
| TestJump_test_lqcp_quicksum_500 | -0.338σ | 1.7σ | 1.95σ | -0.596σ | 1.97σ | ||
| TestJump_test_opf_662 | -0.711σ | 0.322σ | 2.01σ | ||||
| TestJump_test_opf_6620 | 2.26σ | 0.858σ | 1.97σ | ||||
| TestJump_test_opf_quicksum_662 | -0.79σ | 1.14σ | 1.59σ | ||||
| TestJump_test_opf_quicksum_6620 | 1.93σ | 0.873σ | 1.96σ | ||||
| TestDevel_test_issue_691 | 2.41σ | 1.49σ | 2.1σ | 0.922σ | 1.63σ | ||
| TestModels_test_dcopf_case2383wp | 2.0σ | -1.16σ | 2.12σ | -0.0122σ | 1.98σ | ||
| TestModels_test_uc_20140901_expected | 1.8σ | 1.86σ | 1.79σ | -0.0793σ | 2.05σ |
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | 2.23σ | 1.95σ | 2.22σ | ||||
| TestMisc_test_bilinear_100 | 2.88σ | 1.97σ | 2.03σ | 2.02σ | 2.02σ | ||
| TestMisc_test_bilinear_100000 | 1.48σ | 1.96σ | 1.79σ | 1.78σ | 1.93σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 2.87σ | 1.29σ | 2.18σ | 2.14σ | 2.2σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | 1.45σ | 1.98σ | 1.87σ | 1.81σ | 1.88σ | ||
| TestMisc_test_diag_quicksum_100 | 2.99σ | 1.2σ | 1.8σ | 1.73σ | 1.93σ | ||
| TestMisc_test_diag_quicksum_100000 | 0.802σ | 1.45σ | 1.42σ | 1.51σ | 1.88σ | ||
| TestMisc_test_diag_sum_100 | 2.84σ | 2.24σ | 2.11σ | 1.96σ | 2.03σ | ||
| TestMisc_test_diag_sum_100000 | 0.974σ | 1.8σ | 1.86σ | 1.59σ | 1.84σ | ||
| TestMisc_test_pmedian_quicksum_test4 | 2.45σ | 2.03σ | 2.07σ | 1.89σ | 2.09σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 1.56σ | 1.4σ | 1.94σ | 1.74σ | 1.92σ | ||
| TestMisc_test_pmedian_sum_test4 | 0.133σ | 1.78σ | 1.92σ | 1.88σ | 2.03σ | ||
| TestMisc_test_pmedian_sum_test8 | 1.67σ | 1.72σ | 1.57σ | 1.85σ | 1.95σ | ||
| TestMisc_test_pmedian_tuple_test4 | 0.129σ | 2.15σ | 2.12σ | 1.9σ | 2.18σ | ||
| TestMisc_test_pmedian_tuple_test8 | 1.89σ | 2.06σ | 2.09σ | 1.98σ | 2.19σ | ||
| TestJump_test_clnlbean_5000 | 1.69σ | 2.02σ | 1.99σ | ||||
| TestJump_test_clnlbean_50000 | 1.84σ | 1.95σ | 2.03σ | ||||
| TestJump_test_facility_25 | 2.02σ | 1.82σ | 2.07σ | 2.19σ | 2.07σ | ||
| TestJump_test_facility_5 | 2.59σ | 2.09σ | 2.11σ | 2.12σ | 2.08σ | ||
| TestJump_test_facility_quicksum_25 | 2.14σ | 1.96σ | 2.14σ | 2.11σ | 2.1σ | ||
| TestJump_test_facility_quicksum_5 | 2.81σ | 2.1σ | 2.12σ | 2.14σ | 2.1σ | ||
| TestJump_test_lqcp_10 | 2.86σ | 2.12σ | 2.24σ | 2.19σ | 1.69σ | ||
| TestJump_test_lqcp_500 | 1.49σ | 1.99σ | 2.0σ | 2.05σ | 1.97σ | ||
| TestJump_test_lqcp_quicksum_10 | 2.82σ | 0.1σ | 1.98σ | 1.77σ | 1.92σ | ||
| TestJump_test_lqcp_quicksum_500 | 1.54σ | 1.81σ | 2.04σ | 1.96σ | 2.08σ | ||
| TestJump_test_opf_662 | 1.92σ | 1.98σ | 1.72σ | ||||
| TestJump_test_opf_6620 | 1.42σ | 1.59σ | 1.56σ | ||||
| TestJump_test_opf_quicksum_662 | 1.99σ | 1.91σ | 1.93σ | ||||
| TestJump_test_opf_quicksum_6620 | 1.35σ | 1.88σ | 1.94σ | ||||
| TestDevel_test_issue_691 | 1.8σ | 1.34σ | 1.95σ | 1.85σ | 2.13σ | ||
| TestModels_test_dcopf_case2383wp | 1.95σ | 1.73σ | 1.8σ | 1.95σ | 2.08σ | ||
| TestModels_test_uc_20140901_expected | 1.94σ | 1.97σ | 2.02σ | 2.08σ | 2.12σ |
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | 2.2σ | 1.32σ | 2.33σ | ||||
| TestMisc_test_bilinear_100 | 2.83σ | 2.38σ | 2.29σ | 2.1σ | 2.15σ | ||
| TestMisc_test_bilinear_100000 | 1.34σ | 1.99σ | 2.28σ | 2.02σ | 1.9σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 2.9σ | 0.184σ | 2.01σ | 1.94σ | 1.87σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | 0.241σ | 2.01σ | 2.04σ | 1.98σ | 1.89σ | ||
| TestMisc_test_diag_quicksum_100 | 3.07σ | 0.224σ | 2.11σ | 2.19σ | 2.06σ | ||
| TestMisc_test_diag_quicksum_100000 | 2.22σ | 1.94σ | 1.97σ | 1.94σ | 2.01σ | ||
| TestMisc_test_diag_sum_100 | 3.05σ | 2.16σ | 1.9σ | 1.84σ | 1.99σ | ||
| TestMisc_test_diag_sum_100000 | 2.39σ | 1.98σ | 1.9σ | 2.01σ | 1.92σ | ||
| TestMisc_test_pmedian_quicksum_test4 | 2.43σ | 1.67σ | 2.05σ | 1.98σ | 2.03σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 1.93σ | 2.05σ | 1.97σ | 2.01σ | 2.1σ | ||
| TestMisc_test_pmedian_sum_test4 | 0.0945σ | 2.09σ | 2.17σ | 2.05σ | 2.07σ | ||
| TestMisc_test_pmedian_sum_test8 | 1.91σ | 1.83σ | 1.93σ | 2.02σ | 2.11σ | ||
| TestMisc_test_pmedian_tuple_test4 | 0.381σ | 2.06σ | 1.95σ | 1.95σ | 2.03σ | ||
| TestMisc_test_pmedian_tuple_test8 | 1.89σ | 1.94σ | 1.91σ | 2.01σ | 2.04σ | ||
| TestJump_test_clnlbean_5000 | 1.95σ | 1.67σ | 2.07σ | ||||
| TestJump_test_clnlbean_50000 | 2.18σ | 1.91σ | 2.05σ | ||||
| TestJump_test_facility_25 | 1.96σ | 1.75σ | 1.92σ | 2.04σ | 2.13σ | ||
| TestJump_test_facility_5 | 2.68σ | 2.13σ | 2.08σ | 1.96σ | 2.09σ | ||
| TestJump_test_facility_quicksum_25 | 1.93σ | 1.8σ | 1.93σ | 1.92σ | 2.13σ | ||
| TestJump_test_facility_quicksum_5 | 2.65σ | 1.6σ | 2.11σ | 2.03σ | 2.14σ | ||
| TestJump_test_lqcp_10 | 2.93σ | 2.15σ | 2.11σ | 1.99σ | 2.13σ | ||
| TestJump_test_lqcp_500 | 2.41σ | 1.93σ | 1.72σ | 1.78σ | 1.96σ | ||
| TestJump_test_lqcp_quicksum_10 | 2.9σ | 0.0485σ | 1.89σ | 1.91σ | 2.09σ | ||
| TestJump_test_lqcp_quicksum_500 | 1.76σ | 1.91σ | 1.84σ | 1.83σ | 1.95σ | ||
| TestJump_test_opf_662 | 0.791σ | 1.81σ | 1.75σ | ||||
| TestJump_test_opf_6620 | 0.282σ | 1.95σ | 2.07σ | ||||
| TestJump_test_opf_quicksum_662 | 0.392σ | 1.97σ | 1.98σ | ||||
| TestJump_test_opf_quicksum_6620 | 0.681σ | 2.01σ | 1.98σ | ||||
| TestDevel_test_issue_691 | 1.79σ | 1.85σ | 1.88σ | 1.98σ | 1.99σ | ||
| TestModels_test_dcopf_case2383wp | 1.66σ | 1.52σ | 1.55σ | 1.61σ | 1.16σ | ||
| TestModels_test_uc_20140901_expected | 1.33σ | 1.68σ | 1.45σ | 2.05σ | 1.97σ |
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | 1.36σ | 1.11σ | 2.2σ | ||||
| TestMisc_test_bilinear_100 | 2.89σ | 2.01σ | 2.08σ | 1.87σ | 1.87σ | ||
| TestMisc_test_bilinear_100000 | 0.188σ | 1.94σ | 1.92σ | 1.62σ | 1.57σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 2.86σ | 0.0116σ | 2.09σ | 2.04σ | 1.84σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | 0.736σ | 1.95σ | 1.86σ | 1.87σ | 1.85σ | ||
| TestMisc_test_diag_quicksum_100 | 2.93σ | 0.0105σ | 2.04σ | 1.96σ | 1.86σ | ||
| TestMisc_test_diag_quicksum_100000 | 2.34σ | 2.02σ | 1.93σ | 2.08σ | 1.53σ | ||
| TestMisc_test_diag_sum_100 | 2.85σ | 2.03σ | 2.1σ | 1.92σ | 1.95σ | ||
| TestMisc_test_diag_sum_100000 | 2.86σ | 2.14σ | 1.99σ | 2.0σ | 1.63σ | ||
| TestMisc_test_pmedian_quicksum_test4 | 2.36σ | 1.98σ | 2.08σ | 1.91σ | 1.88σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 1.84σ | 2.13σ | 2.2σ | 1.97σ | 1.89σ | ||
| TestMisc_test_pmedian_sum_test4 | 1.63σ | 2.06σ | 2.04σ | 1.92σ | 1.86σ | ||
| TestMisc_test_pmedian_sum_test8 | 1.92σ | 1.98σ | 2.03σ | 1.98σ | 1.88σ | ||
| TestMisc_test_pmedian_tuple_test4 | 2.38σ | 2.39σ | 2.0σ | 2.0σ | 1.93σ | ||
| TestMisc_test_pmedian_tuple_test8 | 1.83σ | 1.88σ | 1.98σ | 2.13σ | 1.88σ | ||
| TestJump_test_clnlbean_5000 | 1.24σ | 1.97σ | 1.82σ | ||||
| TestJump_test_clnlbean_50000 | 2.08σ | 2.04σ | 1.81σ | ||||
| TestJump_test_facility_25 | 2.01σ | 1.77σ | 2.01σ | 1.85σ | 2.2σ | ||
| TestJump_test_facility_5 | 2.63σ | 2.44σ | 2.13σ | 1.99σ | 2.02σ | ||
| TestJump_test_facility_quicksum_25 | 1.92σ | 1.85σ | 2.23σ | 1.74σ | 1.99σ | ||
| TestJump_test_facility_quicksum_5 | 2.62σ | 2.14σ | 2.17σ | 2.07σ | 2.06σ | ||
| TestJump_test_lqcp_10 | 2.82σ | 2.38σ | 2.28σ | 2.33σ | 2.01σ | ||
| TestJump_test_lqcp_500 | 2.18σ | 1.86σ | 2.01σ | 1.89σ | 1.97σ | ||
| TestJump_test_lqcp_quicksum_10 | 2.76σ | 0.0454σ | 2.32σ | 2.15σ | 2.06σ | ||
| TestJump_test_lqcp_quicksum_500 | 1.9σ | 1.96σ | 2.02σ | 1.95σ | 1.92σ | ||
| TestJump_test_opf_662 | 0.585σ | 1.91σ | 1.67σ | ||||
| TestJump_test_opf_6620 | 0.643σ | 2.0σ | 1.82σ | ||||
| TestJump_test_opf_quicksum_662 | 0.365σ | 2.39σ | 1.74σ | ||||
| TestJump_test_opf_quicksum_6620 | 0.381σ | 1.95σ | 1.73σ | ||||
| TestDevel_test_issue_691 | 1.86σ | 2.08σ | 2.0σ | 2.33σ | 2.06σ | ||
| TestModels_test_dcopf_case2383wp | 1.84σ | 1.95σ | 2.16σ | 1.11σ | 1.98σ | ||
| TestModels_test_uc_20140901_expected | 1.81σ | 1.9σ | 1.97σ | 1.97σ | 1.97σ |
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | 2.23σ | 2.01σ | 2.2σ | ||||
| TestMisc_test_bilinear_100 | 2.89σ | 2.03σ | 2.12σ | 2.07σ | 2.06σ | ||
| TestMisc_test_bilinear_100000 | 1.96σ | 2.02σ | 2.15σ | 2.0σ | 2.05σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 2.8σ | 2.29σ | 2.37σ | 2.14σ | 2.23σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | 1.98σ | 1.88σ | 2.12σ | 2.0σ | 2.02σ | ||
| TestMisc_test_diag_quicksum_100 | 2.88σ | 1.09σ | 2.18σ | 1.98σ | 2.1σ | ||
| TestMisc_test_diag_quicksum_100000 | 1.95σ | 2.02σ | 2.11σ | 2.0σ | 2.14σ | ||
| TestMisc_test_diag_sum_100 | 2.89σ | 1.86σ | 2.17σ | 2.02σ | 2.0σ | ||
| TestMisc_test_diag_sum_100000 | 2.23σ | 1.94σ | 2.22σ | 1.65σ | 2.16σ | ||
| TestMisc_test_pmedian_quicksum_test4 | 1.68σ | 1.79σ | 2.32σ | 1.98σ | 2.09σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 1.93σ | 2.0σ | 2.06σ | 2.04σ | 2.11σ | ||
| TestMisc_test_pmedian_sum_test4 | 0.499σ | 1.79σ | 1.78σ | 1.59σ | 1.66σ | ||
| TestMisc_test_pmedian_sum_test8 | 1.69σ | 2.13σ | 2.07σ | 1.97σ | 2.06σ | ||
| TestMisc_test_pmedian_tuple_test4 | 0.951σ | 2.1σ | 2.31σ | 2.03σ | 2.18σ | ||
| TestMisc_test_pmedian_tuple_test8 | 1.88σ | 1.99σ | 2.22σ | 1.99σ | 2.15σ | ||
| TestJump_test_clnlbean_5000 | 1.49σ | 2.13σ | 2.06σ | ||||
| TestJump_test_clnlbean_50000 | 2.08σ | 2.11σ | 2.19σ | ||||
| TestJump_test_facility_25 | 1.91σ | 2.03σ | 2.1σ | 2.04σ | 2.24σ | ||
| TestJump_test_facility_5 | 2.58σ | 2.1σ | 2.14σ | 2.08σ | 2.17σ | ||
| TestJump_test_facility_quicksum_25 | 2.06σ | 2.16σ | 1.95σ | 2.16σ | 2.24σ | ||
| TestJump_test_facility_quicksum_5 | 2.61σ | 2.07σ | 2.07σ | 2.02σ | 2.17σ | ||
| TestJump_test_lqcp_10 | 2.75σ | 2.09σ | 1.98σ | 1.86σ | 2.02σ | ||
| TestJump_test_lqcp_500 | 2.07σ | 2.13σ | 2.1σ | 2.03σ | 2.11σ | ||
| TestJump_test_lqcp_quicksum_10 | 2.73σ | 1.96σ | 2.21σ | 2.16σ | 2.09σ | ||
| TestJump_test_lqcp_quicksum_500 | 1.93σ | 2.18σ | 2.03σ | 2.01σ | 2.21σ | ||
| TestJump_test_opf_662 | 2.58σ | 2.04σ | 2.13σ | ||||
| TestJump_test_opf_6620 | 2.03σ | 2.05σ | 2.12σ | ||||
| TestJump_test_opf_quicksum_662 | 2.18σ | 2.09σ | 2.18σ | ||||
| TestJump_test_opf_quicksum_6620 | 2.24σ | 2.04σ | 2.14σ | ||||
| TestDevel_test_issue_691 | 1.77σ | 1.78σ | 1.91σ | 1.89σ | 1.85σ | ||
| TestModels_test_dcopf_case2383wp | 1.95σ | 1.72σ | 1.73σ | 1.6σ | 2.18σ | ||
| TestModels_test_uc_20140901_expected | 1.94σ | 2.07σ | 1.85σ | 1.59σ | 1.69σ |
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | -1.45σ | 2.25σ | 2.37σ | ||||
| TestMisc_test_bilinear_100 | 3.0σ | 1.91σ | 2.11σ | 2.0σ | 2.03σ | ||
| TestMisc_test_bilinear_100000 | 2.26σ | 1.42σ | 1.7σ | 1.96σ | 1.85σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 3.08σ | 0.113σ | 2.25σ | 1.94σ | 1.75σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | 2.0σ | 1.36σ | 1.66σ | 2.0σ | 1.9σ | ||
| TestMisc_test_diag_quicksum_100 | 3.01σ | 0.0963σ | 2.56σ | 1.97σ | 1.94σ | ||
| TestMisc_test_diag_quicksum_100000 | 3.02σ | 1.35σ | 1.99σ | 1.74σ | 1.87σ | ||
| TestMisc_test_diag_sum_100 | 3.03σ | 2.1σ | 2.2σ | 0.44σ | 1.92σ | ||
| TestMisc_test_diag_sum_100000 | 3.08σ | 1.38σ | 1.92σ | 1.88σ | 1.9σ | ||
| TestMisc_test_pmedian_quicksum_test4 | -0.469σ | -0.63σ | 2.35σ | -0.829σ | 1.74σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 2.33σ | 1.75σ | 1.89σ | 1.58σ | 1.98σ | ||
| TestMisc_test_pmedian_sum_test4 | -0.0743σ | -0.675σ | 2.25σ | -0.985σ | 1.91σ | ||
| TestMisc_test_pmedian_sum_test8 | 2.17σ | 2.01σ | 2.08σ | 1.06σ | 1.99σ | ||
| TestMisc_test_pmedian_tuple_test4 | -0.235σ | -0.535σ | 1.01σ | -0.818σ | 1.96σ | ||
| TestMisc_test_pmedian_tuple_test8 | 2.47σ | 1.7σ | 1.89σ | 1.6σ | 2.02σ | ||
| TestJump_test_clnlbean_5000 | 0.397σ | 1.13σ | 1.83σ | ||||
| TestJump_test_clnlbean_50000 | 2.6σ | 1.72σ | 1.98σ | ||||
| TestJump_test_facility_25 | 2.17σ | 1.63σ | 2.27σ | 2.52σ | 2.03σ | ||
| TestJump_test_facility_5 | -0.167σ | -0.464σ | 0.748σ | -0.51σ | 1.94σ | ||
| TestJump_test_facility_quicksum_25 | 2.32σ | 1.56σ | 2.11σ | 2.54σ | 2.0σ | ||
| TestJump_test_facility_quicksum_5 | -0.175σ | -0.487σ | 2.28σ | -0.56σ | 1.97σ | ||
| TestJump_test_lqcp_10 | -0.0805σ | 2.31σ | 2.18σ | 2.14σ | 2.2σ | ||
| TestJump_test_lqcp_500 | -0.887σ | 1.57σ | 1.9σ | 0.111σ | 2.05σ | ||
| TestJump_test_lqcp_quicksum_10 | -0.0832σ | 0.0567σ | 2.56σ | 2.04σ | 1.94σ | ||
| TestJump_test_lqcp_quicksum_500 | -1.01σ | 1.45σ | 1.89σ | 0.141σ | 1.99σ | ||
| TestJump_test_opf_662 | -1.02σ | 0.187σ | 1.85σ | ||||
| TestJump_test_opf_6620 | 2.26σ | 0.568σ | 1.84σ | ||||
| TestJump_test_opf_quicksum_662 | -0.987σ | 0.148σ | 1.81σ | ||||
| TestJump_test_opf_quicksum_6620 | 2.31σ | 0.6σ | 1.84σ | ||||
| TestDevel_test_issue_691 | 2.01σ | 0.551σ | 1.95σ | 0.479σ | 1.98σ | ||
| TestModels_test_dcopf_case2383wp | 1.76σ | -1.4σ | 2.18σ | -0.113σ | 1.91σ | ||
| TestModels_test_uc_20140901_expected | 1.7σ | 1.69σ | 1.98σ | 0.21σ | 1.9σ |
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | 2.09σ | 1.89σ | 1.98σ | ||||
| TestMisc_test_bilinear_100 | 2.39σ | 2.06σ | 2.08σ | 2.01σ | 2.02σ | ||
| TestMisc_test_bilinear_100000 | 1.7σ | 1.62σ | 1.67σ | 1.59σ | 1.64σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 1.16σ | 1.85σ | 2.06σ | 1.96σ | 0.769σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | 1.65σ | 1.59σ | 1.65σ | 1.58σ | 1.68σ | ||
| TestMisc_test_diag_quicksum_100 | 2.32σ | 0.778σ | 2.01σ | 1.96σ | 1.97σ | ||
| TestMisc_test_diag_quicksum_100000 | 1.45σ | 1.92σ | 2.06σ | 2.08σ | 2.02σ | ||
| TestMisc_test_diag_sum_100 | 2.96σ | 2.16σ | 2.21σ | 2.0σ | 2.01σ | ||
| TestMisc_test_diag_sum_100000 | 0.814σ | 2.13σ | 2.04σ | 2.1σ | 2.07σ | ||
| TestMisc_test_pmedian_quicksum_test4 | 0.591σ | 2.12σ | 2.09σ | 2.07σ | 1.97σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 1.74σ | 1.66σ | 1.85σ | 1.93σ | 2.04σ | ||
| TestMisc_test_pmedian_sum_test4 | 0.145σ | 2.11σ | 1.38σ | 1.33σ | 1.99σ | ||
| TestMisc_test_pmedian_sum_test8 | 1.94σ | 1.95σ | 1.94σ | 1.98σ | 1.98σ | ||
| TestMisc_test_pmedian_tuple_test4 | 2.37σ | 0.664σ | 1.44σ | 1.95σ | 1.99σ | ||
| TestMisc_test_pmedian_tuple_test8 | 1.93σ | 2.09σ | 2.03σ | 1.94σ | 1.84σ | ||
| TestJump_test_clnlbean_5000 | 0.893σ | 2.0σ | 2.08σ | ||||
| TestJump_test_clnlbean_50000 | 1.92σ | 2.0σ | 2.13σ | ||||
| TestJump_test_facility_25 | 1.55σ | 1.9σ | 2.1σ | 1.93σ | 1.99σ | ||
| TestJump_test_facility_5 | 2.57σ | 1.35σ | 2.07σ | 2.07σ | 2.0σ | ||
| TestJump_test_facility_quicksum_25 | 2.2σ | 1.88σ | 2.19σ | 2.05σ | 1.99σ | ||
| TestJump_test_facility_quicksum_5 | 2.59σ | 1.35σ | 2.0σ | 2.02σ | 1.96σ | ||
| TestJump_test_lqcp_10 | 2.86σ | 2.03σ | 2.13σ | 2.03σ | 2.01σ | ||
| TestJump_test_lqcp_500 | 1.54σ | 2.02σ | 2.03σ | 2.07σ | 2.06σ | ||
| TestJump_test_lqcp_quicksum_10 | 2.8σ | 2.06σ | 2.04σ | 1.7σ | 1.7σ | ||
| TestJump_test_lqcp_quicksum_500 | 1.56σ | 2.12σ | 2.05σ | 2.13σ | 2.08σ | ||
| TestJump_test_opf_662 | 0.691σ | 1.87σ | 2.0σ | ||||
| TestJump_test_opf_6620 | 1.56σ | 1.87σ | 2.0σ | ||||
| TestJump_test_opf_quicksum_662 | 2.0σ | 1.92σ | 2.0σ | ||||
| TestJump_test_opf_quicksum_6620 | 1.71σ | 1.93σ | 2.04σ | ||||
| TestDevel_test_issue_691 | 1.62σ | 1.62σ | 1.9σ | 1.84σ | 1.38σ | ||
| TestModels_test_dcopf_case2383wp | 2.11σ | 2.03σ | 2.04σ | 2.12σ | 2.09σ | ||
| TestModels_test_uc_20140901_expected | 1.78σ | 2.06σ | 1.8σ | 1.64σ | 2.07σ |
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | 2.15σ | 1.81σ | 2.04σ | ||||
| TestMisc_test_bilinear_100 | 2.35σ | 1.99σ | 1.98σ | 1.88σ | 2.04σ | ||
| TestMisc_test_bilinear_100000 | 1.02σ | 2.05σ | 2.11σ | 2.02σ | 2.0σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 2.82σ | 0.016σ | 2.16σ | 1.98σ | 2.0σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | 0.949σ | 2.16σ | 2.08σ | 1.94σ | 1.96σ | ||
| TestMisc_test_diag_quicksum_100 | 2.88σ | 0.0128σ | 2.08σ | 1.95σ | 1.93σ | ||
| TestMisc_test_diag_quicksum_100000 | 2.83σ | 2.19σ | 2.02σ | 2.09σ | 1.89σ | ||
| TestMisc_test_diag_sum_100 | 2.95σ | 2.18σ | 2.15σ | 1.98σ | 1.96σ | ||
| TestMisc_test_diag_sum_100000 | 2.26σ | 1.79σ | 1.65σ | 1.62σ | 1.57σ | ||
| TestMisc_test_pmedian_quicksum_test4 | 2.03σ | 1.78σ | 1.68σ | 1.67σ | 1.61σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 1.7σ | 1.7σ | 2.0σ | 1.98σ | 1.91σ | ||
| TestMisc_test_pmedian_sum_test4 | 0.706σ | 1.49σ | 1.56σ | 1.63σ | 1.61σ | ||
| TestMisc_test_pmedian_sum_test8 | 1.74σ | 1.95σ | 1.97σ | 2.0σ | 1.93σ | ||
| TestMisc_test_pmedian_tuple_test4 | 0.638σ | 0.605σ | 2.04σ | 0.818σ | 1.71σ | ||
| TestMisc_test_pmedian_tuple_test8 | 2.01σ | 2.09σ | 2.14σ | 2.04σ | 1.96σ | ||
| TestJump_test_clnlbean_5000 | 1.49σ | 1.6σ | 1.66σ | ||||
| TestJump_test_clnlbean_50000 | 1.82σ | 1.93σ | 2.0σ | ||||
| TestJump_test_facility_25 | 2.02σ | 1.93σ | 2.05σ | 2.08σ | 1.96σ | ||
| TestJump_test_facility_5 | 2.62σ | 2.02σ | 2.06σ | 2.02σ | 2.03σ | ||
| TestJump_test_facility_quicksum_25 | 2.1σ | 1.94σ | 2.05σ | 1.99σ | 1.98σ | ||
| TestJump_test_facility_quicksum_5 | 2.61σ | 2.06σ | 1.39σ | 1.74σ | 1.98σ | ||
| TestJump_test_lqcp_10 | 2.79σ | 1.82σ | 1.82σ | 1.76σ | 1.75σ | ||
| TestJump_test_lqcp_500 | 2.05σ | 1.97σ | 1.96σ | 2.05σ | 1.95σ | ||
| TestJump_test_lqcp_quicksum_10 | 2.79σ | 2.21σ | 2.25σ | 1.98σ | 1.99σ | ||
| TestJump_test_lqcp_quicksum_500 | 2.06σ | 1.97σ | 1.94σ | 2.0σ | 1.92σ | ||
| TestJump_test_opf_662 | 0.711σ | 1.69σ | 2.01σ | ||||
| TestJump_test_opf_6620 | 1.31σ | 1.98σ | 2.07σ | ||||
| TestJump_test_opf_quicksum_662 | 0.777σ | 1.98σ | 2.08σ | ||||
| TestJump_test_opf_quicksum_6620 | 1.14σ | 1.97σ | 2.18σ | ||||
| TestDevel_test_issue_691 | 1.68σ | 1.89σ | 1.92σ | 1.5σ | 1.89σ | ||
| TestModels_test_dcopf_case2383wp | 1.91σ | 0.996σ | 2.01σ | 1.92σ | 1.94σ | ||
| TestModels_test_uc_20140901_expected | 1.75σ | 1.97σ | 1.95σ | 2.01σ | 2.09σ |
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | 2.52σ | 1.42σ | 2.22σ | ||||
| TestMisc_test_bilinear_100 | 2.92σ | 2.32σ | 2.4σ | 2.29σ | 2.19σ | ||
| TestMisc_test_bilinear_100000 | 0.29σ | 1.9σ | 1.83σ | 1.96σ | 1.96σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 2.99σ | 1.75σ | 2.06σ | 1.96σ | 1.89σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | 0.682σ | 2.1σ | 1.87σ | 1.88σ | 1.9σ | ||
| TestMisc_test_diag_quicksum_100 | 2.9σ | 0.0147σ | 1.73σ | 1.77σ | 2.19σ | ||
| TestMisc_test_diag_quicksum_100000 | 2.24σ | 1.83σ | 1.81σ | 1.76σ | 2.06σ | ||
| TestMisc_test_diag_sum_100 | 2.85σ | 1.88σ | 1.96σ | 1.77σ | 1.91σ | ||
| TestMisc_test_diag_sum_100000 | 2.21σ | 1.9σ | 1.76σ | 1.88σ | 1.8σ | ||
| TestMisc_test_pmedian_quicksum_test4 | 2.44σ | 1.95σ | 1.98σ | 1.85σ | 1.75σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 1.85σ | 1.87σ | 1.92σ | 1.92σ | 1.91σ | ||
| TestMisc_test_pmedian_sum_test4 | 0.0939σ | 1.94σ | 2.0σ | 1.85σ | 0.249σ | ||
| TestMisc_test_pmedian_sum_test8 | 1.85σ | 1.84σ | 1.83σ | 1.78σ | 1.89σ | ||
| TestMisc_test_pmedian_tuple_test4 | 1.1σ | 2.04σ | 2.1σ | 1.85σ | 1.87σ | ||
| TestMisc_test_pmedian_tuple_test8 | 2.0σ | 1.85σ | 1.9σ | 1.85σ | 1.84σ | ||
| TestJump_test_clnlbean_5000 | 0.709σ | 1.92σ | 1.85σ | ||||
| TestJump_test_clnlbean_50000 | 1.77σ | 1.95σ | 1.8σ | ||||
| TestJump_test_facility_25 | 1.86σ | 1.82σ | 1.95σ | 1.82σ | 1.92σ | ||
| TestJump_test_facility_5 | 2.67σ | 1.79σ | 1.99σ | 1.71σ | 1.84σ | ||
| TestJump_test_facility_quicksum_25 | 1.34σ | 1.83σ | 2.02σ | 1.73σ | 1.95σ | ||
| TestJump_test_facility_quicksum_5 | 2.69σ | 1.88σ | 1.98σ | 1.95σ | 0.95σ | ||
| TestJump_test_lqcp_10 | 2.85σ | 2.13σ | 2.11σ | 1.83σ | 2.07σ | ||
| TestJump_test_lqcp_500 | 2.09σ | 1.93σ | 1.87σ | 1.82σ | 1.95σ | ||
| TestJump_test_lqcp_quicksum_10 | 2.89σ | 2.07σ | 2.09σ | 1.89σ | 2.07σ | ||
| TestJump_test_lqcp_quicksum_500 | 2.12σ | 1.85σ | 1.92σ | 1.82σ | 2.02σ | ||
| TestJump_test_opf_662 | 0.166σ | 1.98σ | 1.77σ | ||||
| TestJump_test_opf_6620 | 0.543σ | 2.02σ | 1.97σ | ||||
| TestJump_test_opf_quicksum_662 | 0.451σ | 1.93σ | 1.95σ | ||||
| TestJump_test_opf_quicksum_6620 | 0.625σ | 2.0σ | 1.99σ | ||||
| TestDevel_test_issue_691 | 1.68σ | 1.82σ | 1.91σ | 1.94σ | 1.88σ | ||
| TestModels_test_dcopf_case2383wp | 1.86σ | 1.95σ | 0.89σ | 1.86σ | 1.98σ | ||
| TestModels_test_uc_20140901_expected | 1.72σ | 1.92σ | 1.87σ | 1.86σ | 1.98σ |
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | 2.56σ | 2.16σ | 2.26σ | ||||
| TestMisc_test_bilinear_100 | 2.88σ | 2.43σ | 2.63σ | 2.09σ | 2.46σ | ||
| TestMisc_test_bilinear_100000 | 1.85σ | 2.12σ | 2.23σ | 2.17σ | 2.25σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 2.84σ | 2.48σ | 2.47σ | 2.34σ | 2.22σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | 2.04σ | 2.07σ | 2.27σ | 2.17σ | 2.29σ | ||
| TestMisc_test_diag_quicksum_100 | 2.98σ | 2.22σ | 2.37σ | 2.0σ | 2.31σ | ||
| TestMisc_test_diag_quicksum_100000 | 2.51σ | 2.13σ | 2.17σ | 2.19σ | 2.23σ | ||
| TestMisc_test_diag_sum_100 | 2.98σ | 2.3σ | 2.48σ | 2.27σ | 2.46σ | ||
| TestMisc_test_diag_sum_100000 | 2.3σ | 2.03σ | 2.13σ | 2.13σ | 2.23σ | ||
| TestMisc_test_pmedian_quicksum_test4 | 2.49σ | 2.19σ | 2.27σ | 2.14σ | 2.32σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 2.14σ | 2.0σ | 2.29σ | 2.19σ | 2.29σ | ||
| TestMisc_test_pmedian_sum_test4 | 0.169σ | 2.16σ | 2.3σ | 2.17σ | 2.29σ | ||
| TestMisc_test_pmedian_sum_test8 | 2.04σ | 2.02σ | 2.18σ | 2.13σ | 2.31σ | ||
| TestMisc_test_pmedian_tuple_test4 | 2.36σ | 2.26σ | 2.38σ | 2.13σ | 2.25σ | ||
| TestMisc_test_pmedian_tuple_test8 | 2.06σ | 2.03σ | 2.25σ | 2.14σ | 2.27σ | ||
| TestJump_test_clnlbean_5000 | 2.19σ | 2.16σ | 2.31σ | ||||
| TestJump_test_clnlbean_50000 | 2.16σ | 2.35σ | 2.26σ | ||||
| TestJump_test_facility_25 | 1.97σ | 2.08σ | 2.21σ | 2.44σ | 2.28σ | ||
| TestJump_test_facility_5 | 2.69σ | 2.08σ | 2.25σ | 2.25σ | 2.27σ | ||
| TestJump_test_facility_quicksum_25 | 1.9σ | 2.09σ | 2.14σ | 2.34σ | 2.36σ | ||
| TestJump_test_facility_quicksum_5 | 2.66σ | 2.21σ | 2.19σ | 2.33σ | 2.25σ | ||
| TestJump_test_lqcp_10 | 2.81σ | 2.3σ | 2.32σ | 2.3σ | 2.3σ | ||
| TestJump_test_lqcp_500 | 2.16σ | 2.26σ | 2.17σ | 2.25σ | 2.27σ | ||
| TestJump_test_lqcp_quicksum_10 | 2.83σ | 0.0393σ | 2.36σ | 2.32σ | 2.39σ | ||
| TestJump_test_lqcp_quicksum_500 | 2.15σ | 2.21σ | 2.15σ | 2.23σ | 2.31σ | ||
| TestJump_test_opf_662 | 1.93σ | 2.12σ | 2.26σ | ||||
| TestJump_test_opf_6620 | 2.22σ | 2.14σ | 2.35σ | ||||
| TestJump_test_opf_quicksum_662 | 2.23σ | 2.17σ | 2.37σ | ||||
| TestJump_test_opf_quicksum_6620 | 2.16σ | 2.39σ | 2.28σ | ||||
| TestDevel_test_issue_691 | 1.75σ | 1.9σ | 1.92σ | 2.37σ | 2.23σ | ||
| TestModels_test_dcopf_case2383wp | 2.08σ | 2.53σ | 2.22σ | 2.31σ | 2.28σ | ||
| TestModels_test_uc_20140901_expected | 2.03σ | 2.2σ | 2.21σ | 2.22σ | 2.33σ |