Performance Results


Welcome to Pyomo's performance test results portal!


Please explore the expandable sections below for different categories of Pyomo's current performance. The numbers shown are standard deviations away from the running average (where a positive number is slower than average, negative faster than average).

Note: Alerts are generated based on repeated performance. The table represents only the most recent run of the performance test suite.

Last update: Apr-24-2025 16:13

Performance Degradation Alert
Combination "Python = python-cython-3.11, Problem = TestMisc_test_pmedian_quicksum_test8, Measure = gams" is 0.6334s (2.803σ) above the average run time.

Problem\Measure create_instance discretize postprocessing nl lp bar gams
TestStochPDEgas_test_stochpdegas_automatic 1.06σ 1.14σ 1.63σ
TestMisc_test_bilinear_100 1.52σ 0.0772σ 1.54σ 1.46σ 1.54σ
TestMisc_test_bilinear_100000 0.941σ 0.078σ 0.796σ 0.246σ 0.517σ
TestMisc_test_bilinear_nlcontext_100 1.08σ 1.11σ 0.497σ 1.24σ 1.96σ
TestMisc_test_bilinear_nlcontext_100000 1.04σ 0.467σ 1.05σ 0.609σ 2.5σ
TestMisc_test_diag_quicksum_100 1.99σ 2.18σ 2.32σ 2.2σ 1.86σ
TestMisc_test_diag_quicksum_100000 2.07σ 1.62σ 0.278σ 0.474σ 0.201σ
TestMisc_test_diag_sum_100 0.293σ 0.941σ 0.965σ 0.787σ 0.723σ
TestMisc_test_diag_sum_100000 0.0158σ 0.0535σ 0.0854σ 0.853σ 1.42σ
TestMisc_test_pmedian_quicksum_test4 0.86σ 0.124σ 0.425σ 0.444σ 0.48σ
TestMisc_test_pmedian_quicksum_test8 1.08σ 0.818σ 0.213σ 0.822σ 0.899σ
TestMisc_test_pmedian_sum_test4 0.0214σ 1.0σ 1.55σ 1.58σ 0.916σ
TestMisc_test_pmedian_sum_test8 1.43σ 1.68σ 0.381σ 0.634σ 1.61σ
TestMisc_test_pmedian_tuple_test4 1.74σ 1.09σ 0.022σ 1.08σ 1.6σ
TestMisc_test_pmedian_tuple_test8 1.84σ 2.05σ 0.864σ 0.49σ 2.43σ
TestJump_test_clnlbean_5000 0.309σ 0.156σ 0.563σ
TestJump_test_clnlbean_50000 0.632σ 2.02σ 1.75σ
TestJump_test_facility_25 -0.0155σ 0.631σ 0.382σ 0.314σ 0.435σ
TestJump_test_facility_5 0.321σ 1.02σ 1.47σ 0.997σ 1.37σ
TestJump_test_facility_quicksum_25 0.297σ 1.35σ 2.0σ 1.83σ 1.33σ
TestJump_test_facility_quicksum_5 0.0581σ 1.24σ 1.92σ 1.31σ 1.16σ
TestJump_test_lqcp_10 0.0828σ 1.07σ 1.44σ 0.418σ 1.29σ
TestJump_test_lqcp_500 1.04σ 2.22σ 1.02σ 1.2σ 1.68σ
TestJump_test_lqcp_quicksum_10 0.807σ 1.64σ 1.84σ 1.17σ 0.851σ
TestJump_test_lqcp_quicksum_500 1.74σ 0.121σ 2.11σ 1.2σ 1.05σ
TestJump_test_opf_662 0.337σ 0.144σ 0.342σ
TestJump_test_opf_6620 0.594σ 0.761σ 1.96σ
TestJump_test_opf_quicksum_662 1.47σ 1.07σ 1.15σ
TestJump_test_opf_quicksum_6620 0.385σ 0.514σ 1.36σ
TestDevel_test_issue_691 0.496σ 0.331σ 0.757σ 0.858σ 0.933σ
TestModels_test_dcopf_case2383wp 1.51σ 1.5σ 1.67σ 0.787σ 0.171σ
TestModels_test_uc_20140901_expected 0.679σ 0.841σ 2.03σ 1.86σ 1.03σ

Problem\Measure create_instance discretize postprocessing nl lp bar gams
TestStochPDEgas_test_stochpdegas_automatic 2.1σ 1.5σ 2.15σ
TestMisc_test_bilinear_100 1.99σ 0.681σ 1.3σ 1.05σ 1.24σ
TestMisc_test_bilinear_100000 1.27σ 1.45σ 0.41σ 0.178σ 0.931σ
TestMisc_test_bilinear_nlcontext_100 1.87σ 0.76σ 1.86σ 1.56σ 1.38σ
TestMisc_test_bilinear_nlcontext_100000 1.77σ 1.68σ 0.472σ 0.288σ 0.198σ
TestMisc_test_diag_quicksum_100 1.45σ 0.803σ 1.11σ 0.74σ 0.897σ
TestMisc_test_diag_quicksum_100000 0.379σ 0.973σ 1.42σ 1.41σ 1.45σ
TestMisc_test_diag_sum_100 0.608σ 0.911σ 0.918σ 1.27σ 1.19σ
TestMisc_test_diag_sum_100000 1.04σ 0.668σ 0.199σ 0.163σ 0.225σ
TestMisc_test_pmedian_quicksum_test4 1.26σ 0.0881σ 0.149σ 0.418σ 0.058σ
TestMisc_test_pmedian_quicksum_test8 0.544σ 0.62σ 0.767σ 1.34σ 1.06σ
TestMisc_test_pmedian_sum_test4 0.482σ 0.115σ 0.101σ -0.00872σ 0.0284σ
TestMisc_test_pmedian_sum_test8 1.17σ 0.869σ 0.463σ 1.04σ 1.18σ
TestMisc_test_pmedian_tuple_test4 0.631σ 0.21σ 0.0816σ 0.126σ 0.0684σ
TestMisc_test_pmedian_tuple_test8 1.54σ 0.36σ 1.08σ 0.856σ 1.0σ
TestJump_test_clnlbean_5000 0.192σ 0.54σ 1.38σ
TestJump_test_clnlbean_50000 1.05σ 1.85σ 1.75σ
TestJump_test_facility_25 0.212σ 0.302σ 1.49σ 0.861σ 0.642σ
TestJump_test_facility_5 0.842σ 1.58σ 0.5σ 1.19σ 1.06σ
TestJump_test_facility_quicksum_25 0.777σ 1.11σ 0.326σ 0.218σ 0.0151σ
TestJump_test_facility_quicksum_5 0.0215σ 0.707σ 0.439σ 0.6σ 0.0676σ
TestJump_test_lqcp_10 0.239σ 1.59σ 1.1σ -0.0476σ 0.199σ
TestJump_test_lqcp_500 1.43σ 0.383σ 1.8σ 0.912σ 1.21σ
TestJump_test_lqcp_quicksum_10 1.57σ 1.31σ 1.5σ 1.5σ 1.83σ
TestJump_test_lqcp_quicksum_500 0.531σ 0.758σ 1.76σ 1.33σ 1.22σ
TestJump_test_opf_662 0.504σ 0.564σ 1.06σ
TestJump_test_opf_6620 0.308σ 0.36σ 1.19σ
TestJump_test_opf_quicksum_662 1.68σ 1.76σ 1.42σ
TestJump_test_opf_quicksum_6620 1.69σ 0.283σ 1.42σ
TestDevel_test_issue_691 0.131σ 1.87σ 1.39σ 2.08σ 1.81σ
TestModels_test_dcopf_case2383wp 0.933σ 0.415σ 0.311σ 0.229σ 0.237σ
TestModels_test_uc_20140901_expected 0.0552σ 1.54σ 0.392σ 1.69σ 1.55σ

Problem\Measure create_instance discretize postprocessing nl lp bar gams
TestStochPDEgas_test_stochpdegas_automatic 1.59σ 0.194σ 1.11σ
TestMisc_test_bilinear_100 1.2σ 1.79σ 1.49σ 1.39σ 2.19σ
TestMisc_test_bilinear_100000 0.202σ 0.282σ 0.129σ 1.46σ 1.55σ
TestMisc_test_bilinear_nlcontext_100 1.58σ 0.68σ 1.62σ 1.33σ 0.782σ
TestMisc_test_bilinear_nlcontext_100000 0.295σ 0.694σ 1.27σ 0.509σ 1.01σ
TestMisc_test_diag_quicksum_100 0.502σ 1.42σ 0.92σ 1.02σ 1.54σ
TestMisc_test_diag_quicksum_100000 0.284σ 0.177σ 0.12σ 0.149σ 0.13σ
TestMisc_test_diag_sum_100 0.00965σ 1.13σ 0.955σ 1.05σ 0.786σ
TestMisc_test_diag_sum_100000 0.00118σ 0.692σ 1.15σ 1.6σ 1.52σ
TestMisc_test_pmedian_quicksum_test4 1.57σ 1.52σ 1.45σ 1.41σ 1.4σ
TestMisc_test_pmedian_quicksum_test8 1.08σ 1.13σ 1.08σ 0.239σ 1.5σ
TestMisc_test_pmedian_sum_test4 -0.0157σ 0.0361σ 0.0838σ 0.165σ 0.69σ
TestMisc_test_pmedian_sum_test8 0.0278σ 0.401σ 2.23σ 1.86σ 1.01σ
TestMisc_test_pmedian_tuple_test4 1.92σ 0.729σ 0.0927σ 1.17σ 1.05σ
TestMisc_test_pmedian_tuple_test8 0.695σ 1.02σ 0.956σ 0.187σ 1.71σ
TestJump_test_clnlbean_5000 0.205σ 0.63σ 1.38σ
TestJump_test_clnlbean_50000 1.46σ 0.828σ 0.574σ
TestJump_test_facility_25 0.00828σ 0.942σ 1.41σ 1.51σ 0.405σ
TestJump_test_facility_5 0.0703σ 2.67σ 2.59σ 2.14σ 1.92σ
TestJump_test_facility_quicksum_25 0.613σ 0.445σ 1.42σ 0.705σ 0.183σ
TestJump_test_facility_quicksum_5 0.0803σ 0.249σ 0.194σ 0.142σ 0.141σ
TestJump_test_lqcp_10 0.0249σ 0.749σ 1.31σ 0.696σ 0.236σ
TestJump_test_lqcp_500 0.25σ 2.05σ 1.87σ 0.571σ 1.38σ
TestJump_test_lqcp_quicksum_10 0.434σ 1.17σ 1.84σ 0.783σ 0.449σ
TestJump_test_lqcp_quicksum_500 0.375σ 2.26σ 1.84σ 0.5σ 1.68σ
TestJump_test_opf_662 0.577σ 0.0852σ 0.78σ
TestJump_test_opf_6620 0.547σ 0.823σ 2.4σ
TestJump_test_opf_quicksum_662 1.62σ 1.48σ 0.612σ
TestJump_test_opf_quicksum_6620 0.768σ 1.58σ 0.745σ
TestDevel_test_issue_691 0.622σ 1.21σ 0.58σ 0.231σ 0.05σ
TestModels_test_dcopf_case2383wp 0.031σ 0.284σ 0.423σ 0.0934σ 0.382σ
TestModels_test_uc_20140901_expected 0.0392σ 0.662σ 0.288σ 1.43σ 2.06σ

Problem\Measure create_instance discretize postprocessing nl lp bar gams
TestStochPDEgas_test_stochpdegas_automatic 1.15σ 0.269σ 0.72σ
TestMisc_test_bilinear_100 0.406σ 1.19σ 0.76σ 0.648σ 1.01σ
TestMisc_test_bilinear_100000 0.379σ 0.415σ 1.04σ 1.46σ 1.52σ
TestMisc_test_bilinear_nlcontext_100 0.859σ 1.31σ 1.21σ 1.82σ 2.02σ
TestMisc_test_bilinear_nlcontext_100000 1.42σ 0.761σ 0.243σ 0.138σ 1.53σ
TestMisc_test_diag_quicksum_100 0.693σ 1.33σ 1.14σ 1.65σ 1.63σ
TestMisc_test_diag_quicksum_100000 0.781σ 0.142σ 0.162σ 0.114σ 0.172σ
TestMisc_test_diag_sum_100 0.56σ 1.16σ 0.171σ 1.54σ 2.15σ
TestMisc_test_diag_sum_100000 0.471σ 0.243σ 0.419σ 0.356σ 0.555σ
TestMisc_test_pmedian_quicksum_test4 1.17σ 1.02σ 1.08σ 1.06σ 1.03σ
TestMisc_test_pmedian_quicksum_test8 1.17σ 1.78σ 2.04σ 0.31σ 1.23σ
TestMisc_test_pmedian_sum_test4 0.193σ 0.511σ 0.0629σ 0.102σ 1.36σ
TestMisc_test_pmedian_sum_test8 0.267σ 0.434σ 1.15σ 1.47σ 2.04σ
TestMisc_test_pmedian_tuple_test4 0.181σ 0.0648σ 0.0586σ 0.0602σ 0.136σ
TestMisc_test_pmedian_tuple_test8 0.315σ 1.17σ 1.15σ 0.344σ 0.985σ
TestJump_test_clnlbean_5000 1.5σ 1.27σ 1.0σ
TestJump_test_clnlbean_50000 1.5σ 2.28σ 0.55σ
TestJump_test_facility_25 0.791σ 1.35σ 0.221σ 1.94σ 0.199σ
TestJump_test_facility_5 0.165σ 1.44σ 1.13σ 0.95σ 0.575σ
TestJump_test_facility_quicksum_25 0.358σ 0.319σ 0.32σ 0.212σ 0.0785σ
TestJump_test_facility_quicksum_5 0.0993σ 0.0755σ 1.69σ 0.358σ 0.566σ
TestJump_test_lqcp_10 0.264σ 0.0245σ 0.879σ 0.925σ 0.599σ
TestJump_test_lqcp_500 1.36σ 1.45σ 2.53σ 1.02σ 0.209σ
TestJump_test_lqcp_quicksum_10 1.32σ 1.88σ 1.67σ 1.71σ 1.68σ
TestJump_test_lqcp_quicksum_500 0.537σ 2.28σ 0.327σ 1.22σ 0.808σ
TestJump_test_opf_662 -0.201σ 0.194σ 1.63σ
TestJump_test_opf_6620 0.426σ 1.24σ 2.17σ
TestJump_test_opf_quicksum_662 -0.11σ 0.573σ 0.384σ
TestJump_test_opf_quicksum_6620 0.471σ 0.0615σ 1.46σ
TestDevel_test_issue_691 0.75σ 1.6σ 1.6σ 1.01σ 0.617σ
TestModels_test_dcopf_case2383wp 0.287σ 0.0464σ 0.545σ 0.0458σ 0.747σ
TestModels_test_uc_20140901_expected -0.0835σ 1.36σ 1.21σ 2.1σ 1.04σ

Problem\Measure create_instance discretize postprocessing nl lp bar gams
TestStochPDEgas_test_stochpdegas_automatic 1.75σ 0.667σ 2.52σ
TestMisc_test_bilinear_100 0.579σ 1.51σ 0.193σ 1.49σ 0.957σ
TestMisc_test_bilinear_100000 0.382σ 2.56σ 1.86σ 2.37σ 1.42σ
TestMisc_test_bilinear_nlcontext_100 1.49σ 1.98σ 2.36σ 1.29σ 1.9σ
TestMisc_test_bilinear_nlcontext_100000 1.65σ 2.05σ 2.31σ 0.894σ 1.16σ
TestMisc_test_diag_quicksum_100 0.0444σ 2.24σ 2.23σ 1.02σ 1.85σ
TestMisc_test_diag_quicksum_100000 0.0886σ 0.61σ 0.5σ 1.55σ 1.55σ
TestMisc_test_diag_sum_100 0.221σ 1.12σ 0.86σ 1.37σ 1.77σ
TestMisc_test_diag_sum_100000 0.147σ 1.07σ 1.73σ 1.33σ 1.65σ
TestMisc_test_pmedian_quicksum_test4 0.575σ 1.75σ 1.67σ 1.33σ 1.36σ
TestMisc_test_pmedian_quicksum_test8 1.66σ 2.35σ 1.57σ 2.33σ 1.16σ
TestMisc_test_pmedian_sum_test4 -0.0138σ 1.11σ 1.17σ 0.564σ 0.237σ
TestMisc_test_pmedian_sum_test8 0.192σ 1.98σ 2.2σ 1.46σ 1.3σ
TestMisc_test_pmedian_tuple_test4 0.905σ 1.19σ 1.33σ 1.1σ 1.3σ
TestMisc_test_pmedian_tuple_test8 0.893σ 1.96σ 1.64σ 1.44σ 1.5σ
TestJump_test_clnlbean_5000 0.651σ 2.36σ 1.12σ
TestJump_test_clnlbean_50000 0.484σ 2.54σ 2.23σ
TestJump_test_facility_25 0.0522σ 1.56σ 1.58σ 0.34σ 2.01σ
TestJump_test_facility_5 0.153σ 1.5σ 1.4σ 1.45σ 0.469σ
TestJump_test_facility_quicksum_25 0.0733σ 1.52σ 1.78σ 0.318σ 0.396σ
TestJump_test_facility_quicksum_5 0.0926σ 0.18σ 0.364σ 0.384σ 0.529σ
TestJump_test_lqcp_10 0.293σ 1.55σ 1.93σ 1.24σ 1.09σ
TestJump_test_lqcp_500 0.189σ 2.36σ 1.19σ 2.32σ 0.745σ
TestJump_test_lqcp_quicksum_10 1.45σ 2.34σ 2.26σ 2.28σ 2.38σ
TestJump_test_lqcp_quicksum_500 1.17σ 1.21σ 1.54σ 0.437σ 1.91σ
TestJump_test_opf_662 1.51σ 1.81σ 1.74σ
TestJump_test_opf_6620 0.539σ 0.893σ 1.5σ
TestJump_test_opf_quicksum_662 0.131σ 0.174σ 0.261σ
TestJump_test_opf_quicksum_6620 0.242σ 1.11σ 1.31σ
TestDevel_test_issue_691 0.435σ 1.77σ 1.81σ 1.86σ 1.26σ
TestModels_test_dcopf_case2383wp 1.83σ 1.85σ 1.67σ 0.611σ 0.322σ
TestModels_test_uc_20140901_expected 0.201σ 1.9σ 1.02σ 1.64σ 1.47σ

Problem\Measure create_instance discretize postprocessing nl lp bar gams
TestStochPDEgas_test_stochpdegas_automatic 1.25σ 1.2σ 1.8σ
TestMisc_test_bilinear_100 1.71σ 1.57σ 1.98σ 2.19σ 1.72σ
TestMisc_test_bilinear_100000 0.855σ 1.16σ 1.79σ 1.88σ 1.67σ
TestMisc_test_bilinear_nlcontext_100 1.22σ 1.96σ 1.87σ 0.869σ 1.5σ
TestMisc_test_bilinear_nlcontext_100000 1.37σ 0.455σ 0.469σ 0.541σ 1.09σ
TestMisc_test_diag_quicksum_100 1.45σ 1.3σ 1.16σ 0.613σ 1.74σ
TestMisc_test_diag_quicksum_100000 0.936σ 0.675σ 0.558σ 0.799σ 0.587σ
TestMisc_test_diag_sum_100 0.916σ 1.3σ 1.34σ 0.882σ 1.19σ
TestMisc_test_diag_sum_100000 0.232σ 0.149σ 0.352σ 0.166σ 0.524σ
TestMisc_test_pmedian_quicksum_test4 0.203σ 0.11σ 0.116σ 0.0797σ 0.329σ
TestMisc_test_pmedian_quicksum_test8 0.673σ 2.03σ 1.66σ 0.834σ 0.713σ
TestMisc_test_pmedian_sum_test4 0.0649σ 0.0462σ 0.0855σ 0.0364σ 0.144σ
TestMisc_test_pmedian_sum_test8 0.183σ 1.91σ 1.72σ 1.51σ 1.43σ
TestMisc_test_pmedian_tuple_test4 0.235σ 0.0897σ 0.0779σ 0.0993σ 0.145σ
TestMisc_test_pmedian_tuple_test8 0.246σ 1.61σ 1.59σ 1.98σ 2.52σ
TestJump_test_clnlbean_5000 0.862σ 0.487σ 0.462σ
TestJump_test_clnlbean_50000 0.584σ 0.278σ 2.06σ
TestJump_test_facility_25 1.45σ 1.62σ 2.02σ 0.945σ 0.547σ
TestJump_test_facility_5 0.17σ 1.01σ 0.476σ 0.972σ 1.29σ
TestJump_test_facility_quicksum_25 0.204σ 0.862σ 0.378σ 1.39σ 1.39σ
TestJump_test_facility_quicksum_5 0.353σ 1.12σ 1.4σ 1.76σ 1.55σ
TestJump_test_lqcp_10 1.52σ 1.38σ 0.406σ 0.809σ 1.12σ
TestJump_test_lqcp_500 1.16σ 0.184σ 1.76σ 2.39σ 1.02σ
TestJump_test_lqcp_quicksum_10 0.578σ 1.38σ 1.46σ 0.878σ 0.832σ
TestJump_test_lqcp_quicksum_500 0.486σ 2.33σ 1.91σ 0.9σ 0.676σ
TestJump_test_opf_662 1.77σ 1.63σ 2.38σ
TestJump_test_opf_6620 1.04σ 2.17σ 1.38σ
TestJump_test_opf_quicksum_662 1.65σ 0.554σ 2.28σ
TestJump_test_opf_quicksum_6620 1.41σ 0.6σ 2.13σ
TestDevel_test_issue_691 0.262σ 1.44σ 1.34σ 0.556σ 0.313σ
TestModels_test_dcopf_case2383wp 0.865σ 0.0985σ 0.111σ 0.112σ 0.158σ
TestModels_test_uc_20140901_expected 0.135σ 2.42σ 1.63σ 1.25σ 0.544σ

Problem\Measure create_instance discretize postprocessing nl lp bar gams
TestStochPDEgas_test_stochpdegas_automatic -0.00783σ 0.166σ 1.17σ
TestMisc_test_bilinear_100 0.657σ 1.32σ 0.609σ 1.19σ 0.575σ
TestMisc_test_bilinear_100000 0.189σ 0.572σ 0.368σ 1.03σ 1.08σ
TestMisc_test_bilinear_nlcontext_100 0.412σ 1.45σ 1.29σ 1.8σ 1.54σ
TestMisc_test_bilinear_nlcontext_100000 2.05σ 2.5σ 1.75σ 2.31σ 1.33σ
TestMisc_test_diag_quicksum_100 0.544σ 1.48σ 1.13σ 1.15σ 1.08σ
TestMisc_test_diag_quicksum_100000 0.437σ 0.469σ 0.513σ 0.103σ 0.163σ
TestMisc_test_diag_sum_100 1.12σ 1.34σ 0.795σ 1.29σ 2.22σ
TestMisc_test_diag_sum_100000 0.598σ 0.282σ 0.685σ 0.112σ 0.127σ
TestMisc_test_pmedian_quicksum_test4 0.26σ 0.0804σ 0.0943σ 0.061σ 0.167σ
TestMisc_test_pmedian_quicksum_test8 0.805σ 1.01σ 1.0σ 1.4σ 2.8σ
TestMisc_test_pmedian_sum_test4 0.356σ 0.426σ 0.19σ 0.0732σ 0.55σ
TestMisc_test_pmedian_sum_test8 0.118σ 0.215σ 0.766σ 0.391σ 1.99σ
TestMisc_test_pmedian_tuple_test4 1.23σ 0.883σ 1.1σ 1.03σ 0.953σ
TestMisc_test_pmedian_tuple_test8 2.09σ 0.298σ 0.261σ 0.215σ 0.516σ
TestJump_test_clnlbean_5000 1.15σ 0.332σ 1.52σ
TestJump_test_clnlbean_50000 0.965σ 2.04σ 1.45σ
TestJump_test_facility_25 0.0636σ 0.158σ 0.0899σ 0.93σ 0.245σ
TestJump_test_facility_5 0.0891σ 0.401σ 0.63σ 0.359σ 0.949σ
TestJump_test_facility_quicksum_25 0.603σ 0.834σ 0.417σ 1.23σ 0.32σ
TestJump_test_facility_quicksum_5 0.132σ 0.391σ 0.189σ 0.33σ 0.583σ
TestJump_test_lqcp_10 0.34σ 1.83σ 0.414σ 0.445σ 0.509σ
TestJump_test_lqcp_500 0.542σ 0.714σ 2.51σ 0.547σ 0.196σ
TestJump_test_lqcp_quicksum_10 0.601σ 1.48σ 0.904σ 1.7σ 0.886σ
TestJump_test_lqcp_quicksum_500 0.405σ 2.04σ 1.59σ 0.205σ 0.487σ
TestJump_test_opf_662 0.89σ 0.37σ 0.535σ
TestJump_test_opf_6620 1.56σ 1.89σ 2.17σ
TestJump_test_opf_quicksum_662 1.4σ 1.08σ 1.24σ
TestJump_test_opf_quicksum_6620 0.521σ 0.159σ 1.47σ
TestDevel_test_issue_691 0.175σ 0.58σ 0.112σ 0.0458σ 0.0235σ
TestModels_test_dcopf_case2383wp 0.252σ 0.0777σ 0.212σ 0.104σ 0.372σ
TestModels_test_uc_20140901_expected 0.18σ 0.207σ 1.19σ 3.06σ 0.779σ

Problem\Measure create_instance discretize postprocessing nl lp bar gams
TestStochPDEgas_test_stochpdegas_automatic 1.04σ 0.474σ 0.702σ
TestMisc_test_bilinear_100 0.555σ 1.12σ 0.75σ 1.71σ 1.39σ
TestMisc_test_bilinear_100000 0.477σ 0.703σ 0.43σ 0.132σ 0.128σ
TestMisc_test_bilinear_nlcontext_100 0.918σ 1.11σ 1.55σ 1.41σ 1.37σ
TestMisc_test_bilinear_nlcontext_100000 1.31σ 0.406σ 0.205σ 0.21σ 0.361σ
TestMisc_test_diag_quicksum_100 0.482σ 1.46σ 1.88σ 1.41σ 1.31σ
TestMisc_test_diag_quicksum_100000 0.461σ 0.0883σ 0.761σ 0.467σ 1.71σ
TestMisc_test_diag_sum_100 0.402σ 1.03σ 0.984σ 1.25σ 1.74σ
TestMisc_test_diag_sum_100000 0.639σ 0.243σ 0.339σ 0.185σ 0.163σ
TestMisc_test_pmedian_quicksum_test4 0.0967σ 0.121σ 0.157σ 0.0468σ 0.0763σ
TestMisc_test_pmedian_quicksum_test8 1.31σ 2.65σ 1.36σ 0.307σ 0.273σ
TestMisc_test_pmedian_sum_test4 0.401σ 0.528σ 0.517σ 0.506σ 1.11σ
TestMisc_test_pmedian_sum_test8 0.377σ 0.289σ 1.34σ 2.3σ 0.736σ
TestMisc_test_pmedian_tuple_test4 0.795σ 0.392σ 0.307σ 0.239σ 0.185σ
TestMisc_test_pmedian_tuple_test8 0.295σ 1.45σ 0.46σ 1.61σ 2.52σ
TestJump_test_clnlbean_5000 0.198σ 0.327σ 0.44σ
TestJump_test_clnlbean_50000 0.396σ 0.352σ 0.545σ
TestJump_test_facility_25 0.295σ 1.15σ 0.777σ 0.792σ 0.187σ
TestJump_test_facility_5 0.0503σ 0.384σ 0.442σ 0.226σ 0.359σ
TestJump_test_facility_quicksum_25 0.449σ 0.161σ 0.607σ 1.37σ 1.06σ
TestJump_test_facility_quicksum_5 1.88σ 2.29σ 0.445σ 2.15σ 2.44σ
TestJump_test_lqcp_10 2.57σ 2.52σ 2.34σ 2.42σ 2.36σ
TestJump_test_lqcp_500 1.75σ 1.27σ 0.267σ 0.231σ 1.99σ
TestJump_test_lqcp_quicksum_10 0.795σ 1.9σ 1.73σ 2.25σ 1.64σ
TestJump_test_lqcp_quicksum_500 1.19σ 0.244σ 0.183σ 0.249σ 2.06σ
TestJump_test_opf_662 0.568σ 0.0846σ 0.579σ
TestJump_test_opf_6620 0.851σ 0.551σ 0.407σ
TestJump_test_opf_quicksum_662 0.312σ 0.225σ 0.296σ
TestJump_test_opf_quicksum_6620 0.898σ 0.123σ 0.869σ
TestDevel_test_issue_691 0.188σ 0.547σ 0.353σ 0.112σ 0.118σ
TestModels_test_dcopf_case2383wp 0.607σ 0.122σ 0.0958σ 0.122σ 0.241σ
TestModels_test_uc_20140901_expected 0.333σ 1.72σ 1.43σ 0.223σ 0.498σ

Problem\Measure create_instance discretize postprocessing nl lp bar gams
TestStochPDEgas_test_stochpdegas_automatic 1.21σ 0.801σ 1.97σ
TestMisc_test_bilinear_100 1.38σ 1.6σ 1.5σ 1.31σ 1.86σ
TestMisc_test_bilinear_100000 1.69σ 0.847σ 0.515σ 0.327σ 1.21σ
TestMisc_test_bilinear_nlcontext_100 2.0σ 1.1σ 1.43σ 2.1σ 1.59σ
TestMisc_test_bilinear_nlcontext_100000 1.68σ 1.56σ 1.54σ 1.47σ 1.14σ
TestMisc_test_diag_quicksum_100 1.17σ 0.602σ 0.736σ -0.0124σ 0.338σ
TestMisc_test_diag_quicksum_100000 1.21σ 1.73σ 1.21σ 1.11σ 0.975σ
TestMisc_test_diag_sum_100 0.583σ 1.08σ 0.726σ 0.996σ 1.36σ
TestMisc_test_diag_sum_100000 0.812σ 0.545σ 0.878σ 0.86σ 1.82σ
TestMisc_test_pmedian_quicksum_test4 2.03σ 2.06σ 1.84σ 1.73σ 1.34σ
TestMisc_test_pmedian_quicksum_test8 1.87σ 2.3σ 1.41σ 1.3σ 1.27σ
TestMisc_test_pmedian_sum_test4 0.673σ 2.19σ 2.1σ 1.69σ 1.56σ
TestMisc_test_pmedian_sum_test8 1.18σ 1.6σ 2.24σ 2.05σ 1.22σ
TestMisc_test_pmedian_tuple_test4 1.56σ 1.47σ 1.89σ 1.42σ 1.66σ
TestMisc_test_pmedian_tuple_test8 1.2σ 0.955σ 1.26σ 2.01σ 2.2σ
TestJump_test_clnlbean_5000 1.28σ 0.915σ 0.649σ
TestJump_test_clnlbean_50000 0.824σ 1.36σ 1.5σ
TestJump_test_facility_25 0.579σ 0.94σ 0.784σ 1.36σ 1.55σ
TestJump_test_facility_5 1.14σ 0.985σ 0.859σ 0.753σ 0.763σ
TestJump_test_facility_quicksum_25 0.748σ 2.02σ 1.85σ 1.54σ 1.99σ
TestJump_test_facility_quicksum_5 2.04σ 2.46σ 2.25σ 1.86σ 2.04σ
TestJump_test_lqcp_10 1.69σ 1.45σ 1.4σ 1.59σ 1.94σ
TestJump_test_lqcp_500 1.05σ 1.16σ 1.52σ 1.14σ 2.58σ
TestJump_test_lqcp_quicksum_10 0.377σ 1.04σ 0.484σ 0.281σ 0.684σ
TestJump_test_lqcp_quicksum_500 0.954σ 1.02σ 1.47σ 2.02σ 2.02σ
TestJump_test_opf_662 1.33σ 1.5σ 2.29σ
TestJump_test_opf_6620 1.44σ 0.91σ 1.15σ
TestJump_test_opf_quicksum_662 2.09σ 0.557σ 2.3σ
TestJump_test_opf_quicksum_6620 1.75σ 1.15σ 2.37σ
TestDevel_test_issue_691 1.68σ 2.07σ 1.82σ 1.62σ 1.36σ
TestModels_test_dcopf_case2383wp 1.18σ 1.64σ 2.05σ 1.87σ 1.63σ
TestModels_test_uc_20140901_expected 1.65σ 1.52σ 1.02σ 1.44σ 2.34σ

Problem\Measure create_instance discretize postprocessing nl lp bar gams
TestStochPDEgas_test_stochpdegas_automatic 0.949σ 0.0945σ 1.05σ
TestMisc_test_bilinear_100 0.34σ 1.46σ 1.49σ 1.64σ 2.12σ
TestMisc_test_bilinear_100000 0.65σ 1.26σ 0.869σ 0.413σ 0.527σ
TestMisc_test_bilinear_nlcontext_100 1.3σ 1.69σ 1.14σ 1.66σ 1.85σ
TestMisc_test_bilinear_nlcontext_100000 0.378σ 1.02σ 0.741σ 0.447σ 0.175σ
TestMisc_test_diag_quicksum_100 0.503σ 0.642σ 1.3σ 0.975σ 1.14σ
TestMisc_test_diag_quicksum_100000 0.773σ 0.208σ 0.108σ 0.916σ 1.19σ
TestMisc_test_diag_sum_100 1.01σ 2.16σ 2.4σ 1.72σ 1.37σ
TestMisc_test_diag_sum_100000 1.74σ 1.41σ 1.53σ 2.17σ 1.32σ
TestMisc_test_pmedian_quicksum_test4 0.533σ 1.32σ 0.252σ 0.262σ 0.0452σ
TestMisc_test_pmedian_quicksum_test8 1.29σ 1.71σ 0.361σ 0.587σ 1.65σ
TestMisc_test_pmedian_sum_test4 1.44σ 2.06σ 1.82σ 1.89σ 1.53σ
TestMisc_test_pmedian_sum_test8 0.583σ 2.31σ 0.39σ 0.443σ 1.13σ
TestMisc_test_pmedian_tuple_test4 1.08σ 1.46σ 0.88σ 1.38σ 1.17σ
TestMisc_test_pmedian_tuple_test8 1.39σ 1.86σ 1.42σ 0.795σ 1.09σ
TestJump_test_clnlbean_5000 0.207σ 0.715σ 2.19σ
TestJump_test_clnlbean_50000 1.58σ 1.63σ 2.08σ
TestJump_test_facility_25 0.0107σ 0.0516σ 0.129σ 1.44σ 1.02σ
TestJump_test_facility_5 0.0519σ 0.407σ 0.00903σ 0.418σ 0.712σ
TestJump_test_facility_quicksum_25 0.0485σ 0.094σ -0.0155σ 0.292σ 0.232σ
TestJump_test_facility_quicksum_5 0.383σ 0.472σ 0.0105σ 1.87σ 1.2σ
TestJump_test_lqcp_10 1.46σ 1.69σ 1.89σ 1.62σ 2.03σ
TestJump_test_lqcp_500 1.18σ 1.76σ 1.74σ 0.853σ 1.36σ
TestJump_test_lqcp_quicksum_10 1.02σ 1.94σ 1.03σ 1.42σ 0.603σ
TestJump_test_lqcp_quicksum_500 2.06σ 0.195σ 0.662σ 1.01σ 2.81σ
TestJump_test_opf_662 0.0715σ 0.439σ 0.413σ
TestJump_test_opf_6620 0.179σ 0.943σ 1.51σ
TestJump_test_opf_quicksum_662 0.0709σ 0.344σ 0.638σ
TestJump_test_opf_quicksum_6620 0.287σ 0.217σ 1.36σ
TestDevel_test_issue_691 0.416σ 1.16σ 1.36σ 1.56σ 0.579σ
TestModels_test_dcopf_case2383wp 0.3σ 0.989σ 0.456σ 2.12σ 1.5σ
TestModels_test_uc_20140901_expected 2.01σ 0.314σ 0.221σ 1.13σ 2.54σ