Performance Results


Welcome to Pyomo's performance test results portal!


Please explore the expandable sections below for different categories of Pyomo's current performance. The numbers shown are standard deviations away from the running average (where a positive number is slower than average, negative faster than average).

Note: Alerts are generated based on repeated performance. The table represents only the most recent run of the performance test suite.

Last update: Apr-25-2024 17:48

Performance Degradation Alert
Combination "Python = python-cython-3.10, Problem = TestJump_test_lqcp_500, Measure = lp" is 0.4635s (2.925σ) above the average run time.

Problem\Measure create_instance discretize postprocessing nl lp bar gams
TestStochPDEgas_test_stochpdegas_automatic 0.295σ 0.0496σ -0.0565σ
TestMisc_test_bilinear_100 0.525σ 1.26σ 1.83σ 1.19σ 1.3σ
TestMisc_test_bilinear_100000 1.94σ 0.851σ 0.838σ 0.647σ 0.776σ
TestMisc_test_bilinear_nlcontext_100 0.888σ 0.363σ 2.24σ 0.927σ 0.917σ
TestMisc_test_bilinear_nlcontext_100000 1.58σ 0.855σ 1.33σ 0.262σ 0.326σ
TestMisc_test_diag_quicksum_100 0.32σ 2.13σ 1.81σ 1.59σ 0.728σ
TestMisc_test_diag_quicksum_100000 2.01σ 0.681σ 0.23σ 0.523σ 1.78σ
TestMisc_test_diag_sum_100 1.06σ 1.25σ 2.32σ 1.19σ 2.15σ
TestMisc_test_diag_sum_100000 2.03σ 1.06σ 0.835σ 0.461σ 1.26σ
TestMisc_test_pmedian_quicksum_test4 0.0911σ 1.37σ 1.67σ 0.831σ 0.447σ
TestMisc_test_pmedian_quicksum_test8 0.259σ 1.34σ 1.17σ 0.206σ 0.206σ
TestMisc_test_pmedian_sum_test4 0.232σ 1.52σ 2.4σ 0.493σ 0.41σ
TestMisc_test_pmedian_sum_test8 0.195σ 0.839σ 0.821σ 0.336σ 0.233σ
TestMisc_test_pmedian_tuple_test4 0.376σ 1.66σ 1.35σ 1.61σ 0.395σ
TestMisc_test_pmedian_tuple_test8 0.203σ 1.04σ 1.33σ 0.312σ 0.263σ
TestJump_test_clnlbean_5000 0.0974σ 0.976σ 0.0782σ
TestJump_test_clnlbean_50000 0.292σ 0.722σ 0.35σ
TestJump_test_facility_25 1.09σ 0.448σ 0.938σ 0.838σ 1.2σ
TestJump_test_facility_5 0.574σ 1.85σ 1.05σ 0.726σ 0.979σ
TestJump_test_facility_quicksum_25 0.199σ 0.549σ 1.77σ 0.634σ 0.738σ
TestJump_test_facility_quicksum_5 0.0544σ 0.94σ 1.69σ 0.64σ 0.502σ
TestJump_test_lqcp_10 0.0767σ 1.92σ 1.93σ 1.98σ 1.06σ
TestJump_test_lqcp_500 0.099σ 1.38σ 2.82σ 0.389σ 0.191σ
TestJump_test_lqcp_quicksum_10 1.09σ 2.24σ 2.26σ 2.29σ 0.734σ
TestJump_test_lqcp_quicksum_500 0.0907σ 1.77σ 2.66σ 0.235σ 0.115σ
TestJump_test_opf_662 0.7σ 0.73σ 0.0329σ
TestJump_test_opf_6620 0.782σ 1.01σ 0.0167σ
TestJump_test_opf_quicksum_662 1.15σ 1.58σ 0.965σ
TestJump_test_opf_quicksum_6620 1.34σ 0.928σ 0.221σ
TestDevel_test_issue_691 0.0713σ 1.11σ 0.388σ 0.197σ 0.511σ
TestModels_test_dcopf_case2383wp 1.09σ 0.81σ 1.77σ 0.418σ 0.302σ
TestModels_test_uc_20140901_expected 0.0791σ 0.943σ 1.06σ 0.592σ 0.4σ

Problem\Measure create_instance discretize postprocessing nl lp bar gams
TestStochPDEgas_test_stochpdegas_automatic 0.883σ 1.69σ 0.31σ
TestMisc_test_bilinear_100 0.535σ 2.28σ 2.25σ 1.37σ 1.27σ
TestMisc_test_bilinear_100000 2.47σ 0.654σ 0.887σ 0.574σ 2.05σ
TestMisc_test_bilinear_nlcontext_100 0.208σ 2.39σ 1.64σ 1.45σ 1.84σ
TestMisc_test_bilinear_nlcontext_100000 1.47σ 0.933σ 0.44σ 2.64σ 1.79σ
TestMisc_test_diag_quicksum_100 0.54σ 1.74σ 2.28σ 2.24σ 2.4σ
TestMisc_test_diag_quicksum_100000 1.79σ 1.39σ 1.27σ 1.15σ 0.664σ
TestMisc_test_diag_sum_100 0.985σ 2.09σ 1.24σ 1.54σ 2.19σ
TestMisc_test_diag_sum_100000 2.23σ 1.98σ 1.51σ 1.07σ 1.72σ
TestMisc_test_pmedian_quicksum_test4 0.196σ 2.69σ 2.51σ 0.136σ 0.841σ
TestMisc_test_pmedian_quicksum_test8 0.0173σ 0.747σ 1.51σ 0.544σ 0.696σ
TestMisc_test_pmedian_sum_test4 0.0157σ 1.24σ 1.31σ 2.22σ 0.171σ
TestMisc_test_pmedian_sum_test8 0.172σ 1.05σ 1.1σ 0.619σ 0.283σ
TestMisc_test_pmedian_tuple_test4 -0.0342σ 1.81σ 1.83σ 0.915σ 0.258σ
TestMisc_test_pmedian_tuple_test8 0.245σ 0.722σ 0.54σ 0.339σ 0.383σ
TestJump_test_clnlbean_5000 -0.115σ 1.82σ 0.78σ
TestJump_test_clnlbean_50000 -0.0775σ 0.957σ 1.25σ
TestJump_test_facility_25 0.522σ 0.588σ 0.558σ 1.14σ 1.76σ
TestJump_test_facility_5 0.114σ 1.45σ 1.54σ 2.22σ 2.36σ
TestJump_test_facility_quicksum_25 -0.0312σ 1.43σ 0.841σ 0.754σ 1.51σ
TestJump_test_facility_quicksum_5 0.163σ 1.53σ 0.816σ 1.88σ 2.35σ
TestJump_test_lqcp_10 0.433σ 0.984σ 1.5σ 1.95σ 1.99σ
TestJump_test_lqcp_500 0.0175σ 1.04σ 2.57σ 0.335σ 0.148σ
TestJump_test_lqcp_quicksum_10 -0.038σ 1.44σ 2.23σ 0.529σ 1.85σ
TestJump_test_lqcp_quicksum_500 0.00074σ 1.29σ 2.47σ 0.0365σ 0.263σ
TestJump_test_opf_662 0.738σ 0.537σ 1.09σ
TestJump_test_opf_6620 0.509σ 1.47σ 0.535σ
TestJump_test_opf_quicksum_662 0.564σ 0.433σ 0.175σ
TestJump_test_opf_quicksum_6620 0.577σ 1.44σ 0.234σ
TestDevel_test_issue_691 0.687σ 1.54σ 0.157σ 0.283σ 0.382σ
TestModels_test_dcopf_case2383wp 0.757σ 0.865σ 1.44σ 0.705σ 1.43σ
TestModels_test_uc_20140901_expected -0.381σ 0.997σ 1.32σ 0.412σ 0.294σ

Problem\Measure create_instance discretize postprocessing nl lp bar gams
TestStochPDEgas_test_stochpdegas_automatic 1.54σ 0.642σ 0.265σ
TestMisc_test_bilinear_100 0.928σ 1.35σ 1.54σ 1.98σ 1.47σ
TestMisc_test_bilinear_100000 1.57σ 0.679σ 2.21σ 0.605σ 1.67σ
TestMisc_test_bilinear_nlcontext_100 0.826σ 0.725σ 1.65σ 1.63σ 1.82σ
TestMisc_test_bilinear_nlcontext_100000 1.53σ 1.1σ 0.688σ 1.01σ 1.64σ
TestMisc_test_diag_quicksum_100 0.178σ 1.96σ 2.14σ 1.22σ 1.84σ
TestMisc_test_diag_quicksum_100000 2.4σ 0.714σ 1.18σ 1.47σ 1.98σ
TestMisc_test_diag_sum_100 0.814σ 0.115σ 1.91σ 1.89σ 1.98σ
TestMisc_test_diag_sum_100000 1.65σ 1.02σ 1.44σ 1.56σ 2.07σ
TestMisc_test_pmedian_quicksum_test4 0.283σ 0.824σ 1.33σ 1.77σ 0.351σ
TestMisc_test_pmedian_quicksum_test8 -0.000838σ 0.737σ 1.22σ 0.337σ 0.197σ
TestMisc_test_pmedian_sum_test4 0.564σ 0.433σ 1.15σ 1.52σ 0.214σ
TestMisc_test_pmedian_sum_test8 0.126σ 0.965σ 1.04σ 0.593σ 0.32σ
TestMisc_test_pmedian_tuple_test4 0.0771σ 0.407σ 1.66σ 0.747σ 0.315σ
TestMisc_test_pmedian_tuple_test8 0.0584σ 0.774σ 0.907σ 0.515σ 0.289σ
TestJump_test_clnlbean_5000 -0.181σ 0.862σ 0.609σ
TestJump_test_clnlbean_50000 -0.332σ 1.15σ 0.766σ
TestJump_test_facility_25 -0.232σ 1.3σ 1.74σ 1.48σ 1.88σ
TestJump_test_facility_5 0.479σ 1.87σ 1.02σ 1.36σ 1.12σ
TestJump_test_facility_quicksum_25 0.145σ 0.904σ 0.559σ 1.93σ 1.94σ
TestJump_test_facility_quicksum_5 0.602σ 1.55σ 0.98σ 1.31σ 1.54σ
TestJump_test_lqcp_10 0.51σ 1.86σ 2.35σ 0.622σ 1.35σ
TestJump_test_lqcp_500 0.0272σ 2.13σ 2.48σ 0.744σ 0.369σ
TestJump_test_lqcp_quicksum_10 0.641σ 2.24σ 2.24σ 1.44σ 1.43σ
TestJump_test_lqcp_quicksum_500 0.0332σ 2.06σ 2.82σ 0.845σ 0.342σ
TestJump_test_opf_662 1.19σ 0.522σ 0.523σ
TestJump_test_opf_6620 1.06σ 1.55σ 1.01σ
TestJump_test_opf_quicksum_662 0.617σ 1.01σ 1.82σ
TestJump_test_opf_quicksum_6620 1.35σ 0.951σ 1.54σ
TestDevel_test_issue_691 0.434σ 1.16σ 1.71σ 0.289σ 0.513σ
TestModels_test_dcopf_case2383wp 0.315σ 1.1σ 0.659σ 0.611σ 0.599σ
TestModels_test_uc_20140901_expected 0.375σ 1.24σ 0.893σ 0.822σ 0.48σ

Problem\Measure create_instance discretize postprocessing nl lp bar gams
TestStochPDEgas_test_stochpdegas_automatic 0.96σ 0.246σ 2.15σ
TestMisc_test_bilinear_100 0.891σ 0.618σ 0.933σ 0.883σ 1.74σ
TestMisc_test_bilinear_100000 0.936σ 1.58σ 0.651σ 0.495σ 1.77σ
TestMisc_test_bilinear_nlcontext_100 1.47σ 0.277σ 0.766σ 0.995σ 0.458σ
TestMisc_test_bilinear_nlcontext_100000 2.01σ 1.02σ 1.77σ 0.734σ 1.5σ
TestMisc_test_diag_quicksum_100 0.248σ 0.979σ 2.4σ 0.466σ 2.69σ
TestMisc_test_diag_quicksum_100000 0.883σ 0.498σ 1.08σ 0.822σ 2.38σ
TestMisc_test_diag_sum_100 0.52σ 1.08σ 1.84σ 1.17σ 2.48σ
TestMisc_test_diag_sum_100000 0.81σ 1.54σ 0.674σ 0.412σ 2.98σ
TestMisc_test_pmedian_quicksum_test4 0.156σ 1.66σ 1.8σ 1.62σ 0.896σ
TestMisc_test_pmedian_quicksum_test8 0.864σ 1.86σ 1.44σ 0.44σ 0.531σ
TestMisc_test_pmedian_sum_test4 0.974σ 2.08σ 1.91σ 1.11σ 1.17σ
TestMisc_test_pmedian_sum_test8 0.744σ 0.963σ 1.34σ 0.535σ 0.101σ
TestMisc_test_pmedian_tuple_test4 0.092σ 1.71σ 1.73σ 0.774σ 0.253σ
TestMisc_test_pmedian_tuple_test8 0.199σ 0.665σ 0.863σ 0.241σ 0.125σ
TestJump_test_clnlbean_5000 0.0289σ 0.606σ 0.985σ
TestJump_test_clnlbean_50000 0.695σ 1.19σ 1.36σ
TestJump_test_facility_25 0.647σ 1.61σ 0.855σ 1.39σ 1.54σ
TestJump_test_facility_5 0.601σ 1.64σ 1.6σ 1.18σ 0.835σ
TestJump_test_facility_quicksum_25 1.17σ 1.45σ 1.16σ 1.61σ 1.52σ
TestJump_test_facility_quicksum_5 0.216σ 2.2σ 1.5σ 2.02σ 1.77σ
TestJump_test_lqcp_10 0.101σ 1.18σ 0.492σ 0.53σ 0.852σ
TestJump_test_lqcp_500 0.0457σ 1.77σ 2.52σ 0.484σ 0.108σ
TestJump_test_lqcp_quicksum_10 -0.00768σ 1.81σ 2.35σ 1.5σ 0.796σ
TestJump_test_lqcp_quicksum_500 0.0175σ 1.82σ 2.36σ 0.255σ 0.138σ
TestJump_test_opf_662 0.242σ 1.72σ 0.261σ
TestJump_test_opf_6620 0.658σ 1.06σ 0.567σ
TestJump_test_opf_quicksum_662 1.14σ 0.7σ 0.473σ
TestJump_test_opf_quicksum_6620 0.503σ 1.46σ 0.61σ
TestDevel_test_issue_691 0.593σ 0.815σ 0.984σ -0.00153σ 0.271σ
TestModels_test_dcopf_case2383wp 0.867σ 2.25σ 1.2σ 0.56σ 0.365σ
TestModels_test_uc_20140901_expected 0.549σ 1.7σ 1.76σ 0.648σ 0.316σ

Problem\Measure create_instance discretize postprocessing nl lp bar gams
TestStochPDEgas_test_stochpdegas_automatic 0.368σ 0.185σ 0.295σ
TestMisc_test_bilinear_100 0.155σ 1.24σ 1.44σ 1.22σ 1.6σ
TestMisc_test_bilinear_100000 0.767σ 1.04σ 1.14σ 1.56σ 0.861σ
TestMisc_test_bilinear_nlcontext_100 0.863σ 1.36σ 1.53σ 0.571σ 0.509σ
TestMisc_test_bilinear_nlcontext_100000 1.31σ 0.729σ 0.825σ 1.26σ 1.69σ
TestMisc_test_diag_quicksum_100 0.733σ 2.03σ 2.6σ 1.8σ 1.8σ
TestMisc_test_diag_quicksum_100000 0.596σ 0.71σ 0.971σ 1.46σ 1.55σ
TestMisc_test_diag_sum_100 0.623σ 2.43σ 1.48σ 2.16σ 1.57σ
TestMisc_test_diag_sum_100000 0.829σ 0.66σ 0.832σ 1.59σ 1.31σ
TestMisc_test_pmedian_quicksum_test4 0.314σ 1.28σ 1.54σ 0.45σ 0.402σ
TestMisc_test_pmedian_quicksum_test8 0.234σ 0.34σ 1.14σ 0.167σ 0.225σ
TestMisc_test_pmedian_sum_test4 0.0719σ 2.24σ 1.61σ 1.15σ 0.268σ
TestMisc_test_pmedian_sum_test8 -0.0257σ 0.792σ 1.59σ 0.305σ 0.0966σ
TestMisc_test_pmedian_tuple_test4 0.123σ 1.42σ 0.99σ 1.59σ 0.628σ
TestMisc_test_pmedian_tuple_test8 0.073σ 0.234σ 1.24σ 0.357σ 0.106σ
TestJump_test_clnlbean_5000 0.484σ 0.866σ 1.22σ
TestJump_test_clnlbean_50000 0.471σ 1.3σ 1.27σ
TestJump_test_facility_25 0.324σ 1.03σ 1.84σ 1.02σ 0.697σ
TestJump_test_facility_5 0.158σ 0.798σ 1.35σ 1.67σ 0.596σ
TestJump_test_facility_quicksum_25 0.801σ 1.02σ 1.91σ 1.24σ 0.513σ
TestJump_test_facility_quicksum_5 0.199σ 1.92σ 2.02σ 1.24σ 0.982σ
TestJump_test_lqcp_10 0.0127σ 1.07σ 2.14σ 1.56σ 1.33σ
TestJump_test_lqcp_500 0.0649σ 1.39σ 2.82σ 0.655σ 0.492σ
TestJump_test_lqcp_quicksum_10 1.14σ 1.46σ 2.16σ 1.39σ 1.03σ
TestJump_test_lqcp_quicksum_500 0.136σ 1.73σ 2.8σ 0.624σ 0.279σ
TestJump_test_opf_662 1.27σ 1.22σ 0.748σ
TestJump_test_opf_6620 0.544σ 0.623σ 0.107σ
TestJump_test_opf_quicksum_662 0.532σ 0.667σ 0.856σ
TestJump_test_opf_quicksum_6620 0.66σ 0.916σ 0.247σ
TestDevel_test_issue_691 0.871σ 0.557σ 0.865σ 0.184σ 0.202σ
TestModels_test_dcopf_case2383wp 4.81e-05σ 0.947σ 1.36σ 0.55σ 0.401σ
TestModels_test_uc_20140901_expected -0.0234σ 0.838σ 1.72σ 0.442σ 0.229σ

Problem\Measure create_instance discretize postprocessing nl lp bar gams
TestStochPDEgas_test_stochpdegas_automatic 0.489σ 0.727σ 0.231σ
TestMisc_test_bilinear_100 1.89σ 2.02σ 1.51σ 2.67σ 1.83σ
TestMisc_test_bilinear_100000 0.628σ 1.13σ 0.873σ 1.26σ 0.621σ
TestMisc_test_bilinear_nlcontext_100 0.632σ 1.83σ 2.75σ 1.52σ 0.964σ
TestMisc_test_bilinear_nlcontext_100000 0.649σ 1.14σ 0.894σ 0.426σ 1.25σ
TestMisc_test_diag_quicksum_100 0.991σ 2.5σ 2.42σ 2.25σ 1.24σ
TestMisc_test_diag_quicksum_100000 0.752σ 1.54σ 1.63σ 0.225σ 0.707σ
TestMisc_test_diag_sum_100 0.224σ 2.46σ 0.162σ 1.06σ 1.64σ
TestMisc_test_diag_sum_100000 1.25σ 0.237σ 1.03σ 0.264σ 0.648σ
TestMisc_test_pmedian_quicksum_test4 0.499σ 1.79σ 1.08σ 0.742σ 0.549σ
TestMisc_test_pmedian_quicksum_test8 0.585σ 0.9σ 1.54σ -0.00063σ 0.136σ
TestMisc_test_pmedian_sum_test4 0.563σ 1.15σ 0.993σ 0.866σ 0.559σ
TestMisc_test_pmedian_sum_test8 0.602σ 1.01σ 1.13σ -0.126σ 0.252σ
TestMisc_test_pmedian_tuple_test4 1.18σ 1.14σ 2.26σ 0.67σ 0.713σ
TestMisc_test_pmedian_tuple_test8 0.597σ 0.849σ 1.77σ 0.113σ 0.229σ
TestJump_test_clnlbean_5000 0.861σ 0.832σ 0.952σ
TestJump_test_clnlbean_50000 1.35σ 2.02σ 2.22σ
TestJump_test_facility_25 2.78σ 1.73σ 1.66σ 1.4σ 1.09σ
TestJump_test_facility_5 1.59σ 0.952σ 1.65σ 1.06σ 1.23σ
TestJump_test_facility_quicksum_25 2.32σ 1.32σ 2.38σ 0.921σ 1.08σ
TestJump_test_facility_quicksum_5 0.995σ 1.14σ 0.592σ 0.267σ 0.918σ
TestJump_test_lqcp_10 0.397σ 1.99σ 1.98σ 1.84σ 1.69σ
TestJump_test_lqcp_500 0.158σ 1.89σ 2.92σ 0.86σ 0.187σ
TestJump_test_lqcp_quicksum_10 1.96σ 2.47σ 2.24σ 2.11σ 0.983σ
TestJump_test_lqcp_quicksum_500 0.176σ 1.51σ 2.72σ 0.734σ 0.301σ
TestJump_test_opf_662 1.5σ 1.2σ 0.657σ
TestJump_test_opf_6620 1.13σ 0.936σ 0.714σ
TestJump_test_opf_quicksum_662 1.12σ 0.707σ 0.334σ
TestJump_test_opf_quicksum_6620 1.34σ 1.58σ 0.902σ
TestDevel_test_issue_691 0.853σ 1.01σ 0.742σ 0.104σ 0.517σ
TestModels_test_dcopf_case2383wp 0.41σ 0.421σ 0.732σ 0.41σ 0.873σ
TestModels_test_uc_20140901_expected 0.389σ 0.806σ 1.38σ 0.6σ 0.436σ

Problem\Measure create_instance discretize postprocessing nl lp bar gams
TestStochPDEgas_test_stochpdegas_automatic 0.698σ 0.244σ 0.222σ
TestMisc_test_bilinear_100 0.116σ 0.364σ 1.44σ 1.87σ 0.138σ
TestMisc_test_bilinear_100000 1.37σ 0.599σ 0.864σ 2.02σ 1.34σ
TestMisc_test_bilinear_nlcontext_100 0.706σ 2.59σ 2.83σ 1.79σ 1.98σ
TestMisc_test_bilinear_nlcontext_100000 1.63σ 0.542σ 0.317σ 0.301σ 2.23σ
TestMisc_test_diag_quicksum_100 1.05σ 1.92σ 2.47σ 1.62σ 1.49σ
TestMisc_test_diag_quicksum_100000 1.5σ 1.71σ 0.752σ 0.908σ 1.93σ
TestMisc_test_diag_sum_100 1.43σ 0.187σ 0.93σ 2.36σ 2.11σ
TestMisc_test_diag_sum_100000 1.45σ 1.44σ 2.0σ 0.809σ 1.71σ
TestMisc_test_pmedian_quicksum_test4 0.175σ 2.22σ 2.29σ 1.72σ 0.798σ
TestMisc_test_pmedian_quicksum_test8 -0.15σ 0.276σ 1.39σ 0.0246σ 0.218σ
TestMisc_test_pmedian_sum_test4 -0.0974σ 1.29σ 1.17σ 1.59σ 1.48σ
TestMisc_test_pmedian_sum_test8 -0.187σ 0.699σ 1.03σ 0.326σ 0.183σ
TestMisc_test_pmedian_tuple_test4 -0.714σ 2.13σ 2.27σ 0.983σ 0.648σ
TestMisc_test_pmedian_tuple_test8 -0.524σ 0.419σ 0.993σ -0.0616σ 0.219σ
TestJump_test_clnlbean_5000 -0.204σ 0.444σ 1.47σ
TestJump_test_clnlbean_50000 -0.528σ 0.974σ 1.77σ
TestJump_test_facility_25 -0.573σ 0.415σ 1.0σ 0.643σ 1.65σ
TestJump_test_facility_5 -0.254σ 1.96σ 1.93σ 1.36σ 1.14σ
TestJump_test_facility_quicksum_25 -0.502σ 1.05σ 1.41σ 0.764σ 1.88σ
TestJump_test_facility_quicksum_5 0.553σ 2.49σ 2.22σ 0.633σ 1.57σ
TestJump_test_lqcp_10 0.519σ 1.16σ 2.77σ 1.37σ 1.62σ
TestJump_test_lqcp_500 0.0566σ 1.58σ 2.39σ 0.899σ 0.77σ
TestJump_test_lqcp_quicksum_10 1.04σ 1.96σ 2.13σ 1.7σ 1.54σ
TestJump_test_lqcp_quicksum_500 0.0411σ 1.77σ 2.47σ 0.832σ 0.671σ
TestJump_test_opf_662 1.25σ 1.28σ 1.32σ
TestJump_test_opf_6620 0.593σ 1.88σ 1.43σ
TestJump_test_opf_quicksum_662 0.686σ 0.434σ 2.18σ
TestJump_test_opf_quicksum_6620 1.08σ 0.767σ 1.6σ
TestDevel_test_issue_691 0.588σ 0.879σ 1.58σ 0.297σ 0.496σ
TestModels_test_dcopf_case2383wp 0.124σ 1.05σ 2.05σ 1.2σ 0.557σ
TestModels_test_uc_20140901_expected -0.257σ 0.595σ 1.55σ 0.393σ 0.457σ

Problem\Measure create_instance discretize postprocessing nl lp bar gams
TestStochPDEgas_test_stochpdegas_automatic 1.04σ 0.0247σ 0.0498σ
TestMisc_test_bilinear_100 0.967σ 2.39σ 2.25σ 1.84σ 2.36σ
TestMisc_test_bilinear_100000 1.22σ 0.508σ 0.33σ 0.658σ 0.718σ
TestMisc_test_bilinear_nlcontext_100 0.126σ 1.38σ 2.4σ 2.24σ 1.34σ
TestMisc_test_bilinear_nlcontext_100000 1.9σ 0.53σ 0.0467σ 0.497σ 0.666σ
TestMisc_test_diag_quicksum_100 1.01σ 1.93σ 2.18σ 2.11σ 1.97σ
TestMisc_test_diag_quicksum_100000 1.44σ 1.7σ 0.324σ 1.21σ 1.56σ
TestMisc_test_diag_sum_100 0.143σ 2.37σ 2.42σ 1.97σ 1.68σ
TestMisc_test_diag_sum_100000 1.65σ 0.6σ 0.687σ 1.3σ 1.14σ
TestMisc_test_pmedian_quicksum_test4 0.297σ 2.3σ 1.78σ 0.665σ 0.327σ
TestMisc_test_pmedian_quicksum_test8 0.0896σ 0.653σ 1.47σ 0.238σ 0.133σ
TestMisc_test_pmedian_sum_test4 0.0891σ 1.53σ 1.38σ 0.578σ 0.976σ
TestMisc_test_pmedian_sum_test8 0.00884σ 0.66σ 0.958σ 0.278σ 0.229σ
TestMisc_test_pmedian_tuple_test4 0.891σ 0.549σ 1.96σ 1.35σ 0.499σ
TestMisc_test_pmedian_tuple_test8 0.0669σ 0.925σ 1.39σ 0.514σ 0.312σ
TestJump_test_clnlbean_5000 0.942σ 1.93σ 0.617σ
TestJump_test_clnlbean_50000 0.302σ 0.982σ 1.63σ
TestJump_test_facility_25 0.865σ 0.743σ 0.908σ 0.487σ 1.48σ
TestJump_test_facility_5 0.562σ 1.41σ 1.44σ 1.08σ 0.629σ
TestJump_test_facility_quicksum_25 1.47σ 1.37σ 0.696σ 0.575σ 0.79σ
TestJump_test_facility_quicksum_5 0.138σ 0.882σ 0.983σ 1.1σ 1.28σ
TestJump_test_lqcp_10 1.25σ 2.21σ 2.42σ 1.0σ 1.32σ
TestJump_test_lqcp_500 0.0299σ 1.9σ 1.76σ 0.0313σ 0.185σ
TestJump_test_lqcp_quicksum_10 0.566σ 1.52σ 1.92σ 0.926σ 0.635σ
TestJump_test_lqcp_quicksum_500 0.0438σ 1.63σ 2.54σ 0.359σ 0.188σ
TestJump_test_opf_662 1.47σ 0.529σ 1.26σ
TestJump_test_opf_6620 0.833σ 0.946σ 0.746σ
TestJump_test_opf_quicksum_662 1.1σ 1.88σ 1.05σ
TestJump_test_opf_quicksum_6620 0.646σ 1.02σ 1.03σ
TestDevel_test_issue_691 0.803σ 0.883σ 0.294σ 0.108σ 1.41σ
TestModels_test_dcopf_case2383wp 0.168σ 0.811σ 0.813σ 0.541σ 0.286σ
TestModels_test_uc_20140901_expected 0.389σ 0.68σ 0.929σ 0.133σ 0.123σ

Problem\Measure create_instance discretize postprocessing nl lp bar gams
TestStochPDEgas_test_stochpdegas_automatic 1.03σ 0.143σ 0.244σ
TestMisc_test_bilinear_100 1.02σ 1.34σ 0.342σ 1.83σ 1.18σ
TestMisc_test_bilinear_100000 1.44σ 1.38σ 0.649σ 0.636σ 0.487σ
TestMisc_test_bilinear_nlcontext_100 0.601σ 1.97σ 1.73σ 1.82σ 1.41σ
TestMisc_test_bilinear_nlcontext_100000 1.57σ 0.953σ 1.48σ 0.725σ 0.622σ
TestMisc_test_diag_quicksum_100 0.173σ 2.05σ 2.32σ 2.12σ 2.14σ
TestMisc_test_diag_quicksum_100000 2.07σ 1.45σ 1.0σ 0.46σ 2.23σ
TestMisc_test_diag_sum_100 0.867σ 2.44σ 2.34σ 0.397σ 2.19σ
TestMisc_test_diag_sum_100000 1.4σ 1.36σ 1.19σ 0.613σ 2.29σ
TestMisc_test_pmedian_quicksum_test4 0.715σ 2.31σ 1.19σ 0.967σ 0.971σ
TestMisc_test_pmedian_quicksum_test8 0.548σ 1.2σ 1.23σ 0.261σ 0.377σ
TestMisc_test_pmedian_sum_test4 0.29σ 2.16σ 1.23σ 0.809σ 0.674σ
TestMisc_test_pmedian_sum_test8 0.381σ 1.15σ 1.22σ 0.56σ 0.574σ
TestMisc_test_pmedian_tuple_test4 0.167σ 0.342σ 1.37σ 1.4σ 1.67σ
TestMisc_test_pmedian_tuple_test8 0.344σ 0.581σ 0.665σ 0.285σ 0.494σ
TestJump_test_clnlbean_5000 0.947σ 0.859σ 1.58σ
TestJump_test_clnlbean_50000 1.13σ 1.53σ 1.31σ
TestJump_test_facility_25 0.631σ 1.0σ 0.223σ 0.786σ 1.2σ
TestJump_test_facility_5 0.241σ 1.66σ 1.11σ 0.973σ 1.04σ
TestJump_test_facility_quicksum_25 0.503σ 1.92σ 1.05σ 0.527σ 1.05σ
TestJump_test_facility_quicksum_5 0.831σ 0.996σ 0.86σ 1.22σ 1.96σ
TestJump_test_lqcp_10 0.374σ 2.09σ 2.35σ 1.88σ 0.544σ
TestJump_test_lqcp_500 0.126σ 1.85σ 0.393σ -0.00792σ 0.0276σ
TestJump_test_lqcp_quicksum_10 0.0661σ 0.428σ 0.405σ 0.258σ 0.347σ
TestJump_test_lqcp_quicksum_500 0.0597σ 0.127σ 0.64σ 0.0558σ 0.137σ
TestJump_test_opf_662 0.237σ 0.135σ 0.111σ
TestJump_test_opf_6620 0.158σ 0.123σ 0.0515σ
TestJump_test_opf_quicksum_662 0.156σ 0.127σ 0.169σ
TestJump_test_opf_quicksum_6620 0.16σ 0.16σ 0.0711σ
TestDevel_test_issue_691 0.0291σ 0.108σ 0.167σ 0.0597σ 0.255σ
TestModels_test_dcopf_case2383wp 0.167σ 0.219σ 0.69σ 0.0653σ 0.0693σ
TestModels_test_uc_20140901_expected 0.495σ 1.01σ 0.957σ 0.0786σ 0.569σ

Problem\Measure create_instance discretize postprocessing nl lp bar gams
TestStochPDEgas_test_stochpdegas_automatic 0.385σ 0.2σ 0.0929σ
TestMisc_test_bilinear_100 1.52σ 1.81σ 1.23σ 0.975σ 0.368σ
TestMisc_test_bilinear_100000 0.717σ 1.78σ 0.685σ 2.04σ 1.31σ
TestMisc_test_bilinear_nlcontext_100 0.829σ 0.9σ 0.715σ 1.85σ 0.439σ
TestMisc_test_bilinear_nlcontext_100000 2.27σ 1.5σ 1.21σ 1.03σ 1.07σ
TestMisc_test_diag_quicksum_100 1.51σ 2.17σ 2.06σ 1.52σ 2.01σ
TestMisc_test_diag_quicksum_100000 1.21σ 1.3σ 1.21σ 0.55σ 2.23σ
TestMisc_test_diag_sum_100 0.758σ 1.23σ 2.22σ 1.79σ 2.1σ
TestMisc_test_diag_sum_100000 2.12σ 1.12σ 1.09σ 0.614σ 2.16σ
TestMisc_test_pmedian_quicksum_test4 0.0582σ 0.75σ 0.798σ 1.09σ 0.81σ
TestMisc_test_pmedian_quicksum_test8 0.0278σ 1.25σ 1.15σ 0.0794σ 0.705σ
TestMisc_test_pmedian_sum_test4 0.583σ 2.48σ 0.773σ 0.647σ 1.25σ
TestMisc_test_pmedian_sum_test8 0.0791σ 0.764σ 1.16σ 0.124σ 0.68σ
TestMisc_test_pmedian_tuple_test4 0.0217σ 1.94σ 1.75σ 0.612σ 0.826σ
TestMisc_test_pmedian_tuple_test8 0.151σ 0.986σ 1.07σ 0.31σ 0.797σ
TestJump_test_clnlbean_5000 0.361σ 1.7σ 1.49σ
TestJump_test_clnlbean_50000 0.551σ 1.78σ 1.74σ
TestJump_test_facility_25 0.271σ 1.24σ 0.99σ 1.46σ 2.22σ
TestJump_test_facility_5 0.059σ 0.777σ 1.1σ 1.29σ 1.26σ
TestJump_test_facility_quicksum_25 0.727σ 0.641σ 1.01σ 0.632σ 2.05σ
TestJump_test_facility_quicksum_5 0.698σ 1.06σ 2.15σ 1.08σ 1.4σ
TestJump_test_lqcp_10 0.317σ 1.2σ 2.12σ 0.799σ 0.577σ
TestJump_test_lqcp_500 0.149σ 1.71σ 2.88σ 0.414σ 0.544σ
TestJump_test_lqcp_quicksum_10 0.21σ 1.74σ 2.49σ 1.49σ 1.27σ
TestJump_test_lqcp_quicksum_500 0.117σ 1.6σ 2.92σ 0.409σ 0.484σ
TestJump_test_opf_662 0.295σ 0.535σ 0.467σ
TestJump_test_opf_6620 1.07σ 1.48σ 1.31σ
TestJump_test_opf_quicksum_662 1.14σ 1.26σ 0.356σ
TestJump_test_opf_quicksum_6620 1.0σ 1.56σ 1.24σ
TestDevel_test_issue_691 1.15σ 1.6σ 0.936σ 0.187σ 0.304σ
TestModels_test_dcopf_case2383wp 0.231σ 0.88σ 1.1σ 0.734σ 1.32σ
TestModels_test_uc_20140901_expected 0.234σ 0.997σ 1.56σ 0.459σ 1.0σ