Performance Results


Welcome to Pyomo's performance test results portal!


Please explore the expandable sections below for different categories of Pyomo's current performance. The numbers shown are standard deviations away from the running average (where a positive number is slower than average, negative faster than average).

Note: Alerts are generated based on repeated performance. The table represents only the most recent run of the performance test suite.

Last update: Nov-19-2024 00:42

Performance Degradation Alert
Combination "Python = python-3.9, Problem = TestModels_test_uc_20140901_expected, Measure = gams" is 0.6257s (2.48σ) above the average run time.
Performance Degradation Alert
Combination "Python = python-3.9, Problem = TestModels_test_uc_20140901_expected, Measure = bar" is 0.3692s (2.538σ) above the average run time.
Performance Degradation Alert
Combination "Python = python-3.9, Problem = TestJump_test_opf_6620, Measure = gams" is 0.2838s (2.233σ) above the average run time.
Performance Degradation Alert
Combination "Python = python-3.9, Problem = TestJump_test_clnlbean_50000, Measure = gams" is 0.2684s (2.298σ) above the average run time.
Performance Degradation Alert
Combination "Python = python-cython-3.9, Problem = TestJump_test_opf_quicksum_6620, Measure = gams" is 0.2368s (2.402σ) above the average run time.
Performance Degradation Alert
Combination "Python = python-cython-3.9, Problem = TestJump_test_opf_6620, Measure = gams" is 0.2314s (2.358σ) above the average run time.
Performance Degradation Alert
Combination "Python = python-3.12, Problem = TestJump_test_clnlbean_50000, Measure = gams" is 0.1958s (2.354σ) above the average run time.
Performance Degradation Alert
Combination "Python = python-3.9, Problem = TestJump_test_facility_25, Measure = gams" is 0.1414s (2.556σ) above the average run time.
Performance Degradation Alert
Combination "Python = python-3.9, Problem = TestMisc_test_bilinear_nlcontext_100000, Measure = gams" is 0.1373s (2.247σ) above the average run time.
Performance Degradation Alert
Combination "Python = python-3.9, Problem = TestJump_test_facility_quicksum_25, Measure = gams" is 0.1312s (2.476σ) above the average run time.
Performance Degradation Alert
Combination "Python = python-3.9, Problem = TestMisc_test_bilinear_100000, Measure = gams" is 0.1242s (2.149σ) above the average run time.
Performance Degradation Alert
Combination "Python = python-3.9, Problem = TestMisc_test_bilinear_100000, Measure = bar" is 0.1159s (2.275σ) above the average run time.
Performance Degradation Alert
Combination "Python = python-3.9, Problem = TestMisc_test_bilinear_nlcontext_100000, Measure = bar" is 0.1137s (2.303σ) above the average run time.

Problem\Measure create_instance discretize postprocessing nl lp bar gams
TestStochPDEgas_test_stochpdegas_automatic 1.39σ 1.71σ 1.82σ
TestMisc_test_bilinear_100 1.51σ 1.7σ 1.76σ 1.47σ 1.22σ
TestMisc_test_bilinear_100000 0.922σ 0.608σ 1.3σ 1.48σ 1.55σ
TestMisc_test_bilinear_nlcontext_100 2.48σ 1.38σ 1.96σ 1.39σ 2.11σ
TestMisc_test_bilinear_nlcontext_100000 2.43σ 0.468σ 1.67σ 1.37σ 1.42σ
TestMisc_test_diag_quicksum_100 1.73σ 1.97σ 1.59σ 1.73σ 1.78σ
TestMisc_test_diag_quicksum_100000 1.12σ 1.11σ 0.224σ 1.63σ 1.8σ
TestMisc_test_diag_sum_100 2.71σ 1.97σ 2.1σ 1.64σ 1.8σ
TestMisc_test_diag_sum_100000 1.36σ 0.655σ 0.449σ 1.52σ 1.69σ
TestMisc_test_pmedian_quicksum_test4 1.86σ 1.5σ 0.662σ 0.287σ 0.946σ
TestMisc_test_pmedian_quicksum_test8 1.84σ 1.28σ 0.3σ 0.608σ 0.784σ
TestMisc_test_pmedian_sum_test4 2.79σ 1.41σ 0.395σ 0.744σ 0.983σ
TestMisc_test_pmedian_sum_test8 2.19σ 1.49σ 0.31σ 0.708σ 1.21σ
TestMisc_test_pmedian_tuple_test4 2.24σ 1.92σ 0.642σ 1.36σ 1.35σ
TestMisc_test_pmedian_tuple_test8 1.6σ 1.11σ -0.0621σ 0.808σ 1.07σ
TestJump_test_clnlbean_5000 2.85σ 0.991σ 1.79σ
TestJump_test_clnlbean_50000 2.4σ 0.982σ 1.57σ
TestJump_test_facility_25 2.22σ 0.222σ -0.0133σ 1.49σ 1.61σ
TestJump_test_facility_5 1.99σ 1.02σ 1.19σ 1.55σ 1.26σ
TestJump_test_facility_quicksum_25 1.65σ 0.279σ 0.232σ 1.04σ 1.69σ
TestJump_test_facility_quicksum_5 1.87σ 1.14σ 1.23σ 1.62σ 1.69σ
TestJump_test_lqcp_10 2.39σ 1.44σ 1.88σ 1.46σ 1.96σ
TestJump_test_lqcp_500 1.71σ -0.184σ -0.362σ 1.04σ 1.43σ
TestJump_test_lqcp_quicksum_10 2.61σ 1.91σ 1.13σ 0.855σ 1.8σ
TestJump_test_lqcp_quicksum_500 1.49σ -0.297σ 0.217σ 1.0σ 1.56σ
TestJump_test_opf_662 2.31σ 0.0852σ 1.32σ
TestJump_test_opf_6620 1.66σ 0.2σ 1.4σ
TestJump_test_opf_quicksum_662 2.35σ 0.332σ 1.34σ
TestJump_test_opf_quicksum_6620 1.53σ 0.371σ 1.43σ
TestDevel_test_issue_691 0.916σ 1.46σ 0.181σ 0.628σ 0.43σ
TestModels_test_dcopf_case2383wp 0.299σ 0.57σ 0.248σ 1.54σ 1.87σ
TestModels_test_uc_20140901_expected 2.33σ 0.322σ -0.216σ 1.16σ 1.35σ

Problem\Measure create_instance discretize postprocessing nl lp bar gams
TestStochPDEgas_test_stochpdegas_automatic 2.12σ 2.77σ 2.05σ
TestMisc_test_bilinear_100 1.91σ 1.64σ 0.085σ 0.877σ 1.61σ
TestMisc_test_bilinear_100000 0.55σ 2.17σ 2.29σ 2.3σ 1.92σ
TestMisc_test_bilinear_nlcontext_100 0.914σ 2.04σ 2.38σ 2.61σ 2.18σ
TestMisc_test_bilinear_nlcontext_100000 0.79σ 1.85σ 2.3σ 2.18σ 1.82σ
TestMisc_test_diag_quicksum_100 0.239σ 1.81σ 1.78σ 2.42σ 2.14σ
TestMisc_test_diag_quicksum_100000 0.827σ 1.59σ 2.14σ 1.48σ 2.46σ
TestMisc_test_diag_sum_100 0.587σ 1.2σ 0.128σ 1.95σ 1.97σ
TestMisc_test_diag_sum_100000 0.49σ 1.52σ 2.31σ 1.17σ 2.4σ
TestMisc_test_pmedian_quicksum_test4 1.09σ 2.69σ 1.46σ 1.96σ 2.55σ
TestMisc_test_pmedian_quicksum_test8 0.901σ 1.91σ 1.39σ 1.42σ 2.22σ
TestMisc_test_pmedian_sum_test4 1.91σ 2.73σ 2.45σ 2.25σ 2.66σ
TestMisc_test_pmedian_sum_test8 1.71σ 1.6σ 1.97σ 1.76σ 2.04σ
TestMisc_test_pmedian_tuple_test4 2.37σ 3.0σ 2.56σ 2.48σ 2.62σ
TestMisc_test_pmedian_tuple_test8 1.03σ 2.02σ 1.68σ 1.4σ 2.44σ
TestJump_test_clnlbean_5000 2.48σ 1.54σ 2.09σ
TestJump_test_clnlbean_50000 2.55σ 1.51σ 1.98σ
TestJump_test_facility_25 2.37σ 1.61σ 2.45σ 2.5σ 1.99σ
TestJump_test_facility_5 1.99σ 1.91σ 2.3σ 2.12σ 2.12σ
TestJump_test_facility_quicksum_25 1.71σ 1.78σ 1.85σ 2.4σ 2.06σ
TestJump_test_facility_quicksum_5 1.8σ 2.12σ 2.47σ 2.35σ 1.29σ
TestJump_test_lqcp_10 1.96σ 2.33σ 1.61σ 2.27σ 2.18σ
TestJump_test_lqcp_500 0.602σ 1.42σ 1.52σ 2.07σ 2.0σ
TestJump_test_lqcp_quicksum_10 0.282σ 2.54σ 2.14σ 2.55σ 2.19σ
TestJump_test_lqcp_quicksum_500 1.32σ 1.3σ 1.42σ 2.17σ 2.09σ
TestJump_test_opf_662 0.827σ 0.817σ 2.05σ
TestJump_test_opf_6620 0.409σ 0.855σ 2.08σ
TestJump_test_opf_quicksum_662 1.11σ 0.65σ 2.02σ
TestJump_test_opf_quicksum_6620 0.773σ 1.04σ 2.08σ
TestDevel_test_issue_691 1.58σ 1.76σ 1.85σ 1.18σ 2.2σ
TestModels_test_dcopf_case2383wp 1.08σ 2.3σ 1.18σ 2.39σ 2.39σ
TestModels_test_uc_20140901_expected 2.1σ 1.81σ 1.99σ 2.16σ 2.36σ

Problem\Measure create_instance discretize postprocessing nl lp bar gams
TestStochPDEgas_test_stochpdegas_automatic 1.39σ 2.64σ 1.59σ
TestMisc_test_bilinear_100 2.22σ 1.76σ 1.56σ 1.9σ 2.03σ
TestMisc_test_bilinear_100000 1.22σ 1.81σ 0.792σ 2.43σ 2.29σ
TestMisc_test_bilinear_nlcontext_100 2.19σ 1.26σ 1.55σ 2.18σ 1.49σ
TestMisc_test_bilinear_nlcontext_100000 1.53σ 1.83σ 0.905σ 2.28σ 2.35σ
TestMisc_test_diag_quicksum_100 1.24σ 2.02σ 1.75σ 1.82σ 1.19σ
TestMisc_test_diag_quicksum_100000 0.612σ 1.05σ 1.92σ 1.33σ 1.94σ
TestMisc_test_diag_sum_100 1.8σ 0.794σ 1.1σ 1.27σ 1.29σ
TestMisc_test_diag_sum_100000 0.196σ 0.865σ 2.3σ 1.33σ 1.95σ
TestMisc_test_pmedian_quicksum_test4 2.33σ 1.63σ 2.12σ 2.05σ 1.1σ
TestMisc_test_pmedian_quicksum_test8 1.95σ 1.18σ 1.02σ 1.22σ 2.19σ
TestMisc_test_pmedian_sum_test4 2.54σ 0.114σ 1.79σ 0.372σ 2.56σ
TestMisc_test_pmedian_sum_test8 2.41σ 1.25σ 1.26σ 1.4σ 1.87σ
TestMisc_test_pmedian_tuple_test4 2.38σ 1.07σ 2.34σ 1.68σ 2.56σ
TestMisc_test_pmedian_tuple_test8 2.05σ 1.28σ 1.24σ 1.34σ 2.13σ
TestJump_test_clnlbean_5000 2.81σ 2.6σ 2.45σ
TestJump_test_clnlbean_50000 2.67σ 1.99σ 2.35σ
TestJump_test_facility_25 1.47σ 2.23σ 0.817σ 2.94σ 2.06σ
TestJump_test_facility_5 2.09σ 2.43σ 1.64σ 2.35σ 2.07σ
TestJump_test_facility_quicksum_25 1.49σ 1.91σ 0.975σ 2.59σ 2.04σ
TestJump_test_facility_quicksum_5 1.85σ 0.914σ 1.59σ 2.23σ 2.16σ
TestJump_test_lqcp_10 0.909σ 1.58σ 1.4σ 1.69σ 2.12σ
TestJump_test_lqcp_500 0.674σ 1.43σ 0.334σ 2.08σ 1.87σ
TestJump_test_lqcp_quicksum_10 2.37σ 1.43σ 1.58σ 2.14σ 2.03σ
TestJump_test_lqcp_quicksum_500 0.959σ 1.77σ 0.195σ 1.99σ 1.83σ
TestJump_test_opf_662 0.85σ 0.495σ 2.16σ
TestJump_test_opf_6620 0.377σ 1.3σ 2.18σ
TestJump_test_opf_quicksum_662 0.666σ 1.33σ 2.13σ
TestJump_test_opf_quicksum_6620 0.638σ 2.07σ 2.17σ
TestDevel_test_issue_691 1.48σ 0.316σ 0.637σ 2.29σ 2.4σ
TestModels_test_dcopf_case2383wp 1.98σ 0.899σ 1.96σ 2.29σ 1.99σ
TestModels_test_uc_20140901_expected 2.05σ 1.7σ 1.39σ 1.82σ 1.84σ

Problem\Measure create_instance discretize postprocessing nl lp bar gams
TestStochPDEgas_test_stochpdegas_automatic -0.357σ 0.859σ 1.15σ
TestMisc_test_bilinear_100 0.928σ 1.56σ 1.52σ 1.83σ 2.32σ
TestMisc_test_bilinear_100000 1.32σ 0.784σ 0.659σ 1.91σ 1.88σ
TestMisc_test_bilinear_nlcontext_100 1.01σ 1.75σ 2.29σ 1.66σ 1.78σ
TestMisc_test_bilinear_nlcontext_100000 0.718σ 1.45σ 0.949σ 1.9σ 2.02σ
TestMisc_test_diag_quicksum_100 1.53σ 1.39σ 1.55σ 1.47σ 1.23σ
TestMisc_test_diag_quicksum_100000 1.21σ 0.885σ 1.42σ 0.597σ 1.05σ
TestMisc_test_diag_sum_100 1.1σ 0.973σ 1.37σ 1.39σ 1.33σ
TestMisc_test_diag_sum_100000 0.498σ 1.3σ 1.87σ 1.02σ 1.21σ
TestMisc_test_pmedian_quicksum_test4 1.41σ 1.28σ 1.96σ 1.34σ 2.37σ
TestMisc_test_pmedian_quicksum_test8 0.696σ 0.734σ 1.14σ 1.11σ 1.37σ
TestMisc_test_pmedian_sum_test4 1.81σ 2.19σ 2.3σ 1.41σ 1.58σ
TestMisc_test_pmedian_sum_test8 0.678σ 1.14σ 1.52σ 1.41σ 1.2σ
TestMisc_test_pmedian_tuple_test4 1.2σ 1.95σ 1.48σ 1.55σ 0.574σ
TestMisc_test_pmedian_tuple_test8 0.703σ 1.12σ 1.45σ 1.01σ 1.62σ
TestJump_test_clnlbean_5000 0.814σ 1.77σ 2.13σ
TestJump_test_clnlbean_50000 1.26σ 1.12σ 1.83σ
TestJump_test_facility_25 0.621σ 0.861σ 0.954σ 0.816σ 1.16σ
TestJump_test_facility_5 0.219σ 0.628σ 0.683σ 1.18σ 1.11σ
TestJump_test_facility_quicksum_25 0.415σ 0.178σ 0.244σ 0.666σ 1.13σ
TestJump_test_facility_quicksum_5 0.0153σ 0.82σ 0.752σ 1.32σ 1.23σ
TestJump_test_lqcp_10 0.673σ 1.13σ 1.45σ 1.46σ 1.24σ
TestJump_test_lqcp_500 0.12σ 0.283σ 0.24σ 0.857σ 0.918σ
TestJump_test_lqcp_quicksum_10 0.342σ 0.758σ 0.728σ 1.01σ 0.963σ
TestJump_test_lqcp_quicksum_500 0.0647σ 0.352σ 0.724σ 2.08σ 1.96σ
TestJump_test_opf_662 0.259σ 1.25σ 2.22σ
TestJump_test_opf_6620 0.79σ 1.41σ 2.15σ
TestJump_test_opf_quicksum_662 1.4σ 1.56σ 2.23σ
TestJump_test_opf_quicksum_6620 0.778σ 1.3σ 2.23σ
TestDevel_test_issue_691 1.1σ 1.12σ 1.05σ 1.49σ 1.58σ
TestModels_test_dcopf_case2383wp 1.46σ 0.85σ 1.2σ 1.88σ 2.0σ
TestModels_test_uc_20140901_expected 1.42σ 0.726σ 1.29σ 1.87σ 1.81σ

Problem\Measure create_instance discretize postprocessing nl lp bar gams
TestStochPDEgas_test_stochpdegas_automatic 0.839σ 2.24σ 1.07σ
TestMisc_test_bilinear_100 1.8σ 1.38σ 1.9σ 2.52σ 2.74σ
TestMisc_test_bilinear_100000 1.27σ 2.63σ 2.11σ 2.28σ 2.15σ
TestMisc_test_bilinear_nlcontext_100 1.77σ 2.52σ 2.03σ 2.42σ 2.28σ
TestMisc_test_bilinear_nlcontext_100000 1.1σ 1.97σ 1.83σ 2.3σ 2.25σ
TestMisc_test_diag_quicksum_100 1.94σ 1.44σ 2.34σ 1.87σ 2.22σ
TestMisc_test_diag_quicksum_100000 1.06σ 2.02σ 2.69σ 2.46σ 2.67σ
TestMisc_test_diag_sum_100 1.36σ 1.08σ 2.03σ 1.97σ 2.77σ
TestMisc_test_diag_sum_100000 0.852σ 1.98σ 2.76σ 2.33σ 2.72σ
TestMisc_test_pmedian_quicksum_test4 2.73σ 2.57σ 2.94σ 2.78σ 2.6σ
TestMisc_test_pmedian_quicksum_test8 2.24σ 1.5σ 1.87σ 1.45σ 2.33σ
TestMisc_test_pmedian_sum_test4 2.92σ 2.46σ 2.79σ 2.65σ 2.59σ
TestMisc_test_pmedian_sum_test8 2.47σ 1.95σ 1.82σ 1.82σ 2.4σ
TestMisc_test_pmedian_tuple_test4 2.77σ 2.17σ 2.5σ 2.79σ 2.42σ
TestMisc_test_pmedian_tuple_test8 2.47σ 1.71σ 1.7σ 1.59σ 2.37σ
TestJump_test_clnlbean_5000 2.05σ 2.66σ 2.28σ
TestJump_test_clnlbean_50000 1.88σ 2.44σ 2.3σ
TestJump_test_facility_25 2.22σ 2.32σ 2.49σ 2.59σ 2.56σ
TestJump_test_facility_5 2.19σ 2.48σ 0.904σ 1.94σ 2.45σ
TestJump_test_facility_quicksum_25 2.25σ 2.49σ 2.48σ 2.55σ 2.48σ
TestJump_test_facility_quicksum_5 2.06σ 2.86σ 2.48σ 2.53σ 2.32σ
TestJump_test_lqcp_10 1.6σ 2.42σ 2.2σ 2.38σ 2.46σ
TestJump_test_lqcp_500 0.791σ 1.6σ 1.79σ 2.17σ 2.22σ
TestJump_test_lqcp_quicksum_10 2.15σ 2.29σ 2.26σ 2.59σ 2.35σ
TestJump_test_lqcp_quicksum_500 0.598σ 2.2σ 1.34σ 2.18σ 2.18σ
TestJump_test_opf_662 0.602σ 2.69σ 2.11σ
TestJump_test_opf_6620 -0.0324σ 2.6σ 2.23σ
TestJump_test_opf_quicksum_662 0.857σ 2.58σ 2.11σ
TestJump_test_opf_quicksum_6620 0.883σ 2.65σ 2.21σ
TestDevel_test_issue_691 0.782σ 1.94σ 2.12σ 0.843σ 2.27σ
TestModels_test_dcopf_case2383wp 2.03σ 2.72σ 2.71σ 2.28σ 2.42σ
TestModels_test_uc_20140901_expected 2.26σ 2.31σ 2.33σ 2.54σ 2.48σ

Problem\Measure create_instance discretize postprocessing nl lp bar gams
TestStochPDEgas_test_stochpdegas_automatic 0.75σ 1.23σ 0.0367σ
TestMisc_test_bilinear_100 1.38σ 0.905σ 1.42σ 1.42σ 1.26σ
TestMisc_test_bilinear_100000 2.15σ -0.293σ 0.0826σ 1.76σ 1.91σ
TestMisc_test_bilinear_nlcontext_100 2.08σ 0.852σ 0.91σ 1.8σ 1.28σ
TestMisc_test_bilinear_nlcontext_100000 0.342σ 0.0395σ -0.111σ 1.66σ 1.82σ
TestMisc_test_diag_quicksum_100 2.26σ 1.23σ 1.22σ 1.08σ 1.44σ
TestMisc_test_diag_quicksum_100000 1.4σ 0.774σ 0.4σ 1.13σ 0.401σ
TestMisc_test_diag_sum_100 1.63σ 1.21σ 1.52σ 1.23σ 0.98σ
TestMisc_test_diag_sum_100000 0.904σ 0.201σ -0.0517σ 1.1σ 0.0648σ
TestMisc_test_pmedian_quicksum_test4 1.22σ 1.7σ 0.397σ 0.584σ 1.48σ
TestMisc_test_pmedian_quicksum_test8 0.457σ 1.92σ -0.0151σ 1.13σ 0.921σ
TestMisc_test_pmedian_sum_test4 1.66σ 1.49σ 0.548σ 1.52σ 1.1σ
TestMisc_test_pmedian_sum_test8 1.49σ 1.76σ 0.369σ 0.693σ 0.381σ
TestMisc_test_pmedian_tuple_test4 1.45σ 1.79σ 0.635σ 1.49σ 1.6σ
TestMisc_test_pmedian_tuple_test8 0.867σ 1.29σ -0.0991σ 1.58σ 1.24σ
TestJump_test_clnlbean_5000 2.23σ 0.687σ 2.13σ
TestJump_test_clnlbean_50000 1.38σ 0.653σ 2.06σ
TestJump_test_facility_25 1.66σ -0.0191σ -0.258σ 1.68σ 2.14σ
TestJump_test_facility_5 0.711σ 1.97σ 1.15σ 2.11σ 1.98σ
TestJump_test_facility_quicksum_25 1.48σ -0.18σ -0.0756σ 1.96σ 2.07σ
TestJump_test_facility_quicksum_5 1.26σ 1.13σ 0.434σ 1.92σ 2.09σ
TestJump_test_lqcp_10 1.86σ 1.52σ 1.69σ 1.91σ 2.01σ
TestJump_test_lqcp_500 1.73σ -0.111σ -0.532σ 1.64σ 1.71σ
TestJump_test_lqcp_quicksum_10 1.76σ 1.11σ 0.67σ 1.78σ 1.77σ
TestJump_test_lqcp_quicksum_500 0.895σ -0.448σ -0.41σ 1.17σ 1.51σ
TestJump_test_opf_662 0.971σ -0.364σ 1.83σ
TestJump_test_opf_6620 0.73σ -0.0517σ 2.09σ
TestJump_test_opf_quicksum_662 1.88σ 0.264σ 2.07σ
TestJump_test_opf_quicksum_6620 1.71σ -0.125σ 2.16σ
TestDevel_test_issue_691 0.483σ 1.87σ -0.24σ 0.258σ 0.149σ
TestModels_test_dcopf_case2383wp 1.53σ -0.137σ -0.361σ 1.08σ 1.74σ
TestModels_test_uc_20140901_expected 1.17σ 0.39σ 0.0773σ 1.48σ 1.86σ

Problem\Measure create_instance discretize postprocessing nl lp bar gams
TestStochPDEgas_test_stochpdegas_automatic 1.83σ 1.83σ 0.403σ
TestMisc_test_bilinear_100 0.514σ 0.0869σ 1.25σ 1.57σ 0.599σ
TestMisc_test_bilinear_100000 1.03σ 1.77σ 2.32σ 1.62σ 2.21σ
TestMisc_test_bilinear_nlcontext_100 0.857σ 1.14σ 1.11σ 1.83σ 0.117σ
TestMisc_test_bilinear_nlcontext_100000 0.642σ 1.48σ 1.99σ 1.76σ 2.31σ
TestMisc_test_diag_quicksum_100 0.786σ 1.82σ 1.82σ 0.549σ 1.44σ
TestMisc_test_diag_quicksum_100000 0.952σ 1.27σ 2.11σ 0.62σ 2.41σ
TestMisc_test_diag_sum_100 1.14σ 1.58σ 1.34σ 1.08σ 2.1σ
TestMisc_test_diag_sum_100000 0.308σ 1.13σ 2.29σ 0.222σ 2.45σ
TestMisc_test_pmedian_quicksum_test4 0.883σ 2.26σ 2.5σ 1.06σ 2.48σ
TestMisc_test_pmedian_quicksum_test8 0.361σ 1.62σ 1.84σ 1.12σ 2.3σ
TestMisc_test_pmedian_sum_test4 1.72σ 2.88σ 2.75σ 1.13σ 2.6σ
TestMisc_test_pmedian_sum_test8 1.54σ 1.9σ 2.05σ 1.57σ 2.34σ
TestMisc_test_pmedian_tuple_test4 1.02σ 2.61σ 2.72σ 0.818σ 2.26σ
TestMisc_test_pmedian_tuple_test8 0.582σ 2.28σ 2.18σ 1.42σ 2.26σ
TestJump_test_clnlbean_5000 2.5σ 1.52σ 2.23σ
TestJump_test_clnlbean_50000 1.82σ 1.81σ 2.05σ
TestJump_test_facility_25 1.19σ 2.0σ 1.94σ 2.14σ 2.29σ
TestJump_test_facility_5 0.974σ 1.66σ 2.42σ 2.0σ 2.32σ
TestJump_test_facility_quicksum_25 1.42σ 2.19σ 2.37σ 2.16σ 2.48σ
TestJump_test_facility_quicksum_5 1.1σ 2.6σ 2.51σ 1.7σ 2.31σ
TestJump_test_lqcp_10 1.49σ 1.66σ 1.94σ 2.13σ 1.2σ
TestJump_test_lqcp_500 0.705σ 2.19σ 1.62σ 2.01σ 2.12σ
TestJump_test_lqcp_quicksum_10 0.677σ 2.16σ 2.26σ 2.32σ 2.1σ
TestJump_test_lqcp_quicksum_500 0.633σ 2.35σ 1.78σ 1.92σ 2.16σ
TestJump_test_opf_662 0.712σ 0.627σ 2.08σ
TestJump_test_opf_6620 0.244σ 0.622σ 2.3σ
TestJump_test_opf_quicksum_662 0.928σ 0.332σ 2.22σ
TestJump_test_opf_quicksum_6620 0.696σ 0.648σ 2.19σ
TestDevel_test_issue_691 1.16σ 1.92σ 1.4σ 0.783σ 1.75σ
TestModels_test_dcopf_case2383wp 0.357σ 1.94σ 2.53σ 1.79σ 1.93σ
TestModels_test_uc_20140901_expected 2.24σ 2.03σ 2.47σ 1.55σ 2.01σ

Problem\Measure create_instance discretize postprocessing nl lp bar gams
TestStochPDEgas_test_stochpdegas_automatic 0.408σ 2.31σ 1.83σ
TestMisc_test_bilinear_100 2.44σ 0.75σ 0.91σ 1.14σ 1.68σ
TestMisc_test_bilinear_100000 1.31σ 0.849σ 0.317σ 1.75σ 1.99σ
TestMisc_test_bilinear_nlcontext_100 1.93σ 0.769σ 0.548σ 0.936σ 1.44σ
TestMisc_test_bilinear_nlcontext_100000 1.35σ 0.902σ 0.195σ 1.99σ 1.99σ
TestMisc_test_diag_quicksum_100 1.41σ 1.51σ 1.07σ 1.15σ 1.67σ
TestMisc_test_diag_quicksum_100000 0.943σ 0.933σ 1.91σ 1.28σ 2.01σ
TestMisc_test_diag_sum_100 1.14σ 1.23σ 1.58σ 1.32σ 1.65σ
TestMisc_test_diag_sum_100000 0.255σ 0.555σ 1.63σ 1.24σ 1.99σ
TestMisc_test_pmedian_quicksum_test4 2.05σ 1.34σ 1.98σ 1.91σ 2.37σ
TestMisc_test_pmedian_quicksum_test8 1.99σ 0.919σ 1.83σ 2.1σ 2.22σ
TestMisc_test_pmedian_sum_test4 2.41σ 1.51σ 2.06σ 2.13σ 2.5σ
TestMisc_test_pmedian_sum_test8 2.04σ 1.45σ 1.36σ 1.7σ 1.99σ
TestMisc_test_pmedian_tuple_test4 2.19σ 1.09σ 1.67σ 2.12σ 2.33σ
TestMisc_test_pmedian_tuple_test8 1.75σ 1.52σ 1.54σ 2.08σ 2.25σ
TestJump_test_clnlbean_5000 2.56σ 1.51σ 1.89σ
TestJump_test_clnlbean_50000 1.97σ 1.19σ 2.01σ
TestJump_test_facility_25 1.43σ 1.23σ 0.787σ 1.69σ 1.79σ
TestJump_test_facility_5 0.494σ 2.38σ 2.26σ 2.09σ 2.17σ
TestJump_test_facility_quicksum_25 0.891σ 1.24σ 1.07σ 2.0σ 1.8σ
TestJump_test_facility_quicksum_5 1.25σ 2.28σ 1.9σ 2.0σ 2.01σ
TestJump_test_lqcp_10 1.46σ 2.11σ 1.32σ 2.13σ 2.13σ
TestJump_test_lqcp_500 0.344σ 0.863σ 0.278σ 1.51σ 1.69σ
TestJump_test_lqcp_quicksum_10 0.842σ 1.1σ 1.7σ 1.82σ 1.96σ
TestJump_test_lqcp_quicksum_500 0.266σ 1.12σ -0.0433σ 1.38σ 1.72σ
TestJump_test_opf_662 0.251σ 1.03σ 1.8σ
TestJump_test_opf_6620 0.201σ 0.876σ 1.95σ
TestJump_test_opf_quicksum_662 1.01σ 0.834σ 1.73σ
TestJump_test_opf_quicksum_6620 0.727σ 0.705σ 1.71σ
TestDevel_test_issue_691 0.903σ 0.508σ 0.754σ 1.12σ 1.7σ
TestModels_test_dcopf_case2383wp 0.974σ 0.343σ 1.92σ 2.0σ 1.85σ
TestModels_test_uc_20140901_expected 1.73σ 0.911σ 0.94σ 1.7σ 1.78σ

Problem\Measure create_instance discretize postprocessing nl lp bar gams
TestStochPDEgas_test_stochpdegas_automatic 1.73σ 2.33σ 1.07σ
TestMisc_test_bilinear_100 1.24σ 1.35σ 1.78σ 1.96σ 2.49σ
TestMisc_test_bilinear_100000 0.505σ 0.98σ 1.07σ 2.18σ 2.12σ
TestMisc_test_bilinear_nlcontext_100 1.8σ 1.2σ 1.37σ 1.49σ 1.6σ
TestMisc_test_bilinear_nlcontext_100000 0.498σ 1.18σ 1.24σ 2.12σ 2.1σ
TestMisc_test_diag_quicksum_100 1.54σ 1.17σ 1.98σ 1.7σ 1.46σ
TestMisc_test_diag_quicksum_100000 0.421σ 1.07σ 1.63σ 1.37σ 1.31σ
TestMisc_test_diag_sum_100 1.3σ 1.94σ 1.82σ 2.01σ 1.3σ
TestMisc_test_diag_sum_100000 0.945σ 0.888σ 1.03σ 1.21σ 1.22σ
TestMisc_test_pmedian_quicksum_test4 0.791σ 1.76σ 2.31σ 1.74σ 1.97σ
TestMisc_test_pmedian_quicksum_test8 0.439σ 1.11σ 0.97σ 1.83σ 1.33σ
TestMisc_test_pmedian_sum_test4 1.34σ 1.97σ 2.54σ 2.14σ 1.47σ
TestMisc_test_pmedian_sum_test8 0.794σ 1.18σ 1.02σ 1.19σ 1.52σ
TestMisc_test_pmedian_tuple_test4 0.707σ 1.99σ 1.97σ 1.85σ 1.44σ
TestMisc_test_pmedian_tuple_test8 0.968σ 1.98σ 1.45σ 1.6σ 0.914σ
TestJump_test_clnlbean_5000 1.3σ 1.65σ 2.01σ
TestJump_test_clnlbean_50000 1.22σ 1.03σ 1.38σ
TestJump_test_facility_25 0.664σ 0.495σ 0.636σ 2.1σ 2.02σ
TestJump_test_facility_5 0.439σ 1.86σ 2.0σ 2.3σ 2.18σ
TestJump_test_facility_quicksum_25 0.749σ 0.684σ 0.708σ 1.94σ 2.21σ
TestJump_test_facility_quicksum_5 0.503σ 2.08σ 2.04σ 2.41σ 2.2σ
TestJump_test_lqcp_10 0.767σ 2.06σ 2.1σ 2.38σ 2.06σ
TestJump_test_lqcp_500 0.512σ 0.435σ 0.896σ 1.8σ 1.93σ
TestJump_test_lqcp_quicksum_10 0.537σ 1.5σ 1.86σ 2.11σ 1.49σ
TestJump_test_lqcp_quicksum_500 0.946σ 0.637σ 0.833σ 1.68σ 2.03σ
TestJump_test_opf_662 1.53σ 1.49σ 2.26σ
TestJump_test_opf_6620 1.48σ 1.15σ 1.98σ
TestJump_test_opf_quicksum_662 1.89σ 2.05σ 2.04σ
TestJump_test_opf_quicksum_6620 1.22σ 1.33σ 2.06σ
TestDevel_test_issue_691 0.93σ 0.629σ 0.877σ 1.1σ 1.48σ
TestModels_test_dcopf_case2383wp 1.8σ 0.733σ 1.46σ 1.96σ 2.17σ
TestModels_test_uc_20140901_expected 0.817σ 1.86σ 2.09σ 1.91σ 1.98σ

Problem\Measure create_instance discretize postprocessing nl lp bar gams
TestStochPDEgas_test_stochpdegas_automatic 1.21σ 1.85σ -0.112σ
TestMisc_test_bilinear_100 2.22σ 1.44σ 1.19σ 1.29σ 1.11σ
TestMisc_test_bilinear_100000 1.09σ 2.14σ 1.76σ 1.86σ 2.22σ
TestMisc_test_bilinear_nlcontext_100 2.31σ 1.71σ 2.04σ 1.44σ 2.13σ
TestMisc_test_bilinear_nlcontext_100000 0.465σ 2.08σ 1.61σ 1.95σ 2.19σ
TestMisc_test_diag_quicksum_100 2.31σ 1.29σ 1.96σ 1.87σ 1.36σ
TestMisc_test_diag_quicksum_100000 0.642σ 1.59σ 2.03σ 1.09σ 1.97σ
TestMisc_test_diag_sum_100 1.22σ 1.83σ 1.95σ 1.51σ 1.72σ
TestMisc_test_diag_sum_100000 0.288σ 1.35σ 2.09σ 1.19σ 1.97σ
TestMisc_test_pmedian_quicksum_test4 1.27σ 2.3σ 2.55σ 0.626σ 2.02σ
TestMisc_test_pmedian_quicksum_test8 1.93σ 1.53σ 2.0σ 0.836σ 1.5σ
TestMisc_test_pmedian_sum_test4 2.46σ 1.89σ 2.12σ 0.817σ 1.86σ
TestMisc_test_pmedian_sum_test8 1.94σ 1.35σ 1.29σ 0.422σ 1.6σ
TestMisc_test_pmedian_tuple_test4 2.33σ 2.18σ 2.51σ 0.907σ 1.78σ
TestMisc_test_pmedian_tuple_test8 1.5σ 1.52σ 1.79σ 0.647σ 1.2σ
TestJump_test_clnlbean_5000 1.59σ 2.47σ 2.29σ
TestJump_test_clnlbean_50000 1.84σ 2.65σ 1.65σ
TestJump_test_facility_25 2.47σ 2.45σ 2.39σ 1.97σ 2.33σ
TestJump_test_facility_5 1.67σ 0.932σ 0.693σ 2.12σ 2.18σ
TestJump_test_facility_quicksum_25 2.42σ 2.38σ 2.15σ 2.17σ 2.29σ
TestJump_test_facility_quicksum_5 2.1σ 2.71σ 2.42σ 2.08σ 2.18σ
TestJump_test_lqcp_10 1.67σ 2.47σ 1.98σ 2.26σ 2.17σ
TestJump_test_lqcp_500 0.772σ 2.0σ 2.03σ 1.88σ 2.0σ
TestJump_test_lqcp_quicksum_10 1.76σ 0.123σ 1.32σ 1.85σ 1.91σ
TestJump_test_lqcp_quicksum_500 0.118σ 2.25σ 1.19σ 2.01σ 2.02σ
TestJump_test_opf_662 0.0773σ 2.52σ 2.43σ
TestJump_test_opf_6620 0.165σ 2.63σ 2.36σ
TestJump_test_opf_quicksum_662 0.628σ 2.78σ 2.25σ
TestJump_test_opf_quicksum_6620 0.273σ 2.39σ 2.4σ
TestDevel_test_issue_691 1.12σ 1.52σ 0.228σ 1.36σ 2.0σ
TestModels_test_dcopf_case2383wp 1.36σ 2.55σ 2.45σ 2.07σ 2.36σ
TestModels_test_uc_20140901_expected 2.44σ 2.18σ 2.25σ 1.8σ 2.07σ