Benchmark
constructor(experimentName: String, macroReplications: Int, replicationBudgetPerRun: Int, confirmation: ConfirmationOptions?, verificationReplications: Int?, startTime: Instant, endTime: Instant, problemResults: List<ProblemBenchmarkResult>, solverCaseDescriptions: Map<String, String>, solverConfigurations: Map<String, Map<String, String>>, traces: Map<String, List<IterationTracePoint>>)(source)
Parameters
experiment
the experiment's name
macro
the number of macro-replications per (problem, solver) pair
replication
the per-cell replication budget
start
when the experiment's run() began
end
when the experiment's run() completed
problem
the per-problem results, in the experiment's problem order
solver
solver case label to its description
solver
solver case label to the configuration properties read from the first solver instance the case created — the configuration that actually ran, not what was assumed
traces
cell label to the cell's iteration trace; empty unless the experiment captured traces