Benchmark
data class BenchmarkSummary(val experimentName: String, val macroReplications: Int, val replicationBudgetPerRun: Int, val confirmation: ConfirmationOptions?, val verificationReplications: Int?, val startTime: Instant, val endTime: Instant, val problemResults: List<ProblemBenchmarkResult>, val solverCaseDescriptions: Map<String, String>, val solverConfigurations: Map<String, Map<String, String>>, val traces: Map<String, List<IterationTracePoint>>)(source)
The in-memory result of a benchmark experiment: one entry per problem, in problem order, each holding its cell-level run records, confirmation outcome, and gap basis.
Parameters
experiment
the experiment's name
macro
the number of macro-replications per (problem, solver) pair
replication
the per-cell replication budget
start
when the experiment's run() began
end
when the experiment's run() completed
problem
the per-problem results, in the experiment's problem order
solver
solver case label to its description
solver
solver case label to the configuration properties read from the first solver instance the case created — the configuration that actually ran, not what was assumed
traces
cell label to the cell's iteration trace; empty unless the experiment captured traces
Constructors
Link copied to clipboard
constructor(experimentName: String, macroReplications: Int, replicationBudgetPerRun: Int, confirmation: ConfirmationOptions?, verificationReplications: Int?, startTime: Instant, endTime: Instant, problemResults: List<ProblemBenchmarkResult>, solverCaseDescriptions: Map<String, String>, solverConfigurations: Map<String, Map<String, String>>, traces: Map<String, List<IterationTracePoint>>)