BenchmarkRunResult

constructor(experimentName: String, problemName: String, solverLabel: String, repNum: Int, cellLabel: String, status: MemberStatus, startingPoint: Map<String, Double>, bestInputs: Map<String, Double>, bestObjective: Double, bestPenalizedObjective: Double, isBestValid: Boolean, isInputFeasible: Boolean, responseConstraintViolation: Double, responseEstimates: Map<String, EstimatedResponse>, responseConstraintAssessments: List<ResponseConstraintAssessment>, numOracleCalls: Int, numReplicationsRequested: Int, totalIterations: Int?, wallClockMillis: Long?, cpuTimeMillis: Long?, gap: Double?, gapType: GapType?, errorMessage: String? = null)(source)

Parameters

experimentName

the owning experiment's name

problemName

the problem case's name

solverLabel

the solver case's label

repNum

the 1-based macro-replication number

cellLabel

the unique cell label ("problem_solver_rN"); also the solver's name

status

the cell's lifecycle outcome (completed, failed, stopped before start)

startingPoint

the common starting point the cell's solver was given

bestInputs

the best design point the solver found (the problem's bad solution when the cell failed — see the isBestValid flag)

bestObjective

the estimated objective value at the best point (model scale)

bestPenalizedObjective

the solver-internal penalized objective at the best point

isBestValid

false when the best solution is a placeholder from a failed or never-started cell

isInputFeasible

whether the best point satisfies the problem's input ranges and deterministic constraints

responseConstraintViolation

the total response-constraint violation at the best point (zero when response-feasible or the problem has no response constraints)

responseEstimates

the best point's estimate for every response of the problem, keyed by response name, including the objective. These are what a selection rule needs in order to be replayed offline: with the average, variance and count of each response preserved, a solution sufficient for ranking can be rebuilt without re-simulating.

responseConstraintAssessments

the best point's per-constraint assessment, in the problem's constraint order. The aggregate responseConstraintViolation above cannot say WHICH constraint bound; this can. Empty when the problem has no response constraints.

numOracleCalls

the solver's cumulative oracle-call count

numReplicationsRequested

the solver's cumulative requested replications — the actual budget consumption used for normalization

totalIterations

the solver's iteration count, when the solver ran

wallClockMillis

the solver's execution time in milliseconds, when tracked

cpuTimeMillis

the CPU time the cell's worker thread spent running the solver, in milliseconds. Portable across machines in a way wall clock is not, because it does not depend on the worker count or on what else the machine was doing. Counts only the worker thread, so work an evaluator delegates elsewhere is excluded. Null when the cell never ran or the JVM does not report per-thread CPU time.

gap

the optimality gap of the best objective against the problem's gap basis

gapType

the basis the gap was computed against

errorMessage

the failure cause when the cell failed; null otherwise