replay
fun replayProblem(db: BenchmarkResultsDb, expId: Int, problemName: String, problemDefinition: ProblemDefinition, evaluator: EvaluatorIfc, options: ConfirmationOptions): ProblemReplayResult(source)
Replays one problem's selection under the supplied rule.
Only the finalists the rule chooses are simulated, against the supplied evaluator; the rest of the study is read from the database.
Parameters
db
the results database holding the source experiment
exp
the source experiment's id
problem
the problem to replay
problem
the definition the study ran
evaluator
the evaluator used for the replayed confirmation's fresh simulation
options
the confirmation configuration to apply — this is the rule under test