replay
fun replayExperiment(db: BenchmarkResultsDb, sourceExperimentName: String, newExperimentName: String, problemCases: List<ProblemCase>, options: ConfirmationOptions): Pair<Int, List<ProblemReplayResult>>(source)
Replays every problem of a finished experiment and saves the result as a new experiment.
Return
the new experiment's id, paired with the per-problem replay results
Parameters
db
the results database; the source experiment is read, never written
source
the experiment to replay. When several share the name, the most recent is used.
new
the name to save the replay under; must differ from the source
problem
the cases the study was defined with, supplying a fresh problem definition and evaluator per problem. Problems present in the database but absent here are skipped, so a subset can be replayed.
options
the confirmation configuration to apply