Benchmark
Parameters
the experiment's name; flows into every run record
the problem cases; names must be unique
the solver configurations; labels must be unique
the number of macro-replications per (problem, solver) pair in the study this experiment belongs to; it fixes the addressing of starting points, so blocks of one study must all declare the same value
which of those macro-replications THIS experiment runs. Defaults to all of them. Running a study as several experiments over disjoint sub-ranges is cell-for-cell identical to running it as one, which is how a long study is checkpointed: each block is saved on completion and a resumed run skips the blocks already present
the per-cell replication budget
confirmation-stage options; null disables confirmation
when true, every cell solver's per-iteration progress (iteration, cumulative replications, best penalized objective) is captured into the summary's traces, keyed by cell label — opt-in because traces grow with the budget
when non-null, each problem's winning point is re-simulated at this replication count on a dedicated evaluator and recorded — the classic verify-at-elevated-replications step
the maximum number of cells running at the same time; null uses the smaller of the cell count and the available processors
the stream provider for experiment-level draws (currently: the common starting points); defaults to a fresh provider so identically configured experiments reproduce each other exactly
invoked with each freshly created cell solver before it runs, on the cell's worker thread — the attachment hook for per-cell trackers and instrumentation; anything it touches must be safe to use from worker threads