Skip to main content

Hyperparameters Reference

When you create a training, an Advanced Configuration step lets you fine-tune a curated set of hyperparameters on top of your chosen model size (Small / Medium / Large). This page documents every one of them — what it does, and which values are accepted.

Everything not listed here (model architecture, loss internals, optimizer internals, infra tuning) is fixed by the size tier you pick, so results stay comparable and reproducible across runs.

Training budget

HyperparameterWhat it controls
run_nameIdentifier for the training run. Set by the platform when you create the training.
epochsHow many passes over your training data to run.
seedRandom seed — set it to get reproducible results across runs.
checkpoint_epoch_progressHow often (in fractions of an epoch) a checkpoint is saved. Keep this equal to epoch_progress under Evaluation — otherwise the best-performing checkpoint may not have a saved state to restore.

Sequence & history controls

HyperparameterWhat it controls
max_seqlen_per_client_train / max_seqlen_per_client_evalMaximum history (number of events) read per client, for training and evaluation respectively.
min_context_train / min_context_evalMinimum history required before a target is scored.
min_context_strict_train / min_context_strict_evalWhen enabled, targets that don't meet the minimum history are excluded instead of being scored with a shorter context. Pin this per project — changing it changes which rows get scored, so metrics stop being comparable across runs.
max_seqlen_per_chunkHow much history is processed per forward pass.
seqlen_trunc_probProbability of randomly truncating a sequence during training — a regularizer against overfitting on very long histories.
batch_size_train / batch_size_evalBatch size for training and evaluation. Larger eval batches don't change scores and can be slower with variable-length data.

Training dynamics

HyperparameterWhat it controls
adamw_learning_rateLearning rate for the standard optimizer.
muon_learning_rateLearning rate for the Muon optimizer (matrix-parameter updates). Only relevant when use_muon is on.
use_muonTurns the Muon optimizer on/off. true | false
warmup_epoch_progressFraction of training spent ramping the learning rate up from its minimum before decaying.
min_adamw_learning_rateFloor for adamw_learning_rate at the end of the schedule.
min_muon_learning_rateFloor for muon_learning_rate at the end of the schedule.
early_stopping_eval_patienceNumber of evaluations without improvement before training stops early.
thresholdMinimum improvement required for an evaluation to count as "better" for early stopping.

Loss semantics

HyperparameterWhat it controlsOptions
loss_averagingHow the loss is averaged: per client (each client counts equally) or per transaction (each event counts equally).by_client | by_transaction
loss_weightingWhether more recent events get more weight in the loss (temporal) or all events count equally (uniform).temporal | uniform

Evaluation & delivery

HyperparameterWhat it controlsOptions
main_metricThe headline metric used to pick the best checkpoint and reported as the training's overall score.acc | auroc | auprc | gini | precision | recall | f1 | r2 | loss
use_low_fpr_metricsAdds a low-false-positive-rate recall metric — useful for fraud/risk use cases where false positives are costly.true | false
epoch_progressHow often (in fractions of an epoch) evaluation runs. Keep this equal to checkpoint_epoch_progress above.
logits_output_include_target_columnsWhether the delivered score file also includes the true target values alongside the model's scores.true | false

Data sampling

HyperparameterWhat it controls
client_sampling_ratioFraction of clients to use — lower it to train faster/cheaper on a subsample. 1.0 = use all clients.
client_sampling_seedSeed controlling which clients get sampled (independent of the training seed) — change it to draw a different subsample.
stats.sampling_ratioFraction of data used to compute normalization statistics — a cost lever, not a quality one for most datasets.
inactivity_gapHow long without any activity counts as a gap in a client's history (e.g. 15d). Accepts a number + unit: s, m, h, d, w.

Next steps