towhee.trainer.optimization.optimization.get_warmup_steps

towhee.trainer.optimization.optimization.get_warmup_steps(num_training_steps: int, warmup_steps: int, warmup_ratio: float) → int[source]

Get number of steps used for a linear warmup.

Parameters:

  • num_training_steps (int) – All training steps when training.

  • warmup_steps (int) – Warmup steps. If > 0, warmup_ratio will not work.

  • warmup_ratio (float) – Ratio of num training steps to warmup.

Returns:

Warmup steps.