noether.core.schedules.polynomial¶
Classes¶
A scheduler that decreases polynomially from the maximum to minimum value over the total number of steps. |
|
A scheduler that increases polynomially from the minimum to maximum value over the total number of steps. |
Module Contents¶
- class noether.core.schedules.polynomial.PolynomialDecreasingSchedule(config)¶
Bases:
noether.core.schedules.base.DecreasingProgressScheduleA scheduler that decreases polynomially from the maximum to minimum value over the total number of steps.
Initialize the scheduler.
- Parameters:
config (noether.core.schemas.schedules.PolynomialDecreasingScheduleConfig) – Configuration for the polynomial decreasing schedule.
Example
>>> schedule_config: >>> kind: noether.core.schedules.PolynomialDecreasingSchedule >>> power: 2.0 >>> start_value: ${model.optim.lr} # reference to the lr defined above >>> end_value: 1e-6- power¶
- class noether.core.schedules.polynomial.PolynomialIncreasingSchedule(config)¶
Bases:
noether.core.schedules.base.IncreasingProgressScheduleA scheduler that increases polynomially from the minimum to maximum value over the total number of steps.
Initialize the scheduler.
- Parameters:
config (noether.core.schemas.schedules.PolynomialIncreasingScheduleConfig) – Configuration for the polynomial increasing schedule.
Example
>>> schedule_config: >>> kind: noether.core.schedules.PolynomialIncreasingSchedule >>> power: 2.0 >>> start_value: 1e-6 >>> max_value: ${model.optim.lr} # reference to the lr defined above- power¶