noether.core.schedules.cosine¶

Classes¶

`CosineDecreasingSchedule`	Cosine annealing scheduler with decreasing values.
`CosineIncreasingSchedule`	Cosine annealing scheduler with increasing values.

Module Contents¶

class noether.core.schedules.cosine.CosineDecreasingSchedule(config)¶

Bases: noether.core.schedules.base.DecreasingProgressSchedule

Cosine annealing scheduler with decreasing values.

Example

schedule_config:
    kind: noether.core.schedules.CosineDecreasingSchedule
    max_value: ${model.optim.lr} # or just manually set the starting value
    end_value: 0.0

Initialize the scheduler.

Parameters:: config (noether.core.schemas.schedules.DecreasingProgressScheduleConfig)

class noether.core.schedules.cosine.CosineIncreasingSchedule(config)¶

Bases: noether.core.schedules.base.IncreasingProgressSchedule

Cosine annealing scheduler with increasing values.

Example

schedule_config:
    kind: noether.core.schedules.CosineIncreasingSchedule
    max_value: ${model.optim.lr}
    start_value: 0.0

Initialize the scheduler.

Parameters:: config (noether.core.schemas.schedules.IncreasingProgressScheduleConfig)