noether.core.schedules.cosine¶

Classes¶

`CosineDecreasingScheduleConfig`
`CosineDecreasingSchedule`	Cosine annealing scheduler with decreasing values.
`CosineIncreasingScheduleConfig`
`CosineIncreasingSchedule`	Cosine annealing scheduler with increasing values.

Module Contents¶

class noether.core.schedules.cosine.CosineDecreasingScheduleConfig(/, **data)¶

Bases: noether.core.schedules.base.DecreasingProgressScheduleConfig

Parameters:: data (Any)

kind: Literal['noether.core.schedules.CosineDecreasingSchedule'] = 'noether.core.schedules.CosineDecreasingSchedule'¶: The fully qualified class name of the scheduler.

class noether.core.schedules.cosine.CosineDecreasingSchedule(config)¶

Bases: noether.core.schedules.base.DecreasingProgressSchedule

Cosine annealing scheduler with decreasing values.

Example

schedule_config:
    kind: noether.core.schedules.CosineDecreasingSchedule
    max_value: ${model.optim.lr} # or just manually set the starting value
    end_value: 0.0

Initialize the scheduler.

Parameters:: config (noether.core.schedules.schemas.DecreasingProgressScheduleConfig)

class noether.core.schedules.cosine.CosineIncreasingScheduleConfig(/, **data)¶

Bases: noether.core.schedules.schemas.IncreasingProgressScheduleConfig

Parameters:: data (Any)

kind: Literal['noether.core.schedules.CosineIncreasingSchedule'] = 'noether.core.schedules.CosineIncreasingSchedule'¶: The fully qualified class name of the scheduler.

class noether.core.schedules.cosine.CosineIncreasingSchedule(config)¶

Bases: noether.core.schedules.base.IncreasingProgressSchedule

Cosine annealing scheduler with increasing values.

Example

schedule_config:
    kind: noether.core.schedules.CosineIncreasingSchedule
    max_value: ${model.optim.lr}
    start_value: 0.0

Initialize the scheduler.

Parameters:: config (noether.core.schedules.schemas.IncreasingProgressScheduleConfig)