noether.core.schedules.cosine

Classes

CosineDecreasingSchedule	Cosine annealing scheduler with decreasing values.
CosineIncreasingSchedule	Cosine annealing scheduler with increasing values.

Module Contents

class noether.core.schedules.cosine.CosineDecreasingSchedule(config)

Bases: noether.core.schedules.base.DecreasingProgressSchedule

Cosine annealing scheduler with decreasing values.

Example

>>> schedule_config:
>>>   kind: noether.core.schedules.CosineDecreasingSchedule
>>>   max_value: ${model.optim.lr}
>>>   end_value: 0.0

Initialize the scheduler.

Parameters:

config (noether.core.schemas.schedules.DecreasingProgressScheduleConfig)

class noether.core.schedules.cosine.CosineIncreasingSchedule(config)

Bases: noether.core.schedules.base.IncreasingProgressSchedule

Cosine annealing scheduler with increasing values.

Example

>>> schedule_config:
>>>   kind: noether.core.schedules.CosineIncreasingSchedule
>>>   max_value: ${model.optim.lr}
>>>   start_value: 0.0

Initialize the scheduler.

Parameters:

config (noether.core.schemas.schedules.IncreasingProgressScheduleConfig)