noether.core.callbacks.default.online_loss

Classes

OnlineLossCallback

Callback to track the loss of the model after every gradient accumulation step and log the average loss.

Module Contents

class noether.core.callbacks.default.online_loss.OnlineLossCallback(callback_config, **kwargs)

Bases: noether.core.callbacks.periodic.PeriodicCallback

Callback to track the loss of the model after every gradient accumulation step and log the average loss.

Initializes the OnlineLossCallback.

Parameters:

  • callback_config (noether.core.schemas.callbacks.OnlineLossCallbackConfig) – The configuration for the callback.

  • **kwargs – additional arguments passed to the parent class.

verbose
tracked_losses: collections.defaultdict[str, list[torch.Tensor]]