.rst .pdf

InverseExponentialTimeDecayLR

class modelzoo.common.pytorch.optim.lr_scheduler.InverseExponentialTimeDecayLR (optimizer: torch.optim.optimizer.Optimizer, initial_learning_rate: float, step_exponent: int, decay_steps: int, decay_rate: float, staircase: bool = False, disable_lr_steps_reset: bool = False)

Decays the learning rate inverse-exponentially over time, as described in https://www.tensorflow.org/api_docs/python/tf/keras/optimizers/schedules/InverseTimeDecay

Parameters:

optimizer – The optimizer to schedule

initial_learning_rate – The initial learning rate

step_exponent – Exponential value

decay_steps – Number of steps to perform the decay

decay_rate – The decay rate

staircase – If True, decay the learning rate at discrete intervals