Oscillate learning rate

1. To get out of saddle points or local minima

2. When model could be sensitive to initial learning rate

scheduler = torch.optim.lr_scheduler.CyclicLR(optimizer, 1e-4, 1e-3, cycle_momentum=False)

Link to reading