Rate this Page

torch.optim.nadam.nadam#

torch.optim.nadam.nadam(params,grads,exp_avgs,exp_avg_sqs,mu_products,state_steps,decoupled_weight_decay=False,foreach=None,capturable=False,differentiable=False,has_complex=False,maximize=False,*,beta1,beta2,lr,weight_decay,momentum_decay,eps)[source]#

Functional API that performs NAdam algorithm computation.

SeeNAdam for details.