Class ParameterUpdaterAdamClassic¶
Defined in File minibatchOptimization.h
Inheritance Relationships¶
Base Type¶
public parpe::ParameterUpdater
(Class ParameterUpdater)
Class Documentation¶
-
class
parpe
::
ParameterUpdaterAdamClassic
: public parpe::ParameterUpdater¶ Minibatch optimizer: Adam Classic Updater A momentum-based and so-called adaptive mini batching algorithm, using the original settings from the literature.
Public Functions
-
ParameterUpdaterAdamClassic
() = default¶
-
virtual void
updateParameters
(double learningRate, int iteration, gsl::span<const double> gradient, gsl::span<double> parameters, gsl::span<const double> lowerBounds = gsl::span<const double>(), gsl::span<const double> upperBounds = gsl::span<const double>()) override¶ Update parameter vector.
- Parameters
learningRate
: Current learning rate, i.e., step-sizeiteration
: Current iteration, i.e., epochgradient
: Cost function gradient at parametersparameters
: In: Current parameters, Out: Updated parameters
-
virtual void
undoLastStep
() override¶ If ODE becomes non-integrable, the last step must be undone using this method
-
virtual void
clearCache
() override¶ If the ODE is repeatedly non-integrable, a cold restart is performed using this method
-
virtual void
initialize
(unsigned int numParameters) override¶ Intialize the parameter updater
-