Class ParameterUpdater¶
Defined in File minibatchOptimization.h
Inheritance Relationships¶
Derived Types¶
public parpe::ParameterUpdaterAdam
(Class ParameterUpdaterAdam)public parpe::ParameterUpdaterAdamClassic
(Class ParameterUpdaterAdamClassic)public parpe::ParameterUpdaterMomentum
(Class ParameterUpdaterMomentum)public parpe::ParameterUpdaterRmsProp
(Class ParameterUpdaterRmsProp)public parpe::ParameterUpdaterVanilla
(Class ParameterUpdaterVanilla)
Class Documentation¶
-
class
parpe
::
ParameterUpdater
¶ Interface for parameter updaters for minibatch optimizers.
Subclassed by parpe::ParameterUpdaterAdam, parpe::ParameterUpdaterAdamClassic, parpe::ParameterUpdaterMomentum, parpe::ParameterUpdaterRmsProp, parpe::ParameterUpdaterVanilla
Public Functions
-
virtual void
updateParameters
(double learningRate, int iteration, gsl::span<const double> gradient, gsl::span<double> parameters, gsl::span<const double> lowerBounds = gsl::span<const double>(), gsl::span<const double> upperBounds = gsl::span<const double>()) = 0¶ Update parameter vector.
- Parameters
learningRate
: Current learning rate, i.e., step-sizeiteration
: Current iteration, i.e., epochgradient
: Cost function gradient at parametersparameters
: In: Current parameters, Out: Updated parameters
-
virtual void
undoLastStep
() = 0¶ If ODE becomes non-integrable, the last step must be undone using this method
-
virtual void
clearCache
() = 0¶ If the ODE is repeatedly non-integrable, a cold restart is performed using this method
-
virtual void
initialize
(unsigned int numParameters) = 0¶ Intialize the parameter updater
-
virtual
~ParameterUpdater
() = default¶
-
virtual void