Class ParameterUpdaterVanilla¶
Defined in File minibatchOptimization.h
Inheritance Relationships¶
Base Type¶
public parpe::ParameterUpdater
(Class ParameterUpdater)
Class Documentation¶
-
class
parpe
::
ParameterUpdaterVanilla
: public parpe::ParameterUpdater¶ Minibatch optimizer: Vanilla SGD Updater The simplest mini batch algorithm.
Public Functions
-
ParameterUpdaterVanilla
() = default¶
-
virtual void
updateParameters
(double learningRate, int iteration, gsl::span<const double> gradient, gsl::span<double> parameters, gsl::span<const double> lowerBounds = gsl::span<const double>(), gsl::span<const double> upperBounds = gsl::span<const double>()) override¶ Update parameter vector.
- Parameters
learningRate
: Current learning rate, i.e., step-sizeiteration
: Current iteration, i.e., epochgradient
: Cost function gradient at parametersparameters
: In: Current parameters, Out: Updated parameters
-
virtual void
undoLastStep
() override¶ If ODE becomes non-integrable, the last step must be undone using this method
-
virtual void
clearCache
() override¶ If the ODE is repeatedly non-integrable, a cold restart is performed using this method
-
virtual void
initialize
(unsigned int numParameters) override¶ Intialize the parameter updater
-