public class RMSProp extends Object implements GradientUpdater
| Constructor and Description |
|---|
RMSProp()
Creates a new RMSProp updater that uses a decay rate of 0.9
|
RMSProp(double rho)
Creates a new RMSProp updater
|
RMSProp(RMSProp toCopy)
Copy constructor
|
| Modifier and Type | Method and Description |
|---|---|
RMSProp |
clone() |
double |
getRho() |
void |
setRho(double rho)
Sets the decay rate used by rmsprop.
|
void |
setup(int d)
Sets up this updater to update a weight vector of dimension
d
by a gradient of the same dimension |
void |
update(Vec x,
Vec grad,
double eta)
Updates the weight vector
x such that x = x-ηf(grad),
where f(grad) is some function on the gradient that effectively returns a
new vector. |
double |
update(Vec x,
Vec grad,
double eta,
double bias,
double biasGrad)
Updates the weight vector
x such that x = x-ηf(grad),
where f(grad) is some function on the gradient that effectively returns a
new vector. |
public RMSProp()
public RMSProp(double rho)
rho - the decay rate to usepublic RMSProp(RMSProp toCopy)
toCopy - the object to copypublic void setRho(double rho)
rho - the decay rate in (0, 1) to usepublic double getRho()
public void update(Vec x, Vec grad, double eta)
GradientUpdaterx such that x = x-ηf(grad),
where f(grad) is some function on the gradient that effectively returns a
new vector. It is not necessary for the internal implementation to ever
explicitly form any of these objects, so long as x is mutated to
have the correct result.update in interface GradientUpdaterx - the vector to mutate such that is has been updated by the
gradientgrad - the gradient to update the weight vector x frometa - the learning rate to applypublic double update(Vec x, Vec grad, double eta, double bias, double biasGrad)
GradientUpdaterx such that x = x-ηf(grad),
where f(grad) is some function on the gradient that effectively returns a
new vector. It is not necessary for the internal implementation to ever
explicitly form any of these objects, so long as x is mutated to
have the correct result. update in interface GradientUpdaterx - the vector to mutate such that is has been updated by the
gradientgrad - the gradient to update the weight vector x frometa - the learning rate to applybias - the bias term of the vectorbiasGrad - the gradient for the bias termbias = bias - returnValuepublic RMSProp clone()
clone in interface GradientUpdaterclone in class Objectpublic void setup(int d)
GradientUpdaterd
by a gradient of the same dimensionsetup in interface GradientUpdaterd - the dimension of the weight vector that will be updatedCopyright © 2017. All rights reserved.