public class SimpleSGD extends Object implements GradientUpdater
setup(int).| Constructor and Description |
|---|
SimpleSGD()
Creates a new SGD updater
|
| Modifier and Type | Method and Description |
|---|---|
SimpleSGD |
clone() |
void |
setup(int d)
Sets up this updater to update a weight vector of dimension
d
by a gradient of the same dimension |
void |
update(Vec x,
Vec grad,
double eta)
Updates the weight vector
x such that x = x-ηf(grad),
where f(grad) is some function on the gradient that effectively returns a
new vector. |
double |
update(Vec x,
Vec grad,
double eta,
double bias,
double biasGrad)
Updates the weight vector
x such that x = x-ηf(grad),
where f(grad) is some function on the gradient that effectively returns a
new vector. |
public void update(Vec x, Vec grad, double eta)
GradientUpdaterx such that x = x-ηf(grad),
where f(grad) is some function on the gradient that effectively returns a
new vector. It is not necessary for the internal implementation to ever
explicitly form any of these objects, so long as x is mutated to
have the correct result.update in interface GradientUpdaterx - the vector to mutate such that is has been updated by the
gradientgrad - the gradient to update the weight vector x frometa - the learning rate to applypublic double update(Vec x, Vec grad, double eta, double bias, double biasGrad)
GradientUpdaterx such that x = x-ηf(grad),
where f(grad) is some function on the gradient that effectively returns a
new vector. It is not necessary for the internal implementation to ever
explicitly form any of these objects, so long as x is mutated to
have the correct result. update in interface GradientUpdaterx - the vector to mutate such that is has been updated by the
gradientgrad - the gradient to update the weight vector x frometa - the learning rate to applybias - the bias term of the vectorbiasGrad - the gradient for the bias termbias = bias - returnValuepublic SimpleSGD clone()
clone in interface GradientUpdaterclone in class Objectpublic void setup(int d)
GradientUpdaterd
by a gradient of the same dimensionsetup in interface GradientUpdaterd - the dimension of the weight vector that will be updatedCopyright © 2017. All rights reserved.