jsat.math.optimization

Class BFGS

java.lang.Object

jsat.math.optimization.BFGS

All Implemented Interfaces:

Optimizer2

public class BFGS
extends Object
implements Optimizer2

Implementation of the Broyden–Fletcher–Goldfarb–Shanno (BFGS) algorithm for function minimization. For n dimensional problems it requires O(n²) work per iteration and uses first order information to approximate the Hessian.

Author:

Edward Raff

Constructor Summary

Constructors

Constructor and Description
BFGS() Creates a new BFGS optimization object that uses a maximum of 250 iterations and a backtracking line search.
BFGS(int maxIterations, LineSearch lineSearch) Creates a new BFGS optimization object

Method Summary

Modifier and Type	Method and Description
Optimizer2	clone()
LineSearch	getLineSearch() Returns the line search method used at each iteration
int	getMaximumIterations() Returns the maximum number of iterations to perform
boolean	isInftNormCriterion() Returns whether or not the infinity norm (true) or 2 norm (false) is used to determine convergence.
void	optimize(double tolerance, Vec w, Vec x0, Function f, FunctionVec fp, FunctionVec fpp) Attempts to optimize the given function by finding the value of w that will minimize the value returned by f(w), using w = x0 as an initial starting point.
void	optimize(double tolerance, Vec w, Vec x0, Function f, FunctionVec fp, FunctionVec fpp, ExecutorService ex) Attempts to optimize the given function by finding the value of w that will minimize the value returned by f(w), using w = x0 as an initial starting point.
void	setInftNormCriterion(boolean inftNormCriterion) By default the infinity norm is used to judge convergence.
void	setLineSearch(LineSearch lineSearch) Sets the line search method used at each iteration
void	setMaximumIterations(int iterations) Sets the maximum number of iterations allowed for the optimization method

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

BFGS

public BFGS()

Creates a new BFGS optimization object that uses a maximum of 250 iterations and a backtracking line search.

BFGS

public BFGS(int maxIterations,
            LineSearch lineSearch)

Creates a new BFGS optimization object

Parameters:

maxIterations - the maximum number of iterations to allow before stopping

lineSearch - the line search method to use on updates

Method Detail

optimize

public void optimize(double tolerance,
                     Vec w,
                     Vec x0,
                     Function f,
                     FunctionVec fp,
                     FunctionVec fpp)

Description copied from interface: Optimizer2

Attempts to optimize the given function by finding the value of w that will minimize the value returned by f(w), using w = x₀ as an initial starting point.

Specified by:

optimize in interface Optimizer2

Parameters:

tolerance - the value that the gradient norm must be less than to consider converged

w - the the location to store the final solution

x0 - the initial guess for the solution. This value will not be changed, and intermediate matrices will be created as the same type.

f - the objective function to minimizer

fp - the derivative of the objective function, may be null depending on the optimizer

fpp - the Hessian of the objective function, may be null depending on the optimizer

optimize

public void optimize(double tolerance,
                     Vec w,
                     Vec x0,
                     Function f,
                     FunctionVec fp,
                     FunctionVec fpp,
                     ExecutorService ex)

Description copied from interface: Optimizer2

Attempts to optimize the given function by finding the value of w that will minimize the value returned by f(w), using w = x₀ as an initial starting point.

Specified by:

optimize in interface Optimizer2

Parameters:

tolerance - the value that the gradient norm must be less than to consider converged

w - the the location to store the final solution

x0 - the initial guess for the solution. This value will not be changed, and intermediate matrices will be created as the same type.

f - the objective function to minimizer

fp - the derivative of the objective function, may be null depending on the optimizer

fpp - the Hessian of the objective function, may be null depending on the optimizer

ex - the source of threads for parallel computation, may be null to perform serial computation.

setInftNormCriterion

public void setInftNormCriterion(boolean inftNormCriterion)

By default the infinity norm is used to judge convergence. If set to false, the 2 norm will be used instead.

Parameters:

inftNormCriterion -

isInftNormCriterion

public boolean isInftNormCriterion()

Returns whether or not the infinity norm (true) or 2 norm (false) is used to determine convergence.

Returns:

true if the infinity norm is in use, false for the 2 norm

setMaximumIterations

public void setMaximumIterations(int iterations)

Description copied from interface: Optimizer2

Sets the maximum number of iterations allowed for the optimization method

Specified by:

setMaximumIterations in interface Optimizer2

Parameters:

iterations - the maximum number of iterations to perform

getMaximumIterations

public int getMaximumIterations()

Description copied from interface: Optimizer2

Returns the maximum number of iterations to perform

Specified by:

getMaximumIterations in interface Optimizer2

Returns:

the maximum number of iterations to perform

setLineSearch

public void setLineSearch(LineSearch lineSearch)

Sets the line search method used at each iteration

Parameters:

lineSearch - the line search method used at each iteration

getLineSearch

public LineSearch getLineSearch()

Returns the line search method used at each iteration

Returns:

the line search method used at each iteration

clone

public Optimizer2 clone()

Specified by:

clone in interface Optimizer2

Overrides:

clone in class Object