Repository files navigation

Pure Python implementation of bayesian global optimization with gaussianprocesses.

This is a constrained global optimization package built upon bayesian inferenceand gaussian processes, that attempts to find the maximum value of an unknownfunction in as few iterations as possible. This technique is particularlysuited for optimization of high cost functions and situations where the balancebetween exploration and exploitation is important.

• pip (via PyPI):

$pip install bayesian-optimization

• Conda (via conda-forge):

$conda install -c conda-forge bayesian-optimization

See thedocumentation for how to use this package.

Bayesian optimization works by constructing a posterior distribution of functions (gaussian process) that best describes the function you want to optimize. As the number of observations grows, the posterior distribution improves, and the algorithm becomes more certain of which regions in parameter space are worth exploring and which are not, as seen in the picture below.

As you iterate over and over, the algorithm balances its needs of exploration and exploitation taking into account what it knows about the target function. At each step a Gaussian Process is fitted to the known samples (points previously explored), and the posterior distribution, combined with a exploration strategy (such as UCB (Upper Confidence Bound), or EI (Expected Improvement)), are used to determine the next point that should be explored (see the gif below).

This process is designed to minimize the number of steps required to find a combination of parameters that are close to the optimal combination. To do so, this method uses a proxy optimization problem (finding the maximum of the acquisition function) that, albeit still a hard problem, is cheaper (in the computational sense) and common tools can be employed. Therefore Bayesian Optimization is most adequate for situations where sampling the function to be optimized is a very expensive endeavor. See the references for a proper discussion of this method.

This project is under active development. If you run into trouble, find a bug or noticeanything that needs correction, please let us know by filing an issue.

This is a function optimization package, therefore the first and most important ingredient is, of course, the function to be optimized.

DISCLAIMER: We know exactly how the output of the function below depends on its parameter. Obviously this is just an example, and you shouldn't expect to know it in a real scenario. However, it should be clear that you don't need to. All you need in order to use this package (and more generally, this technique) is a functionf that takes a known set of parameters and outputs a real number.

defblack_box_function(x,y):"""Function with unknown internals we wish to maximize.    This is just serving as an example, for all intents and    purposes think of the internals of this function, i.e.: the process    which generates its output values, as unknown.    """return-x**2- (y-1)**2+1

All we need to get started is to instantiate aBayesianOptimization object specifying a function to be optimizedf, and its parameters with their corresponding bounds,pbounds. This is a constrained optimization technique, so you must specify the minimum and maximum values that can be probed for each parameter in order for it to work

frombayes_optimportBayesianOptimization# Bounded region of parameter spacepbounds= {'x': (2,4),'y': (-3,3)}optimizer=BayesianOptimization(f=black_box_function,pbounds=pbounds,random_state=1,)

The BayesianOptimization object will work out of the box without much tuning needed. The main method you should be aware of ismaximize, which does exactly what you think it does.

There are many parameters you can pass to maximize, nonetheless, the most important ones are:

• n_iter: How many steps of bayesian optimization you want to perform. The more steps the more likely to find a good maximum you are.
• init_points: How many steps ofrandom exploration you want to perform. Random exploration can help by diversifying the exploration space.

optimizer.maximize(init_points=2,n_iter=3,)

|   iter    |  target   |     x     |     y     |-------------------------------------------------|  1        | -7.135    |  2.834    |  1.322    ||  2        | -7.78     |  2.0      | -1.186    ||  3        | -19.0     |  4.0      |  3.0      ||  4        | -16.3     |  2.378    | -2.413    ||  5        | -4.441    |  2.105    | -0.005822 |=================================================

The best combination of parameters and target value found can be accessed via the propertyoptimizer.max.

print(optimizer.max)>>> {'target':-4.441293113411222,'params': {'y':-0.005822117636089974,'x':2.104665051994087}}

While the list of all parameters probed and their corresponding target values is available via the propertyoptimizer.res.

fori,resinenumerate(optimizer.res):print("Iteration {}:\n\t{}".format(i,res))>>>Iteration0:>>>     {'target':-7.135455292718879,'params': {'y':1.3219469606529488,'x':2.8340440094051482}}>>>Iteration1:>>>     {'target':-7.779531005607566,'params': {'y':-1.1860045642089614,'x':2.0002287496346898}}>>>Iteration2:>>>     {'target':-19.0,'params': {'y':3.0,'x':4.0}}>>>Iteration3:>>>     {'target':-16.29839645063864,'params': {'y':-2.412527795983739,'x':2.3776144540856503}}>>>Iteration4:>>>     {'target':-4.441293113411222,'params': {'y':-0.005822117636089974,'x':2.104665051994087}}

If you used this package in your research, please cite it:

@Misc{,    author = {Fernando Nogueira},    title = {{Bayesian Optimization}: Open source constrained global optimization tool for {Python}},    year = {2014--},    url = " https://github.com/bayesian-optimization/BayesianOptimization"}

If you used any of the advanced functionalities, please additionally cite the corresponding publication:

For theSequentialDomainTransformer:

@article{    author = {Stander, Nielen and Craig, Kenneth},    year = {2002},    month = {06},    pages = {},    title = {On the robustness of a simple domain reduction scheme for simulation-based optimization},    volume = {19},    journal = {International Journal for Computer-Aided Engineering and Software (Eng. Comput.)},    doi = {10.1108/02644400210430190}}

For constrained optimization:

@inproceedings{gardner2014bayesian,    title={Bayesian optimization with inequality constraints.},    author={Gardner, Jacob R and Kusner, Matt J and Xu, Zhixiang Eddie and Weinberger, Kilian Q and Cunningham, John P},    booktitle={ICML},    volume={2014},    pages={937--945},    year={2014}}

For optimization over non-float parameters:

@article{garrido2020dealing,  title={Dealing with categorical and integer-valued variables in bayesian optimization with gaussian processes},  author={Garrido-Merch{\'a}n, Eduardo C and Hern{\'a}ndez-Lobato, Daniel},  journal={Neurocomputing},  volume={380},  pages={20--35},  year={2020},  publisher={Elsevier}}