I was wondering what differences and relations are between "search methods" and "optimization methods"?
Especially when solving an optimization problem? I emphasize the context of solving optimization problems, because I guess search methods are not just for solving optimization problems, but also non-optimization problems?
My confusion comes from the following facts:
- There are some optimization methods, named "xxx search", such as local search, stochastic search, .... What does "search" mean actually? I wonder if there are optimization methods that are not "search"?
- Also in this book Introduction to Stochastic Search and Optimization by Spall, I don't quite understand the difference between "Search" and "Optimization" in its title as well as in its content. Why needs to distinguish between "Search" and "Optimization", if they mean the same? Or does "Optimization" mean stochastic optimization tasks/problems instead of optimization methods, as opposed to "search" means the methods to solve the optimization tasks/problems?
- Also No free lunch in search and optimization distinguishes search and optimization again.
Thanks and regards!