This tag is intended for questions on methods for the (constrained or unconstrained) minimization or maximization of functions.

learn more… | top users | synonyms

4
votes
2answers
72 views

Finding quick solution to a collection of systems of fairly simple but nonlinear equations

So I have a collection of systems of equations, basically $n$ systems of equations, each composed of $k$ equations: $$\frac{a_1x_{1j}}{a_1x_{1j} + \cdots + a_kx_{kj}} + \log x_{1j} + 1 - B_{1j} = 0$$ ...
1
vote
0answers
62 views

Choose of basis set

I am engaged with the syntheses and DFT calculations of coordination complexes. I wonder how can I set up the basis set for carried out using B3LYP method and mixed basis sets of LanL2DZ for Pd and 6-...
0
votes
0answers
29 views

How to optimize interaction of flexible 3D shapes in space/what is this technique called

I am not sure what terminology I should use here or even what field this is. That information itself would be incredibly helpful, this is new territory for me. I'm trying to figure out how to solve ...
1
vote
0answers
37 views

Conservative Short Sales Portfolio Optimization with MatLab code help

I'm trying to solve the optimization problem below with MatLab, but I'm unsure of how to modify the constraints in the quadprog function (or how to add the constraints with the Portfolio object). In ...
0
votes
0answers
28 views

Problem with Levenberg-Marquardt for FEMU case

I m trying to implement a Levenberg-Marquart on python to identify 2 material parameters via Finite Elements calculations and full-field measurements as called FEMU (Finite Elements Model Updating). ...
1
vote
2answers
80 views

GSA Search Algorithm in C++

Is there any version of GSA (Gravitational Search Algorithm)[1] implemented with C++ or even C#? What I found was implemented using MATLAB which is not good for me. [1] Rashedi, Esmat, Hossein ...
0
votes
1answer
38 views

NONLINEAR ENERGY MINIMIZATION EXAMPLE

I am learning about FEM methods and nonlinear optimization. I would like to try my nonlinear trust region solver on some simple nonlinear problem. What would be good example to implement for ...
0
votes
1answer
81 views

Integer programming with Matlab

I'd like to know how to solve in MATLAB the following integer optimization problem : $\underset{B,D}{\arg\min} \Vert{Y-XDB}\Vert_{2}$ where $X,Y$ are given matrices. The constraint is the following ...
2
votes
2answers
62 views

Fitting rectangle to segments in image

I have the task to fit a rotated rectangle of known size into an image like This is a synthetic test case, in the real application, everything is rather blurred. The rectangle has to cover as much ...
2
votes
2answers
87 views

What kind of optimisation algorithm is suitable for a computationally expensive function?

I have a reference value $R$ and a modelled value $M$. $M$ is generated using a stochastic algorithm with parameters $a$ and $b$. The objective is to tune $a$ and $b$ so that $M$ is as close as $R$ ...
9
votes
3answers
189 views

why non-convex optimization should be a problem?

I was very surprised when I started to read something about non-convex optimization in general and I saw statements like this: Many practical problems of importance are non-convex, and most non-...
5
votes
0answers
139 views

Optimization on the manifold of stochastic matrices

So I have an optimization problem of the form $$\text{maximize}\hspace{3mm}f(A):{\bf R}^{K\times K}\rightarrow{\bf R}$$ $$\text{subject to}\hspace{19mm}A^T{\bf 1}=\bf{1}$$ $$\hspace{33mm}A\geq 0$$ ...
0
votes
0answers
35 views

lbfgsb quit at the first iteration

Recently I've been working on the implementation of an algorithm, which need me to solve a bounded optimization problem with quality constraints. So I downloaded a Matlab wrapper for lbfgsb. It is L-...
1
vote
0answers
11 views

Is casadi suitable for data fitting?

Quite often I do fit some ODE or DAE systems to my data (small to medium sized problems). Via the assimulo package, I found Casadi and read a bit about the language modellica. Casadi offers automatic ...
1
vote
1answer
59 views

Repeated 1d minimization with similar parameters (scipy)

I have a function f(x,k1,k2) and I am trying to minimize it over x for different values of ...
0
votes
2answers
89 views

On Boyd et al.'s convergence analysis of ADMM: Why do we need the convexity assumption?

Please refer to Boyd et al.'s convergence analysis of ADMM (Chapter 3 and Appendix A). My question is: Why do we need $f$ and $g$ to be convex? I don't see the need of this assumption. If the ...
0
votes
1answer
54 views

Divide and conquer for optimizing weakly unimodal continuous function?

Is there a divide and conquer algorithm for optimizing weakly unimodal continuous functions? Adding more details: My function has a flat line on the left and right and then there is a global ...
0
votes
0answers
24 views

Will Golden Section Search work for optimizing weakly unimodal functions?

Will Golden Section Search work for optimizing weakly unimodal functions? If not is there any variation of it that will allow for optimizing weakly unimodal functions instead of strictly unimodal ...
4
votes
2answers
66 views

Subgradients of non-convex functions

In these notes (section 2.3), it is stated that: A point $x^*$ is a minimizer of a function $f$ (not necessarily convex) if and only if $f$ is subdifferentiable at $x^*$ and $0 \in\partial f(x^*).$...
0
votes
0answers
36 views

MINPACK implementation in Fortran77 code

I am using LMDIF1 subroutine of MINPACK Library for curve fitting. The external subroutine fo6in LMDIF1 is the program that I want to use for curve fitting and was ...
4
votes
1answer
58 views

Simple bound constrained optimization problem

My problem is $$\text{minimize}: \phantom{2} f(x) \\ \text{subject to }: \phantom{2} x_4 \ge 0$$ where $x=(x_1,x_2,x_3,x_4)$. I know that the fourth component $x_4$ of the desired local minimizer ...
0
votes
0answers
43 views

About training HMM by using EM

I am new to EM algorithm, studying Hidden Markov Model. During training my HMM by EM, I am very confused on the data setting. (text processing) Please confirm whether my EM usage is okay or not. At ...
1
vote
2answers
100 views

Which C++ Multi-objective Optimization libraries allows the addition of custom problems and custom algorithms?

I'm working on a custom discrete and constrained multi-objective optimization problem and I'd like to know which libraries or platforms that implement algorithms like ...
0
votes
0answers
63 views

Need help writing the code for the following optimization

I need to find $X$ for which the following expression is minimized: $$ \min ||Y - F^{-1}(X)||_2 + ||X||_1 $$ where $Y$ is an array (of length approx 44000, an audio sample I will be reading using ...
4
votes
0answers
41 views

Mobile robot path following using model predictive control (MPC)

I'am trying to implement a path following algorithm based on MPC (Model Predictive Control), found in this paper : Path Following Mobile Robot in the Presence of Velocity Constraints Principle: ...
0
votes
0answers
16 views

How to solve a model with a quadratic term in the objective function on CPLEX?

I introduced a model with a quadratic objective function in CPLEX but it takes a long time to solve it, I think there is a way to tell CPLEX that the model has a quadratic objective function, but I ...
14
votes
3answers
354 views

Scientific Programming Contests

I regularly compete in so called "Programming Contests", where you solve difficult algorithmic problems with your own code and problem solving skills during a limited time-frame. For referential ...
5
votes
1answer
174 views

Solving a set of linear equations with block structure and weak coupling

I have a standard set of linear equations $Ax=b$ where the Hessian matrix $A$ has the special block structure as shown: $A= \begin{pmatrix} T & U\\ U^T & V \end{pmatrix}$, $x= \begin{...
2
votes
0answers
65 views

Solving a nonlinear poisson equation via variational minimization

I am kind of new in finite elements and I am solving simple "Poisson nonlinear" problem. $- \nabla ((1 + u^2) \nabla u) = f$ $u = 0 \ \text{on} \ \Omega $ I am using Newton solver, where I have ...
0
votes
0answers
49 views

What is the fastest method for solving a quadratic programm repeatedly,( warmstarted)?

I have a quadratic problem, \begin{align} \min_{x\in [0,1]^n} x^T p+ \frac{1}{2\lambda} x^T Q x \end{align} ($Q$ is semidefinite) which I want to solve repeatedly, with the slight change of p and Q, ...
1
vote
0answers
44 views

Scaling a vector-valued non-linear function for numerical optimization/minimization

I am trying to minimize a non-linear vector-valued function in MATLAB. As a test case for my code, I try to minimize a function whose solution I know apriori. The problem is that one of the ...
0
votes
0answers
20 views

Ordering of eigenvectors to maximise trace of diagonalising matrix

I asked a similar question on the Mathematics stack exchange here without much success, so I thought I'd ask it with a more practical bent here. Suppose we have a Hermitian matrix $H$ with (for the ...
3
votes
0answers
59 views

Best way to add a positivity constraint to Newton's Method

So given an objective function $f({\bf x})$, I would like to include a positivity constraint when I perform the fixed point iteration: $${\bf x}^{(t+1)}={\bf x}^{(t)} - \text{H}_f^{-1}\nabla f({\bf x}^...
1
vote
0answers
43 views

Exact line Search in Steepest descent

I wanted to clarify the idea of the exact line search in steepest descent method. An exact line search involves starting with a relatively large step size ($\alpha$) for movement along the search ...
0
votes
0answers
138 views

how to solve a 2D non-linear Poisson equation?

I am trying to solve the following equation for $P(x,y)$: $$I = P \nabla \cdot \frac{1}{P^2} \nabla{P}$$ where $P$ and $I$ are functions of x and y. $I(x,y)$ and $P(x,y)$ I want to understand ...
1
vote
1answer
35 views

limiting function as cost function: logistic function between -a and +a

I would like to fit a diffusion coefficient as function of e.g. salt, pH etc. If I use a linear combination of all variables, I will have to apply constraints because the model fails, if the diffusion ...
1
vote
1answer
77 views

Fit curve with rectangles

I have a one-dimensional set of points, i.e. $(n,y_n), 1\leq n \leq N$. I want to fit them with a linear combination of $k$ rectangular functions in a least-squared-error sense. Each rectangle is ...
1
vote
1answer
93 views

Can this equation be solved with the conjugate gradient method?

Let $A$ be positive-definite and $C$ diagonal positive-definite, consider the problem of solving the following equation for $\bf x$ $$A{\bf x}+C\begin{bmatrix} e^{x_1} \\ \vdots \\ e^{x_n} \end{...
0
votes
0answers
114 views

Preconditioned Conjugate Gradient linear system solver in MATLAB

I have been trying to use the MATLAB's pcg() function to minimize an energy functional. Converting minimization problems to the solution of a linear system is ...
3
votes
0answers
77 views

Striking examples of success of local search algorithms

In N queens problem https://en.wikipedia.org/wiki/Eight_queens_puzzle, trying to find solution by backtracking encounters difficulties quite fast (even for SWI-Prolog, http://swish.swi-prolog.org/...
0
votes
2answers
116 views

What method do you suggest to solve this minimax, quadratic in both variables problem?

I have a problem of the form, \begin{align} minimize_{y} maximize_{x}&\quad x^T y - y^T (B\odot x x^T) y\\ s.t. &x\in [l,u]\\ &Ay=b \end{align} How to efficiently solve this problem? ...
0
votes
3answers
67 views

Symmetric hash function

Can you provide a hash functions $F(x) | F(x) = F(\overline{x}), x \in {\{0;1\}}^n$ $\overline{x} $ is $x$ where all bits are swapped: $0 \rightarrow 1, 1 \rightarrow 0$ Basically it will help me ...
4
votes
1answer
102 views

Efficient way to generate a list of possible matrices (all integer components) with a determinant $V$

I have an interesting problem from my research that I have been struggling to solve. One part of the problem involves generating all possible matrices, where each set contains three integer vectors, ...
5
votes
0answers
145 views

Best Open Source BLAS / LAPACK package

I was wondering what is a more optimized open source BLAS/LAPACK package with respect to modern multi-core processors (Haswell and beyond). Is there any distribution that can attain performance close ...
0
votes
1answer
77 views

How to understand what's going wrong in a code for solving a problem with augmented lagrangian?

I am very new to optimization. so, sorry If I ask a simple question. I have a problem with a dozen of variables. I want to use Augmented Lagrangian for solving the problem. I write a code based on the ...
0
votes
0answers
33 views

Nonlinear Least Square Regression - Black-Box or LMA Type Methods

In Nonlinear Least Square Regression, is providing errors from all calculated points to the solver like LMA provide any advantage (in terms of speed and number of iterations) over minimizing the sum ...
1
vote
0answers
29 views

Optimal distribution of zeros and ones over matrix

I have the following problem: Given a matrix with n rows and m columns. Some elements of the matrix are unavailable. For each column, you have a set containing a number of zeros and ones which must ...
4
votes
0answers
31 views

Calculus of Variations with unknown cost function but some data

I have a problem that I've framed out in a particular way, but I don't know if I'm re-inventing the wheel here. Is there an existing literature base in this problem? Does it have a corresponding term ...
0
votes
0answers
73 views

Problem in using N-BFGS-B in optim

I am a beginner user of R. I am trying to maximize log likelihood function with the bounded parameters. The function is a kind of gamma mixture model which try to ...