Questions tagged [optimization]

This tag is intended for questions on methods for the (constrained or unconstrained) minimization or maximization of functions.

Filter by
Sorted by
Tagged with
2
votes
0answers
61 views

How to derive the adjoint sensitivity equations for a least squares objective function gradient

The Problem I would like to determine the gradient of a least squares objective function which depends on a vector of 40 parameters $p$, and the solution of a system of 32 differential equations. In ...
0
votes
0answers
19 views

Solving nearest symplectic matrix with line search, why do we divide by 2-norm?

I was trying to understand the line search method (following the steps proposed by this paper) that given a matrix $A$, returns me the nearest matrix $X$ that is symplectic, i.e. $X^TJX = J$ where $J =...
1
vote
0answers
58 views

Optimization on the multinomial manifolds of stochastic non-square matrices

Thanks for note! So I have an optimization problem with simple form but the decision variable is a large-scale matrix. My problem is similar to a existing problem here about multinomial manifolds and ...
5
votes
0answers
388 views

Optimization on the manifold of stochastic matrices

So I have an optimization problem of the form $$\text{maximize}\hspace{3mm}f(A):{\bf R}^{K\times K}\rightarrow{\bf R}$$ $$\text{subject to}\hspace{19mm}A^T{\bf 1}=\bf{1}$$ $$\hspace{33mm}A\geq 0$$ ...
0
votes
1answer
69 views

How can I deal with optimization problems that have a sum of functions of Z as a constraint when Z is the quantity to be minimized?

I have a problem where I have to minimize a certain quantity $Z$ subject to the following constraints:- $w_1 + w_2 + w_3 = 1$ $\frac{f_1(w_1*Z) + f_2(w_2 * Z) + f_3(w_3 * Z)}{Z} >= k$ where $k$ ...
4
votes
1answer
353 views

Conway's FRACTRAN

I've implemented fractran and playing with sequences iteratively in C. https://mathworld.wolfram.com/FRACTRAN.html Sloan: https://oeis.org/A007542 I can generate correct results, but I would like to ...
4
votes
0answers
60 views

Optimize linear equation using inner products and subject to L1 norm

I have a linear system of the form $A x = b$ where $A$ and $b$ are known, $A$ is "square", and $\lvert b \rvert_1 = \lvert x \rvert_1 = 1$. Unfortunately, I am working in a framework that ...
1
vote
1answer
48 views

Constraint programming problem with conditional constraints and some unknown indicator variables

I have an interesting little problem that I believe can be formulated in terms of optimization or constraint programming. I have a few dozen variables $a$, $b$, $c$ ... and a set of constraints that ...
2
votes
2answers
114 views

L1 least squares minimization with a sparse matrix

I have the following problem: $$\min_{x\in \mathbb{R}^n}\|Ax-b\|_1$$ where the matrix $A$ is large and sparse. I am looking for methods/code that can minimize this efficiently. References are very ...
2
votes
0answers
27 views

Scaling tensor approximation by symmetric tensor decomposition with SciPy's L-BFGS-B

I am trying to approximate a symmetric tensor of which the values are in the range of [1e-7,1e-4], by a symmetric tensor decomposition of lower rank. For this I am using the L-BFGS-B method in SciPy's ...
0
votes
1answer
70 views

Interpreting multivariable root-finding results from Matlab's fsolve algorithm

Edit: So I was able to get the same value of r that's given, when coding up the sum of squares of function values directly in the script file, rather than on the Command Window. So, maybe there's a ...
3
votes
1answer
65 views

Plotting optimum as a function of parameter in the objective

I am trying to minimize a 2d function using scipy.optimize. Specifically I want to plot the minimum value of the function fun as a function of the parameter wjk. The problem is that I cannot pass wjk ...
4
votes
0answers
99 views

Inverse problem with uncertain forward operator

Suppose I want to solve a linear inverse problem. In this example we take a convolution with the kernel: $$\frac{1}{(y^2+z^2)^{3/2}}$$ We only take a fixed $z$ for the computation and convolve with ...
2
votes
2answers
60 views

In a dynamical system, what might be a good reason why periodicity in an object's velocities is important?

I'm studying periodic motions in a dynamical system and, as a newbie, I narrowly think of an object's periodicity in its spatial x-y coordinates, but what might be a good reason why the existence of ...
84
votes
17answers
99k views

Is there a high quality nonlinear programming solver for Python?

I have several challenging non-convex global optimization problems to solve. Currently I use MATLAB's Optimization Toolbox (specifically, fmincon() with algorithm=<...
0
votes
1answer
71 views

R function or package for carrying out maximum likelihood techniques in random effect models

I am applying optim() function in R to obtain maximum likelihood estimates of the fixed effects and random effects in a model with bivariate random effects. The ...
2
votes
1answer
60 views

Reformulating a convex optimization problem with $x \mapsto \max(x,0)$ in the constraint

I am wondering if there is a well-known transformation allowing one to solve convex optimization problems of the form $$\begin{array}{ll} \underset{x}{\text{maximize}} & r^T x\\ \text{subject to} &...
6
votes
1answer
148 views

How to solve a 4th order nonnegative LASSO problem?

I need to solve the following 4th order nonnegative LASSO problem: $$ \min_{x \geq 0} \quad || |Ax|^2 - b ||^2 + \lambda ||x||_1 $$ where $|\cdot|^2$ denotes element-wise squared. $A$ is small size (e....
3
votes
1answer
85 views

Solve two-player game - minimize the l-infinity norm of a matrix-vector product

I have a matrix $M$ with non-negative real entries, and I would like to minimize the objective function $$\Phi(v) = \|Mv\|_\infty,$$ where $v$ is constrained to be a probability vector, i.e., $v_1+\...
5
votes
1answer
148 views

An optimization method for bounding the eigenvalues of a unknown non symmetric matrix

Given a positive objective function $f$ that acts on a real-valued matrix $A$, I am interested in the following problem $$\underset{A \in \mathbb{R}^{n \times n}}{\text{minimize}} \quad f(A) \quad \...
1
vote
0answers
86 views

N-dimensional optimization of moments of distribution function

Let's say I have a bag of marbles. Each marble has several attributes (color, diameter, surface roughness, weight). I know that there is a statistical relationship between various marble attributes ...
0
votes
0answers
64 views

Which algorithm is capable of solving a combinatorial optimization problem like this?

The problem I have at hand is a regression problem where each of $p$ inputs, $x_1, x_2, x_3, \cdots, x_p$, needs to undergo a variable transformation using one of $q$ basis functions from a set of ...
1
vote
0answers
51 views

Quadratic optimization with nonlinear vector term

I wish to minimize the quantity $$W=1/2x^TAx-x^Tg(y)$$ with respect to $x$ and $y$, which are vectors of unknowns. $A$ is a sparse square symmetric positive definite matrix and $g(y)$ is a vector with ...
1
vote
4answers
1k views

Which C++ Multi-objective Optimization libraries allows the addition of custom problems and custom algorithms?

I'm working on a custom discrete and constrained multi-objective optimization problem and I'd like to know which libraries or platforms that implement algorithms like ...
0
votes
0answers
69 views

Derivative-free ill-conditioned non-linear least squares

I am looking for a package which can solve (non-linear) least squares problems without the use of derivatives (because of an expensive model), but which also deals with ill-conditioning well (such as ...
1
vote
0answers
50 views

How to speed up the Mixed-Integer Quadratic Program process?

Currently, I am solving a problem in the format: M is an integer as well. The problem that troubles me is that X is a vector in {0,1} with a size of 7000. I use the solver in https://github.com/...
1
vote
0answers
38 views

implementation of shell elements in a topology optimization algorithm

I am working on developing a topology optimization solver based on the finite element method and I want to add a triangular shell element in it. I used the classic finite element method but I didn’t ...
1
vote
2answers
300 views

Jacobians with automatic differentiation

I have an objective function F: Nx1 -> Nx1, where N>30000. There are many sparse matrix/tensor multiplications in this function, so taking an analytic Jacobian by paper and pen is cumbersome. ...
1
vote
0answers
32 views

What is the generalization of the resource allocation problem I'm dealing with here?

I'm dealing with a problem as follows: I have a finite set of money 𝑚 to spend over 𝑟 different raffles, and I need to spend approximately to my budget, with the goal of maximizing my probability ...
7
votes
1answer
372 views

When and when not to use automatic differentiation

I am just learning (more) about automatic differentiation (AD) and at this stage it kind of seems like black magic to me. The second paragraph of its Wikipedia article makes it sound too good to be ...
2
votes
0answers
34 views

Convergence of Truncated Newton for non-convex Hessian

I was wondering if anyone could enlighten me about the convergence properties of the truncated newton method in case of a non-positive definite hessian $\nabla^2 f = H$. From the Book 'Numerical ...
3
votes
2answers
111 views

Optimization of expensive model with many parameters

I have a physical model which takes $\sim50$ parameters and gives $\sim2000$ outputs taking tens of minutes to run. I need to optimize these parameters to give outputs as close as possible to data. ...
0
votes
0answers
18 views

Benchmark instances for directed 3-Cycle cover

The directed 3-Cycle cover asks for a vertex-covering set of oriented cycles with at least three vertices per cycle such that every vertex is covered by exactly one cycle. I have scrutinzed the ...
4
votes
1answer
142 views

How to define a dimensionless Objective function for determining how peaked a curve is?

I have attached 2 plots for FFT spectra. One is considered good and one is bad. The good one is classified on the basis of how closely spaced the frequencies and the bad is based on how multiple ...
2
votes
2answers
99 views

Using MILP to place a set of primers along a genome

Define variables $p_i,u_i\in\{0,1\}^G$, for $i=1,\ldots,8$ and $G=30000$. Let $v$ be a constant vector also in $\{0,1\}^G$, with approximately 25% of its entries equal to $1$ (randomly located). Let ...
0
votes
0answers
33 views

Estimating the dimension of a solution space in nonlinear least squares

Suppose I have a nonlinear least squares problem, $$ \min_{\mathbf{x}} || \mathbf{f}(\mathbf{x}) ||^2 $$ with $n$ residuals and $m$ parameters, so that $\mathbf{x} \in \mathbb{R}^m$, and $\mathbf{f} \...
2
votes
0answers
37 views

Non-negative Least Squares to perform Inverse Laplace with weights

I'm trying to perform the inverse Laplace transform of a (noisy) dataset $y_i$ using Tikhonov regularization: $$\min \sum_{i=1}^{N} \left(\int_0^\infty e^{-s_i t} f(t) \, dt - y_i \right)^2 - \lambda^...
5
votes
0answers
20 views

Optimization for sampling multiple points of maximized minimum distance

I'm trying to find a way to sample new points that have maximum minimum-distance (maximin distance). The current situation is where there are ns number of pre-existing sample points. I want N number ...
4
votes
2answers
8k views

Tikhonov regularization in the non-negative least square - NNLS (python:scipy)

I am working on a project that I need to add a regularization into the NNLS algorithm. Is there a way to add the Tikhonov regularization into the NNLS implementation of scipy [1]? [2] talks about it, ...
-2
votes
1answer
303 views

Multi-objective optimization problem - Euclidean space

I am looking for some clues for an optimization problem. My problem consists of arriving to a image by optimizing multiple layers with the pixel position probability. This is an overview of the ...
0
votes
1answer
59 views

Norm constraint in CVXPY

I'm trying to implement the algorithm outlined in https://arxiv.org/abs/1211.5608 on a small scale. I have a linear operator $\mathcal{A}$ which is defined as $$\text{trace}(A^*_l(hm^*))$$ where $$A_l ...
0
votes
1answer
28 views

How to check curvature of a vector valued function

In terms of numerical optimization, the newton-rapson method requires a pos. definite Hessian $\nabla^2f$ respectively pos. curvature for computing the next step $p_k$ by solving $$\nabla^2 f p_k = -\...
1
vote
1answer
30 views

Genetic algorithm: fitness proportionate selection using RMSD as fitness function?

I'm implementing a genetic algorithm to optimise $x$ so as to minimise the RMSD error $r(x)$ between my model and experimental data. During the selection stage of recombination, I wish to select '...
1
vote
1answer
61 views

Making Hessian positive semidefinite

I have a large problem that I'm optimizing with Newton method. This involves a large sparse Hessian matrix. For better convergence and not to get stuck prematurely, I'd like to make the Hessian ...
1
vote
1answer
98 views

Machine Learning for Optimization

I have a function which takes 100+ coefficients and outputs $x$. I wish to optimise $x$. Running the simulation 50 000 times will take around 15 minutes, however, this happens in parallel - and the ...
1
vote
1answer
55 views

How do I get scipy.minimize to terminate below a certain loss threshold?

I was looking at the scipy.minimize documentation to see if I could find a way to terminate optimization when the loss gets below some cut-off, and I couldn't see ...
2
votes
1answer
81 views

A concave maximization that is not supported on CVX

I try to solve a maximization problem using CVX. In its simplest form, I want to maximize $$f(x,y)=y*h_b\left(\frac{x}{y}\right),$$ where $h_b(\cdot)$ is the binary entropy function. In the context ...
0
votes
1answer
21 views

Python: Getting second output variable from minimizing a computationally intensive function on first outputs

I have a function in python that is quite computationally expensive to evaluate, of the form: ...
0
votes
2answers
84 views

How to minimize $(x-a)^2+(y-b)^2$ subject to $ \sqrt{a}+\sqrt{b}=\sqrt{2}$?

I am not sure if this is on-topic here, but I am trying. Let $x,y$ be positive real numbers. I am trying to find $$ \min_{\sqrt{a}+\sqrt{b}=\sqrt{2}}(x-a)^2+(y-b)^2$$ I tried using Mathematica for ...
0
votes
1answer
35 views

Avalability of SNOPT optimization solver

I'd like to know if SNOPT solver is available free of cost for academic research in any of the optimization software packages. I came across a few softwares that have SNOPT, but those require a ...

1
2 3 4 5
17