Questions tagged [nonlinear-equations]

Solution of nonlinear systems of equations. The equations might be algebraic or differential equations.

Filter by
Sorted by
Tagged with
17 votes
1 answer
5k views

When is Newton-Krylov not an appropriate solver?

Recently I have been comparing different non-linear solvers from scipy and was particularly impressed with the Newton-Krylov example in the Scipy Cookbook in which they solve a second order ...
user avatar
  • 5,269
15 votes
2 answers
3k views

Is it possible to solve nonlinear PDEs without using Newton-Raphson iteration?

I am trying to understand some results and would appreciate some general comments on tackling nonlinear problems. Fisher's equation (a nonlinear reaction-diffusion PDE), $$ u_t = du_{xx} + \beta u ...
user avatar
  • 5,269
15 votes
1 answer
3k views

Comparing Jacobi and Gauss-Seidel methods for nonlinear iterations

It is well known that for certain linear systems Jacobi and Gauss-Seidel iterative methods have the same convergence behavior, e.g. Stein-Rosenberg Theorem. I am wondering if similar results exist for ...
user avatar
  • 151
11 votes
3 answers
4k views

Solution of quartic equation

Is there a open C-implementation for the solution of quartic equations: $$ax⁴+bx³+cx²+dx+e=0$$ I am thinking of an implementation of Ferrari's solution. On Wikipedia I read that the solution is ...
user avatar
  • 1,109
11 votes
2 answers
528 views

Numerical method for equation solving that works on stochastically computed functions

There are many well known numerical methods for solving equations of the type $$ f(x) = 0, \quad x \in \mathbb{R}^n,$$ e.g. bisection method, Newton's method, etc. In my application $f(x)$ is ...
user avatar
  • 2,560
10 votes
3 answers
878 views

Methods of solving non-linear advection-diffusion systems beyond Newton-Raphson?

I'm working on a project where I have two adv-diff coupled domains through their respective source terms (one domain adds mass, the other subtracts mass). For brevity, I'm modeling them in steady ...
user avatar
10 votes
1 answer
530 views

Solving a difficult system of equations numerically

I have a system of $n$ non-linear equations that I want to solve numerically: $$\mathbf{f}(\mathbf{x})=\mathbf{a}$$ $$\mathbf{f}=(f_1,\dots,f_n)\quad\mathbf{x}=(x_1,\dots,x_n)$$ This system has a ...
user avatar
  • 2,560
9 votes
2 answers
2k views

Is the shooting method the only general numerical method for solving nonlinear boundary value ODEs?

During my wandering in Mathematica.se, I gradually noticed that a certain kind of differential equation solving problem is "troubling" us all the time, that is, the boundary value problem (BVP) of ...
user avatar
  • 328
9 votes
3 answers
2k views

Basin of attraction for Newton's method

Newton's method for solving nonlinear equations is known to converge quadratically when the starting guess is "sufficiently close" to the solution. What is "sufficiently close"? Is there literature ...
user avatar
9 votes
2 answers
1k views

What does the Von Neumann's stability analysis tell us about non-linear finite difference equations?

I am reading a paper [1] where they solve the following non-linear equation \begin{equation} u_t + u_x + uu_x - u_{xxt} = 0 \end{equation} using finite difference methods. They also analyse the ...
user avatar
  • 265
9 votes
0 answers
207 views

Imbalance of variables in Mixing Newton's method and Linear solver for a Non-linear system

Problem Solving a non-linear system of equations. The number of variables is the same as the number of equations. When I fix a set of variables (say $\vec{y}$) and keep another set free (say $\vec{...
user avatar
  • 163
9 votes
0 answers
128 views

Review of modern homotopy methods and practical techniques

I'm hoping someone can recommend recent literature concerning homotopy methods for solving systems of nonlinear equations. Already by the time of Layne Watson's 1986 paper there were a lot of methods,...
user avatar
  • 297
8 votes
5 answers
372 views

Iterative solution to a nonlinear equation

I appologize in advance if this question is silly. I need to compute the root of \begin{equation} u -f(u) =0 \end{equation} Where $u$ is a real vector and $f(u)$ is a real-vector valued function. ...
user avatar
8 votes
1 answer
554 views

Nonlinear wave equation - Finite element or finite difference

I would like to know the which is more advantageous when it comes to solving nonlinear hyperbolic equations, Finite Element or Finite difference methods? Which method will be better in capturing ...
user avatar
  • 103
8 votes
2 answers
6k views

Solve non-linear set of three equations using scipy

I need to solve a non-linear set of three equations using scipy. However, I do not have any clue on which algorithm is suitable for my problem from a mathematical point of view (stability, convergence ...
user avatar
  • 223
8 votes
1 answer
1k views

Newton iteration applied to nonlinear PDE

I'm having difficulty understanding how to apply Newton iteration to nonlinear PDEs and then use a fully implicit scheme to time step. For example, I want to solve Burgers equation $$u_{t} + u u_{x} -...
user avatar
  • 163
8 votes
1 answer
155 views

F(x) = 0 vs. ||F(x)||^2->min

In many areas of application, one needs to solve a nonlinear system of equations $$ F(x) = 0. $$ Sometimes, the formulation $$ \|F(x)\|^2 \to\min $$ is used. Clearly, every solution $\hat{x}$ of $F(x)=...
user avatar
7 votes
4 answers
8k views

How to find more than one root of a polynomial?

This program finds the first root of the function f, defined in the code. There are 5 roots of this function. (x=1,2,3,4,5) I wish to find all of the roots in this program and print them to the screen....
user avatar
7 votes
3 answers
2k views

Convergence of fixed point iterations of a non-linear matrix system

I'm working on modeling two phase immiscible flow in a porous medium. When I setup the system of equations, I obtain a non-linear system of equations that can be expressed in the form: $A(x)x=b$ ...
user avatar
  • 11.8k
7 votes
2 answers
175 views

For a non-linear PDEs should the source term be discretised at $u_j$ or averaged over $(u_{j+1} + u_{j-1})/2$?

The non-linear Poisson equation in one-dimension, $$ 0 = \frac{\partial^2u}{\partial x^2} - f(u) $$ can be discretised as to give, $$ u_{j-1} -2u_{j} + u_{j+1} = h^2 f(u_j) $$ where $h$ is the ...
user avatar
  • 5,269
7 votes
3 answers
428 views

Strong coupling of a non-linear multiphysic problem: failure with Newton Raphson method

I am trying to solve a multiphysic problem using finite elements and a Newton Raphson solution scheme. I have two non-linear subsystems that are coupled bi-directionally. The first subsystem includes ...
user avatar
  • 71
7 votes
1 answer
205 views

Understanding the Eisenstat-Walker method for choosing the tolerance of a linear solver when solving a non-linear PDE

We are working on the solution of large non-linear PDE (say the Navier-Stokes equation) which we solve using Newton's method with an analytical formulation of the jacobian. For very large systems, we ...
user avatar
  • 1,127
7 votes
1 answer
220 views

What would be a good approach to solving this large data non-linear least squares optimisation

Introduction to Problem I'm using a Truncated Signed Distance Function to perform 3D reconstruction from depth images. Essentially I have a large voxel grid where each voxel contains the signed ...
user avatar
7 votes
1 answer
444 views

Numerical method for nonlinear system of algebraic equations of special type

I have a nonlinear system of algebraic equations of special kind: $$ \begin{array}{rcl} x_{i}+y_{i}+z_{0,1}+c_{i,1}z_{1,1} & = & d_{i,1}, \\ x_{i}^2 + y_{i}^2 + z_{0,2} + c_{i,1} z_{...
user avatar
  • 445
6 votes
2 answers
233 views

What are the numerical methods for huge polynomial systems?

Let a system of $n$ polynomial equations of degree $d$ with $m$ variables. I'm interested in a sparse system with $d = 3$, $n \sim 2000000$, $m \sim 50000$ and integer coefficients. What techniques ...
user avatar
6 votes
1 answer
332 views

Eikonal Equation solver with different grid densities

The Fast Marching Method, Fast Iterative Method, and Fast Sweeping Method are three ways of solving the Eikonal Equation on a discrete grid, essentially just a wavefront spreading out from initial ...
user avatar
  • 313
6 votes
4 answers
2k views

parameters estimation

I have to estimate a parameter (K), but I don't know how I can do it. I think by a regression model (minimum least square?), but I'm not sure. The system is: ...
user avatar
  • 63
6 votes
1 answer
1k views

Algorithm for solving system of quadratic equations and linear equations

Let $x \in R^N$. From a Spectral Chebyshev collocation method, I have a system of quadratic and linear equations. Denote them, $$ x^T Q_i x + L_i^T x = 0 $$ and $$ A x = 0 $$ Furthermore, I know ...
user avatar
  • 368
6 votes
4 answers
885 views

Large-scale nonlinear optimization problem

I want to solve a nonlinear optimization problem of the following form \begin{equation} \min\left(\sum_i d^{x_i}c_{i}\right)\\ 0 \leq x_{i} \leq a\\ \sum_{i} x_{i} \leq b \end{equation} $a$, $b$, $...
user avatar
  • 800
6 votes
1 answer
181 views

Numerical methods for boundary-value ODEs with a jump condition

I want to solve a non linear system of equations of a particular kind. I find it hard to formulate clearly so I directly give a simple example. $ f''=A(f,g)\\ g''=B(f,g) $ with the boundary ...
user avatar
  • 247
6 votes
1 answer
326 views

Non-linear optimization using approximate gradient

I'm working with non-linear optimization for imaging, such as MRI and CT. Our problem is of the form $\|Ax-b \|_2^2+\lambda \|Wx\|_1$. $A$ is never formed explicitly, so we're limited to approaches ...
user avatar
  • 2,473
6 votes
1 answer
830 views

Nonlinear dynamics: algorithm suggest

I've just started a thesis on nonlinear dynamics which entails numerical analysis of the Duffing oscillator (DO). It's basically just a second order ODE, or equivalently a set of ODEs. Say, after ...
user avatar
6 votes
0 answers
633 views

Implementing a Hill-Type Muscle Model

I'm interested in implementing the muscle model used in Geijtenbeek and Wang et al's work. Both papers link to the paper by Geyer and Herr, which describes this model: However, the paper on this ...
user avatar
  • 313
5 votes
1 answer
284 views

Why do we solve non-linearity in hyperbolic PDEs that way?

I am used to solve parabolic or elliptic non-linear PDE and the common methods to tackle non-linearity are Picard's iteration and Newton's method. I am a bit confused by the way things are done with ...
user avatar
5 votes
3 answers
3k views

Solving a linear equation system with pure Neumann condition

I am trying to solve a linear equation system $\textbf{A}\textbf{x}=\textbf{b}$, e.g. a Poisson equation discretized in strong form, using biCGstab method. Since there are only natural Neumann ...
user avatar
  • 79
5 votes
2 answers
403 views

Implementation of nonlinear term in FEM

Although there are similar questions, I am also struggling with the implementation of the following term in "my own code" by Finite Element Method, namely, $\nabla \phi \cdot \nabla \phi$. $\phi$ is ...
user avatar
5 votes
2 answers
300 views

How to do upwinding in finite volume schemes for nonlinear equations?

In finite difference theory, you learn, that you have to use upwinding for equations with high convection, like Burgers' equation. What does the finite volume equivalent look like? What if the ...
user avatar
5 votes
1 answer
1k views

Confusion regarding the Adam-Moulton and Backwards Differentiation Formula (BDF) of the VODE solver

I am exploring the Method of Lines as a way of time stepping semi-discretised PDEs with ODE time-integration solvers. For an excellent introduction to this technique see the scholarpedia.org article. ...
user avatar
  • 5,269
5 votes
1 answer
8k views

Newton-Raphson method for nonlinear partial differential equations

For the numerical solution of Reynolds equations (a non-linear partial differential equation), the Newton-Raphson method is generally proposed. After getting algebraic equations from a finite ...
user avatar
5 votes
1 answer
102 views

What are systematic ways of approximating a non-smooth (non-continuously differentiable) system dynamic to be n-smooth?

I have a system dynamic that is non-smooth because it has several signum and absolute value functions in it (three-tank level control). I can obviously choose different sigmoid functions to ...
user avatar
  • 173
5 votes
2 answers
168 views

Convergence issues for a non-linear system

I have a nasty system of coupled integral equations, which I managed to discretize and recast a non-linear system, i.e. something like: $$ \vec{w} = F \left( \vec{w} \right) \hspace{32pt} w \in \...
user avatar
  • 247
5 votes
1 answer
214 views

Nonlinear least-squares solvers vs. generic minimization

A nonlinear least-squares problem with $F:\mathbb{R}^m\to\mathbb{R}^n$, $$ F(x) \to \min_x \quad (\text{in the least-squares sense}) $$ really means minimizing $$ \frac{1}{2} \|F(x)\|^2 \to \min_x. $$ ...
user avatar
5 votes
1 answer
147 views

Can redundant variables be beneficial for root-finding convergence

Suppose I have $n$ generally nonlinear equations for $n$ variables, like e.g. for $n=2$ the system $F(x,y)=0$ $$ \begin{aligned} x^2+2y-4&=0\\ \sqrt{8}x+y^2-5&=0 \end{aligned} $$ By ...
user avatar
  • 103
5 votes
1 answer
177 views

Quantifying the degree of nonlinearity in a heat transfer problem

I’m working with a heat equation of the form. $$\frac{d(\rho(T)c_p(T)T)}{dt}-\nabla\cdot(k(T)\nabla T)=f$$ with temperature dependent density $\rho(T)$, specific heat $c_p(T)$, and thermal ...
user avatar
  • 11.8k
5 votes
1 answer
173 views

Evolving nonlinear Schrodinger equation with higher-order algorithms?

First I will give the relevant information for my question, and then I'll ask the question. $\large{\textrm{Background}}$ For evolving the nonlinear Schrodinger equation (NLS), one typically uses [a ...
user avatar
5 votes
1 answer
2k views

Numerical solution of non-linear diffusion equation via finite-difference with the Crank-Nicolson method

I want to numerically solve the non-linear diffusion equation: $$ \frac{\partial}{\partial t} T(x,t)= \frac{\partial}{\partial x}\left(T^{5/2} \frac{\partial T}{\partial x} \right) $$ I want to use ...
user avatar
5 votes
2 answers
211 views

Solving a nonlinear algebraic system that includes a linear term

I am trying to solve a particular system of non linear equations written as $F(x) = 0$ in an efficient way. More specifically, $$F(x) = (I - \gamma A)x - g(x) + C$$ where $\gamma$ is a scalarconstant,...
user avatar
  • 147
5 votes
1 answer
131 views

Analysis of nonlinear finite element methods

I have been doing a lot of reading on the development of finite element methods and their analysis using, e.g., functional analysis. I am clear on the formulation of the weak form of a PDE and ...
user avatar
  • 53
5 votes
1 answer
328 views

Convergence of Jacobi's method for a semilinear elliptic PDE

I have an iterative finite difference scheme for the Poisson equation $$ \nabla^2 u=-\rho $$ It's the Jacobi method, which has the form (for 1D systems) $$ u^{n+1}_{i} = \frac{1}{2}(u^n_{i+1} + u^n_{...
user avatar
  • 371
5 votes
1 answer
805 views

Solving a set of linear equations with block structure and weak coupling

I have a standard set of linear equations $Ax=b$ where the Hessian matrix $A$ has the special block structure as shown: $A= \begin{pmatrix} T & U\\ U^T & V \end{pmatrix}$, $x= \begin{...
user avatar
  • 153

1
2 3 4 5
7