Questions tagged [newton-method]

Method for finding successively better approximations to the roots (or zeroes) of a real-valued function

26 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
8
votes
0answers
183 views

Imbalance of variables in Mixing Newton's method and Linear solver for a Non-linear system

Problem Solving a non-linear system of equations. The number of variables is the same as the number of equations. When I fix a set of variables (say $\vec{y}$) and keep another set free (say $\vec{...
5
votes
0answers
489 views

Best way to add a positivity constraint to Newton's Method

So given an objective function $f({\bf x})$, I would like to include a positivity constraint when I perform the fixed point iteration: $${\bf x}^{(t+1)}={\bf x}^{(t)} - \text{H}_f^{-1}\nabla f({\bf x}^...
3
votes
0answers
144 views

Difference between Dishonest Newton method and Very Dishonest Newton method

What is the difference between the Dishonest Newton method and the Very Dishonest Newton method? Is there a difference or do they mean the same thing? I have tried searching for this on the internet ...
2
votes
1answer
154 views

Solving nonlinear PDE with finite difference based on Newton-Krylov

I am now working on solving MHD equations with finite difference method, which include nonlinear equations: $$ \frac{\partial\rho}{\partial t}+\nabla\cdot\left[\left(\rho_0+\rho\right){v}\right]-\...
2
votes
0answers
72 views

Nonlinear system with diagonal nonlinearity

Consider a nonlinear system of the form $\boldsymbol{f}(\boldsymbol{x}) = \boldsymbol{0}_{\mathbb{R}^n}$ for $\boldsymbol{x} \in \mathbb{R}^n$, where the function $\boldsymbol{f}$ is given by \begin{...
2
votes
0answers
198 views

How to prevent BFGS from getting stuck on astronomically large gradient?

I have implemented BFGS myself from scratch in order to solve minimization problems. Part of BFGS, as I understand it, is that the approximation to the Hessian is supposed to be positive definite, ...
2
votes
0answers
101 views

Optimization based integration for MPM

I'm considering implementing (just for simplicity) the unconstrained implicit optimization based integration for Material Point Method as described in Chenfanfu Jiang's thesis on MPM (the minimization ...
2
votes
0answers
276 views

Does applying the Newton-Raphson iteration for matrix reciprocal refine a matrix inverse from LU/GE?

This is a follow-up to this answer. Suppose you have a possibly very ill-conditioned matrix $A$, and you compute its inverse with LU/GE to get $X_{\text{lu}}\approx A^{-1}$. The Newton-Raphson ...
2
votes
0answers
285 views

Quasi Newton method for block diagonal Hessian

I am having an unconstrained optimization problem, where the Hessian is positive semidefinite and block diagonal. The function is strictly convex, hence, the curvature condition ($ s^{T}_{k}y_{k} > ...
2
votes
0answers
401 views

Applying Newton-Raphson method to system of two differential equations, one time independent, one time dependent

The goal is to couple system of two nonlinear differential equations by applying appropriate space and time discretization and Newton-Raphson scheme. The equations system is $$\left[ \begin{array}{c} ...
2
votes
0answers
955 views

Newton Iteration method convergence

I wrote a Python code which solves a second degree nonlinear differential equation using the Newton iteration method. The code converges to a 2-cycle within 50 or so iterations. The cycle only ...
1
vote
0answers
39 views

Inverse Newton Method for optimization: is this the correct algorithm?

I am trying to implement the algorithm in this article. I have already asked a question before about it here, and I am trying to figure out what I am doing wrong. This time, it's this section of the ...
1
vote
0answers
52 views

How to avoid gsl root finder evaluate function outside its domain

When I use the newton's method or hybrid solver in the GSL package to deal with 1-D or multidimensional root solving problems, the code frequently crashes when the solver requests function value ...
1
vote
0answers
77 views

How to use Wolfe-Powell step-size control in quasi-Newton method?

I'm trying to find the minimum of a function using the quasi-Newton method with the Broyden-Fletcher-Goldfarb-Shanno (BFGS) algorithm. But I want to change the following implementation, so that: 1) ...
1
vote
0answers
363 views

Vectorised root finding in Python

I have an array of size (254, 80) which I am trying to use Scipy's fsolve on. I have found that the speed of using fsolve on a vector is quicker than it is in a for loop but only for vectors upto ...
1
vote
0answers
455 views

Newton - Raphson method : maxima of function in 2 variables

I am computing the maximum of a function (with two-variables) using Newton-Raphson method. The function is : $e^{-(x \ - x_0)^2 - (y \ - y_0)^2}$, whose maxima exists at $(x_0,y_0)$. The Jacobian ...
1
vote
0answers
75 views

Successive iteration method for solving eigenvalue ploblem

I have a question concerning the branch of successive iteration methods (Newton, Runge-Kutta). I definitely know (or can read in Wikipedia) the implementation of these methods. But I was wondering ...
1
vote
0answers
126 views

Jacobian of the electron and hole drift diffusion equations with respect to potential in semiconductors

These are the discretized drift diffusion equations as taken from the book "Analysis and Simulation of Semiconductor Devices". The electron continuity equation is: $$((\Delta_{j-1}^y+\Delta_j^y)/2\...
1
vote
0answers
84 views

Using Newton-Raphson method to solve the hydrostatic equation

I'm trying to use newton-raphson method for nonlinear systems of equations as described in 'Numerical recipies' book in chapter 9.6 to solve the hydrostatic equation for a polytropic star. For each ...
1
vote
0answers
101 views

Quasi Newton taking very small steps

I have implemented a Quasi-Newton method based on the Hessian approximation. I am noticing that the algorithm takes too many iterations to converge, even though it does converge. What I am not able to ...
1
vote
0answers
113 views

Solving a large system of nonlinear equations, where timeseries are the unknown

I am trying to solve a problem, which I find quite hard, like, headache-hard. I have to solve the following set of $M$ nonlinear equations: $$F(X)=\begin{bmatrix}f_1 (X)\\f_2 (X)\\...\\f_M (X)\\ \end{...
1
vote
0answers
67 views

Mapping to a computationally less expensive basis when employing Newton's method

I'm looking for advice, or references, for a change of basis to my dependent variables that leads to a less computationally expensive scheme when solving a system of coupled polynomial equations. ...
1
vote
0answers
86 views

Increase convergence of non-linear equations resulting from ODEs

I am trying to solve a set of couple ODEs: $V_l(r) - r W_l(r) - f1(r) W_l' = 0\tag 1$ $r^2 h''_l(r) + f2 r h_l'(r) + f3 h_l(r) - f4 U_l(r) = 0 \tag 2$ $\kappa (U_l + h_l) + V_{l+1} + W_{l+1} = 0\...
0
votes
1answer
14 views

How to check curvature of a vector valued function

In terms of numerical optimization, the newton-rapson method requires a pos. definite Hessian $\nabla^2f$ respectively pos. curvature for computing the next step $p_k$ by solving $$\nabla^2 f p_k = -\...
0
votes
0answers
22 views

Solving natural convection equations (heat and flow) with the shooting method (managing 2 boundary values)

TL;DR I've been implementing a python program to solve numerically equations for natural convection based on a particular similarity variable using runge-kutta 4 and the shooting method. However I don'...
0
votes
0answers
116 views

Jacobian-free approach for time-dependent equations for implicit time-stepping

When solving time-dependent non-linear equations, such as the non-linear diffusion equation $$\partial_tu=\nabla\left(D(u)\nabla u\right)$$ usually Newton's method is applied, with (coupled with the ...