Maybe my question is obvious but i cannot find any good source which answers it
I trying to learn about proximal gradient. One thing which is not clear for me is particular algorithm for line search. According to this presentation (slide 20) and some other sources backtracking line search with previous step length as initialization is good choice.
I implemented simple version of LASSO with proximal gradient and it looks like that increasing step from time to time can make convergence significantly faster.
So my question is: Is it good idea to use bracketing in proximal gradient?
(Accoring to "Numerical optimization by Nocedal and Wright" i use term "bracketing" in meaning "finding initial interval for backtracking")
My second question is: Which is best line search algorithm for LASSO/general proximal gradient?
Sorry for my English