Opening Convex Optimization II: Sequential Convex Programming and Conjugate Gradient Methods
Convex Optimization II: Sequential Convex Programming and Conjugate Gradient Methods
- Length
- 1 h 13 min
- Level
- Undergraduate
- Recorded
- Stanford University2008
Chapter 1 of 9: Before the lecture
Boyd bounds conjugate gradient error with low-degree polynomials that are small on the eigenvalues.
Convex optimization methods continue with a study of heuristics for non-convex problems, finishing difference of convex programming and alternating convex optimization before moving to linear equation solvers. The lecture categorizes linear solvers into dense direct, sparse direct, and iterative indirect methods, noting their scaling and reliability trade-offs. Symmetric positive definite systems are introduced as the primary focus, arising from Newton steps, quadratic minimization, and elliptic partial differential equations. The Conjugate Gradient method is then developed through Krylov subspaces, using spectral analysis and polynomial approximation on the spectrum to bound errors and explain convergence behavior.
Convex optimization methods continue with a study of heuristics for non-convex problems, finishing difference of convex programming and alternating convex optimization before moving to linear equation solvers. The lecture categorizes linear solvers into dense direct, sparse direct, and iterative indirect methods, noting their scaling and reliability trade-offs. Symmetric positive definite systems are introduced as the primary focus, arising from Newton steps, quadratic minimization, and elliptic partial differential equations. The Conjugate Gradient method is then developed through Krylov subspaces, using spectral analysis and polynomial approximation on the spectrum to bound errors and explain convergence behavior.
Convex Optimization book appendix

This lecture
Lecture 31 of 37 of Convex Optimization I.
Choose a node to see how it connects to this lecture. What comes before is on the leftat the top. What comes after is on the rightat the bottom. The ring is what it teaches. People and places are above. Other lectures and books are below.
Press a chosen node again to open it.
Your comment is kept while you sign up.Sign in