Continuous optimization
MATH-329
Media
Media
- Announcements (Forum)
- Lecture notes (last update: Dec. 13, 2024) (File)
- What to expect for the final exam of MATH 329 in Jan. 2025 (File)
- Textbook: Numerical Optimization by Nocedal and Wright (URL)
- MediaSpace channel for this course (lecture videos) (URL)
- MATLAB MOOC (URL)
- "Learn X with Y" page about Matlab (URL)
- Vectorize your code (it's a small part of the grade for homework) (URL)
- Partial list of other EPFL courses about optimization / using optimization (URL)
o Form groups of three on Moodle before lecture in week 2 if you have preferences, and we will propose random assignments to complete groups where needed.
o HW is done in groups, but I highly recommend that you all learn all aspects of the assignments.
o Expect 4 homework problems.
o You get ~3 weeks for each. They are a lot of work: get to them early.
o First one distributed in week 2.
First lecture: intro to the course, then most of Chapters 1 and 2 from the lecture notes. Except for applications and things that have to do with second-order derivatives (Hessians), consider that everything else in those chapters that we have not talked about yet is part of general background that you should be (or become) comfortable with (especially multivariate calculus and linear algebra).
- Form groups of 3 for homework assignments (Group choice)
- Exercises 1 (File)
- Solutions 1 (File)
- Operational Research: Methods and Applications (URL)
- Blackboard pictures (Folder)
- Exercises 2 (File)
- Solutions 2 (Folder)
- Matlab code for contour plots (File)
- Proof that "twice differentiable at a point" implies Hessian is symmetric (just in case you are curious) (File)
- Blackboard pictures (Folder)
- Code for multidimensional Rosenbrock (Folder)
- Exercises 5 (File)
- Solutions 5 (File)
- Blackboard pictures (Folder)
Break
28 October - 3 November
4 November - 10 November
11 November - 17 November
18 November - 24 November
25 November - 1 December
2 December - 9 December
- Exercises 12 (File)
- Solutions 12 (File)
- Solutions 12 code (File)
- Blackboard pictures (Folder)
- Codes used during lecture (Folder)
9 December - 15 December
This week, we consider a few different optimization software packages for Matlab. The lecture is an interactive software demo, and the exercise session gives you a chance to explore that software.
If you want to try things out for yourself during lecture, it's useful if you install the following ahead of time:
CVX: http://cvxr.com/cvx/download/ : unzip then run cvx_setup
Manopt: https://www.manopt.org/downloads.html : unzip then run importmanopt
Example scripts are below.
- power plants (File)
- optim on circle (File)
- rosenbrock 2D (File)
- optim on disk (File)
- smallest ball (File)
- Lecture 13 (File)
16 December - 20 December
Basics of semidefinite programming, and illustration with Max-Cut.