This repository contains code for the report First-order Methods on Large-scale Convex Optimization Problems
The main testing file to run is test_subgrad.m. This contains comparison between the following methods:
- Subgradient method with 1/n step size.
- Subgradient method with fixed step size eps/|g_k|^2.
- Subgradient method with Polyak's step size.
- Subgradient method with Polyak first, then fixed step size.
- Subgradient method with restart.
- Perceptron method with fixed step size eps/|g_k|^2.
- Perceptron method with Polyak's step size.
The other testing files focus on analyzing the effect of different parameters on the restart method. The results for those experiments are contained in the ./data/ folder, and can be accessed by running data_manipulation.m within the folder.