DImplementing First-order Optimization Methods: Algorithmic Considerations and Bespoke Microcontrollers

Xinwei Zhang, John Sartori, Mingyi Hong, Sairaj V. Dhople

Abstract: Optimization problems are commonplace across energy, manufacturing, and communication industries. Efforts across academia are largely centered on theoretical properties and solution algorithms for optimization problems. Limited attention has been paid to systematically address challenges involved in implementing algorithms on end-use hardware platforms that are typically resource and power constrained. Through this paper, we seek to uncover the link between algorithmic considerations (e.g., convergence, precision) and hardware resources (e.g., memory utilization, gate usage) when optimization problems are deployed on general-purpose microcontrollers: a class of embedded systems with low power consumption and high configurability. Without loss of generality, we focus our attention on first-order optimization methods implemented on the popular MSP430 microcontroller architecture. We outline a strategy to architect bespoke microcontrollers that are optimized to improve cost, power, and other performance metrics for a particular algorithm. In so doing, we take a critical step in bridging the gap between theoretical properties of optimization problems, algorithmic considerations in algorithms, and design goals for computer architecture.