EdgeServe: efficient deep learning model caching at the edge

Tian Guo, Robert J. Walls, Samuel S. Ogden

Abstract: In this work, we look at how to effectively manage and utilize deep learning models at each edge location, to provide performance guarantees to inference requests. We identify challenges to use these deep learning models at resource-constrained edge locations, and propose to adapt existing cache algorithms to effectively manage these deep learning models.