gShare: A centralized GPU memory management framework to enable GPU memory sharing for containers

Munkyu Lee, Hyunho Ahn, Cheol-Ho Hong, Dimitrios S. Nikolopoulos

Abstract: Highlights•We propose gShare, a user-level centralized GPU memory framework for containers.•We design gShare as a lightweight framework for a container environment.•gShare implements a sophisticated memory allocator consisting of three suballocators.•gShare enforces memory isolation between processes and containers.•We thoroughly evaluate gShare using popular deep learning and HPC workloads.