2019 (modified: 11 Nov 2022)ICML 2019Readers: Everyone
Abstract:Dynamic neural networks are becoming increasingly common, and yet it is hard to implement them efficiently. On-the-fly operation batching for such models is sub-optimal and suffers from run time ov...