Abstract: This paper introduces a specialized profiler for energy consumption prediction and proposes a Conceptual Green Orchestration Pipeline that utilizes the profiler as middleware. The system's architecture integrates a standard orchestrator (like Kubernetes) with a local ONNX model registry, targeting edge devices for deployment. Crucially, the profiler demonstrated strong performance, achieving 89% accuracy in selecting the optimal deployment device for resource-intensive models, a significant improvement over the 33.4% accuracy seen with random placement.
External IDs:doi:10.1145/3774901.3778062
Loading