Abstract: Highlights•A heterogeneous channel-level search space is proposed.•The impact of knowledge distillation on different stages of architecture search is explored.•We find implementing a distillation strategy after architecture search yields great benefits.
Loading