You Only Search Once: On Lightweight Differentiable Architecture Search for Resource-Constrained Embedded Platforms
TimeWednesday, July 13th10:30am - 10:53am PDT
Location3004, Level 3
Embedded System Design Methodologies
DescriptionIn practice, to obtain the architecture that exactly meets the given resource constraint, previous hardware-aware differentiable neural architecture search (NAS) methods require to perform a plethora of search runs to tune the hyper-parameters by trial and error, and thus the total search cost increases proportionally. To resolve this, we introduce a lightweight hardware-aware differentiable NAS framework dubbed LightNAS, striving to find the desired architecture that satisfies various resource constraints through a one-time search (i.e., you only search once). Extensive experiments are conducted to show the superiority of LightNAS over state-of-the-art methods. Related codes will be released upon acceptance.