AdaDeep:A DNN hyperparameter optimization framework
![](/hugo/public/project/adadeep/featured_hu365b47f313294339103702780f024cd4_106078_720x2500_fit_q75_h2_lanczos.webp)
Adadeep integrates the adaptive model compression problem with a DNN hyperparameter optimization framework, using reinforcement learning to achieve adaptive lightweight model architecture search.
Model Architecture Diagram:
Description: To address these challenges, we propose AdaDeep, an automated DNN compression framework that explores the trade-off between performance and resource constraints at a holistic system level. AdaDeep selects the most suitable combination of compression techniques and corresponding hyperparameters for a given DNN, layer-by-layer. Additionally, AdaDeep uncovers novel combinations of compression techniques. Evaluations show that AdaDeep achieves significant improvements in latency, energy efficiency, and storage blueuction in DNNs, while incurring negligible accuracy loss.