An efficient neural architecture search based on PCDARTS

Deep learning has achieved great achievements in a variety of tasks, such as image classification, speech recognition, and cultural heritage protection. However, manually design deep convolution neural networks for certain tasks requires a long time. Furthermore, it also requires the designer to have certain professional knowledge. Faced with an increasingly complex network architecture, it has become more and more difficult to design only manually. Neural architecture search provides a method to overcome problems in manually designing networks. It mainly includes search space, search strategy, and performance evaluation. In this paper, a new search method, F-PCDARTS, is proposed based on PCDARTS. In the research space, we propose to apply channel shuffle and global context for efficient feature extraction. At the same time, in terms of search strategy, a fixed reduction cell is designed to search normal cells, which solves the difficult and time-consuming problem of search optimization. The experiment results indicate a 9.8% reduction in network search time, requiring only 0.09 GPU days. Furthermore, the validation accuracy of CIFAR10 and CIFAR100 is improved by 0.09% and 0.12%, respectively. The method we propose effectively reduces the time of network search.

Authors

Institutions

Publication Details

Published
2024-12-06
DOI
https://doi.org/10.1109/iiki65561.2024.00018
Primary Topic
Neural Networks and Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

An efficient neural architecture search based on PCDARTS

Hengyi Li, Lin Meng, Zhuo Li
Neural Networks and Applications
article

An efficient neural architecture search based on PCDARTS

Hengyi Li, Lin Meng, Zhuo Li
article en

Abstract

Deep learning has achieved great achievements in a variety of tasks, such as image classification, speech recognition, and cultural heritage protection. However, manually design deep convolution neural networks for certain tasks requires a long time. Furthermore, it also requires the designer to have certain professional knowledge. Faced with an increasingly complex network architecture, it has become more and more difficult to design only manually. Neural architecture search provides a method to overcome problems in manually designing networks. It mainly includes search space, search strategy, and performance evaluation. In this paper, a new search method, F-PCDARTS, is proposed based on PCDARTS. In the research space, we propose to apply channel shuffle and global context for efficient feature extraction. At the same time, in terms of search strategy, a fixed reduction cell is designed to search normal cells, which solves the difficult and time-consuming problem of search optimization. The experiment results indicate a 9.8% reduction in network search time, requiring only 0.09 GPU days. Furthermore, the validation accuracy of CIFAR10 and CIFAR100 is improved by 0.09% and 0.12%, respectively. The method we propose effectively reduces the time of network search.

Ritsumeikan University (JP)
Openalex Percentile: Top 74%
Neural Networks and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.