Theory-inspired path-regularized differential network architecture search

• Main Authors: ZHOU, Pan, XIONG, Caiming, SOCHER, Richard, HOI, Steven C. H.
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2020
• Subjects: OS and Networks; Systems Architecture
• Online Access: https://ink.library.smu.edu.sg/sis_research/8998; https://ink.library.smu.edu.sg/context/sis_research/article/10001/viewcontent/2020_NeurIPS_NAS__1_.pdf
• Institution: Singapore Management University

Despite its high search efficiency, differential architecture search (DARTS) often selects network architectures with dominated skip connections which lead to performance degradation. However, theoretical understandings on this issue remain absent, hindering the development of more advanced methods...