Wang, Chao; Chen, Zhenpeng; Zhou, Minghui; (2023) AutoML from Software Engineering Perspective: Landscapes and Challenges. In: Proceedings of the 20th International Conference on Mining Software Repositories (MSR) 2023 IEEE/ACM. (pp. pp. 39-51). Institute of Electrical and Electronics Engineers (IEEE): Melbourne, Australia.

Preview

Text MSR23.pdf - Accepted Version Download (533kB) | Preview

Abstract

Machine learning (ML) has been widely adopted in modern software, but the manual configuration of ML (e.g., hyper-parameter configuration) poses a significant challenge to software developers. Therefore, automated ML (AutoML), which seeks the optimal configuration of ML automatically, has received increasing attention from the software engineering community. However, to date, there is no comprehensive understanding of how AutoML is used by developers and what challenges developers encounter in using AutoML for software development. To fill this knowledge gap, we conduct the first study on understanding the use and challenges of AutoML from software developers’ perspective. We collect and analyze 1,554 AutoML downstream repositories, 769 AutoML-related Stack Overflow questions, and 1,437 relevant GitHub issues. The results suggest the increasing popularity of AutoML in a wide range of topics, but also the lack of relevant expertise. We manually identify specific challenges faced by developers for AutoML-enabled software. Based on the results, we derive a series of implications for AutoML framework selection, framework development, and research.

Download activity - last month

Export as CSVJSONXML

Download activity - last 12 months

Export as CSVXMLJSON

Downloads by country - last 12 months

Export as CSVJSONXML

Archive Staff Only

View Item