Logo image
Towards Automation for MLOps: An Exploratory Study of Bot Usage in Deep Learning Libraries
Conference proceeding   Peer reviewed

Towards Automation for MLOps: An Exploratory Study of Bot Usage in Deep Learning Libraries

Akond Rahman, Farzana Ahamed Bhuiyan, Mohammad Mehedi Hassan, Hossain Shahriar and Fan Wu
2022 IEEE 46th Annual Computers, Software, and Applications Conference (COMPSAC), pp.1093-1097
Annual Computers, Software, and Applications Conference (COMPSAC), 46th (Los Alamitos, California, USA, 06/27/2022–07/01/2022)
08/2022
Web of Science ID: WOS:000855983300163

Metrics

Abstract

bots Deep learning deployment devops empirical study mlops Intelligent Agents or Systems Machine Learning
Machine learning (ML) operations or MLOps advocates for integration of DevOps- related practices into the ML development and deployment process. Adoption of MLOps can be hampered due to a lack of knowledge related to how development tasks can be automated. A characterization of bot usage in ML projects can help practitioners on the types of tasks that can be automated with bots, and apply that knowledge into their ML development and deployment process. To that end, we conduct a preliminary empirical study with 135 issues reported mined from 3 libraries related to deep learning: Keras, PyTorch, and Tensorflow. From our empirical study we observe 9 categories of tasks that are automated with bots. We conclude our work-in-progress paper by providing a list of lessons that we learned from our empirical study.

Details

Logo image