Machine learning in AI Factories – five theses for developing, managing and maintaining data-driven artificial intelligence at large scale

Abstract The use of artificial intelligence (AI) is today’s dominating technological trend across all industries. With the maturing of deep learning and other data-driven techniques, AI has over the last decade become an essential component for an increasing number of products and services. In parallel to this development, technological advances have been accelerating the production of novel AI models from large-scale datasets. This global phenomenon has been driving the need for an efficient industrialized approach to develop, manage and maintain AI models at large scale. Such an approach is provided by the state-of-the-art operational concept termed AI Factory, which refers to an infrastructure for AI models and implements the idea of AI as a Service (AIaaS). Moreover, it ensures performance, transparency and reproducibility of AI models at any point in the continuous AI development process. This concept, however, does not only require new technologies and architectures, but also new job roles. Here, we discuss current trends, outline requirements and identify success factors for AI Factories. We conclude with recommendations for their successful use in practice as well as perspectives on future developments.