Marc Torrens Lecturer, Department of Operations, Innovation & Data Sciences The most sought-after profession at any organization interested in implementing machine learning is that of data scientist. Leadership and engineering are essential, but their role in the successful deployment of machine-learning models in production is often overlooked. Nowadays, industry is realizing that the only valid machine-learned models are those in production. In this article, we discuss how leadership and engineering are essential to monetizing machine-learning initiatives. Nowadays, we refer to the capability of machines to be extremely competitive at a specific task in a particular domain as artificial intelligence (AI). As Daniel Dennett argues in his book From Bacteria to Bach and Back: The Evolution of Minds, we are creating extremely competent machines that have no understanding of the world whatsoever. Nonetheless, machine learning (ML) - a subfield of AI - is transforming all sorts of organizations, businesses and government bodies in unprecedented ways. This is a natural consequence of two factors: a) the availability of data as a result of the digitization of words, and b) an increase in computing power. Both of these factors are growing at an exponential pace, so this is just the beginning of a new ML age. However, although the press surprises us every day with new ML applications that perform better than experts at certain specific tasks, ML techniques are reaching a plateau. Machine learning is transforming all sorts of organizations, businesses and governments in unprecedented ways The innovations produced at the global scale are merely incremental. A few years back, most newcomers to the field saw deep learning as the solution to all AI problems. Nowadays, more people have started to understand the limitations and can see how far we are from general or strong AI. The focus thus turns to robust engineered solutions that make use of well-known techniques. This revolution is currently being led by technology companies and mostly being implemented by data scientists. This is why data scientists are among the most sought-after professions nowadays. Data scientists understand data and know how to create ML models that discover hidden patterns in large data repositories. They are enthusiastic about fine-tuning models and finding the right parameters for a specific scenario. However, data science is not enough for organizations to benefit from ML in production. We are seeing a process of democratization of ML: various platforms and libraries are lowering the barrier to the incorporation of ML in non-technology companies. From my point of view, the data-science and experimental part of ML will be less relevant and good leadership and engineering practices will make all the difference. The ML industry therefore also needs a new kind of profiles corresponding to leadership and engineering. There is a huge difference between building a ML model for a specific task and embedding such a model in the heart of an organization. In other words, there is a huge gap between having a model that works in the lab and preparing a model for people to use in their products and services. Most organizations nowadays aim to include ML in their businesses, but few are effectively embedding those models into the organization's actual processes. As ML has matured, it has become clear that leadership and software engineering are essential to any ML initiative. Although most attention has been focused on data science, specialized leadership and engineering are also needed in order to bring ML into the heart of industrial organizations. The machine learning industry needs a new kind of profiles corresponding to leadership and engineering Software engineers are responsible for embedding ML into production IT systems in order to make model outputs actionable for businesses. This requires integration with data sources, automation of ML workflow, and links between ML predictions and production IT systems. Leadership and business development are essential to the ML lifecycle. ML initiatives must be driven by the needs and goals specified by business developers. This new job requires a new type of leadership with knowledge of ML from a business point of view. New leadership should: - Understand the overall ML lifecycle, from problem definition to maintenance in production. - Be familiar with the main types of ML models, in particular what they do, what they need and what output they produce. - Understand the various ways to evaluate a model in order to estimate the benefit for the business of a given model and task. - Be able to interpret a model that is gaining new knowledge of a domain in order to improve decision-making. - Understand that ML is based on an experimental science that is not yet automated or industrialized. ML projects should therefore be managed iteratively to deal with uncertainty. There is no doubt that ML is changing all sorts of organizations in unprecedented ways. In the recent years, most attention has focused on data science, which is the expertise needed to develop models in order to discover hidden patterns in large datasets. However, this new era requires a new type of leadership and engineering that is capable of a) making business sense out of ML through new actionable business insights, and b) bringing ML models into production IT systems at the heart of organizations. About the author Marc Torrens is a computer science engineer from the Polytechnic University of Catalonia in Barcelona. He holds a PhD in Artificial Intelligence from the Swiss Federal Institute of Technology in Lausanne. Prof. Torrens has published more than 20 papers in journals and has attended numerous international conferences. He is also the inventor of more than 20 patents on recommendation and personalization technologies. Prof. Torrens's research focuses on how artificial intelligence can be applied to solve problems that people and businesses commonly face. He is convinced that artificial intelligence technology will help humans overcome longstanding challenges and dramatically improve our lives.

ESADE

Back to home

Leadership and engineering: the missing pieces in the machine learning era

04/2019


Marc Torrens


Lecturer, Department of Operations, Innovation & Data Sciences




The most sought-after profession at any organization interested in implementing machine learning is that of data scientist. Leadership and engineering are essential, but their role in the successful deployment of machine-learning models in production is often overlooked. Nowadays, industry is realizing that the only valid machine-learned models are those in production. In this article, we discuss how leadership and engineering are essential to monetizing machine-learning initiatives.


Nowadays, we refer to the capability of machines to be extremely competitive at a specific task in a particular domain as artificial intelligence (AI). As Daniel Dennett argues in his book From Bacteria to Bach and Back: The Evolution of Minds, we are creating extremely competent machines that have no understanding of the world whatsoever. Nonetheless, machine learning (ML) - a subfield of AI - is transforming all sorts of organizations, businesses and government bodies in unprecedented ways.


This is a natural consequence of two factors: a) the availability of data as a result of the digitization of words, and b) an increase in computing power. Both of these factors are growing at an exponential pace, so this is just the beginning of a new ML age. However, although the press surprises us every day with new ML applications that perform better than experts at certain specific tasks, ML techniques are reaching a plateau.


Machine learning is transforming all sorts of organizations, businesses and governments in unprecedented ways


The innovations produced at the global scale are merely incremental. A few years back, most newcomers to the field saw deep learning as the solution to all AI problems. Nowadays, more people have started to understand the limitations and can see how far we are from general or strong AI. The focus thus turns to robust engineered solutions that make use of well-known techniques.


This revolution is currently being led by technology companies and mostly being implemented by data scientists. This is why data scientists are among the most sought-after professions nowadays. Data scientists understand data and know how to create ML models that discover hidden patterns in large data repositories. They are enthusiastic about fine-tuning models and finding the right parameters for a specific scenario.



However, data science is not enough for organizations to benefit from ML in production. We are seeing a process of democratization of ML: various platforms and libraries are lowering the barrier to the incorporation of ML in non-technology companies. From my point of view, the data-science and experimental part of ML will be less relevant and good leadership and engineering practices will make all the difference. The ML industry therefore also needs a new kind of profiles corresponding to leadership and engineering.


There is a huge difference between building a ML model for a specific task and embedding such a model in the heart of an organization. In other words, there is a huge gap between having a model that works in the lab and preparing a model for people to use in their products and services. Most organizations nowadays aim to include ML in their businesses, but few are effectively embedding those models into the organization's actual processes.


As ML has matured, it has become clear that leadership and software engineering are essential to any ML initiative. Although most attention has been focused on data science, specialized leadership and engineering are also needed in order to bring ML into the heart of industrial organizations.


The machine learning industry needs a new kind of profiles corresponding to leadership and engineering


Software engineers are responsible for embedding ML into production IT systems in order to make model outputs actionable for businesses. This requires integration with data sources, automation of ML workflow, and links between ML predictions and production IT systems.


Leadership and business development are essential to the ML lifecycle. ML initiatives must be driven by the needs and goals specified by business developers. This new job requires a new type of leadership with knowledge of ML from a business point of view. New leadership should:


- Understand the overall ML lifecycle, from problem definition to maintenance in production.


- Be familiar with the main types of ML models, in particular what they do, what they need and what output they produce.


- Understand the various ways to evaluate a model in order to estimate the benefit for the business of a given model and task.


- Be able to interpret a model that is gaining new knowledge of a domain in order to improve decision-making.


- Understand that ML is based on an experimental science that is not yet automated or industrialized. ML projects should therefore be managed iteratively to deal with uncertainty.


There is no doubt that ML is changing all sorts of organizations in unprecedented ways. In the recent years, most attention has focused on data science, which is the expertise needed to develop models in order to discover hidden patterns in large datasets. However, this new era requires a new type of leadership and engineering that is capable of a) making business sense out of ML through new actionable business insights, and b) bringing ML models into production IT systems at the heart of organizations.


About the author


Marc Torrens is a computer science engineer from the Polytechnic University of Catalonia in Barcelona. He holds a PhD in Artificial Intelligence from the Swiss Federal Institute of Technology in Lausanne. Prof. Torrens has published more than 20 papers in journals and has attended numerous international conferences. He is also the inventor of more than 20 patents on recommendation and personalization technologies. 


Prof. Torrens's research focuses on how artificial intelligence can be applied to solve problems that people and businesses commonly face. He is convinced that artificial intelligence technology will help humans overcome longstanding challenges and dramatically improve our lives.

More Knowledge
Free double hierarchy hesitant fuzzy linguistic term sets: An application on ranking alternatives in GDM
Montserrat Adell, Jordi; Xu , Zeshui; Gou , Xunjie; Agell Jan, Nria
Information Fusion
N 47, 05/2019, p. 45 - 59
La inteligencia artificial: el camino hacia la ultrainteligencia
Parra , Sergio; Torrens Arnal, Marc
Barcelona (Spain): RBA, 11/2017
143 p.
Desafos de la ciencia. National Geographic.; ; n 6
Banking on innovation through data
Torrens Arnal, Marc
In The FinTech Book
Barcelona (Spain): John Wiley & Sons, Ltd, 2016
p. 232 - 234
Back to home