{"id":287,"date":"2019-02-11T10:13:06","date_gmt":"2019-02-11T09:13:06","guid":{"rendered":"https:\/\/www.codemotion.com\/magazine\/ai-with-a-devops-mindset\/"},"modified":"2020-01-31T11:32:01","modified_gmt":"2020-01-31T10:32:01","slug":"ai-with-a-devops-mindset","status":"publish","type":"post","link":"https:\/\/www.codemotion.com\/magazine\/ai-ml\/machine-learning\/ai-with-a-devops-mindset\/","title":{"rendered":"AI with a devOps mindset: Thiago De Faria on how to unlock the full potential of Machine Learning"},"content":{"rendered":"

D<\/span>igital transformation is changing the business world, making the role of IT and information technology<\/span> more and more central and inalienable. The new needs and the new technologies required by the product teams to the technical teams<\/span> are creating contaminations of roles, skills and knowledge<\/span>, bringing together people who until now have never worked too closely together.<\/p>\n

A recent example of this contamination comes from the increasing requests and solutions based on Artificial Intelligence<\/span> and Machine Learning<\/span>, which led to teams<\/span> incorporating a “new” technical figure: the data scientist.<\/p>\n

Over the years, we have witnessed the birth and consolidation of practices and tools designed to encourage conversation between all the different components of the team (product, development, operations). The advent of a new figure like the data scientist introduces into the choir a new voice that, by custom, is moulded to work in a different way.<\/p>\n

\"\"<\/a><\/p>\n

Thiago De Faria, in his talk at Codemotion Milan 2018<\/a>, highlighted how the DevOps culture, based on experimentation, continuous evaluation, sharing and automation, can be the key to unlocking the full potential of ML, AI, and data scientists within a company<\/span>.<\/p>\n

What data scientists do for AI<\/h2>\n

The traditional approach to solutions based on AI and ML involves a phase of exploration and cleaning of the available data<\/span> and, in the event that there is something useful in the data<\/span>, the construction and the development of a model based on this data<\/span>.
\nThe solutions based on AI and ML are obviously characterised by not relying on a predefined set of “if then else” conditions, which makes them on the one hand more difficult to debug (it is not possible to identify the point of the error) and, on the other, heavily dependent on the validity of the starting data.<\/p>\n

\"\"<\/a><\/p>\n

When an AI \/ ML solution is implemented in and for the “business”, in addition to the most common known issues – brownfield, data change, businesses not knowing what they want\/need, deployment and monitoring – more specific issues are added.
\nMost of those new issues are largely attributable to the different methodologies with which data scientists are used to work. For instance, data scientists could have a poor approach towards code management; they are more accustomed with local development and without versioning. Working within a business-driven organisation requires documenting your work for the next people, packaging it to deploy on production and measuring its effectiveness from end-user feedback.<\/p>\n

Of course, there is no silver bullet, as Thiago said, but a cultural change and new ways of working can really save the day. The most effective source of inspiration is the DevOps culture.<\/p>\n

Fighting Bias, Drift and Fragility with Culture, Automation, Measurement and Sharing<\/h2>\n

The DevOps movement has taught us that collaboration – cross-functional collaboration – is the foundation of successful teams<\/span>. Involving data scientists in discussions is the first necessary step. Likewise, data scientists must allow team members to understand the specificity of their role and knowledge.<\/p>\n

Furthermore, data scientists can take advantage of the methodologies and practices refined in the past decades by software development teams and bring them back into their workflow. The first step to do this is to admit, as Thiago says, that “local data science is dead”.<\/p>\n

It is, therefore, useful and necessary to leave your laptop and move to the cloud, or at least to a shared environment, and set a ML development pipeline from day one to allow continuous evaluation of the model.<\/p>\n

\n

Coding at Room 3 with @thiagoavadore<\/a> @LINKITGroup<\/a> #AI<\/a> #MachineLearning<\/a> #DeepLearning<\/a> #codemotion<\/a> pic.twitter.com\/KyrCbTZHLX<\/a><\/p>\n

\u2014 Codemotion (@CodemotionIT) November 29, 2018<\/a><\/p><\/blockquote>\n