{"id":104,"date":"2019-05-30T10:32:50","date_gmt":"2019-05-30T10:32:50","guid":{"rendered":"https:\/\/www.codemotion.com\/magazine\/machine-learning-and-fairness-how-to-make-it-happen\/"},"modified":"2020-01-31T11:19:17","modified_gmt":"2020-01-31T10:19:17","slug":"machine-learning-and-fairness-how-to-make-it-happen","status":"publish","type":"post","link":"https:\/\/www.codemotion.com\/magazine\/ai-ml\/machine-learning\/machine-learning-and-fairness-how-to-make-it-happen\/","title":{"rendered":"Machine learning and fairness, how to make it happen"},"content":{"rendered":"<p><span id=\"urn:batch-analysis-248763c2-24b2-4861-867d-28d5a5c7a48b\" class=\"textannotation disambiguated wl-no-link wl-other\" itemid=\"http:\/\/data.wordlift.io\/wl01770\/entity\/machine_learning\">Machine Learning<\/span> is an awesome tool and really affects our lives. But how can we be sure that a machine\u2019s choices are fair? Let&#8217;s take a look and find out together.<\/p>\n<h2>Why do we care about bias?<\/h2>\n<p>Commonly, machines are considered almost faultless and for this reason we think that their decisions aren\u2019t conditioned by <strong>prejudices<\/strong>. Unfortunately, this is completely wrong and <a href=\"https:\/\/events.codemotion.com\/conferences\/rome\/2019\/speaker\/2251\/\" rel=\"noopener noreferrer\" target=\"_blank\">Azzurra Ragone<\/a>, Innovation Manager and previously Program Manager at <span id=\"urn:batch-analysis-43a2091f-020f-4ae1-8b53-1e4c42e775a2\" class=\"textannotation disambiguated wl-no-link wl-other\" itemid=\"http:\/\/data.wordlift.io\/wl01770\/entity\/google\">Google<\/span>, explained to us why in her talk at <a href=\"https:\/\/events.codemotion.com\/conferences\/rome\/2019\/agenda\/\" rel=\"noopener noreferrer\" target=\"_blank\">Codemotion Rome 2019<\/a>.<\/p>\n<p><iframe loading=\"lazy\" title=\"Azzurra Ragone | Fairness in Machine Learning | Codemotion Rome 2019\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube-nocookie.com\/embed\/6mFUGMJJc3s?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/p>\n<p><span id=\"urn:batch-analysis-bd3fc833-c305-4fff-8dca-3e6d04f06157\" class=\"textannotation disambiguated wl-no-link wl-other\" itemid=\"http:\/\/data.wordlift.io\/wl01770\/entity\/machine_learning\">Machine Learning<\/span> algorithms, just like any other simpler algorithms, are made by people and discrimination is in <span id=\"urn:batch-analysis-9c429cdf-325f-470b-9021-c4c03a525b4a\" class=\"textannotation disambiguated wl-no-link wl-other\" itemid=\"http:\/\/data.wordlift.io\/wl01770\/entity\/human_nature\">human nature<\/span>. Taking that into account, we can imagine why it is pretty easy for a certain <span id=\"urn:batch-analysis-339e257b-3796-49ec-bb7b-501274498b30\" class=\"textannotation disambiguated wl-no-link wl-other\" itemid=\"http:\/\/data.wordlift.io\/wl01770\/entity\/belief\">belief<\/span> to pass on to an <span id=\"urn:batch-analysis-f61b1478-41c4-48a8-87cc-c0e105e5cf82\" class=\"textannotation disambiguated wl-no-link wl-other\" itemid=\"http:\/\/data.wordlift.io\/wl01770\/entity\/artificial_intelligence\">Artificial Intelligence<\/span>.<\/p>\n<p>The question now is: should we care? Just try to imagine a situation where a <strong>life-changing decision<\/strong> is made by a machine. We are so used to others taking decisions for us, like a school admission, that we take for granted the fairness of their choice. But machines don\u2019t know fairness, at least until we teach it to them.<\/p>\n<p>In their book \u201cFairness and Machine Learning\u201d, Solon Barocas, Moritz Hardt and Arvind Narayanan wrote:<\/p>\n<p><q>Arbitrary, inconsistent, or faulty <span id=\"urn:batch-analysis-5dce6f9b-6292-4a5c-9900-375a445fcb73\" class=\"textannotation disambiguated wl-no-link wl-other\" itemid=\"http:\/\/data.wordlift.io\/wl01770\/entity\/decision-making\">decision-making<\/span> thus raises serious concerns because it risks limiting our ability to achieve the goals that we have set for ourselves and access the opportunities for which we are qualified.<\/q><\/p>\n<p>One example is the <strong>geo-bias<\/strong>, a very frequent problem that originates from the western-centered world we live in. For instance, ImageNet, an image database organized by <span id=\"urn:batch-analysis-6a300f92-8d6d-449b-842f-424ab6beee8c\" class=\"textannotation disambiguated wl-no-link wl-other\" itemid=\"http:\/\/data.wordlift.io\/wl01770\/entity\/machine_learning\">Machine Learning<\/span>, has 45% of its images coming from the USA (4% of world population) while China and India (36% of world population) generate a mere 3% of images. The deficiency in culture variety leads to huge misunderstanding, like an Indian bridal dress being mistaken for a performer\u2019s dress and so on.<\/p>\n<p>This happens because a <span id=\"urn:batch-analysis-d1fdde3a-c5e7-491b-bbcd-efd1394ee8c5\" class=\"textannotation disambiguated wl-no-link wl-other\" itemid=\"http:\/\/data.wordlift.io\/wl01770\/entity\/machine_learning\">Machine Learning<\/span> system works very well only if it is trained with <strong>large amounts of <span id=\"urn:batch-analysis-b2d6d532-d69b-41dd-a563-84e7ceb1e885\" class=\"textannotation disambiguated wl-no-link wl-other\" itemid=\"http:\/\/data.wordlift.io\/wl01770\/entity\/data\">data<\/span><\/strong>. The obvious consequence is that minorities are not fairly represented by AIs.<\/p>\n<p>Then how do they learn <span id=\"urn:batch-analysis-e05f62f4-c952-48b4-9745-e6a6cb779203\" class=\"textannotation disambiguated wl-no-link wl-other\" itemid=\"http:\/\/data.wordlift.io\/wl01770\/entity\/data\">data<\/span>?<\/p>\n<h2>The Machine Learning Loop<\/h2>\n<p>To describe how an AI learns, we use the <strong><span id=\"urn:batch-analysis-a56dfe38-9627-48ba-9fbf-0029d58ebf67\" class=\"textannotation disambiguated wl-no-link wl-other\" itemid=\"http:\/\/data.wordlift.io\/wl01770\/entity\/machine_learning\">Machine Learning<\/span> Loop<\/strong>.<\/p>\n<p>The process is very simple: we start from the current <strong>state of the World<\/strong> and, by measurement, we acquire <strong><span id=\"urn:batch-analysis-95804fb1-65bb-470d-a91b-d60c7ca207f7\" class=\"textannotation disambiguated wl-no-link wl-other\" itemid=\"http:\/\/data.wordlift.io\/wl01770\/entity\/data\">Data<\/span><\/strong>. Then, a <strong>Model<\/strong> is produced by learning. Next, an effect is produced on Individuals by models\u2019 actions and a successive feedback modifies the Model. Eventually, the state of the World will change and the Loop will start again.<\/p>\n<p>Let\u2019s look closer at the various steps.<\/p>\n<p>Talking about <strong>measurement<\/strong>, we have to keep in mind that the origin of <span id=\"urn:batch-analysis-d555bf0a-8ebc-4913-bd8f-8e381f0651b9\" class=\"textannotation disambiguated wl-no-link wl-other\" itemid=\"http:\/\/data.wordlift.io\/wl01770\/entity\/data\">data<\/span> is vital. Variables of interest, the process to transform observation into numbers, the data collection itself. Everything must be strictly defined.<\/p>\n<p>However, the most critical phase, in which biases are easily introduced, is certainly the <strong>learning<\/strong> one. At this stage, our AI gains knowledge and information, but also prejudices and stereotypes. Using <span id=\"urn:batch-analysis-9d1fe09b-8ed9-41eb-9bf1-9c1274b9d260\" class=\"textannotation disambiguated wl-no-link wl-other\" itemid=\"http:\/\/data.wordlift.io\/wl01770\/entity\/google\">Google<\/span> Translator as an example, the famous online interpreter, when translating from a gender-neutral language to English, it tends to associate doctors with men and nurses with women.<\/p>\n<p>Moving on to the <strong>action<\/strong> segment, <span id=\"urn:batch-analysis-86e07fdd-ea6b-47ef-8b0d-5426e649627e\" class=\"textannotation disambiguated wl-no-link wl-other\" itemid=\"http:\/\/data.wordlift.io\/wl01770\/entity\/machine_learning\">Machine Learning<\/span> ranges from prediction to classification and each functionality can affect human life in serious ways. <span id=\"urn:batch-analysis-d747063c-3709-4e55-bc72-edbd42617bbd\" class=\"textannotation disambiguated wl-no-link wl-other\" itemid=\"http:\/\/data.wordlift.io\/wl01770\/entity\/bias\">Bias<\/span> isn\u2019t generated in this phase but, of course, its effects take place.<\/p>\n<p><strong>Feedback<\/strong> is again a critical zone and it is essential to properly design the auto-correction strategy. In fact, wrong error management can lead to unexpected and, above all, unwanted results. For example, we should avoid self-fulfilling feedback loops, an event that occurs when <span id=\"urn:batch-analysis-3c97a07d-9150-433d-a418-fc114768749a\" class=\"textannotation disambiguated wl-no-link wl-other\" itemid=\"http:\/\/data.wordlift.io\/wl01770\/entity\/data\">data<\/span>, discovered on the basis of predictions, is used to update the model. Case in point, a crime-predicting AI could increase <span id=\"urn:batch-analysis-228a33d7-134a-40b3-9722-6226f3151ede\" class=\"textannotation disambiguated wl-no-link wl-other\" itemid=\"http:\/\/data.wordlift.io\/wl01770\/entity\/security\">security<\/span> in high-crime zones, leading to a rise in minor crime detection. But this will eventually increase crime rates, causing a disproportion in <span id=\"urn:batch-analysis-9b7a5f63-ecd6-4e80-a910-af2d7fb818a1\" class=\"textannotation disambiguated wl-no-link wl-other\" itemid=\"http:\/\/data.wordlift.io\/wl01770\/entity\/security\">security<\/span>.<\/p>\n<h2>How do we avoid bias?<\/h2>\n<p>Completely eliminating <span id=\"urn:batch-analysis-2089a78f-ba81-4220-b13e-9958f22a968f\" class=\"textannotation disambiguated wl-no-link wl-other\" itemid=\"http:\/\/data.wordlift.io\/wl01770\/entity\/bias\">bias<\/span> is a very difficult task, but finding and fixing it is a realistic goal. To achieve this, first we need to analyse our AI and look for clues. Are there any missing features? Are there any unexpected values? Are data sources unbalanced? If, for any of these questions, the answer is yes, we must immediately do something.<\/p>\n<p>One really useful tool in <span id=\"urn:batch-analysis-8d0f0375-1201-4f97-85c7-21e33e205a12\" class=\"textannotation disambiguated wl-no-link wl-other\" itemid=\"http:\/\/data.wordlift.io\/wl01770\/entity\/machine_learning\">Machine Learning<\/span> management is <strong>Facets<\/strong>. It helps explore <span id=\"urn:batch-analysis-b4ee4c69-1471-4b46-8214-655b8f0c3ff8\" class=\"textannotation disambiguated wl-no-link wl-other\" itemid=\"http:\/\/data.wordlift.io\/wl01770\/entity\/data\">data<\/span> and gives us a clear representation of values distribution, like the quantity of samples for each gender and age, making us aware which segment is poorly trained.<\/p>\n<p><img decoding=\"async\" class=\"aligncenter wp-image-2474 size-full\" src=\"https:\/\/www.codemotion.com\/magazine\/wp-content\/uploads\/2019\/05\/Screen-Shot-2019-05-30-at-12.32.52.png\" alt=\"\"><\/p>\n<p>Let\u2019s take a tumor-prediction model: evaluating it with Facets, we could notice that male patients are less likely to have a precise diagnosis than their female counterparts. How can we solve this? Just feed the model with more male patients\u2019 <span id=\"urn:batch-analysis-2e8d6625-6c02-4960-8da1-11da64b9a614\" class=\"textannotation disambiguated wl-no-link wl-other\" itemid=\"http:\/\/data.wordlift.io\/wl01770\/entity\/data\">data<\/span>.<\/p>\n<p>Another great tool to integrate Facets is <strong>What-if<\/strong>. It extends Facets with a more immediate visual interface and datapoint correlation. Also, it can compare different models\u2019 <span id=\"urn:batch-analysis-09497674-0ffd-46f0-8160-7c403270217f\" class=\"textannotation disambiguated wl-no-link wl-other\" itemid=\"http:\/\/data.wordlift.io\/wl01770\/entity\/performance\">performances<\/span>, making very easy to choose which one is more suitable for our purpose. And last, but not least, What-if incorporates different <strong>Fairness-Testing tools<\/strong> that help us achieve fairness smoothly.<\/p>\n<p>Finally, we have a more basic <span id=\"urn:batch-analysis-6bd6cc8d-c933-4fb0-94c3-49976942bbb3\" class=\"textannotation disambiguated wl-no-link wl-other\" itemid=\"http:\/\/data.wordlift.io\/wl01770\/entity\/strategy\">strategy<\/span> to avoid <span id=\"urn:batch-analysis-03e367fa-668a-483d-9291-2c6cff55522a\" class=\"textannotation disambiguated wl-no-link wl-other\" itemid=\"http:\/\/data.wordlift.io\/wl01770\/entity\/bias\">bias<\/span> so, let\u2019s try it. After all, technology should be a service for all of us.<br \/>\nAnd remember, as Kate Crawford and Ryan Calo wrote in \u201cThere is a blind spot in AI research\u201d:<\/p>\n<p><q>AI is a cultural shift as much as a technical one. Autonomous systems are changing <span id=\"urn:batch-analysis-dbe8f99a-b613-4554-b447-8cdcfa0faa59\" class=\"textannotation disambiguated wl-no-link wl-other\" itemid=\"http:\/\/data.wordlift.io\/wl01770\/entity\/workplace\">workplaces<\/span>, streets and schools. We need to ensure that those changes are beneficial, before they are built further into the infrastructure of <span id=\"urn:batch-analysis-d2f794b2-f078-458d-a354-c3269185327c\" class=\"textannotation disambiguated wl-no-link wl-other\" itemid=\"http:\/\/data.wordlift.io\/wl01770\/entity\/everyday_life\">everyday life<\/span>.<\/q><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Machine Learning is an awesome tool and really affects our lives. But how can we be sure that a machine\u2019s choices are fair? Let&#8217;s take a look and find out together. Why do we care about bias? Commonly, machines are considered almost faultless and for this reason we think that their decisions aren\u2019t conditioned by&#8230; <a class=\"more-link\" href=\"https:\/\/www.codemotion.com\/magazine\/ai-ml\/machine-learning\/machine-learning-and-fairness-how-to-make-it-happen\/\">Read more<\/a><\/p>\n","protected":false},"author":18,"featured_media":105,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_editorskit_title_hidden":false,"_editorskit_reading_time":0,"_editorskit_is_block_options_detached":false,"_editorskit_block_options_position":"{}","_uag_custom_page_level_css":"","_genesis_hide_title":false,"_genesis_hide_breadcrumbs":false,"_genesis_hide_singular_image":false,"_genesis_hide_footer_widgets":false,"_genesis_custom_body_class":"","_genesis_custom_post_class":"","_genesis_layout":"","footnotes":""},"categories":[35],"tags":[4],"collections":[],"class_list":{"0":"post-104","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-machine-learning","8":"tag-codemotion-rome","9":"entry"},"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v26.9 (Yoast SEO v27.5) - https:\/\/yoast.com\/product\/yoast-seo-premium-wordpress\/ -->\n<title>Machine learning and fairness, how to make it happen - Codemotion Magazine<\/title>\n<meta name=\"description\" content=\"Codemotion and Facebook organized the Tech Leadership Training boot camp, heres a personal reportage from one of our attendees.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.codemotion.com\/magazine\/ai-ml\/machine-learning\/machine-learning-and-fairness-how-to-make-it-happen\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Machine learning and fairness, how to make it happen\" \/>\n<meta property=\"og:description\" content=\"Codemotion and Facebook organized the Tech Leadership Training boot camp, heres a personal reportage from one of our attendees.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.codemotion.com\/magazine\/ai-ml\/machine-learning\/machine-learning-and-fairness-how-to-make-it-happen\/\" \/>\n<meta property=\"og:site_name\" content=\"Codemotion Magazine\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/Codemotion.Italy\/\" \/>\n<meta property=\"article:published_time\" content=\"2019-05-30T10:32:50+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2020-01-31T10:19:17+00:00\" \/>\n<meta name=\"author\" content=\"Valerio Bernardi\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:image\" content=\"https:\/\/www.codemotion.com\/magazine\/wp-content\/uploads\/2019\/05\/091617_learning-machine_feat-1.jpg\" \/>\n<meta name=\"twitter:creator\" content=\"@CodemotionIT\" \/>\n<meta name=\"twitter:site\" content=\"@CodemotionIT\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Valerio Bernardi\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/ai-ml\\\/machine-learning\\\/machine-learning-and-fairness-how-to-make-it-happen\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/ai-ml\\\/machine-learning\\\/machine-learning-and-fairness-how-to-make-it-happen\\\/\"},\"author\":{\"name\":\"Valerio Bernardi\",\"@id\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/#\\\/schema\\\/person\\\/a194cd70b3fa57d323a992c19691159f\"},\"headline\":\"Machine learning and fairness, how to make it happen\",\"datePublished\":\"2019-05-30T10:32:50+00:00\",\"dateModified\":\"2020-01-31T10:19:17+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/ai-ml\\\/machine-learning\\\/machine-learning-and-fairness-how-to-make-it-happen\\\/\"},\"wordCount\":952,\"publisher\":{\"@id\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/ai-ml\\\/machine-learning\\\/machine-learning-and-fairness-how-to-make-it-happen\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/wp-content\\\/uploads\\\/2019\\\/05\\\/091617_learning-machine_feat-1.jpg\",\"keywords\":[\"Codemotion Rome\"],\"articleSection\":[\"Machine Learning\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/ai-ml\\\/machine-learning\\\/machine-learning-and-fairness-how-to-make-it-happen\\\/\",\"url\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/ai-ml\\\/machine-learning\\\/machine-learning-and-fairness-how-to-make-it-happen\\\/\",\"name\":\"Machine learning and fairness, how to make it happen - Codemotion Magazine\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/ai-ml\\\/machine-learning\\\/machine-learning-and-fairness-how-to-make-it-happen\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/ai-ml\\\/machine-learning\\\/machine-learning-and-fairness-how-to-make-it-happen\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/wp-content\\\/uploads\\\/2019\\\/05\\\/091617_learning-machine_feat-1.jpg\",\"datePublished\":\"2019-05-30T10:32:50+00:00\",\"dateModified\":\"2020-01-31T10:19:17+00:00\",\"description\":\"Codemotion and Facebook organized the Tech Leadership Training boot camp, heres a personal reportage from one of our attendees.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/ai-ml\\\/machine-learning\\\/machine-learning-and-fairness-how-to-make-it-happen\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/ai-ml\\\/machine-learning\\\/machine-learning-and-fairness-how-to-make-it-happen\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/ai-ml\\\/machine-learning\\\/machine-learning-and-fairness-how-to-make-it-happen\\\/#primaryimage\",\"url\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/wp-content\\\/uploads\\\/2019\\\/05\\\/091617_learning-machine_feat-1.jpg\",\"contentUrl\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/wp-content\\\/uploads\\\/2019\\\/05\\\/091617_learning-machine_feat-1.jpg\",\"width\":860,\"height\":460,\"caption\":\"machine learning fairness concept\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/ai-ml\\\/machine-learning\\\/machine-learning-and-fairness-how-to-make-it-happen\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"AI\\\/ML\",\"item\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/ai-ml\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Machine Learning\",\"item\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/ai-ml\\\/machine-learning\\\/\"},{\"@type\":\"ListItem\",\"position\":4,\"name\":\"Machine learning and fairness, how to make it happen\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/#website\",\"url\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/\",\"name\":\"Codemotion Magazine\",\"description\":\"We code the future. Together\",\"publisher\":{\"@id\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/#organization\",\"name\":\"Codemotion\",\"url\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/wp-content\\\/uploads\\\/2019\\\/11\\\/codemotionlogo.png\",\"contentUrl\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/wp-content\\\/uploads\\\/2019\\\/11\\\/codemotionlogo.png\",\"width\":225,\"height\":225,\"caption\":\"Codemotion\"},\"image\":{\"@id\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/Codemotion.Italy\\\/\",\"https:\\\/\\\/x.com\\\/CodemotionIT\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/#\\\/schema\\\/person\\\/a194cd70b3fa57d323a992c19691159f\",\"name\":\"Valerio Bernardi\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/c6da4dc781eeca8a2e8ba25141d78c8d2e10c832c2e29231ab23be4b155bf538?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/c6da4dc781eeca8a2e8ba25141d78c8d2e10c832c2e29231ab23be4b155bf538?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/c6da4dc781eeca8a2e8ba25141d78c8d2e10c832c2e29231ab23be4b155bf538?s=96&d=mm&r=g\",\"caption\":\"Valerio Bernardi\"},\"description\":\"Valerio Bernardi is a Computer Engineering Student at Roma 3 University (Rome), with a passion for innovation and video games. Tech writer since 2015., his field his automation, ranging between industries and AI.\",\"url\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/author\\\/valerio-bernardi\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Machine learning and fairness, how to make it happen - Codemotion Magazine","description":"Codemotion and Facebook organized the Tech Leadership Training boot camp, heres a personal reportage from one of our attendees.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.codemotion.com\/magazine\/ai-ml\/machine-learning\/machine-learning-and-fairness-how-to-make-it-happen\/","og_locale":"en_US","og_type":"article","og_title":"Machine learning and fairness, how to make it happen","og_description":"Codemotion and Facebook organized the Tech Leadership Training boot camp, heres a personal reportage from one of our attendees.","og_url":"https:\/\/www.codemotion.com\/magazine\/ai-ml\/machine-learning\/machine-learning-and-fairness-how-to-make-it-happen\/","og_site_name":"Codemotion Magazine","article_publisher":"https:\/\/www.facebook.com\/Codemotion.Italy\/","article_published_time":"2019-05-30T10:32:50+00:00","article_modified_time":"2020-01-31T10:19:17+00:00","author":"Valerio Bernardi","twitter_card":"summary_large_image","twitter_image":"https:\/\/www.codemotion.com\/magazine\/wp-content\/uploads\/2019\/05\/091617_learning-machine_feat-1.jpg","twitter_creator":"@CodemotionIT","twitter_site":"@CodemotionIT","twitter_misc":{"Written by":"Valerio Bernardi","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.codemotion.com\/magazine\/ai-ml\/machine-learning\/machine-learning-and-fairness-how-to-make-it-happen\/#article","isPartOf":{"@id":"https:\/\/www.codemotion.com\/magazine\/ai-ml\/machine-learning\/machine-learning-and-fairness-how-to-make-it-happen\/"},"author":{"name":"Valerio Bernardi","@id":"https:\/\/www.codemotion.com\/magazine\/#\/schema\/person\/a194cd70b3fa57d323a992c19691159f"},"headline":"Machine learning and fairness, how to make it happen","datePublished":"2019-05-30T10:32:50+00:00","dateModified":"2020-01-31T10:19:17+00:00","mainEntityOfPage":{"@id":"https:\/\/www.codemotion.com\/magazine\/ai-ml\/machine-learning\/machine-learning-and-fairness-how-to-make-it-happen\/"},"wordCount":952,"publisher":{"@id":"https:\/\/www.codemotion.com\/magazine\/#organization"},"image":{"@id":"https:\/\/www.codemotion.com\/magazine\/ai-ml\/machine-learning\/machine-learning-and-fairness-how-to-make-it-happen\/#primaryimage"},"thumbnailUrl":"https:\/\/www.codemotion.com\/magazine\/wp-content\/uploads\/2019\/05\/091617_learning-machine_feat-1.jpg","keywords":["Codemotion Rome"],"articleSection":["Machine Learning"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.codemotion.com\/magazine\/ai-ml\/machine-learning\/machine-learning-and-fairness-how-to-make-it-happen\/","url":"https:\/\/www.codemotion.com\/magazine\/ai-ml\/machine-learning\/machine-learning-and-fairness-how-to-make-it-happen\/","name":"Machine learning and fairness, how to make it happen - Codemotion Magazine","isPartOf":{"@id":"https:\/\/www.codemotion.com\/magazine\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.codemotion.com\/magazine\/ai-ml\/machine-learning\/machine-learning-and-fairness-how-to-make-it-happen\/#primaryimage"},"image":{"@id":"https:\/\/www.codemotion.com\/magazine\/ai-ml\/machine-learning\/machine-learning-and-fairness-how-to-make-it-happen\/#primaryimage"},"thumbnailUrl":"https:\/\/www.codemotion.com\/magazine\/wp-content\/uploads\/2019\/05\/091617_learning-machine_feat-1.jpg","datePublished":"2019-05-30T10:32:50+00:00","dateModified":"2020-01-31T10:19:17+00:00","description":"Codemotion and Facebook organized the Tech Leadership Training boot camp, heres a personal reportage from one of our attendees.","breadcrumb":{"@id":"https:\/\/www.codemotion.com\/magazine\/ai-ml\/machine-learning\/machine-learning-and-fairness-how-to-make-it-happen\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.codemotion.com\/magazine\/ai-ml\/machine-learning\/machine-learning-and-fairness-how-to-make-it-happen\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.codemotion.com\/magazine\/ai-ml\/machine-learning\/machine-learning-and-fairness-how-to-make-it-happen\/#primaryimage","url":"https:\/\/www.codemotion.com\/magazine\/wp-content\/uploads\/2019\/05\/091617_learning-machine_feat-1.jpg","contentUrl":"https:\/\/www.codemotion.com\/magazine\/wp-content\/uploads\/2019\/05\/091617_learning-machine_feat-1.jpg","width":860,"height":460,"caption":"machine learning fairness concept"},{"@type":"BreadcrumbList","@id":"https:\/\/www.codemotion.com\/magazine\/ai-ml\/machine-learning\/machine-learning-and-fairness-how-to-make-it-happen\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.codemotion.com\/magazine\/"},{"@type":"ListItem","position":2,"name":"AI\/ML","item":"https:\/\/www.codemotion.com\/magazine\/ai-ml\/"},{"@type":"ListItem","position":3,"name":"Machine Learning","item":"https:\/\/www.codemotion.com\/magazine\/ai-ml\/machine-learning\/"},{"@type":"ListItem","position":4,"name":"Machine learning and fairness, how to make it happen"}]},{"@type":"WebSite","@id":"https:\/\/www.codemotion.com\/magazine\/#website","url":"https:\/\/www.codemotion.com\/magazine\/","name":"Codemotion Magazine","description":"We code the future. Together","publisher":{"@id":"https:\/\/www.codemotion.com\/magazine\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.codemotion.com\/magazine\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.codemotion.com\/magazine\/#organization","name":"Codemotion","url":"https:\/\/www.codemotion.com\/magazine\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.codemotion.com\/magazine\/#\/schema\/logo\/image\/","url":"https:\/\/www.codemotion.com\/magazine\/wp-content\/uploads\/2019\/11\/codemotionlogo.png","contentUrl":"https:\/\/www.codemotion.com\/magazine\/wp-content\/uploads\/2019\/11\/codemotionlogo.png","width":225,"height":225,"caption":"Codemotion"},"image":{"@id":"https:\/\/www.codemotion.com\/magazine\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/Codemotion.Italy\/","https:\/\/x.com\/CodemotionIT"]},{"@type":"Person","@id":"https:\/\/www.codemotion.com\/magazine\/#\/schema\/person\/a194cd70b3fa57d323a992c19691159f","name":"Valerio Bernardi","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/c6da4dc781eeca8a2e8ba25141d78c8d2e10c832c2e29231ab23be4b155bf538?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/c6da4dc781eeca8a2e8ba25141d78c8d2e10c832c2e29231ab23be4b155bf538?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/c6da4dc781eeca8a2e8ba25141d78c8d2e10c832c2e29231ab23be4b155bf538?s=96&d=mm&r=g","caption":"Valerio Bernardi"},"description":"Valerio Bernardi is a Computer Engineering Student at Roma 3 University (Rome), with a passion for innovation and video games. Tech writer since 2015., his field his automation, ranging between industries and AI.","url":"https:\/\/www.codemotion.com\/magazine\/author\/valerio-bernardi\/"}]}},"featured_image_src":"https:\/\/www.codemotion.com\/magazine\/wp-content\/uploads\/2019\/05\/091617_learning-machine_feat-1-600x400.jpg","featured_image_src_square":"https:\/\/www.codemotion.com\/magazine\/wp-content\/uploads\/2019\/05\/091617_learning-machine_feat-1-600x460.jpg","author_info":{"display_name":"Valerio Bernardi","author_link":"https:\/\/www.codemotion.com\/magazine\/author\/valerio-bernardi\/"},"uagb_featured_image_src":{"full":["https:\/\/www.codemotion.com\/magazine\/wp-content\/uploads\/2019\/05\/091617_learning-machine_feat-1.jpg",860,460,false],"thumbnail":["https:\/\/www.codemotion.com\/magazine\/wp-content\/uploads\/2019\/05\/091617_learning-machine_feat-1-150x150.jpg",150,150,true],"medium":["https:\/\/www.codemotion.com\/magazine\/wp-content\/uploads\/2019\/05\/091617_learning-machine_feat-1-300x160.jpg",300,160,true],"medium_large":["https:\/\/www.codemotion.com\/magazine\/wp-content\/uploads\/2019\/05\/091617_learning-machine_feat-1-768x411.jpg",768,411,true],"large":["https:\/\/www.codemotion.com\/magazine\/wp-content\/uploads\/2019\/05\/091617_learning-machine_feat-1.jpg",860,460,false],"1536x1536":["https:\/\/www.codemotion.com\/magazine\/wp-content\/uploads\/2019\/05\/091617_learning-machine_feat-1.jpg",860,460,false],"2048x2048":["https:\/\/www.codemotion.com\/magazine\/wp-content\/uploads\/2019\/05\/091617_learning-machine_feat-1.jpg",860,460,false],"small-home-featured":["https:\/\/www.codemotion.com\/magazine\/wp-content\/uploads\/2019\/05\/091617_learning-machine_feat-1.jpg",100,53,false],"sidebar-featured":["https:\/\/www.codemotion.com\/magazine\/wp-content\/uploads\/2019\/05\/091617_learning-machine_feat-1-180x128.jpg",180,128,true],"genesis-singular-images":["https:\/\/www.codemotion.com\/magazine\/wp-content\/uploads\/2019\/05\/091617_learning-machine_feat-1.jpg",860,460,false],"archive-featured":["https:\/\/www.codemotion.com\/magazine\/wp-content\/uploads\/2019\/05\/091617_learning-machine_feat-1-400x225.jpg",400,225,true],"gb-block-post-grid-landscape":["https:\/\/www.codemotion.com\/magazine\/wp-content\/uploads\/2019\/05\/091617_learning-machine_feat-1-600x400.jpg",600,400,true],"gb-block-post-grid-square":["https:\/\/www.codemotion.com\/magazine\/wp-content\/uploads\/2019\/05\/091617_learning-machine_feat-1-600x460.jpg",600,460,true]},"uagb_author_info":{"display_name":"Valerio Bernardi","author_link":"https:\/\/www.codemotion.com\/magazine\/author\/valerio-bernardi\/"},"uagb_comment_info":0,"uagb_excerpt":"Machine Learning is an awesome tool and really affects our lives. But how can we be sure that a machine\u2019s choices are fair? Let&#8217;s take a look and find out together. Why do we care about bias? Commonly, machines are considered almost faultless and for this reason we think that their decisions aren\u2019t conditioned by&#8230;&hellip;","lang":"en","_links":{"self":[{"href":"https:\/\/www.codemotion.com\/magazine\/wp-json\/wp\/v2\/posts\/104","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.codemotion.com\/magazine\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.codemotion.com\/magazine\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.codemotion.com\/magazine\/wp-json\/wp\/v2\/users\/18"}],"replies":[{"embeddable":true,"href":"https:\/\/www.codemotion.com\/magazine\/wp-json\/wp\/v2\/comments?post=104"}],"version-history":[{"count":3,"href":"https:\/\/www.codemotion.com\/magazine\/wp-json\/wp\/v2\/posts\/104\/revisions"}],"predecessor-version":[{"id":3097,"href":"https:\/\/www.codemotion.com\/magazine\/wp-json\/wp\/v2\/posts\/104\/revisions\/3097"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.codemotion.com\/magazine\/wp-json\/wp\/v2\/media\/105"}],"wp:attachment":[{"href":"https:\/\/www.codemotion.com\/magazine\/wp-json\/wp\/v2\/media?parent=104"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.codemotion.com\/magazine\/wp-json\/wp\/v2\/categories?post=104"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.codemotion.com\/magazine\/wp-json\/wp\/v2\/tags?post=104"},{"taxonomy":"collections","embeddable":true,"href":"https:\/\/www.codemotion.com\/magazine\/wp-json\/wp\/v2\/collections?post=104"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}