{"id":361,"date":"2018-09-24T15:21:19","date_gmt":"2018-09-24T13:21:19","guid":{"rendered":"https:\/\/www.codemotion.com\/magazine\/kai-wahner-build-a-scalable-infrastructure-with-apache-kafka\/"},"modified":"2020-01-31T11:37:32","modified_gmt":"2020-01-31T10:37:32","slug":"kai-wahner-build-a-scalable-infrastructure-with-apache-kafka","status":"publish","type":"post","link":"https:\/\/www.codemotion.com\/magazine\/ai-ml\/big-data\/kai-wahner-build-a-scalable-infrastructure-with-apache-kafka\/","title":{"rendered":"Kai W\u00e4hner: build a scalable infrastructure with Apache Kafka"},"content":{"rendered":"

K<\/span>ai W\u00e4hner works as a Technology Evangelist at Confluent, a Silicon Valley startup working closely with the Apache community<\/span> to improve the project<\/span> Kafka, a streaming platform to build highly scalable, mission-critical infrastructures.
\nHis main area of expertise lies within the fields of Big Data Analytics, Machine Learning<\/span>, Integration, Microservices, Internet of Things, Stream Processing and Blockchain. He is a regular speaker at international conferences such as JavaOne, O\u2019Reilly Software Architecture or ApacheCon, furthermore, he also writes articles for professional journals.
\nKai will deliver a talk about Deep Learning<\/span> at Extreme Scale in the Cloud with Apache Kafka and TensorFlow at Codemotion Berlin 2018.<\/a><\/p>\n

Discover more about Codemotion Berlin!<\/a><\/p>\n

Kai, as Tech Evangelist, how would you describe the work Confluent is doing on Kafka?<\/h2>\n

Confluent builds Kafka itself (including Kafka Connect for integration and Kafka Streams for stream processing) and adds a powerful ecosystem including open source components such as REST Proxy, Schema Registry and KSQL (the Streaming SQL engine for Kafka). There is a great 40min video from a conference talk if you want to get a high-level introduction and overview: “Introduction to Apache Kafka as Event-Driven Open Source Streaming Platform”<\/p>\n

How does your working routine look like? What is the most exciting part of being a Tech Evangelist?<\/h2>\n

As Technology Evangelist, I have two main tasks in my daily job<\/span>:
\n1) Work with customers to discuss architectures, projects<\/span> and a combination of different (cutting edge and legacy) technologies, and
\n2) do public talks, webinars and articles. I focus on cutting-edge technologies such as Apache Kafka and its open source ecosystem, Machine Learning<\/span> frameworks such as TensorFlow, Internet of Things<\/span> technologies such as MQTT, container technologies such as Docker and Kubernetes, and modern architectures leveraging microservices or serverless.
\nAs part of preparing talks and demos, I also build small side projects on Github<\/span>, e.g. for running Deep Learning<\/span> models built with TensorFlow, DeepLearning4J or H2O within a Kafka Streams application (https:\/\/github.com\/kaiwaehner\/kafka-streams-machine-learning-examples<\/a>) or end-to-end integration from MQTT devices to Kafka clusters in hybrid scenarios (on premise and public cloud) using KSQL and Confluent Replicator (https:\/\/github.com\/kaiwaehner\/ksql-udf-deep-learning-mqtt-iot<\/a>).<\/p>\n

What are the pros and cons of this technology?<\/h2>\n

Apache Kafka and its open source ecosystem are present in almost any big company<\/span>. It evolved from a scalable messaging layer with high throughput capabilities to a much more powerful streaming platform. The use cases started with big data<\/span> log analytics<\/span> into Hadoop for batch processing, but now include mission-critical deployments for payments, real-time fraud detection, logistics or predictive maintenance. Kafka is everywhere and its ecosystem gets stronger and stronger every month.<\/p>\n

Who is it that could use this technology?<\/h2>\n

Kafka is used by companies<\/span> such as LinkedIn (processing over 4.5 trillion messages per day), Netflix (processing 6 Petabyte data per day at peak times), and almost any other tech giant. But also most traditional companies<\/span> such as banks, telcos, retailers, automotive, and others use Kafka more and more as a central nervous system for their most critical and innovative projects<\/span>.<\/p>\n

It is not just used for high throughput and scalability, it also decouples systems and applications well. This allows building microservice infrastructures without tight coupling. Something that was not possible before – even with tools like Enterprise Service Bus (ESB) or other integration frameworks (which promised similar capabilities. My blog post “Apache Kafka vs. Enterprise Service Bus (ESB)\u2014Friends, Enemies, or Frenemies?” (https:\/\/www.confluent.io\/blog\/apache-kafka-vs-enterprise-service-bus-esb-friends-enemies-or-frenemies\/<\/a>) goes into much more detail here.<\/p>\n

What\u2019s your and your company day-to-day commitment to Kafka?<\/h2>\n

At Confluent, we fix critical bugs, add new features<\/span> (such as exactly-once semantics) and security standards (such as OAuth recently), and build a whole ecosystem with many new components (such as KSQL for scalable stream processing without writing source code<\/span>). We also work closely with the Apache Kafka open source community on Kafka mailing list, via our community Slack channel (https:\/\/launchpass.com\/confluentcommunity<\/a>), in meetups all over the world, or at conferences such as Kafka Summit where you can listen to Kafka Committers from Confluent, but also to companies<\/span> from LinkedIn, Apple, Uber, Zalando, Google<\/span>, and many more.<\/p>\n

Why should people be interested in Kafka?<\/h2>\n

As mentioned above, Kafka is cutting edge technology, but also used in many critical projects<\/span> today. KSQL is a game changer. It allows people with less programming skills to still build powerful stream processing applications on top of Apache Kafka; just with SQL-like code, no source code<\/span> like Java<\/span> needed. KSQL also offers a REST interface, so data engineers and developers can use it from non-JVM languages such as Python, Go or any other REST-based tooling. While KSQL is easy to use, you can build powerful streaming use cases including Streaming ETL, Real Time Dash Boards or Anomaly Detection. The best is that it is based natively on Apache Kafka – with all its benefits like high scalability<\/span>, high volume throughput and fail-over. You can deploy KSQL queries for continuous processing and scale it to millions of messages per second, with high availability and zero data loss.<\/p>\n

What about Kafka and the hot topic \u201cMachine Learning\u201d?<\/h2>\n

At Codemotion Berlin, my talk will be about the combination of Apache Kafka and Machine Learning<\/span> to build a scalable infrastructure for analytic models. This includes ingestion, preprocessing, training, deployment and monitoring of analytic models. This is a huge challenge for most companies<\/span> as you cannot simply deploy some Python code into production and expect 24\/7 availability and good performance<\/span>. You need to have the right infrastructure for the whole ML process. This is where Kafka ecosystem shines, thus this is a perfect combination. See my blog post “How to Build and Deploy Scalable Machine Learning<\/span> in Production with Apache Kafka” (https:\/\/www.confluent.io\/blog\/build-deploy-scalable-machine-learning-production-apache-kafka\/<\/a>).<\/p>\n

Interested in Kafka, Big Data, Machine Learning<\/span><\/strong>? Join us at Codemotion Berlin, don\u2019t miss the opportunity to deepen your knowledge<\/span> on these topics with Kai W\u00e4hner<\/a> on November 20-21!<\/em><\/p>\n

Join Codemotion Berlin!<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

Kai W\u00e4hner works as a Technology Evangelist at Confluent, a Silicon Valley startup working closely with the Apache community to improve the project Kafka, a streaming platform to build highly scalable, mission-critical infrastructures. His main area of expertise lies within the fields of Big Data Analytics, Machine Learning, Integration, Microservices, Internet of Things, Stream Processing… Read more<\/a><\/p>\n","protected":false},"author":73,"featured_media":362,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_editorskit_title_hidden":false,"_editorskit_reading_time":0,"_editorskit_is_block_options_detached":false,"_editorskit_block_options_position":"{}","_uag_custom_page_level_css":"","_genesis_hide_title":false,"_genesis_hide_breadcrumbs":false,"_genesis_hide_singular_image":false,"_genesis_hide_footer_widgets":false,"_genesis_custom_body_class":"","_genesis_custom_post_class":"","_genesis_layout":"","footnotes":""},"categories":[16],"tags":[11],"collections":[],"class_list":{"0":"post-361","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-big-data","8":"tag-codemotion-berlin","9":"entry"},"yoast_head":"\nKai W\u00e4hner: build a scalable infrastructure with Apache Kafka - Codemotion Magazine<\/title>\n<meta name=\"description\" content=\"Codemotion and Facebook organized the Tech Leadership Training boot camp, heres a personal reportage from one of our attendees.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.codemotion.com\/magazine\/ai-ml\/big-data\/kai-wahner-build-a-scalable-infrastructure-with-apache-kafka\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Kai W\u00e4hner: build a scalable infrastructure with Apache Kafka\" \/>\n<meta property=\"og:description\" content=\"Codemotion and Facebook organized the Tech Leadership Training boot camp, heres a personal reportage from one of our attendees.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.codemotion.com\/magazine\/ai-ml\/big-data\/kai-wahner-build-a-scalable-infrastructure-with-apache-kafka\/\" \/>\n<meta property=\"og:site_name\" content=\"Codemotion Magazine\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/Codemotion.Italy\/\" \/>\n<meta property=\"article:published_time\" content=\"2018-09-24T13:21:19+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2020-01-31T10:37:32+00:00\" \/>\n<meta name=\"author\" content=\"Laura Melania Rocchi\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:image\" content=\"https:\/\/www.codemotion.com\/magazine\/wp-content\/uploads\/2018\/09\/wahner.jpg\" \/>\n<meta name=\"twitter:creator\" content=\"@CodemotionIT\" \/>\n<meta name=\"twitter:site\" content=\"@CodemotionIT\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Laura Melania Rocchi\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/ai-ml\\\/big-data\\\/kai-wahner-build-a-scalable-infrastructure-with-apache-kafka\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/ai-ml\\\/big-data\\\/kai-wahner-build-a-scalable-infrastructure-with-apache-kafka\\\/\"},\"author\":{\"name\":\"Laura Melania Rocchi\",\"@id\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/#\\\/schema\\\/person\\\/038c7af11ad8f27a888198b0b7bc0cf9\"},\"headline\":\"Kai W\u00e4hner: build a scalable infrastructure with Apache Kafka\",\"datePublished\":\"2018-09-24T13:21:19+00:00\",\"dateModified\":\"2020-01-31T10:37:32+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/ai-ml\\\/big-data\\\/kai-wahner-build-a-scalable-infrastructure-with-apache-kafka\\\/\"},\"wordCount\":999,\"publisher\":{\"@id\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/ai-ml\\\/big-data\\\/kai-wahner-build-a-scalable-infrastructure-with-apache-kafka\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/wp-content\\\/uploads\\\/2018\\\/09\\\/wahner.jpg\",\"keywords\":[\"Codemotion Berlin\"],\"articleSection\":[\"Big Data\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/ai-ml\\\/big-data\\\/kai-wahner-build-a-scalable-infrastructure-with-apache-kafka\\\/\",\"url\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/ai-ml\\\/big-data\\\/kai-wahner-build-a-scalable-infrastructure-with-apache-kafka\\\/\",\"name\":\"Kai W\u00e4hner: build a scalable infrastructure with Apache Kafka - Codemotion Magazine\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/ai-ml\\\/big-data\\\/kai-wahner-build-a-scalable-infrastructure-with-apache-kafka\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/ai-ml\\\/big-data\\\/kai-wahner-build-a-scalable-infrastructure-with-apache-kafka\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/wp-content\\\/uploads\\\/2018\\\/09\\\/wahner.jpg\",\"datePublished\":\"2018-09-24T13:21:19+00:00\",\"dateModified\":\"2020-01-31T10:37:32+00:00\",\"description\":\"Codemotion and Facebook organized the Tech Leadership Training boot camp, heres a personal reportage from one of our attendees.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/ai-ml\\\/big-data\\\/kai-wahner-build-a-scalable-infrastructure-with-apache-kafka\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/ai-ml\\\/big-data\\\/kai-wahner-build-a-scalable-infrastructure-with-apache-kafka\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/ai-ml\\\/big-data\\\/kai-wahner-build-a-scalable-infrastructure-with-apache-kafka\\\/#primaryimage\",\"url\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/wp-content\\\/uploads\\\/2018\\\/09\\\/wahner.jpg\",\"contentUrl\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/wp-content\\\/uploads\\\/2018\\\/09\\\/wahner.jpg\",\"width\":1200,\"height\":675},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/ai-ml\\\/big-data\\\/kai-wahner-build-a-scalable-infrastructure-with-apache-kafka\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"AI\\\/ML\",\"item\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/ai-ml\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Big Data\",\"item\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/ai-ml\\\/big-data\\\/\"},{\"@type\":\"ListItem\",\"position\":4,\"name\":\"Kai W\u00e4hner: build a scalable infrastructure with Apache Kafka\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/#website\",\"url\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/\",\"name\":\"Codemotion Magazine\",\"description\":\"We code the future. Together\",\"publisher\":{\"@id\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/#organization\",\"name\":\"Codemotion\",\"url\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/wp-content\\\/uploads\\\/2019\\\/11\\\/codemotionlogo.png\",\"contentUrl\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/wp-content\\\/uploads\\\/2019\\\/11\\\/codemotionlogo.png\",\"width\":225,\"height\":225,\"caption\":\"Codemotion\"},\"image\":{\"@id\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/Codemotion.Italy\\\/\",\"https:\\\/\\\/x.com\\\/CodemotionIT\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/#\\\/schema\\\/person\\\/038c7af11ad8f27a888198b0b7bc0cf9\",\"name\":\"Laura Melania Rocchi\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/1c99cd0405b8da827efd6634dc0bee6f74c8c2f1a35fc0f2e1120ce523dacd6e?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/1c99cd0405b8da827efd6634dc0bee6f74c8c2f1a35fc0f2e1120ce523dacd6e?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/1c99cd0405b8da827efd6634dc0bee6f74c8c2f1a35fc0f2e1120ce523dacd6e?s=96&d=mm&r=g\",\"caption\":\"Laura Melania Rocchi\"},\"url\":\"https:\\\/\\\/www.codemotion.com\\\/magazine\\\/author\\\/laura-melania-rocchi\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Kai W\u00e4hner: build a scalable infrastructure with Apache Kafka - Codemotion Magazine","description":"Codemotion and Facebook organized the Tech Leadership Training boot camp, heres a personal reportage from one of our attendees.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.codemotion.com\/magazine\/ai-ml\/big-data\/kai-wahner-build-a-scalable-infrastructure-with-apache-kafka\/","og_locale":"en_US","og_type":"article","og_title":"Kai W\u00e4hner: build a scalable infrastructure with Apache Kafka","og_description":"Codemotion and Facebook organized the Tech Leadership Training boot camp, heres a personal reportage from one of our attendees.","og_url":"https:\/\/www.codemotion.com\/magazine\/ai-ml\/big-data\/kai-wahner-build-a-scalable-infrastructure-with-apache-kafka\/","og_site_name":"Codemotion Magazine","article_publisher":"https:\/\/www.facebook.com\/Codemotion.Italy\/","article_published_time":"2018-09-24T13:21:19+00:00","article_modified_time":"2020-01-31T10:37:32+00:00","author":"Laura Melania Rocchi","twitter_card":"summary_large_image","twitter_image":"https:\/\/www.codemotion.com\/magazine\/wp-content\/uploads\/2018\/09\/wahner.jpg","twitter_creator":"@CodemotionIT","twitter_site":"@CodemotionIT","twitter_misc":{"Written by":"Laura Melania Rocchi","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.codemotion.com\/magazine\/ai-ml\/big-data\/kai-wahner-build-a-scalable-infrastructure-with-apache-kafka\/#article","isPartOf":{"@id":"https:\/\/www.codemotion.com\/magazine\/ai-ml\/big-data\/kai-wahner-build-a-scalable-infrastructure-with-apache-kafka\/"},"author":{"name":"Laura Melania Rocchi","@id":"https:\/\/www.codemotion.com\/magazine\/#\/schema\/person\/038c7af11ad8f27a888198b0b7bc0cf9"},"headline":"Kai W\u00e4hner: build a scalable infrastructure with Apache Kafka","datePublished":"2018-09-24T13:21:19+00:00","dateModified":"2020-01-31T10:37:32+00:00","mainEntityOfPage":{"@id":"https:\/\/www.codemotion.com\/magazine\/ai-ml\/big-data\/kai-wahner-build-a-scalable-infrastructure-with-apache-kafka\/"},"wordCount":999,"publisher":{"@id":"https:\/\/www.codemotion.com\/magazine\/#organization"},"image":{"@id":"https:\/\/www.codemotion.com\/magazine\/ai-ml\/big-data\/kai-wahner-build-a-scalable-infrastructure-with-apache-kafka\/#primaryimage"},"thumbnailUrl":"https:\/\/www.codemotion.com\/magazine\/wp-content\/uploads\/2018\/09\/wahner.jpg","keywords":["Codemotion Berlin"],"articleSection":["Big Data"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.codemotion.com\/magazine\/ai-ml\/big-data\/kai-wahner-build-a-scalable-infrastructure-with-apache-kafka\/","url":"https:\/\/www.codemotion.com\/magazine\/ai-ml\/big-data\/kai-wahner-build-a-scalable-infrastructure-with-apache-kafka\/","name":"Kai W\u00e4hner: build a scalable infrastructure with Apache Kafka - Codemotion Magazine","isPartOf":{"@id":"https:\/\/www.codemotion.com\/magazine\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.codemotion.com\/magazine\/ai-ml\/big-data\/kai-wahner-build-a-scalable-infrastructure-with-apache-kafka\/#primaryimage"},"image":{"@id":"https:\/\/www.codemotion.com\/magazine\/ai-ml\/big-data\/kai-wahner-build-a-scalable-infrastructure-with-apache-kafka\/#primaryimage"},"thumbnailUrl":"https:\/\/www.codemotion.com\/magazine\/wp-content\/uploads\/2018\/09\/wahner.jpg","datePublished":"2018-09-24T13:21:19+00:00","dateModified":"2020-01-31T10:37:32+00:00","description":"Codemotion and Facebook organized the Tech Leadership Training boot camp, heres a personal reportage from one of our attendees.","breadcrumb":{"@id":"https:\/\/www.codemotion.com\/magazine\/ai-ml\/big-data\/kai-wahner-build-a-scalable-infrastructure-with-apache-kafka\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.codemotion.com\/magazine\/ai-ml\/big-data\/kai-wahner-build-a-scalable-infrastructure-with-apache-kafka\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.codemotion.com\/magazine\/ai-ml\/big-data\/kai-wahner-build-a-scalable-infrastructure-with-apache-kafka\/#primaryimage","url":"https:\/\/www.codemotion.com\/magazine\/wp-content\/uploads\/2018\/09\/wahner.jpg","contentUrl":"https:\/\/www.codemotion.com\/magazine\/wp-content\/uploads\/2018\/09\/wahner.jpg","width":1200,"height":675},{"@type":"BreadcrumbList","@id":"https:\/\/www.codemotion.com\/magazine\/ai-ml\/big-data\/kai-wahner-build-a-scalable-infrastructure-with-apache-kafka\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.codemotion.com\/magazine\/"},{"@type":"ListItem","position":2,"name":"AI\/ML","item":"https:\/\/www.codemotion.com\/magazine\/ai-ml\/"},{"@type":"ListItem","position":3,"name":"Big Data","item":"https:\/\/www.codemotion.com\/magazine\/ai-ml\/big-data\/"},{"@type":"ListItem","position":4,"name":"Kai W\u00e4hner: build a scalable infrastructure with Apache Kafka"}]},{"@type":"WebSite","@id":"https:\/\/www.codemotion.com\/magazine\/#website","url":"https:\/\/www.codemotion.com\/magazine\/","name":"Codemotion Magazine","description":"We code the future. Together","publisher":{"@id":"https:\/\/www.codemotion.com\/magazine\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.codemotion.com\/magazine\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.codemotion.com\/magazine\/#organization","name":"Codemotion","url":"https:\/\/www.codemotion.com\/magazine\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.codemotion.com\/magazine\/#\/schema\/logo\/image\/","url":"https:\/\/www.codemotion.com\/magazine\/wp-content\/uploads\/2019\/11\/codemotionlogo.png","contentUrl":"https:\/\/www.codemotion.com\/magazine\/wp-content\/uploads\/2019\/11\/codemotionlogo.png","width":225,"height":225,"caption":"Codemotion"},"image":{"@id":"https:\/\/www.codemotion.com\/magazine\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/Codemotion.Italy\/","https:\/\/x.com\/CodemotionIT"]},{"@type":"Person","@id":"https:\/\/www.codemotion.com\/magazine\/#\/schema\/person\/038c7af11ad8f27a888198b0b7bc0cf9","name":"Laura Melania Rocchi","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/1c99cd0405b8da827efd6634dc0bee6f74c8c2f1a35fc0f2e1120ce523dacd6e?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/1c99cd0405b8da827efd6634dc0bee6f74c8c2f1a35fc0f2e1120ce523dacd6e?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/1c99cd0405b8da827efd6634dc0bee6f74c8c2f1a35fc0f2e1120ce523dacd6e?s=96&d=mm&r=g","caption":"Laura Melania Rocchi"},"url":"https:\/\/www.codemotion.com\/magazine\/author\/laura-melania-rocchi\/"}]}},"featured_image_src":"https:\/\/www.codemotion.com\/magazine\/wp-content\/uploads\/2018\/09\/wahner-600x400.jpg","featured_image_src_square":"https:\/\/www.codemotion.com\/magazine\/wp-content\/uploads\/2018\/09\/wahner-600x600.jpg","author_info":{"display_name":"Laura Melania Rocchi","author_link":"https:\/\/www.codemotion.com\/magazine\/author\/laura-melania-rocchi\/"},"uagb_featured_image_src":{"full":["https:\/\/www.codemotion.com\/magazine\/wp-content\/uploads\/2018\/09\/wahner.jpg",1200,675,false],"thumbnail":["https:\/\/www.codemotion.com\/magazine\/wp-content\/uploads\/2018\/09\/wahner-150x150.jpg",150,150,true],"medium":["https:\/\/www.codemotion.com\/magazine\/wp-content\/uploads\/2018\/09\/wahner-300x169.jpg",300,169,true],"medium_large":["https:\/\/www.codemotion.com\/magazine\/wp-content\/uploads\/2018\/09\/wahner-768x432.jpg",768,432,true],"large":["https:\/\/www.codemotion.com\/magazine\/wp-content\/uploads\/2018\/09\/wahner-1024x576.jpg",1024,576,true],"1536x1536":["https:\/\/www.codemotion.com\/magazine\/wp-content\/uploads\/2018\/09\/wahner.jpg",1200,675,false],"2048x2048":["https:\/\/www.codemotion.com\/magazine\/wp-content\/uploads\/2018\/09\/wahner.jpg",1200,675,false],"small-home-featured":["https:\/\/www.codemotion.com\/magazine\/wp-content\/uploads\/2018\/09\/wahner.jpg",100,56,false],"sidebar-featured":["https:\/\/www.codemotion.com\/magazine\/wp-content\/uploads\/2018\/09\/wahner-180x128.jpg",180,128,true],"genesis-singular-images":["https:\/\/www.codemotion.com\/magazine\/wp-content\/uploads\/2018\/09\/wahner-896x504.jpg",896,504,true],"archive-featured":["https:\/\/www.codemotion.com\/magazine\/wp-content\/uploads\/2018\/09\/wahner-400x225.jpg",400,225,true],"gb-block-post-grid-landscape":["https:\/\/www.codemotion.com\/magazine\/wp-content\/uploads\/2018\/09\/wahner-600x400.jpg",600,400,true],"gb-block-post-grid-square":["https:\/\/www.codemotion.com\/magazine\/wp-content\/uploads\/2018\/09\/wahner-600x600.jpg",600,600,true]},"uagb_author_info":{"display_name":"Laura Melania Rocchi","author_link":"https:\/\/www.codemotion.com\/magazine\/author\/laura-melania-rocchi\/"},"uagb_comment_info":0,"uagb_excerpt":"Kai W\u00e4hner works as a Technology Evangelist at Confluent, a Silicon Valley startup working closely with the Apache community to improve the project Kafka, a streaming platform to build highly scalable, mission-critical infrastructures. His main area of expertise lies within the fields of Big Data Analytics, Machine Learning, Integration, Microservices, Internet of Things, Stream Processing……","lang":"en","_links":{"self":[{"href":"https:\/\/www.codemotion.com\/magazine\/wp-json\/wp\/v2\/posts\/361","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.codemotion.com\/magazine\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.codemotion.com\/magazine\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.codemotion.com\/magazine\/wp-json\/wp\/v2\/users\/73"}],"replies":[{"embeddable":true,"href":"https:\/\/www.codemotion.com\/magazine\/wp-json\/wp\/v2\/comments?post=361"}],"version-history":[{"count":2,"href":"https:\/\/www.codemotion.com\/magazine\/wp-json\/wp\/v2\/posts\/361\/revisions"}],"predecessor-version":[{"id":3153,"href":"https:\/\/www.codemotion.com\/magazine\/wp-json\/wp\/v2\/posts\/361\/revisions\/3153"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.codemotion.com\/magazine\/wp-json\/wp\/v2\/media\/362"}],"wp:attachment":[{"href":"https:\/\/www.codemotion.com\/magazine\/wp-json\/wp\/v2\/media?parent=361"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.codemotion.com\/magazine\/wp-json\/wp\/v2\/categories?post=361"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.codemotion.com\/magazine\/wp-json\/wp\/v2\/tags?post=361"},{"taxonomy":"collections","embeddable":true,"href":"https:\/\/www.codemotion.com\/magazine\/wp-json\/wp\/v2\/collections?post=361"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}