Berlin Buzzwords 2024

Kafka on the Fly: A Serverless Approach to Data Streaming
2024-06-11 , Palais Atelier

This talk will focus on the exploration of serverless Kafka and real-time data streaming with Node.js microservices. In this talk, I will delve into Upstash's serverless Kafka architecture and how it can be leveraged to build scalable and cost-effective solutions for microservices.


Description:
In this session, I will introduce the audience to the concept of serverless computing and its benefits when combined with Kafka for real-time data streaming. We will dive into the specifics of using Upstash, a cutting-edge serverless data streaming platform, to create a truly scalable and event-driven architecture with Kafka.

Throughout the session, I will cover the following key points:

  1. Understanding the fundamentals of serverless computing and its advantages
  2. Exploring the integration of Kafka with serverless architecture
  3. Introducing Upstash - a powerful open-source serverless Data Stream Platform
  4. Demonstrating the setup and configuration of Kafka with Upstash
  5. Showcasing real-life use cases of Kafka on the Fly with Upstash

By the end of this talk, attendees will gain a comprehensive understanding of how serverless Kafka with Upstash can revolutionize real-time data streaming, simplifying deployment, reducing infrastructure costs, and enabling seamless scalability.

Key Takeaways:
- Insight into the benefits of serverless computing for real-time data streaming with Kafka
- Understanding the integration and setup of Kafka with Upstash
- Knowledge of best practices and use cases for serverless Kafka architecture
- Inspiration to leverage serverless technologies for scalable and cost-effective solutions.

See also: Slides (947.6 KB)

I am Desmond Obisi, a software engineer with over five years of experience building web products. I'm an open-source contributor and technical writer whose vision is to build great products and make them easy for the world to use. I am interested in UX, performance, and code interoperability. I am interested in things like blockchain, AI/ML, Cloud Native, and Research. You'll see me speaking and engaging communities if I'm not building products.

I currently contribute to Ansible as a documentation writer, CHAOSS Project as a maintainer, and to Ambassador Labs as a community advocate. Full-time, I work as a software engineer at Resilis