Kafka - The Definitive Guide
Real-time data and stream processing at scale
Published on 6. August 2017
Book
Paperback/Softback
322 pages
978-1-4919-3616-0 (ISBN)
Description
Every enterprise application creates data, whether it's log messages, metrics, user activity, outgoing messages, or something else. And how to move all of this data becomes nearly as important as the data itself. If you're an application architect, developer, or production engineer new to Apache Kafka, this practical guide shows you how to use this open source streaming platform to handle real-time data feeds.
Engineers from Confluent and LinkedIn who are responsible for developing Kafka explain how to deploy production Kafka clusters, write reliable event-driven microservices, and build scalable stream-processing applications with this platform. Through detailed examples, you'll learn Kafka's design principles, reliability guarantees, key APIs, and architecture details, including the replication protocol, the controller, and the storage layer.
Understand publish-subscribe messaging and how it fits in the big data ecosystem.
Explore Kafka producers and consumers for writing and reading messages
Understand Kafka patterns and use-case requirements to ensure reliable data delivery
Get best practices for building data pipelines and applications with Kafka
Manage Kafka in production, and learn to perform monitoring, tuning, and maintenance tasks
Learn the most critical metrics among Kafka's operational measurements
Explore how Kafka's stream delivery capabilities make it a perfect source for stream processing systems
Engineers from Confluent and LinkedIn who are responsible for developing Kafka explain how to deploy production Kafka clusters, write reliable event-driven microservices, and build scalable stream-processing applications with this platform. Through detailed examples, you'll learn Kafka's design principles, reliability guarantees, key APIs, and architecture details, including the replication protocol, the controller, and the storage layer.
Understand publish-subscribe messaging and how it fits in the big data ecosystem.
Explore Kafka producers and consumers for writing and reading messages
Understand Kafka patterns and use-case requirements to ensure reliable data delivery
Get best practices for building data pipelines and applications with Kafka
Manage Kafka in production, and learn to perform monitoring, tuning, and maintenance tasks
Learn the most critical metrics among Kafka's operational measurements
Explore how Kafka's stream delivery capabilities make it a perfect source for stream processing systems
More details
Language
English
Place of publication
Sebastopol
United States
Target group
Professional and scholarly
Dimensions
Height: 232 mm
Width: 178 mm
Thickness: 17 mm
Weight
518 gr
ISBN-13
978-1-4919-3616-0 (9781491936160)
Copyright in bibliographic data and cover images is held by Nielsen Book Services Limited or by the publishers or by their respective licensors: all rights reserved.
Schweitzer Classification
Other editions
New editions
Gwen Shapira | Todd Palino | Rajini Sivaram
Kafka - The Definitive Guide
Real-Time Data and Stream Processing at Scale
Book
11/2021
2nd Edition
O'Reilly
€79.50
Available immediately
Additional editions
E-Book
08/2017
O'Reilly
€32.99
Available for download
Persons
Neha Narkhede is Cofounder and Head of Engineering at Confluent, a company backing the popular Apache Kafka messaging system. Prior to founding Confluent, Neha led streams infrastructure at LinkedIn where she was responsible for LinkedIn s petabyte scale streaming infrastructure built on top of Apache Kafka and Apache Samza. Neha specializes in building and scaling large distributed systems and is one of the initial authors of Apache Kafka. In the past she has worked on search within the database at Oracle and holds a Masters in Computer Science from Georgia Tech.Gwen is a Software Engineer at Cloudera, working on data ingest and focusing on Apache Kafka. She is a frequent contributor to the Apache Kafka project, she has contributed Kafka integration to Apache Flume, and is a committer on Apache Sqoop.Gwen has 15 years of experience working with customers to design scalable data architectures.Formerly a solution architect at Cloudera, senior consultant at Pythian, Oracle ACE Director, and board member at NoCOUG. Gwen is a frequent speaker at industry conferences andcontributes to multiple industry blogs including O Reilly Radar and Ingest.Tips.Todd is a Staff Site Reliability Engineer at LinkedIn, tasked with keeping the largest deployment of Apache Kafka, Zookeeper, and Samza fed and watered. He is responsible for architecture, day-to-day operations, and tools development, including the creation of an advanced monitoring and notification system. Todd is the developer of the open source project Burrow, a Kafka consumer monitoring tool, and can be found sharing his experience on Apache Kafka at industry conferences and tech talks. Todd has spent over 20 years in the technology industryrunning infrastructure services, most recently as a Systems Engineer at Verisign, developing service management automation for DNS, networking, and hardware management, as well as managing hardware and software standards across the company."