Apache Kafka Cookbook
Saurabh Minni (Author)
Cover -- Copyright -- Credits -- About the Author -- About the Reviewers -- www.PacktPub.com -- Table of Contents -- Preface -- Chapter 1: Initiating Kafka -- Introduction -- Setting up multiple Kafka brokers -- Creating topics -- Sending some messages from the console -- Consuming from the console -- Chapter 2: Configuring Brokers -- Introduction -- Configuring the basic settings -- Configuring threads and performance -- Configuring the log settings -- Configuring the replica settings -- Configuring the ZooKeeper settings -- Configuring other miscellaneous parameters -- Chapter 3: Configuring a Producer and Consumer -- Introduction -- Configuring the basic settings for producer -- Configuring the thread and performance for producer -- Configuring the basic settings for consumer -- Configuring the thread and performance for consumer -- Configuring the log settings for consumer -- Configuring the ZooKeeper settings for consumer -- Other configurations for consumer -- Chapter 4: Managing Kafka -- Introduction -- Consumer offset checker -- Understanding dump log segments -- Exporting the ZooKeeper offsets -- Importing ZooKeeper offsets -- Using GetOffsetShell -- Using the JMX tool -- Using the Kafka migration tool -- The MirrorMaker tool -- Replay Log Producer -- Simple Consumer Shell -- State Change Log Merger -- Updating offsets in Zookeeper -- Verifying consumer rebalance -- Chapter 5: Integrating Kafka with Java -- Introduction -- Writing a simple producer -- Writing a simple consumer -- Writing a high-level consumer -- Writing a producer with message partitioning -- Multithreaded consumers in Kafka -- Chapter 6: Operating Kafka -- Introduction -- Adding and removing topics -- Modifying topics -- Implementing a graceful shutdown -- Balancing leadership -- Mirroring data between Kafka clusters -- Expanding clusters
Online-Ressource (129 p)
9781785882449, 1785882449
1020653409
Print version
Description based upon print version of record
Cover; Copyright; Credits; About the Author; About the Reviewers; www.PacktPub.com; Table of Contents; Preface; Chapter 1: Initiating Kafka; Introduction; Setting up multiple Kafka brokers; Creating topics; Sending some messages from the console; Consuming from the console; Chapter 2: Configuring Brokers; Introduction; Configuring the basic settings; Configuring threads and performance; Configuring the log settings; Configuring the replica settings; Configuring the ZooKeeper settings; Configuring other miscellaneous parameters; Chapter 3: Configuring a Producer and Consumer; Introduction
Configuring the basic settings for producerConfiguring the thread and performance for producer; Configuring the basic settings for consumer; Configuring the thread and performance for consumer; Configuring the log settings for consumer; Configuring the ZooKeeper settings for consumer; Other configurations for consumer; Chapter 4: Managing Kafka; Introduction; Consumer offset checker; Understanding dump log segments; Exporting the ZooKeeper offsets; Importing ZooKeeper offsets; Using GetOffsetShell; Using the JMX tool; Using the Kafka migration tool; The MirrorMaker tool; Replay Log Producer
Simple Consumer ShellState Change Log Merger; Updating offsets in Zookeeper; Verifying consumer rebalance; Chapter 5: Integrating Kafka with Java; Introduction; Writing a simple producer; Writing a simple consumer; Writing a high-level consumer; Writing a producer with message partitioning; Multithreaded consumers in Kafka; Chapter 6: Operating Kafka; Introduction; Adding and removing topics; Modifying topics; Implementing a graceful shutdown; Balancing leadership; Mirroring data between Kafka clusters; Expanding clusters; Increasing the replication factor; Checking the consumer position
Decommissioning brokersChapter 7: Integrating Kafka with Third-Party Platforms; Introduction; Using Flume; Using Gobblin; Using Logstash; Configuring Kafka for real-time; Integrating Spark with Kafka; Integrating Storm with Kafka; Integrating Elasticsearch with Kafka; Integrating SolrCloud with Kafka; Chapter 8: Monitoring Kafka; Introduction; Monitoring server stats; Monitoring producer stats; Monitoring consumer stats; Connecting to Graphite; Monitoring with Ganglia; Index