- Course Introduction
Quick Facts
particular | details | |||
---|---|---|---|---|
Medium of instructions
English
|
Mode of learning
Self study
|
Mode of Delivery
Video and Text Based
|
Course and certificate fees
Fees information
$ 299 $1,499
certificate availability
Yes
certificate providing authority
Simpliv Learning
The syllabus
Course Intro
Lesson 1 - Getting Started with Big Data and Apache Kafka
- Learning Objective
- Data Evolution Over Time
- Big Data Overview
- Big Data Analytics
- Messaging System
- Introduction and Features of Kafka
- Kafka Usecases
- Kafka Terminologies
- Kafka Components
- Kafka Architecture
- Kafka Clusters
- Kafka Industry Usecases
- DEMO_Setup A Single Node Single Broker Cluster
- DEMO_Setup A multi Node Single Broker Cluster
- DEMO_Install zookeeper
- DEMO_Install Kafka
- Key Takeaway
- Lesson End Quiz 1
Lesson 2 - Kafka Producer
- Learning Objective - Kafka Producer
- Overview of Producer and It_s Architecture
- Kafka Producer Configuration
- Kafka Producer Optional Configuration
- Kafka Producer Configuration Objects
- Demo - Create a Kafka Producer
- Sending Messages
- Serializers and Custom Serializers
- Demo - Creating a Custom Serializer
- Serializers Challenges and Serializing using Apache Avro
- Demo - Serializing Using Apache Avro
- Partitions
- Demo - Setup Custom Partition
- Key Takeaway-Kafka Producer
- Lesson End Quiz 2
Lesson 3 - Kafka Consumer
- Learning Objectives- Kafka Consumer
- Overview of Kafka Consumers
- Consumer Groups
- Partition Rebalance and Creating a Consumer
- Poll loop and it_s functioning
- Kafka Consumer Configuration- Part1
- Kafka Consumer Configuration- Part2
- Demo - Create Kafka Consumer
- Commit and Offset
- Ways of Commiting Offset - Automatic Offset
- Ways of Commiting Offset - Commit Current Offset
- Ways of Commiting Offset - Asynchronous Commit
- Ways of Commiting Offset - Combining Synchronous and Asynchronous Commits
- Ways of Commiting Offset - Commit Specified Offset
- Rebalance Listeners
- Consuming Records with Specific Offset
- Deserializers
- Demo - Create and Use Custom Deserializer
- Key Takeaway-Kafka Consumer
- Lesson End Quiz 3
Lesson 4 - Kafka Operations and Performance Tuning
- Learning Objectives- Kafka Operations and Performance Tuning
- Kafka Iternals Overview
- Replication and Replica Types
- Preffered Ladder, Request and Request Processing
- Types of Requests
- Partition Allocation, File Management and Segments
- File Format, Index and Compaction
- Kafka Reliability and Reliablity Methods
- Broker Configuration for Replication
- Consumer in Reliable System
- Key Takeaway- Kafka Operations and Performance Tuning
- Lesson End Quiz 4
Lesson 5 - Kafka Cluster Architecture and Administering Kafka
- Lesson 5 - Learning Objective
- Cluster Mirroring
- MirrorMaker Configuration
- MirrorMaker Deployment and Tuning
- Hub and Spokes Architecture and Active Active Architecture
- Active-Standby Architecture and Strech Clusters
- Demo - Setting up MirrorMaker
- Administering Kafka - Topic Operations
- Partition Management
- Console Producer Tool
- Console Consumer Tool
- Lesson 5 - Key Takeaway
- Lesson End Quiz 5
Lesson 6 - Kafka Monitoring and Schema Registry
- Lesson 6 - Learning Objective
- Monitoring and it's importance
- Server or Infrastructure Monitoring and Application Monitoring
- Kafka Monitoring
- Kafka Broker Metrics - Under Replicated Partitions
- Kafka Broker Metrics - Others
- Topic and Partition Specific Metrics
- Logging and Client Monitoring
- Producer and Consumer Metrics
- Quotas and Lag Monitoring
- Monitoring Dashboard
- Demo - Setting up Open Source Health Monitor
- Kafka Schema Registry
- Kafka Component and Architecture
- Kafka Schema Registry Working
- Demo - Using Kafka Schema Registry With Kafka
- Lesson 6 - Key Takeaway
- Lesson End Quiz 6
Lesson 7-Kafka Streams and Kafka Connectors
- Lesson 7 - Learning Objective
- Stream and Stream Processing
- Kafka Stream
- Kafka Stream Architecture and Working
- Kafka Stream Components
- Kafka Stream Architecture Tasks, Threading Model and Local State Store
- Kafka Stream Architecture - Record Buffer
- Memory Management and Streaming Data Pipeline
- Kafka Stream DSL
- KStream Operations
- KTable
- KTable Operations
- Aggregation and Windowing
- Processor Topology and Stream Processor
- Stream and Processor APIs
- Processor APIs - Create Topology
- Kafka Connectors
- Standalone and Sink Connector Configuration
- Running Kafka Connect
- Kafka Connector Distributed Mode
- HTTP Rest Interface
- Demo - Kafka Connector
- Demo - Create an Application using Kafka Streams
- Lesson 7 - Key Takeaway
- Lesson End Quiz 7
Lesson 8 - Integration of Kafka with Storm
- Lesson 8 - Learning Objective
- Apache Storm
- Real-time Analytics
- Apache Storm Architecture
- Apache Storm Components
- Apache Storm Topology
- Apache Storm Topology - Part 1
- Kafka Spout
- Integration of Apache Storm and Kafka
- Lesson 8 - Key Takeaway
- Lesson End Quiz 8
Lesson 9 - Kafka Integration with Spark and Flume
- Lesson 9 - Learning Objective
- Introduction to Spark
- Spark Components
- RDD
- Spark Stream
- Spark Integration with Kafka
- Flume
- Flume Connectors
- Flume Kafka to HDFS Configuration
- Lesson 9 - Key Takeaway
- Lesson End Quiz 9
Lesson 10 - Admin Client and Securing Kafka
- Lesson 10 - Learning Objective
- Admin Client
- Demo - Perform Various Admin Tasks using Admin Client
- Kafka Security
- Kafka Security Component
- SASL
- Configure SSL in Kafka
- Secure using ACLs
- Lesson 10 - Key Takeaway
- Lesson End Quiz 10
Course End Project
- Problem Statement
- Solution
Articles
Popular Articles
prev
next