Apache Pulsar Fundamentals

Apache Pulsar Fundamentals

One-day highly intensive course

This is a one-day intensive course designed to introduce you to the core concepts and practical applications of Apache Pulsar, a next-generation, open-source distributed messaging and streaming platform. In the era of real-time data processing, having a robust and scalable platform like Apache Pulsar is crucial for developing applications that require high-throughput messaging and stream processing.

This course is tailored for developers, data engineers, and architects looking to dive deep into the capabilities of Apache Pulsar, understand its architecture, and learn how to leverage it for building real-time data processing applications. By exploring its unique features, such as native support for multi-tenancy, geo-replication, and persistent storage, participants will gain the insights needed to deploy and manage Apache Pulsar effectively in various operational contexts.

Learning Outcomes

By completing this course, participants will:

• Understand the architecture and core components of Apache Pulsar.
• Learn how to set up and configure an Apache Pulsar instance.
• Gain practical experience with producing and consuming messages in Pulsar.
• Explore advanced features like multi-tenancy, geo-replication, and tiered storage.
• Develop the skills to deploy and manage a Pulsar cluster efficiently.
• Be able to design and implement real-time streaming applications using Pulsar.

Prerequisites

Participants should have:

• Basic knowledge of distributed systems and messaging platforms.
• Familiarity with programming concepts (either Java or Python is Mandatory as the test and deployment shall use one or the other).
• An understanding of containerization and orchestration technologies (e.g., Docker, Kubernetes) is helpful.

Training Outline

1. Introduction to Apache Pulsar
   1. Overview of Apache Pulsar and its place in the data ecosystem
   2. Key features and benefits of using Apache Pulsar
   3. Comparison with other messaging and streaming platforms
2. Apache Pulsar Architecture
   1. Understanding the Pulsar architecture: Brokers, Bookies, and Zookeeper
   2. The role of topics, subscriptions, and producers/consumers in Pulsar
   3. Pulsar's multi-layered architecture for scalability and durability
3. Getting Started with Apache Pulsar
   1. Setting up a Pulsar instance: Installation and configuration
   2. Basic operations: Creating namespaces, managing topics, and configuring retention policies
   3. Producing and consuming messages: Hands-on examples
4. Advanced Features and Capabilities
   1. Multi-tenancy and geo-replication for global deployment
   2. Tiered storage and its benefits for large-scale applications
   3. Stream processing with Pulsar Functions: Developing and deploying simple functions
5. Deployment and Management
   1. Best practices for deploying Pulsar in production environments
   2. Monitoring and managing cluster health and performance
   3. Troubleshooting common issues and performance tuning
6. Building Real-Time Applications with Pulsar
   1. Design considerations for real-time streaming applications
   2. Integrating Apache Pulsar with external systems and services
   3. Case studies: Real-world applications and use cases of Apache Pulsar

This comprehensive one-day course combines theoretical knowledge with practical exercises, enabling participants to not only understand the fundamentals of Apache Pulsar but also apply this knowledge in real-world scenarios. Through lectures, hands-on labs, and discussions, attendees will acquire the skills necessary to embark on their own projects using Apache Pulsar, paving the way for advanced data processing and streaming applications in their organizations.