Explore the principles, technologies, and patterns of message queuing to enable asynchronous communication between distributed systems for improved scalability, reliability, and decoupling.
Intermediate
90h
message-queuing
asynchronous-communication
distributed-systems
middleware
Card legend
Topic
Milestone
Task
Note
Decision
Project
Grouped
- AI Assist
- Progress
Sign in to use AI Assist
Sign In
Proof of Competence
0%
0 / 25 checkpoints declared
0/13 evidence needed for 100% β max 50% without proof
Fundamentals of Message Queuing
You can explain the difference between synchronous and asynchronous communication and identify when to use message queuing
Milestone
Describe asynchronous communication benefits with real-world examples (e.g., order processing)
Checkpoint
You can diagram a message queuing architecture including producers, queues, and consumers
Milestone
Draw a simple message queuing system architecture showing roles of components
Checkpoint
Setup a basic local message queue with consumer and producer sending and receiving messages
Project
Popular Message Queuing Technologies
You can select appropriate message broker technology given a system context and workload
Milestone
Compare message delivery guarantees of RabbitMQ vs Kafka vs AWS SQS (notes or table)
Checkpoint
You can produce and consume messages using RabbitMQ and Kafka in a sample application
Milestone
Run a RabbitMQ producer and consumer exchanging messages (messages seen at consumer)
Checkpoint
Implement an event pipeline using Kafka to stream simple data between services
Project
Designing Reliable Messaging Systems
You can configure message persistence and implement acknowledgement logic to ensure reliable message delivery
Milestone
Create a dead-letter queue configuration in RabbitMQ or Kafka (messages routed on failure)
Checkpoint
You can design message processing logic that is idempotent and preserves ordering when necessary
Milestone
Implement a consumer that safely reprocesses messages without side effects (idempotency)
Checkpoint
Build a message consumer that respects ordering constraints for a business workflow
Project
Advanced Message Queuing Concepts
You can design and implement scalable message processing with partition-aware consumers
Milestone
Configure Kafka partitions and assign consumers in a consumer group (all partitions consumed)
Checkpoint
You can design an event-driven architecture leveraging messaging queues between microservices
Milestone
Map an event-driven flow where services communicate asynchronously via a message queue
Checkpoint
Create a microservices demo where services exchange domain events asynchronously
Project
Tooling, Monitoring, and Best Practices
You can monitor and debug message queue systems using appropriate tools and logs
Milestone
Set up monitoring dashboards for RabbitMQ or Kafka (CPU, message rates, latencies)
Checkpoint
Create a troubleshooting guide for common message queue failures
Project
You can implement security best practices and policies for message queues to protect data and meet compliance
Milestone
Configure TLS and user access controls on a message broker (proof of secured connections)
Checkpoint