Conjuring Events out of Thin Air: Leveraging CDC for Real-Time Insights

Talk Description

Change Data Capture (CDC) offers a powerful solution for organisations struggling with rigid data architectures. By transforming database changes into real-time event streams, CDC enables companies to generate insights and synchronise data across systems without completely rebuilding their applications.

This talk will dive into how AWS services like Database Migration Service (DMS), Kinesis, and S3 can create seamless event streams from various databases. Attendees will learn practical approaches for capturing changes in different database environments, including DynamoDB Streams and Debezium.

We'll explore how to:

• Convert database changes into event streams
• Process and store events using AWS Kinesis and S3
• Use Amazon Athena for ad-hoc analysis
• Address challenges like schema changes and data consistency

Attendees will discover how to build a responsive analytics ecosystem that provides near real-time insights, empowering businesses to make faster, more informed decisions—even without a fully event-driven architecture.

Knowledge Level

Level 200: Experienced. Attendees should have an awareness of the topic but may not have practical experience.