About Client:
The client is a digital marketing expert, driving results for global iGaming leaders with end-to-end marketing strategies and seamless execution.
Background:
The client aimed to modernize their data integration approach to support real-time campaigns and decision-making for multiple brands.
Their existing infrastructure relied on a traditional ETL framework, which they wanted to move away from, in favor of a unified, real-time streaming architecture.
The key objective was to establish a secure, cost-efficient, and scalable pipeline that could deliver real-time data for accurate and timely reporting.
Challenge:
- Compatibility with Existing Infrastructure: The client’s platform provider already operated a Kafka-based on-prem cluster for one of their gaming brands. Extending this setup to support real-time data for other brands introduced complexities.
- Stringent Security Requirements: The client mandated robust security, including certificate-based authentication, which rendered certain managed services like AWS MSK Connect unsuitable.
- Cost Considerations: While cloud solutions such as Confluent Cloud offered robust features, their cost and scalability were not aligned with the client’s requirements.
- Limited Flexibility in Managed Services: AWS managed Kafka services lacked granular control over topics and the ability to pause, reset, or replay streams—capabilities critical for operational flexibility.
