About Client
A popular tribal casino from Connecticut, US with 364,000 square feet (33,800 square meters) of gambling space
Revenue: $700 M (2020)
Background
Our client had recently acquired its 9th casino property. It is home to 2 luxury hotel towers totaling 1,600 rooms, a world-class spa, the 125,000 square-foot Earth Expo Center, a championship golf course, more than 80 shops, restaurants and bars as well as three award-winning entertainment venues- After acquisition, data integration was required to ensure a “single point of truth” and stay ahead of the competition with data driven insights
Challenge
- The client was not able to view an integrated report for both their properties located at two different geographies
- Data was present in 2 databases: SQL Server and Teradata which resulted in discrepancies in reporting and analytics
- There was an issue with monitoring incremental data load from ETL source: SQL Server which took around 20mins
Our Solution
-
An ETL pipeline was setup from scratch on Informatica Intelligent Cloud Service (IICS)- An Audit framework was built to create idempotent data pipeline where data remains synchronous or non-corrupted even after multiple re-runs
- A testing framework was built using python to validate the data and send a report if there are any mismatches between the source data on the SQL Server and the data on the Stage layer on Teradata
- An ETL Audit framework was also setup to ensure that the data warehouse/ data pipeline is resistant to:
- Restart the load from the point of failure
- Maintain the logs about the duration of the daily load
- No. of reads from the source for each table
- No. of inserts into the target for each table
- Push email notifications
- The ETL Audit framework was set up using Teradata Stored Procedures, Teradata BTEQ utility and Windows Bat Scripts
- Email Notifications were set up using PowerShell at each step to notify the progress of the daily load along with the stats for Success or Failure
Outcome
10M+
Client was able to see integrated report for 10M+ data (gaming and player) on a daily basis
0 %
The email notifications ensured that there was almost Zero monitoring required for daily incremental data load from ETL source to Teradata
10 Weeks
Went Live in just 10 weeks
