About Client:
The client is a billion-dollar telecommunications company founded in 1987 based out of Tampa, Florida.
Background:
In their existing environment, the client operates with two databases, namely Oracle and Apache Impala. Additionally, they maintain ETL tools tailored to the specific needs of their primary carrier clients, incorporating technologies like Apache Kudu, Apache Spark, Apache Kafka, and Scala. The majority of their data resides within this environment.
Challenge:
The client faced frequent production halts, causing a sharp rise in operational costs. It was found that the ETL process predominantly used the primary node, with minimal involvement of the standby node.
