Ab Initio ETL Workload Migration to Apache Spark for a Bank
Our client, a leading Fortune 100 company, is a global diversified financial service holding company with multiple business divisions.
The client used Ab Initio business intelligence platform for regulatory reporting and analysis. The powerful GUI-based parallel processing tool was used for Extract, Transform and Load (ETL) data management and analysis.
Xoriant Solution | Key Contributions
Xoriant BFSI team collaborated with the client’s engineering experts to understand vital information in setting up the ETL for data processing used for regulatory reporting and analysis.
Developed a solution to help process metadata and job scheduler to reduce the use of Ab Initio with parallel and multiple rollouts.
Built a scalable and configurable framework for data ingestion with different modules and components using Java, Spring Boot, Apache Spark 2.4, Apache Hive, Avro file format and Oracle.
Achieved close to 80% faster ad hoc report execution
Reduced 75% storage costs with the use of the framework.