Ab Initio ETL Workload Migration to Apache Spark for a Bank

Client Background

• Our client, a leading Fortune 100 company, is a global diversified financial service holding company with multiple business divisions.
• The client used Ab Initio business intelligence platform for regulatory reporting and analysis. The powerful GUI-based parallel processing tool was used for Extract, Transform and Load (ETL) data management and analysis.

Xoriant Solution | Key Contributions

• Xoriant BFSI team collaborated with the client’s engineering experts to understand vital information in setting up the ETL for data processing used for regulatory reporting and analysis. 
• Developed a solution to help process metadata and job scheduler to reduce the use of Ab Initio with parallel and multiple rollouts.
• Built a scalable and configurable framework for data ingestion with different modules and components using Java, Spring Boot, Apache Spark 2.4, Apache Hive, Avro file format and Oracle.

Key Benefits

• Achieved close to 80% faster ad hoc report execution
• Reduced 75% storage costs with the use of the framework.