Ab Initio ETL Workload Migration to Apache Spark for a Bank
Share
Client Background
- Our client, a leading Fortune 100 company, is a global diversified financial service holding company with multiple business divisions.
- The client used Ab Initio business intelligence platform for regulatory reporting and analysis. The powerful GUI-based parallel processing tool was used for Extract, Transform and Load (ETL) data management and analysis.
Xoriant Solution | Key Contributions
- Xoriant BFSI team collaborated with the client’s engineering experts to understand vital information in setting up the ETL for data processing used for regulatory reporting and analysis.
- Developed a solution to help process metadata and job scheduler to reduce the use of Ab Initio with parallel and multiple rollouts.
- Built a scalable and configurable framework for data ingestion with different modules and components using Java, Spring Boot, Apache Spark 2.4, Apache Hive, Avro file format and Oracle.
Key Benefits
- Achieved close to 80% faster ad hoc report execution
- Reduced 75% storage costs with the use of the framework.
Related Post
