Profectus came to us to create a data transformation engine with the purpose of generating aggregated data. Our team at Umbrella Infocare help them to ensure efficient data processing.
Profectus Capital Private Limited is a popular financials solutions provider for Small and Medium Enterprises (SMEs). The Non-Banking Financial Company (NBFC) offers a wide range of loan, financing, and funding solutions. Having financed more than 1300 SMEs across 20+ operational branches in India, Profectus aims to be the first-choice leader in financing and loans for SMEs.
The Challenge
Profectus aimed to create a Data transformation engine with the purpose of generating aggregated data. The resultant transformed data was meant to serve as a data service layer, facilitating the creation of systemized reports, visualization dashboards, and future data science applications. Profectus faced challenges due to their fragmented finance and customer information, leading to time-consuming data retrieval for specific requirements. They conducted daily data runs and occasionally performed combined data runs for the last 4-5 days, particularly during month-end closing. Unfortunately, they lacked the flexibility to run data for different date ranges, hindering their ability to consolidate critical data for enhanced visualization and insights.
The Solution
Umbrella Infocare, a Noventiq company, conducted a thorough evaluation of their current data infrastructure and requirements. They worked alongside the client to harness the capabilities of AWS Glue, facilitating the seamless migration of their data processing to a Spark-based framework. Our dedicated team at Umbrella Infocare played a pivotal role in designing and implementing an automated framework for efficient data processing, enabling the client to successfully attain their goals. Additionally, our team established a system of alerts and notifications to promptly detect any job failures, ensuring smooth data operations.
The Outcome
By implementing a comprehensive data automation and integration framework, Profectus reaps the benefits of accelerated data visualization, timely alerts for job failures, and enhanced flexibility in filtering data for diverse purposes. By leveraging AWS Glue, Profectus achieves a seamless execution of all scripts and jobs, ensuring efficient data querying. The framework also enables Profectus to run queries based on specific conditions, while providing robust monitoring and logging capabilities to track and analyze data operations effectively.
