Business Intelligence Consultant
CurrentThis project, undertaken for a major financial sector player, focuses on migrating the client's telephony activity management system from an on-premise tool to a Cloud-based tool. The primary objectives include ensuring seamless data integration into a Snowflake data warehouse through the utilization of Azure Data Factory. This mandate is divided into two key components: firstly, ensuring data quality by implementing a Python program for generating profiling reports, and secondly, contributing to the development of pipelines responsible for extracting, transforming, and loading data into the Snowflake data warehouse.The tasks encompass designing a client-accessible web profiling tool using the Python Flask framework to generate data quality reports, implementing Data Factory pipelines for extracting data through API calls, performing necessary transformations, and loading it into the target warehouse. The project also involves conducting thorough tests on various pipelines to guarantee the smooth operation of different integration flows.