Software Engineer
CurrentResponsibilites:• ETL Migration to Azure Cloud: Led the migration of the entire ETL infrastructure from the .NET platform to the Azure Cloud, utilizing Azure Data Factory and Databricks (PySpark), resulting in improved scalability, performance & efficiency.• Hybrid Mechanism Optimization: Designed and implemented a hybrid mechanism within the ETL process to significantly reduce data growth, optimize storage usage, and enhance overall system performance, ensuring long-term scalability.• Middle Layer Development for ETL: Developed a robust middle layer within the ETL process to efficiently manage complex business logic by leveraging advanced SQL concepts, improving data processing and system flexibility.• Project Layer Extension: Engineered an internal framework to streamline the extension of product resources to the client layer, minimizing development effort while leveraging advanced design patterns for increased modularity and reusability.